Video & Audio Translation
Learn how to translate video subtitles and work with audio recordings in Codex Editor
Codex Editor provides powerful features for translating video subtitles and managing audio recordings. Whether you're dubbing content, translating subtitles, or creating audio Bibles, Codex handles timing and synchronization automatically.
Overview
What You Can Do
- Translate Video Subtitles - Import VTT/SRT files, translate, and export
- Import Audio Files - Automatic segmentation with Voice Activity Detection
- Record Audio - Record directly inside the cell editor
- Cell-by-Cell Audio Playback - Waveform visualization aligned with each cell
- Transcribe Audio - Whisper-powered automatic speech recognition
- Validate Audio - Multi-user validation workflow for quality checking
- Audio History - Browse and restore previous recordings per cell
Subtitle Translation
Supported Subtitle Formats
- WebVTT (
.vtt) - Modern web standard format - SubRip (
.srt) - Classic subtitle format
Both formats preserve timing information automatically.
Step 1: Import Subtitle Files
- Open Navigation → Add Files
- Select "Source Files"
- Choose "Subtitles (VTT/SRT)" importer
- Upload your subtitle file
What Codex Creates:
MyVideo.source # Original subtitles (read-only)
MyVideo.codex # Your translation workspaceEach subtitle becomes a cell with:
- Original text
- Start timestamp
- End timestamp
- Unique cell ID
Step 2: Translate Subtitles
- Open the
.codexfile (your translation workspace) - Each cell represents one subtitle segment
- Source text appears on the left (if available)
- Type your translation on the right
- Timing information is preserved automatically
Timing Tip: The timestamp metadata is preserved in each cell. You don't need to manually manage start/end times—Codex handles this automatically during export.
Step 3: Export Translated Subtitles
- Open Project Settings (sidebar menu)
- Scroll to Export Project
- Choose "Rebuild Export" or "VTT/SRT" option
- Select your translated
.codexfile - Download the exported subtitle file
Your exported file will have:
- Same timing as the original
- Your translated text
- Original subtitle format (VTT or SRT)
Subtitle Import Examples
Example 1: Simple 1-to-1 Mapping
Original English subtitle:
00:00:10.000 --> 00:00:12.000
Hello, world!After import, becomes a cell:
- Cell ID:
MyVideo 1:1 - Start: 10.0 seconds
- End: 12.0 seconds
- Content: "Hello, world!"
Example 2: Complex Mappings
The subtitle importer handles:
- 1:1 mapping - One source subtitle → one cell
- 1:many mapping - One source split across multiple target subtitles
- many:1 mapping - Multiple sources combined into one target
- many:many mapping - Complex overlapping subtitles
The system uses timestamp overlap detection to automatically align translations during Target Import.
Audio Translation
Importing Audio Files
The audio importer uses Voice Activity Detection (VAD) to automatically split a long audio file into individual segments (one per cell). This is the primary way to bring audio into a Codex project from scratch.
How to import:
- Open Navigation → Add Files
- Choose the Audio importer
- Configure VAD settings (see below)
- Select your audio file(s)
- Review and edit the detected segments
- Click Import
Voice Activity Detection (VAD)
VAD analyzes the audio waveform to find silences and automatically places segment boundaries. Two settings control this behavior:
| Setting | Range | Default | Effect |
|---|---|---|---|
| Silence Threshold | -60 to -20 dB | -40 dB | Lower values detect quieter sounds as speech |
| Min Silence Duration | 0.1 to 2.0 s | 0.5 s | Shorter values create more (finer) segments |
After adjusting the sliders, click Apply to re-run VAD on your file. Click Revert to return to defaults.
Waveform Editor
After the file is processed, a waveform preview appears. You can:
- Drag segment boundaries (the vertical lines) left or right to adjust split points
- Click a segment in the list to highlight it in the waveform and scroll to it
- Play any segment using the play/pause button in the segment list
- Split a segment at its midpoint using the + button
- Merge a segment with the next one using the trash button (dissolves the boundary)
Auto-split: Any segment longer than 30 seconds is automatically split into smaller pieces to keep cell sizes manageable.
Multi-file Import
Select multiple audio files at once. Each file gets its own tab at the top of the importer, and all files are imported sequentially. Each file becomes its own document.
Supported Audio Formats
.mp3- Good compression, widely supported.wav- Recommended for best quality.m4a- Apple format, good quality.aac- Advanced audio coding.ogg- Open source format.webm- Web-native format (also used internally for recordings).flac- Lossless compression
Working with Audio in the Cell Editor
Once a cell has audio (imported or recorded), the cell editor shows a full audio panel with a waveform, playback controls, and several action buttons.
Waveform View
Each cell with audio displays a waveform canvas showing the amplitude of the recording over time. Click play to listen. Only one cell's audio plays at a time—starting playback in one cell automatically stops any other playing cell.
Recording Audio
Codex has built-in audio recording. To record for a cell:
- Open a cell in the editor
- Click Re-record (microphone icon) to open the recorder
- Record your audio using your microphone
- Save the recording—it replaces or is added to the cell's audio
The recorder uses your browser's MediaRecorder API. You may be prompted to grant microphone access the first time.
Transcription (Whisper)
Codex integrates with Whisper automatic speech recognition to generate a text transcription of any cell's audio:
- Click Transcribe in the cell audio panel
- A progress bar shows transcription progress
- When complete, the transcribed text and detected language appear above the waveform
- Click Insert Transcription to copy the text into the cell's translation field
Audio History
Every cell keeps a history of all recordings. Click History (with a count badge showing how many recordings exist) to open the history viewer, where you can:
- Play any previous recording
- Select a recording to make it the active one
- Delete recordings you no longer need
- Restore a previously deleted recording
Audio Validation
For team workflows, cells support multi-user audio validation:
- A Validate badge appears in the top-right corner of the audio panel
- Click it to mark the recording as validated by the current user
- Hover to see which team members have validated that recording
- A configurable required validation count determines when a recording is fully approved
- The badge changes appearance as validation progresses (unvalidated → partially validated → fully validated)
Advanced Workflows
Dubbing Video Content
Complete workflow for video dubbing:
- Import subtitles (VTT/SRT) through Navigation → Add Files
- Translate the subtitle text in the
.codexfile - Record audio for each cell using the built-in recorder or by importing files
- Review using the video player and timeline editor in the editor
- Validate recordings with your team using the audio validation workflow
- Export subtitles for final video through Project Settings
Oral Translation Projects
For communities creating oral translations:
- Import your source text (USFM, plain text, or subtitles)
- Record verse-by-verse using the built-in recorder in each cell
- Use Whisper transcription to generate a text draft from recordings
- Review the transcription against the recording
- Validate with team members using the audio validation feature
- Export your translation when complete
Audio Bible Recording
Book: Jude (example)
- Open your Jude
.codexfile - For each verse cell, click Re-record and record the verse
- Use Transcribe to get a text draft if needed
- Use History to compare takes and select the best one
- Have team members Validate each verse
- Export the final audio files
Subtitle Translation Examples
Example Project: Translating a Documentary
File: Documentary_Episode1.vtt
Step-by-Step:
-
Import:
- Navigation → Add Files → Subtitles
- Upload
Documentary_Episode1.vtt - Creates
Documentary_Episode1.sourceandDocumentary_Episode1.codex
-
Translate:
- Open
Documentary_Episode1.codex - See 247 subtitle cells
- Each cell shows timestamp range
- Translate cell by cell
- Open
-
Export:
- Project Settings → Export
- Select Rebuild Export
- Choose
Documentary_Episode1.codex - Download the exported
.vttfile
-
Test:
- Open the video in the Codex editor's Video tab to preview with the timeline
- Or open in an external player (VLC, etc.) with the exported subtitle file
Best Practices
For Subtitle Translation
- Keep translations concise - Match source length when possible
- Respect timing constraints - Viewers need time to read
- Use natural language - Spoken style, not written
- Test frequently - Export and watch with video using the built-in player
- Consider reading speed - Different languages have different speeds
For Audio Projects
- Use VAD for bulk import - Let Codex segment your files automatically
- Fine-tune boundaries - Drag segment lines in the waveform editor
- Record in a quiet environment - Minimizes background noise
- Use History - Keep multiple takes and pick the best one
- Validate as a team - Use the validation workflow before finalizing
- Transcribe for accuracy checks - Use Whisper to verify recordings match text
For Professional Projects
- Version control - Use Git or regular backups
- Quality checks - Multiple reviewers using audio validation
- Style guides - Document translation conventions
- Delivery formats - Know client requirements before exporting
- Archive everything - Keep all source files and takes
Technical Details
Supported Timestamp Formats
For subtitle files:
WebVTT:
00:00:10.000 --> 00:00:12.500
Subtitle text hereSubRip (SRT):
1
00:00:10,000 --> 00:00:12,500
Subtitle text hereBoth formats are automatically detected and parsed.
Audio Storage
Imported and recorded audio is stored in .project/attachments/files/{BOOK}/ within your project (e.g., .project/attachments/files/MAT/), with a legacy fallback to .project/attachments/{BOOK}/. Recorded files use auto-generated names (e.g., audio-{timestamp}-{id}.webm) and are referenced by attachment ID in cell metadata. The importer manages this automatically.
File Size Considerations
- WAV files: Large but high quality (approximately 10 MB per minute)
- MP3 files: Smaller, good quality (approximately 1 MB per minute at 128 kbps)
- Project size: Plan storage accordingly for complete projects
- Cloud sync: Large audio files may slow synchronization
Next Steps
After setting up your video/audio project:
- Configure export options
- Share with team members
- Use AI assistance for subtitle translation
- Learn about batch translation for faster subtitle work
FAQ
Need help with media translation? Complete the Troubleshooting guide support form for audio, subtitle, and transcription issues, then paste the generated template into Discord.