Remotion Captions & Subtitles — AI-Powered Video Subtitles

What it is

Remotion Captions is an AI skill for generating and rendering subtitles in Remotion videos. It handles transcription with word-level timing, styled subtitle rendering, and export within the Remotion React-based video framework. You feed it audio, it produces timed captions that render as animated text overlays in your video.

This skill targets developers building programmatic videos with Remotion who need automated captioning. It is part of the official Remotion Agent Skill set, designed to work within AI-assisted video production workflows.

Why it saves time or tokens

Manually timing subtitles frame-by-frame is one of the most tedious tasks in video production. This skill automates the entire pipeline: transcribe audio, align words to timestamps, and render styled captions. For AI agents generating videos programmatically, this reduces a multi-hour manual process to a single function call.

How to use

1. Set up a Remotion project with the @remotion/captions package installed
2. Provide the audio source for transcription (supports Whisper and other transcription backends)
3. Use the caption components in your Remotion composition to render timed subtitles

Example

import { Subtitle } from '@remotion/captions';
import { useVideoConfig } from 'remotion';

const MyVideo = () => {
  const { fps } = useVideoConfig();
  const captions = [
    { text: 'Hello world', startMs: 0, endMs: 1500 },
    { text: 'This is automated', startMs: 1600, endMs: 3000 },
  ];

  return (
    <div style={{ position: 'relative' }}>
      <Subtitle
        captions={captions}
        fps={fps}
        style={{
          fontSize: 48,
          color: 'white',
          textShadow: '2px 2px 4px black'
        }}
      />
    </div>
  );
};

Related on TokRepo

• AI tools for video — video production and editing tools curated on TokRepo
• AI tools for content — content creation tools for AI-assisted workflows

Common pitfalls

• Transcription accuracy depends on audio quality; noisy backgrounds or multiple speakers reduce word-level timing precision
• Custom fonts must be loaded before rendering; use the Remotion font loading system or captions will render in the default system font
• Long videos with many caption segments can slow down the Remotion preview; use composition splitting for videos over 5 minutes