Whisper2Subtitles

Machine Learning
Add bilingual subtitles to videos using OpenAI’s Whisper model.
Published

November 9, 2022

A simple Google Colab Notebook to generate transcribed subtitles for videos/audios using OpenAI’s open source whisper model, with options to generate translated subtitles.

You can choose to generate translations using Facebooks’ M2M100_418 model model or manually add translated texts from other tools. The original texts and translated texts will be combined into one bilingual subtitle.

There’s also an option to burn the subtitle into video using ffmpeg directly in the notebook.