This is a multilingual Video Caption Generator or Video Subtitle Generator with Subtitle Embedded on Original Video using ASR and Speech-to-Text. This is a completely free tool and a great Free Open Source Alternative for Descript with Python, OpenAI Whisper and Gradio App.
This video has 3 main parts:
1. Building a Video Caption Generator with OpenAI Whisper
2. Wrapping the Video Caption Generator as Web App with Gradio
3. Deploying the Video Subtitle Generator on Hugging Face Spaces for Free
Code – https://github.com/amrrs/subtitle-embedded-video-generator
Deployed App – https://huggingface.co/spaces/Amrrs/yt-shorts-video-captioning
It can handle multiple languages including low resources Indian Languages like Tamil, Hindi, Malayalam, Telugu to English.
Automatic Captions with OpenAI Whisper Full Tutorial