in

Talk to Anyone! – Better Translations with OpenAI's NEW Realtime API



Summary
Today we’re jumping into the amazing capabilities of the latest AI models from OpenAI and the incredible UI experiences we can build with them. I’ve been struggling to find a good translation tool for a long time and I’ve only just found a great way to have real-time conversations with my entire family! Watch as I share some simple code changes that create a huge difference in my life and in the life of anyone interested in conversing in languages other than their own!

Show Links:
Play with the example here: https://translate.hint.services/
Or view the source code: https://github.com/hoffination/openai-realtime-console

Other links from the show:
OpenAI Translation Example: https://www.youtube.com/watch?v=WzUnEfiIqP4
Whisper Release Info: https://openai.com/index/whisper/
Whisper Turbo Release: https://github.com/openai/whisper/discussions/2363
Realtime API Release: https://openai.com/index/introducing-the-realtime-api/
OpenAI Realtime Console Example: https://github.com/openai/openai-realtime-console

Support the Channel (affiliate links for things I use!)
Eleven Labs – excellent AI voice creations: https://try.elevenlabs.io/s2tuo44b42lb
Descript – amazing AI video editing platform: https://get.descript.com/jg1jj002uhbs

#subscribe
Follow us on Stable Discussion: https://blog.stablediscussion.com/

Join our AI Discord Community
https://www.subbb.me/stablediscussion

Chapters
00:00 Introduction and Overview
01:26 Challenges with Traditional Translation Methods
02:52 Exploring AI Solutions for Translation
04:16 Implementing a Transcription-Based Approach
05:17 Leveraging OpenAI’s Tools for Real-Time Translation
06:33 Demonstration and Code Walkthrough
08:31 Customizing the Translation Interface
13:30 Exploring Dynamic Language Integration
13:52 UI Enhancements and Side Menu Features
14:37 Mobile Interface Challenges
18:38 Adjusting Source and Destination Languages
21:28 Push-to-Talk Button Issues
23:25 Final Tweaks and Testing
24:45 Conclusion and Future Possibilities

NYC Attempt to Scan Subway for Weapons With AI Fails Miserably as System Flooded by False Positives While Detecting Zero Actual Guns

NYC Attempt to Scan Subway for Weapons With AI Fails Miserably as System Flooded by False Positives While Detecting Zero Actual Guns

Sam Altman Invents Bizarre New Unit of Time for Measuring When His Promises Will Come True

Google CEO Says 25 Percent of Its Code Is Now AI-Generated