First thoughts and preliminary insights into OpenAI’s GPT o1 Strawberry in the medical domain, with some expected and unexpected findings. We have a “bake off” between o1 and Doc to demonstrate how o1 fares with tricky medical scenarios
Disclaimer – obviously don’t use AI to diagnose or treat your medical problems, if you are unwell please seek a medical professional (AI isn’t good enough just yet :)).
Hey! If you are enjoying our conversations, reach out, share your thoughts and journey with us. Don’t forget to subscribe whilst you’re here 🙂
Doc – Dr. Joshua Au Yeung – https://www.linkedin.com/in/dr-joshua-auyeung/
Dev – Zeljko Kraljevic https://twitter.com/zeljkokr
LinkedIn Newsletter https://www.linkedin.com/build-relation/newsletter-follow?entityUrn=7216474068085026817
YT – https://youtube.com/@DevAndDoc
Spotify – https://podcasters.spotify.com/pod/show/devanddoc
Apple- https://podcasts.apple.com/gb/podcast/dev-and-doc-ai-for-healthcare-podcast/id1751495120
Substack- https://aiforhealthcare.substack.com/
For enquiries – [email protected]
Editor- Dragan Kraljević https://www.instagram.com/dragan_kraljevic/
Brand design and art direction – Ana Grigorovici https://www.behance.net/anagrigorovici027d
00:00 start + highlights
1:28 intro, what is GPTo1
5:18 what is “reasoning” in o1
12:38 Benchmarks- o1’s successes and failures
24:07 O1 and doctor bake off!
24:21 The pregnancy acid test for LLMs
26:23 clinical coding
30:06 Tricky patient scenarios
32:25 opioid dose conversions
