In this episode of Polyweb, host Sara Landi Tortoli interviews Oliver Klingefjord, the co-founder and technical lead at the Meaning Alignment Institute.
The Institute won an OpenAI grant to explore “democratic fine-tuning” as an approach that differs from Constitutional AI.
During the conversation, Oliver and Sara discuss the process of creating a “moral graph” based on people’s discussions of values, the potential risks of personalized AI models, and the broader implications of their work in aligning technology with human meaning and purpose.
00:00 Intro
04:42 How the Meaning Alignment Institute won the OpenAI grant to explore democratic AI alignment
08:13 Comparing democratic fine-tuning to RLHF and Constitutional AI
12:33 Institute’s process of surfacing underlying values through moral dilemmas
16:00 Creating a “moral graph” to capture wisdom and agreements
22:04 Risks of personalized AI models and the need for shared human values
26:25 Using the moral graph to guide and evaluate AI model outputs
32:12 Potential applications of the moral graph
36:07 Challenges of scaling to superintelligent AI
39:55 Broader implications and the need for people to articulate their values
43:55 Where to find more information about the Meaning Alignment Institute
CHECK OUT THE MEANING ALIGNMENT INSTITUTE: https://www.meaningalignment.org/
OTHER RESOURCES MENTIONED:
Meaning Alignment Institute Substack: https://meaningalignment.substack.com/
Introducing Democratic Fine-Tuning: https://meaningalignment.substack.com/p/introducing-democratic-fine-tuning
Value Discovery GPT: https://chat.openai.com/g/g-TItg5klMA-values-discovery
CONNECT WITH OLIVER:
Linkedin – https://www.linkedin.com/in/oliver-klingefjord-45b662105/
Twitter – https://twitter.com/klingefjord
CONNECT WITH SARA:
Instagram – https://bit.ly/saralanditortoli-instagram
Twitter – https://twitter.com/Sara_LandiTor
Linkedin – https://bit.ly/saralanditortoli-linkedin
Newsletter – https://polyweb.beehiiv.com/
ABOUT POLYWEB:
Polyweb navigates through the intricate nexus of technology, product innovation, and human creativity. Engage with leading entrepreneurs and experts in uncovering how we can forge impactful companies and lead lives enriched with purpose in the Technology Era.
Subscribe to our YouTube channel: https://www.youtube.com/@polywebhq
Listen for free on your favorite Podcast platform – search “PolyWeb” on your podcast app, or click these links:
Apple Podcasts – https://apple.co/3Jp6NA3
Spotify – https://spoti.fi/3OZlfC8
Google Podcasts – https://bit.ly/polyweb-googlepodcast
RSS – https://www.podpage.com/polyweb/
FOLLOW POLYWEB:
YouTube – https://www.youtube.com/@polywebhq/
Website – https://www.podpage.com/polyweb/
Newsletter – https://polyweb.beehiiv.com/
TikTok – https://www.tiktok.com/@polywebhq
Instagram – https://www.instagram.com/polyweb/
Twitter – https://twitter.com/PolyWebHQ
LEAVE A REVIEW
If you enjoyed listening to the podcast, we’d love for you to leave a 5-star review on Apple Podcast
