I want to give you step by step guide on how to reduce LLM cost by 70%, and unpack why it is costing so much now
Get free HubSpot AI For Marketers Course: https://clickhubspot.com/xut
Links
– Follow me on twitter: https://twitter.com/jasonzhou1993
– Join my AI email list: https://crafters.ai/
– My discord: https://discord.gg/eZXprSaCDE
– Inbox Agent: https://www.youtube.com/watch?v=Jv_e6Rt4vWE&t=23s&ab_channel=AIJason
– Research Agent: https://www.youtube.com/watch?v=ogQUlS7CkYA&t=299s&ab_channel=AIJason
– James Brigg on Agent Memory: https://www.pinecone.io/learn/series/langchain/langchain-conversational-memory/
– Another video about details for LLM cost tracking: https://www.youtube.com/watch?v=Alb2kjUzpZ8&ab_channel=LearnfromOpenSourcewithElie
Timestamps
0:00 How I burned $5000 on OpenAI
2:41 My experience with AI Girlfriend Project
6:01 HubSpot AI For Markter
7:23 How to Reduce LLM Cost
8:33 Method 1 – Finetune
9:51 Method 2 – Cascade
10:35 Method 3 – LLM Router
12:47 Method 4 – Multi-Agent
14:07 Method 5 – LLMLingua
16:31 Method 6 – Optimise tool input/output
17:16 Method 7 – Memory Optimisation
19:26 LLM Monitor & Analytics
20:09 Tutorial: Monitor & reduce 75% cost
About Me
My name is Jason Zhou, a product designer who shares interesting AI experiments & products. Email me if you need help building AI apps! [email protected]
#mixtral #gpt4turbo #gpt4 #ai #artificialintelligence #tutorial #stepbystep #openai #llm #chatgpt #largelanguagemodels #largelanguagemodel #bestaiagent #chatgpt #agentgpt #agent #autogen #autogpt
