LLM can be extended, by fine tuning with custom dataset to provide Q&A, summary and many other ChatGPT like functions. In this video, we are using LlamaIndex (GPT Index) which provides a central interface to connect your LLM’s with external data.
Full code discussed in the video can be found here:
– https://github.com/prodramp/DeepWorks/blob/main/ChatGPT/FineTuneLLM.md
== Video Timeline ==
(00:00) Content Intro
(00:59) Gradio UI Demo
(04:24) Training LLM – Concepts
(12:40) Fine-tuning LLM – Concepts
(17:42) Coding Demo
(18:40) finetune.py Coding
(25:20) queryindex.py
(27:29) Results
(29:04) Summary
Please visit:
https://prodramp.com | @prodramp
https://www.linkedin.com/company/prodramp
Content Creator:
Avkash Chauhan (@avkashchauhan)
https://www.linkedin.com/in/avkashchauhan
Tags:
#llm #chatgpt #finetunellm #openai #python #ai
