Vicuna has “90%* high quality of OpenAI ChatGPT and Google Bard” whereas being uncensored, regionally hosted and FAST (relying on {hardware}). This video reveals my up to date set up script that ought to make life simple AND WORKS WITH CPU!
Set up Oobabooga & Vicuna (UPDATED): iex (irm vicuna.tc.ht)
View what this script does & see the supply code right here: https://vicuna.tc.ht
Extra data on Vicuna: https://vicuna.lmsys.org/
Oobabooga: https://github.com/oobabooga/text-generation-webui/
Earlier video exhibiting different options: https://youtu.be/ByV5w1ES38A
Downloading the fashions manually?
CPU: https://huggingface.co/eachadea/ggml-vicuna-13b-4bit/tree/main — All recordsdata go into modelseachadea_ggml-vicuna-13b-4bit
GPU: https://huggingface.co/anon8231489123/vicuna-13b-GPTQ-4bit-128g/tree/main — All recordsdata go into “modelsanon8231489123_vicuna-13b-GPTQ-4bit-128g”
Timestamps:
0:00 – Clarification
0:45 – Why that is distinctive
1:20 – Beginning Vicuna & Oobabooga set up
2:00 – Putting in CPU-only Vicuna & Oobabooga (NEW)
3:00 – Vicuna CPU Desktop Shortcut (NEW)
3:45 – Utilizing Vicuna & Oobabooga in CPU mode (NEW)
4:40 – GPU vs CPU-only set up
5:38 – Putting in Vicuna & Oobabooga for GPU & CPU
6:00 – Downloading GPU and/or CPU Vicuna mannequin
7:07 – GPU vs CPU Vicuna velocity
#Vicuna #AI #LLAMA
—————————–
💸 Discovered this handy? Assist me make extra! Help me by changing into a member: https://youtube.com/channel/UCkih2oVTbXPEpVwE-U7kmHw/join
—————————–
💸 Direct donations through Ko-Fi: https://ko-fi.com/TCNOco
💬 Focus on the video & Recommend (Discord): https://s.tcno.co/Discord
👉 Recreation guides & Easy suggestions: https://YouTube.com/TroubleChuteBasics
🌐 Web site: https://tcno.co
📧 Want voiceovers carried out? Enterprise question? Contact my enterprise e mail: TroubleChute (at) tcno.co
—————————–
🎨 My Themes & Home windows Skins: https://hub.tcno.co/faq/my-windows/
👨💻 Software program I exploit: https://hub.tcno.co/faq/my-software/
➡️ My Setup: https://hub.tcno.co/faq/my-hardware/
🖥️ My Present {Hardware}:
Intel i9-13900k – https://amzn.to/42xQuI1
GIGABYTE Z790 AORUS Grasp – https://amzn.to/3nHuBHx
G.Ability RipJaws 2x(2x32G) [128GB] – https://amzn.to/42cilxN
Corsair H150i 360mm AIO – https://amzn.to/42cznvP
MSI 3080Ti Gaming X Trio – https://amzn.to/3pdnLdb
Corsair 1000W RM1000i – https://amzn.to/42gOTGY
Corsair MP600 PRO XT 2TB – https://amzn.to/3NSvwzx
🎙️ My Present Mic/Recording Gear:
Shure SM7B – https://amzn.to/3nDGYo1
Audient iD14 – https://amzn.to/3pgf2XK
dbx 286s – https://amzn.to/3VNaq7O
Triton Audio FetHead – https://amzn.to/3pdjIgZ
Every part on this video is my private opinion and expertise and shouldn’t be thought of skilled recommendation. At all times do your personal analysis and guarantee what you are doing is secure.
