Speculate OpenAI GPT-4’s vision+text model architecture, training data, and cost to train (the number of GPUs used)
GPT-4 Tech Report reading:
https://youtu.be/cH8jBaEf8Kc
ChatGPT paper reading:
https://youtu.be/Qj0HH8iEljM
GPT-3 paper reading (Language Models are Few-Shot Learners):
Part 1: https://www.youtube.com/watch?v=W1GYXxNhybc
Part 2: https://www.youtube.com/watch?v=rbKpk5bIA2g
Part 3: https://www.youtube.com/watch?v=1oT9LYdCfoM
#openai #chatgptplus #chatgpt #pretrain #gpt4 #gpt3 #review #nlp #ethicalai #llm #bert #coursera #ml #course #rl #rewardmodel #ppo #instructgpt #sota #imagenet #inanutshell
