3 ms·
State of GPT (by Andrej Karpathy)
- jimmySixDOF 3y agoIt was a nice walk through of the big picture process and all that but a hidden gem I came away with was checking out the sources for tables he used in the slidedeck. Particularly the Large Model Systems Organization out of UC Berkley [1] who have a Chatbot Arena running leaderboard based on open human feedback where they show two responses to your prompt, you pick a winner and then they show you what models were used. Great easy way to see the diversity of output and the similarities can be eye opening too. [1] https://chat.Lmsys.org/?arena https://chat.Lmsys.org/?arena