3 ms·
I've been waiting for this ever since they trained BLOOM and even GPT Neo. Without instruction tuning they are almost worthless. If all you want is classificati
by visarga 4y ago
I've been waiting for this ever since they trained BLOOM and even GPT Neo. Without instruction tuning they are almost worthless. If all you want is classification then it's better to use BERT, but if you need the generative part then you have to scale up to these big guys.
What I need is the instruction following skills of GPT-3, running on a single (large) GPU, and not having to pay by token.
- monkmartinez 4y agoI am very much wishing for the same. I have used T0_3B (https://github.com/bigscience-workshop/t-zero https://github.com/bigscience-workshop/t-zero) on my M40 with 24GB of vRAM. It was fun to get it working, but its not remotely comparable to GPT-3 (instructGPT).