7 ms·
I think the best publicly available model that can follow instructions right now is https://huggingface.co/bigscience/bloomz https://huggingface.co/bigscience/b
by tripplyons 4y ago
I think the best publicly available model that can follow instructions right now is https://huggingface.co/bigscience/bloomz https://huggingface.co/bigscience/bloomz.
It has 176 billion trainable parameters, but I think it uses up terabytes of memory, so there is a trade off between model size and the ability of the model.
On most GPUs, you should be able to run https://huggingface.co/google/flan-t5-large https://huggingface.co/google/flan-t5-large. It is pretty good and is trained to follow instructions.
- piecerough 4y agoInstructGPT is actually 1.3B, you don't need 175B like initial GPT-3 model: https://openai.com/blog/instruction-following/ https://openai.com/blog/instruction-following/ ChatGPT is likely a much better variant, but also must be still small and will likely be portable.
- tripplyons 4y agoChatGPT is based on GPT3.5 which is a series of 175B models that includes code-davinci-002, text-davinci-002, and text-davinci-003. I do not think of it as portable.
- PartiallyTyped 4y agoNetwork distillation to the rescue! Provided that you have the means to distill in the first place :D
- ActorNightly 4y agoWould it be possible to run this entire model sequentially, dumping intermediate results to SSD?
- moffkalast 4y agoI've just tried out a few of the flan-t5s and they're surprisingly coherent. It likes dogs and pine trees, thinks Makerbot is the best 3D printer lol. Can even generate some code, though it's usually wrong. And it can't seem to decide if a flower pot is orange or red. Any idea if it's possible to chain feed a conversation into this one? I've tried a few various Q and A formats but none seem to really grab the old context.