3 ms·
InstructGPT is actually 1.3B, you don't need 175B like initial GPT-3 model: https://openai.com/blog/instruction-following/ https://openai.com/blog/instruction-f
by piecerough 4y ago
InstructGPT is actually 1.3B, you don't need 175B like initial GPT-3 model: https://openai.com/blog/instruction-following/ https://openai.com/blog/instruction-following/
ChatGPT is likely a much better variant, but also must be still small and will likely be portable.
- tripplyons 4y agoChatGPT is based on GPT3.5 which is a series of 175B models that includes code-davinci-002, text-davinci-002, and text-davinci-003. I do not think of it as portable.
- PartiallyTyped 4y agoNetwork distillation to the rescue! Provided that you have the means to distill in the first place :D
- ActorNightly 4y agoWould it be possible to run this entire model sequentially, dumping intermediate results to SSD?