4 ms·
Don't use instruct/chat models when the pretrained is available. Chat/instruct are low hanging fruit for deploying to 3rd party users as prompts are easy and s
by kromem 3y ago
Don't use instruct/chat models when the pretrained is available.
Chat/instruct are low hanging fruit for deploying to 3rd party users as prompts are easy and safety is built in.
But they suck compared to the pretrained models for direct usage. Like really, really suck.
Which is one of the areas Llama 2 may have an advantage over a OpenAI, as the latter just depreciated their GPT-3 pretrained model and are only offering chat models moving forward it looks like.
- immibis 3y agoSounds like AI Dungeon 2 is finally going to breathe its last breath. It relies on non-chat models by design.