4 ms·
GPT-4 allows you to use 8k of context in their current beta, if you're using the chat api directly. It will be interesting ( and probably expensive, lol ) when
by knome 4y ago
GPT-4 allows you to use 8k of context in their current beta, if you're using the chat api directly. It will be interesting ( and probably expensive, lol ) when they open it to a full 32k.
- Baeocystin 4y agoI'm really looking forward to being able to use a personalized LoRa on top of a GPT-4+ class model. I want to be able to train on all of may writing over the past few decades and interrogate the history of my ideas, and I think this would be tremendously valuable for writers of all kinds. Heck, think of the value of training (with their blessing) on something like /r/AskHistorians, or other deep-dive, high quality fora.
- Name_Chawps 4y agoThough unfortunately it will cost like $20 per 32k completion...
- M4v3R 4y agoMore like $1,92 (32 * 0,12) for a 32k prompt, or twice that for a 32k completion. Still not cheap though.