3 ms·
Do you send that wall of text on every request? Doesn’t that eat a ton of tokens?
by tmountain 2y ago
Do you send that wall of text on every request? Doesn’t that eat a ton of tokens?
- BiteCode_dev 2y agoSystem prompt.
- QuadrupleA 2y agoSystem prompt is not free, it's priced like a chat message.
- tmountain 2y agoDoes it get sent every round trip?
- trolan 2y agoIf you've built a thread in OpenAI everything is sent each time
- firesteelrain 2y agoI get “memory updated”. It seems like it has some backend DB of sorts.
- HeatrayEnjoyer 2y agoMemory is the personalization feature that learns about you.
- firesteelrain 2y agoAh cool
- pmarreck 2y agoOpenAI's ChatGPT "custom instructions" do not add to your token count AFAIK. They ARE limited in size, though.