3 ms·
I don't know how more people don't talk about the 1M context tokens. While the output is mediocre for cutting edge models, you can context stuff the ever living
by Workaccount2 2y ago
I don't know how more people don't talk about the 1M context tokens. While the output is mediocre for cutting edge models, you can context stuff the ever living hell out of it for some pretty amazing capabilities. 2M tokens is even crazier.
- lordswork 2y agoIt is pretty amazing. I've been using it every day. I do wish you could easily upload an entire repo into it though.
- bongodongobob 2y agoHave it write a program to output a repo as a flat file.
- rm_-rf_slash 2y agoAnything approaching the token limit I turn into a file and upload to a vector store. Results are comparable between Chat and Assistants.
- Keyframe 2y agoThat's a good point. Gemini gatekeeping me on so many answers made me forget about this extraordinary feature of it.