4 ms·
The obvious comparison here is ChatGPT's GPTs. Claude Projects appear to work by dumping the entire "knowledge base" into the context in one go, hence the 200,0
by simonw 2y ago
The obvious comparison here is ChatGPT's GPTs. Claude Projects appear to work by dumping the entire "knowledge base" into the context in one go, hence the 200,000 token limit, which makes it very easy to reason about.
GPTs have a form of RAG built in - you can upload up to 20 documents each of 2 million tokens and those get chunked and vectorized and used to help answer questions - but there's still no internal documentation on how that chunking process works, which makes it hard for me to trust them as I can't make informed decisions about how best to use the knowledge feature.
- handfuloflight 2y ago[dead]
- LordDragonfang 2y agoIf it's anything like the "file upload" feature in ChatGPT, it's not very good. CGPT will frequently straight up lie to me about the contents of even short files I uploaded specifically for it to reference. Like, rewriting the code to use the opposite API pattern from what I gave it, or totally ignoring what detail I put in a file specification and making some up - things it basically never does if I paste the code directly in the chat.
- simonw 2y agoI expect it will work better than that, because the Claude project is dumping the whole set of uploaded files directly into the context. My experience with Claude has been that it's really good at working with large chunks of text that you paste straight into the prompt.
- throwup238 2y agoIt’s nothing like that implementation (I’ve been using it today). It just dumps the entire contents of the files and gives you a progress bar that shows how full the context is. I’m at 55% with a 12k LoC Rust/C++ project.