5 ms·
You only need that info if you know you need it in your rag. Over the last two years of usage I don't recall where I'd need those timestamps but I know there ar
by journal 10mo ago
You only need that info if you know you need it in your rag. Over the last two years of usage I don't recall where I'd need those timestamps but I know there are cases. Still, this would have to be an option because otherwise it would be waste of tokens. However, we have to consider they are competing for the quality AND length of the response even if a shorter response is better. There's a pretzel of considerations when talking about this.
- cj 10mo agoImagine you started having back pain months ago and you remember asking ChatGPT questions when it first started. Now you’re going to the doctor and you forgot exactly when the pain started. You remember that you asked ChatGPT about the pain the day it started. So you look for the chat, and discover there are no dates. It feels like such an obvious thing that’s missing. Let’s not over complicate things. There aren’t that many considerations. It’s just a date. It doesn’t need to be stuffed into the context of the chat. Not sure why quality or length of chat would need to be affected?
- Tom1380 10mo agoThis was me yesterday, verbatim
- gukoff 10mo agoTimestamps are conversation metadata and don't need to be fed to the LLM and require tokens.