3 ms·
Do you mean you want responses cached to e.g. a file based on the inputs?
by chr15m 11mo ago
Do you mean you want responses cached to e.g. a file based on the inputs?
- __MatrixMan__ 11mo agoYeah, if it's a novel prompt, by all means send it to the model, but if its the same prompt as 30s ago, just immediately give me the same response I got 30s ago. That's typically how we expect bash pipelines to work, right?
- chr15m 11mo agoBash pipelines don't do any caching and will execute fresh each time, but I understand your idea and why a cache is useful when iterating on the command line. I'll implement it. Thanks!