3 ms·Does ChatGPT Need a Cache?2 points by redskyluan 4y agoredskyluan 4y agodo you guys think it is good idea to have a cache layer on top of LLMs?