redskyluan

11 ms·

1. 91.▲
   by redskyluan 3y ago

   You are right, most LLM queries won't be exact match, so you will need semantic search for hit those similar but not same questions
2. 92.▲
   Yet Another Cache, but for ChatGPT(zilliz.com)

   2 points by redskyluan 4y ago|1 comments
3. 93.▲
   by redskyluan 4y ago

   We build a cache for cache for ChatGPT, see how it can save your money and time when build application on top of LLMs
4. 94.▲
   by redskyluan 4y ago

   what about the https://huggingface.co/facebook/opt-66b ? I thought the opt series can be used in production
5. 95.▲
   Does ChatGPT Need a Cache?(github.com)

   2 points by redskyluan 4y ago|1 comments
6. 96.▲
   by redskyluan 4y ago

   do you guys think it is good idea to have a cache layer on top of LLMs?
7. 97.▲
   by redskyluan 4y ago

   what will be the target user of this service?
8. 98.▲
   by redskyluan 4y ago

   I really like this idea. did you plan to add more oss projects into it?
9. 99.▲
   by redskyluan 4y ago

   would you please update the milvus score in your benchmark with the latest milvus, thanks
10. 100.▲
    by redskyluan 4y ago

    did you try to serve billion level vectors, on both projects you mentioned? Then you can define what is overengineered. And what about ScaNN and GPU index? the flexibility to support multi index type is a actually a big plus
11. 101.▲
    by redskyluan 4y ago

    We should probably try to implement a PDF search demo on top of Milvus.. LOL
12. 102.▲
    by redskyluan 4y ago

    See https://milvus.io/
13. 103.▲
    by redskyluan 4y ago

    FAISS is simply a library. You will need a system Like Milvus for huge data amount
14. 104.▲
    by redskyluan 5y ago

    cool idea, what skillset are you guys looking for?