SimFG

4 ms·

1.
Ask HN: How can ChatGPT be effectively utilized in the work
1 points by SimFG 3y ago|0 comments
2.
LLMs on a Budget: Cutting Costs and Amplifying Results with GPTCache(medium.com)
1 points by SimFG 3y ago|1 comments
3.
by SimFG 3y ago
Thanks Shivansh for his article
4.
by SimFG 3y ago
Lior's tweet: https://twitter.com/AlphaSignalAI/status/1677348799801425920 You can cut your GPT API expenses by 50% through caching using LangChain and GPTCache. You will also benefit from significant respons
5.
Ask HN: Is LLM caching necessary?
3 points by SimFG 3y ago|1 comments
6.
by SimFG 3y ago
Maybe [GPTCache]( https://github.com/zilliztech/GPTCache ) can make it more attractive, because similar problems can be less expensive, and can also be responded to faster. Of course, the specific configuration needs to
7.
by SimFG 3y ago
At present, we have started applying GPT cache to online products. According to existing data, the effect is good. In fact, it can also be found that some LLM products actually have caching capabilities, such as Github Copilot. However, the
8.
How to better configure your LLM cache(gptcache.readthedocs.io)
1 points by SimFG 3y ago|1 comments
9.
by SimFG 3y ago
Maybe users can discuss about llm output? The question asker can have LLM reproduce the results based on the discussion. Of course, there are many user-related issues involved.
10.
A Strange Thought: New StackOverflow?
3 points by SimFG 3y ago|7 comments
11.
by SimFG 3y ago
Cool, I prefer the OpenAI-Compatible api. Although this is not very technically difficult, it is really intimate, because it make me feel free to use all ChatGPT applications.
12.
by SimFG 3y ago
Looks great! I'm planning to integrate it into my new project(to-chatgpt: https://github.com/SimFG/to-chatgpt ), which will provide users of the ChatGPT applications with a wider range of LLM service options.
13.
Show HN: Make you feel free to use ALL ChatGPT applications(github.com)
4 points by SimFG 3y ago|0 comments
14.
Limited budget or machine resources, how to achieve a decent LLM experience?(github.com)
2 points by SimFG 3y ago|1 comments
15.
by SimFG 3y ago
GPT3.5 answer: If you have limited budget or machine resources, there are several ways to obtain a good large-scale model experience: 1. Pretrained Models: You can use pre-trained models that have already been trained on large datasets. The
16.
Ask HN: Is it appropriate to use a semantic cache in Microsoft Guidance?(github.com)
1 points by SimFG 3y ago|0 comments
17.
by SimFG 3y ago
Sometime, the girlfriend may be busy, need a GPTCache to ease visit stress. :}
18.
by SimFG 3y ago
Maybe GPTCache can reduce the count of llm request for lower cost. detail: https://github.com/zilliztech/GPTCache
19.
How GPTCache works with llama index(github.com)
5 points by SimFG 3y ago|1 comments
20.
by SimFG 3y ago
Someone recently asked me about how GPTCache works with llama index. We've added a new example to our latest documentation, which demonstrates webpage QA. We welcome your feedback if you encounter any issues using GPTCache.