3 ms·
Yes. You need an idle loop that generates API calls to OpenAI even when your service is not used by anyone, to prevent the LLM from getting bored.
by meindnoch 1y ago
Yes. You need an idle loop that generates API calls to OpenAI even when your service is not used by anyone, to prevent the LLM from getting bored.