3 ms·
I do not as I'm not in the ecosystem, but groq is openai compliant, so any tool that is openai compliant (99% are) and lets you put in your own baseurl should w
by 7thpower 2y ago
I do not as I'm not in the ecosystem, but groq is openai compliant, so any tool that is openai compliant (99% are) and lets you put in your own baseurl should work.
For example, many tools will let you use local llms. Instead of putting in the url to the local llm, you would just plug in the groq url and key.
see: https://console.groq.com/docs/openai https://console.groq.com/docs/openai