3 ms·
Is this doing local inference? If so, what inference engine is it using?
by gclawes 1y ago
Is this doing local inference? If so, what inference engine is it using?
- demosthanos 1y agoNo, it's a thin wrapper around an API, probably OpenRouter or similar: https://github.com/ccbikai/ssh-ai-chat/blob/master/src/ai/index.ts https://github.com/ccbikai/ssh-ai-chat/blob/master/src/ai/in...
- ccbikai 1y agoCurrently using the OpenAI API to access multiple models. You can use ollama to access local inference models