3 ms·
Ollama is simply great! I was quite surprised how easy it is to integrate through their API. A simple chat using Ollama + llama3 is less than 40 lines of TypeSc
by wiktor-k 2y ago
Ollama is simply great! I was quite surprised how easy it is to integrate through their API. A simple chat using Ollama + llama3 is less than 40 lines of TypeScript: https://github.com/wiktor-k/llama-chat https://github.com/wiktor-k/llama-chat
- oulipo 2y agoNice! Would there be a way to do that streaming, with streaming voice input too?
- wiktor-k 2y agoStreaming is not a problem (it's just a simple flag: https://github.com/wiktor-k/llama-chat/blob/main/index.ts#L26 https://github.com/wiktor-k/llama-chat/blob/main/index.ts#L2...) but I've never used voice input. The examples show image input though: https://github.com/ollama/ollama/blob/main/docs/api.md#request-with-images https://github.com/ollama/ollama/blob/main/docs/api.md#reque... Maybe you can file an issue here: https://github.com/ollama/ollama/issues https://github.com/ollama/ollama/issues