4 ms·
Last week I started this OllamaTea [1] BubbleTea component library which tries to leverage this idea of an Ollama sidecar. I've really appreciated Ollama as a
by neomantra 2y ago
Last week I started this OllamaTea [1] BubbleTea component library which tries to leverage this idea of an Ollama sidecar.
I've really appreciated Ollama as a simple local inferencing service. I'll now sometimes ask Ollama something using its CLI, rather than going to a URL bar. Once Llama 3.2 Vision became available on Ollama this month [2], I got excited to try them with visual UI elements. I've also wanted to explore some kid-friendly TUIs, which need to be cheap and private.
OllamaTea is not intended to be a full-feature Chat program, but rather as scaffolding for adding Ollama to custom TUI apps.
Once I had the base OllamaTea library, I was able write the POC that inspired the whole thing.; I made a TUI that plots a terminal chart of some market data, converts that to an image, then prompts Ollama about it. Easy to achieve once all the pieces were in place. [3]
The direct Ollama Golang API [4] is very easy to use. OllamaTea just makes it easier to make TUIs. While most of the research action is in Python, I think there's room for ML applications/services/orchestrators written in Golang and working with the Ollama API surface [5].
[1] https://github.com/nimblemarkets/ollamatea https://github.com/nimblemarkets/ollamatea
[2] https://ollama.com/blog/llama3.2-vision https://ollama.com/blog/llama3.2-vision
[3] https://github.com/NimbleMarkets/ollamatea/blob/main/cmd/ot-timechart/README.md#databento-data-example https://github.com/NimbleMarkets/ollamatea/blob/main/cmd/ot-...
[4] https://pkg.go.dev/github.com/ollama/ollama/api https://pkg.go.dev/github.com/ollama/ollama/api
[5] https://github.com/ollama/ollama/blob/main/docs/api.md https://github.com/ollama/ollama/blob/main/docs/api.md