2 ms·
For Golang, I highly recommend yzma to explore this surface. I’ve used it for embedding and summarization (with small models) and just mucking around with inte
by neomantra 5mo ago
For Golang, I highly recommend yzma to explore this surface. I’ve used it for embedding and summarization (with small models) and just mucking around with integrated LLM BubbleTea TUI idea (with bigger models).
https://github.com/hybridgroup/yzma https://github.com/hybridgroup/yzma
And thank you antirez for using your rep and quality output to push this line of evangelism; it is even more important than the software itself.
- neomantra 5mo agoLiteral #showerthought: "why don't you just make the same thing for ds4, it will be awesome" Toweled off and got to work: https://github.com/NimbleMarkets/ds4-go https://github.com/NimbleMarkets/ds4-go The concept is marrying the flexibility of Golang with a specific local high-performance inferencing engine. The clean C interface made it easy. Initial release wraps the API using purego and requires pointing to a DS4 installation. I'm now adding some pre-built installer ergonomics and directory opinions and demos.