2 ms·
Tooling for this was announced on HN 3 months ago, it now does a lot more: https://news.ycombinator.com/item?id=37125118 https://news.ycombinator.com/item?id=37
by dragonwriter 3y ago
Tooling for this was announced on HN 3 months ago, it now does a lot more: https://news.ycombinator.com/item?id=37125118 https://news.ycombinator.com/item?id=37125118
Here is an plugin for one of the popular tools for running multiple local models (it is a tool that presents an OpenAI-style API for downstream consumption, as well as presenting its own Web UI for direct interaction with the models.):
https://github.com/hallucinate-games/oobabooga-jsonformer-plugin https://github.com/hallucinate-games/oobabooga-jsonformer-pl...