4 ms·
Have you looked at llamafile[0]? It can spin up a openAi compatible API for a while host of LLM. [0] https://github.com/Mozilla-Ocho/llamafile https://github.c
by vorticalbox 3y ago
Have you looked at llamafile[0]? It can spin up a openAi compatible API for a while host of LLM.
[0] https://github.com/Mozilla-Ocho/llamafile https://github.com/Mozilla-Ocho/llamafile