2 ms·
I stay away from such frameworks because: - Writing what I want in Python/other-lingo gives me much more customizability than these frameworks offer. - No wor
by behnamoh 2y ago
I stay away from such frameworks because:
- Writing what I want in Python/other-lingo gives me much more customizability than these frameworks offer.
- No worries about the future plans of the repo and having to deal with abandonware.
- No vendor lock in. Currently most repos like this focus on OpenAI's models, but I prefer to work with local models of all kinds and any abstraction above llama.cpp or llama-cpp-python is a no-no for me.
The last point means I refuse to build on top of ollama's API as it's yet another wrapper around llama.cpp.
- rcarmo 2y agoNot using the ollama API means you have to keep track of context yourself, and run all your stuff in the same box. Hardly ideal.