4 ms·
I'm not sure if I want to trust yet another loader with secret sauce, there are already a lot of those around. What I'd really like is a simple utility that, g
by toyg 8d ago
I'm not sure if I want to trust yet another loader with secret sauce, there are already a lot of those around.
What I'd really like is a simple utility that, given my system and a model, will tweak llamacpp to run decently (or tell me it can't be done).
- davada 6d agoIts not so secretive, you can see the parameters they are using (arguments, and inference engine). I understand your point, but the only thing unusual/uncommon about it is the jargon used for LLM/AI systems.