8 ms·
If you integrate with existing tooling, it won’t do this optimization. Unless of course you really go crazy with your setup.
by christina97 2y ago
If you integrate with existing tooling, it won’t do this optimization. Unless of course you really go crazy with your setup.
- moffkalast 2y agoSetting one launch flag on llama.cpp server hardly qualifies as going crazy with one's setup.