4 ms·
Llamafile is great if you don't want to run any meaningful models because it's limited to 4GB.
by gertop 2y ago
Llamafile is great if you don't want to run any meaningful models because it's limited to 4GB.
- cromka 2y agoThat's a Windows limitation, though.
- yjftsjthsd-h 2y agoEven on Windows, you just run the binary separate from the model file. I actually run a single binary separate from the model files because I run it with multiple of them, so I kind of forgot that that was even the default way it kind of expects you to hold it.