2 ms·
I have so far run it on my M1 MacBook using llamafile [1] and found it to be great. Is there any speed/performance/quality/context size/etc. advantage to using
by barnabee 3y ago
I have so far run it on my M1 MacBook using llamafile [1] and found it to be great.
Is there any speed/performance/quality/context size/etc. advantage to using LLM Studio or any of the other *llama tools that require more setup than downloading and running a single llamafile executable?
[1] https://github.com/Mozilla-Ocho/llamafile/ https://github.com/Mozilla-Ocho/llamafile/