3 ms·

I’d recommend starting with llamafile due to its simplicity and then move up to llamacpp and Unsloth.