3 ms·
On a Macbook Pro M2, I get $ ./llamafile-server-0.1-llava-v1.5-7b-q4 [2] 25224 illegal hardware instruction ./llamafile-server-0.1-llava-v1.5-7b-q4
by derwiki 3y ago
On a Macbook Pro M2, I get
$ ./llamafile-server-0.1-llava-v1.5-7b-q4
[2] 25224 illegal hardware instruction ./llamafile-server-0.1-llava-v1.5-7b-q4
- jart 3y agoCould you disable SIP and run `lldb -- $TMPDIR/.ape-1.8 ./llamafile-server-0.1-llava-v1.5-7b-q4` and give me (1) the name of the instruction that's illegal (or its hex value) and (2) the hex address of where that instruction is in memory? You're encouraged to file a GitHub issue about this too. Thanks!
- derwiki 3y agoClosing the loop for anyone reading this thread -- see https://github.com/Mozilla-Ocho/llamafile/issues/11 https://github.com/Mozilla-Ocho/llamafile/issues/11 for the fix. Thanks jart!