2 ms·
Tried to use the example on the documentation: llama_init_from_gpt_params: error: failed to create context with model 'Meltemi-7B-Instruct-v1.5-Q8_0.gguf' main
by gepiti 2y ago
Tried to use the example on the documentation:
llama_init_from_gpt_params: error: failed to create context with model 'Meltemi-7B-Instruct-v1.5-Q8_0.gguf'
main: error: unable to load model
Is something missing?
- fforflo 2y agoI guess you mean the .gguf examples, not Llamafile, right? What command did you use? Maybe you're using an old llama.cpp ?
- gepiti 2y agoInstalled from the link to AlmaLinux 9. The command is from the CLI example: ./Meltemi-7B-Instruct-v1.5-Q8_0.llamafile -p 'Ποιό είναι το νόημα της ζωής;' Thank you very much.