3 ms·

I’ve been using llava via https://github.com/Mozilla-Ocho/llamafile https://github.com/Mozilla-Ocho/llamafile which runs on any modern system.

by ok_dad 3y ago

jart 3y ago
It's so great. I've been this vision model to rename all the files in my Pictures folder. For example, the one-liner: llamafile --temp 0 \ --image ~/Pictures/lemurs.jpg \ -m llava-v1.5-7b-Q4_K.gguf \ --mmproj llava-v1.5-7b-mmproj-Q4_0.gguf \ --grammar 'root ::= [a-z]+ (" " [a-z]+)+' \ -p $'### User: What do you see?\n### Assistant: ' \ --silent-prompt 2>/dev/null | sed -e's/ /_/' -e's/$/.jpg/' Prints to standard output: a_baby_monkey_on_the_back_of_a_mother.jpg This is something that's coming up in the next llamafile release. You have to build from source to have the ability to use grammar and --silent-prompt on a vision model right now. Weights here: https://huggingface.co/jartine/llava-v1.5-7B-GGUF/tree/main https://huggingface.co/jartine/llava-v1.5-7B-GGUF/tree/main Sauce here: https://github.com/mozilla-Ocho/llamafile https://github.com/mozilla-Ocho/llamafile
- sheepscreek 3y ago
  Truly grateful for your work on cosmopolitan, cosmo libc, redbean, nudging POSIX towards realizing the unachieved dream and also for contributing to llama.cpp. It’s like wherever I look, you’ve already left your mark there! To me, you exemplify and embody the spirit of OSS, and to top that - you seem to be just an amazing human. You are an inspiration for me and many others. And even though I know I’ll never ever get close, you make me want to try. Thank you. :)
  - jart 3y ago
    Thanks!
- ok_dad 3y ago
  That's cool! I've been a fan of your projects here since redbean was released, and if I understood C I would be more excited about the underlying tech that runs all these tools, but I'm more of an algorithm designer and back-end data processing system programmer (I use Python), so watching the progression of your technology is very impressive but I barely understand how it works :)

I’ve been using llava via https://github.com/Mozilla-Ocho/llamafile https://github.com/Mozilla-Ocho/llamafile which runs on any modern system.

by ok_dad 3y ago

I’ve been using llava via https://github.com/Mozilla-Ocho/llamafile https://github.com/Mozilla-Ocho/llamafile which runs on any modern system.

jart 3y ago

It's so great. I've been this vision model to rename all the files in my Pictures folder. For example, the one-liner: llamafile --temp 0 \ --image ~/Pictures/lemurs.jpg \ -m llava-v1.5-7b-Q4_K.gguf \ --mmproj llava-v1.5-7b-mmproj-Q4_0.gguf \ --grammar 'root ::= [a-z]+ (" " [a-z]+)+' \ -p $'### User: What do you see?\n### Assistant: ' \ --silent-prompt 2>/dev/null | sed -e's/ /_/' -e's/$/.jpg/' Prints to standard output: a_baby_monkey_on_the_back_of_a_mother.jpg This is something that's coming up in the next llamafile release. You have to build from source to have the ability to use grammar and --silent-prompt on a vision model right now. Weights here: https://huggingface.co/jartine/llava-v1.5-7B-GGUF/tree/main https://huggingface.co/jartine/llava-v1.5-7B-GGUF/tree/main Sauce here: https://github.com/mozilla-Ocho/llamafile https://github.com/mozilla-Ocho/llamafile

sheepscreek 3y ago
Truly grateful for your work on cosmopolitan, cosmo libc, redbean, nudging POSIX towards realizing the unachieved dream and also for contributing to llama.cpp. It’s like wherever I look, you’ve already left your mark there! To me, you exemplify and embody the spirit of OSS, and to top that - you seem to be just an amazing human. You are an inspiration for me and many others. And even though I know I’ll never ever get close, you make me want to try. Thank you. :)
- jart 3y ago
  Thanks!
ok_dad 3y ago
That's cool! I've been a fan of your projects here since redbean was released, and if I understood C I would be more excited about the underlying tech that runs all these tools, but I'm more of an algorithm designer and back-end data processing system programmer (I use Python), so watching the progression of your technology is very impressive but I barely understand how it works :)