llamafile will run on all architectures because it is compiled by cosmopolitan. https://github.com/jart/cosmopolitan https://github.com/jart/cosmopolitan "Cos

llamafile will run on all architectures because it is compiled by cosmopolitan. https://github.com/jart/cosmopolitan https://github.com/jart/cosmopolitan "Cosmopolitan Libc makes C a build-once run-anywhere language, like Java, except it doesn't need an interpreter or virtual machine. Instead, it reconfigures stock GCC and Clang to output a POSIX-approved polyglot format that runs natively on Linux + Mac + Windows + FreeBSD + OpenBSD + NetBSD + BIOS with the best possible performance and the tiniest footprint imaginable." I use it just fine on a Mac M1. The only bottleneck is how much RAM you have. I use whisper for podcast transcription. I use llama for code complete and general q&a and code assistance. You can use the llava models to ingest images and describe them.