I still feel that llamafiles[1] are the easiest way to do this, on most architectures. It's basically just running a binary with a few command-line options, see

I still feel that llamafiles[1] are the easiest way to do this, on most architectures. It's basically just running a binary with a few command-line options, seems pretty close to what you describe you want. [1] https://github.com/Mozilla-Ocho/llamafile https://github.com/Mozilla-Ocho/llamafile