2 ms·
I'm in the process of using a PR'd Dockerfile for Dalai, which i think will handle everything hands free. Ie download the raw files, quantize them, pick which y
by unshavedyak 4y ago
I'm in the process of using a PR'd Dockerfile for Dalai, which i think will handle everything hands free. Ie download the raw files, quantize them, pick which you want (7, 13, etc). We'll see how it goes.
A bit heavy handed perhaps to use NPM/etc, but the Dockerfile really helps me ignore all the dependencies i'm adding hah.
- zamnos 4y agoI might be being dense, but why not distribute the quantized files?
- turbo_fart 4y agoWith alpaca you get just the quantized file, for llama you need to do it all yourself. Why? No idea