4 ms·

So this seems completely open source. Naive question: If I wanted to run this at home just for fun (basically one slightly patient user) what kind of machine(s)

So this seems completely open source. Naive question: If I wanted to run this at home just for fun (basically one slightly patient user) what kind of machine(s) I would need?

redox99 3y ago
You can run a 7B and 13B quantized model on almost any machine on the CPU if you're patient.