2 ms·I've gotten some useful stuff out of 7B param LLMs, and that should fit on a Pi quantized.by SoothingSorbet 3y agoI've gotten some useful stuff out of 7B param LLMs, and that should fit on a Pi quantized.