3 ms·Depends on quantization selected - see https://www.canirunthisllm.net/ https://www.canirunthisllm.net/by blebo 2y agoDepends on quantization selected - see https://www.canirunthisllm.net/ https://www.canirunthisllm.net/