quantized Vicuna runs ok-ish in my 16GB i7 laptop (onboard graphics) and the output is usable see this comparison: https://old.reddit.com/r/LocalLLaMA/comments

quantized Vicuna runs ok-ish in my 16GB i7 laptop (onboard graphics) and the output is usable see this comparison: https://old.reddit.com/r/LocalLLaMA/comments/12ezcly/comparing_models_gpt4xalpaca_vicuna_and_oasst/ https://old.reddit.com/r/LocalLLaMA/comments/12ezcly/compari... these models quantised to 4bit should run in CPU set ups with 16GB of RAM + 16GB of swap (Linux) and perhaps other setups run similarly