3 ms·
9 days later and its now possible to run a 65B parameter LLM on a 64GB macbook pro, significantly outperforming GPT-3, OpenAssistant has announced that they got
by Taek 4y ago
9 days later and its now possible to run a 65B parameter LLM on a 64GB macbook pro, significantly outperforming GPT-3, OpenAssistant has announced that they got more than 100,000 samples of RLHF to replicate the 'Chat' component, Kobold Horde now supports Llama-33B for anyone to try in a playground with no censorship, and at least 4 other independent projects are spun up to develop at-home LLM tooling.
People want good text models at home.