4 ms·
Vicuna: An Open Chatbot Impressing GPT-4
- mromanuk 4y agoI see two big constraints to use it right now: - This runs on the CPU only and does not require GPU. It requires around 60GB of CPU memory for Vicuna-13B. also - We release Vicuna weights as delta weights to comply with the LLaMA model license. You can add our delta to the original LLaMA weights to obtain the Vicuna weights. Instructions: ... This conversion command needs around 60 GB of CPU RAM. Hope they can optimize it further, to make it work with lesser hardware.
- BlackLotus89 4y agoSome people are already releasing the converted weights https://huggingface.co/eachadea/ggml-vicuna-13b-4bit https://huggingface.co/eachadea/ggml-vicuna-13b-4bit
- krunck 4y agoWorks on my GPU. Goodbye ChatGPT.
- mdaniel 4y agoBy far the more interesting link is last week's announcement: https://news.ycombinator.com/item?id=35378683 https://news.ycombinator.com/item?id=35378683