4 ms·
https://github.com/oobabooga/text-generation-webui/ https://github.com/oobabooga/text-generation-webui/ has been running 4bit LLaMA on Radeon hardware with fast
by MacsHeadroom 4y ago
https://github.com/oobabooga/text-generation-webui/ https://github.com/oobabooga/text-generation-webui/ has been running 4bit LLaMA on Radeon hardware with faster speeds and lower memory requirements than this LLaMA.cpp for the past week!