3 ms·
This is an advanced language model that can now run quickly on consumer grade hardware. You used to need thousands of dollars of GPUs to run a model as sophisti
by potatoman22 4y ago
This is an advanced language model that can now run quickly on consumer grade hardware. You used to need thousands of dollars of GPUs to run a model as sophisticated as this - now it can be done on a laptop,
- hot_gril 4y agoRun meaning run inference, not train, right?
- TOMDM 4y agoYes
- mattfrommars 4y agoWasn't LLaMa official meant to run on consumer grade machine? How does this modify the model to make it work. All of this is confusing.
- MacsHeadroom 4y agoYes but it wasn't made to run on a Mac. This project ported LLaMA to Apple Silicon so all the macbook users can finally play with what the rest of us have had access to for the past couple of weeks.