5 ms·
You’ll need > 20 GB of GPU memory run the model. This is the same reason people can’t easily “play with” GPT like models. > would it be possible to run it on
by wokwokwok 4y ago
You’ll need > 20 GB of GPU memory run the model.
This is the same reason people can’t easily “play with” GPT like models.
> would it be possible to run it on a lenovo type laptop?
No.
You might, with a hybrid Mac book pro M1 or M2 with 64GB of combined memory; pretty much any other lapto, categorically no.
You’d have to rent / own a separate server with epic GPU power.
> Final question is will a home brewed version be just as good?
No.
The open source language models are not as good as GPT3.