Distillations are showing (and have been for a while) though that you don't necessarily need big hardware for decent inference. If that's the case, and you can

Distillations are showing (and have been for a while) though that you don't necessarily need big hardware for decent inference. If that's the case, and you can run it on your Macbook trivially or even your smartphone.