8 ms·
Depends on what you class as hobbyist but I am running a T4 for a few minutes to get acquainted with tools and concepts and I found modal.com really good for
by quickthrower2 3y ago
Depends on what you class as hobbyist but I am running
a T4 for a few minutes to get acquainted with tools and concepts
and I found modal.com really good for this. They resell AWS and GCP at the moment.
They also have A100 but T4 is all I need for now.
- whimsicalism 3y agoSignificantly more expensive than equivalent 3090 configuration if you can do model parallelism
- quickthrower2 3y agoWhat do you mean by this? I use less than the $30/m free included usage. I am guessing you mean at some point just buy your own 3090 as it will be cheaper than paying a cloud per second for a server-grade Nvidia setup.
- whimsicalism 3y agoI think this is more applicable for training usecases. If you can get by with less than $30/mo in aws compute (quite expensive) then it likely does not make a didference. What I mean is that you can rent out 4 3090 GPUs for much cheaper than renting an A100 on aws because you are not paying Nvidia's "cloud tax" on flops/$