3 ms·
> 1. Are any groups doing meaningful ML research without access to farms of H100? Sure, there's a lot of work to be done on the inferencing side of things. You
by talldayo 3y ago
> 1. Are any groups doing meaningful ML research without access to farms of H100?
Sure, there's a lot of work to be done on the inferencing side of things. You're just about boned if you want to train a competitive model without competitive compute though.
> 2. Are freely available datasets as high quality as what might be available to larger companies?
There have been, for a while. The Pile is the one everyone points too, but smaller finetuning datasets are everywhere now. None of them are super useful unless you intend to train a model though.