4 ms·
The zero shot ability is convenient. But for tasks that you need to get done millions of times, I’d much rather spend $10 on GPU compute and maybe a day of trai
by leobg 4y ago
The zero shot ability is convenient. But for tasks that you need to get done millions of times, I’d much rather spend $10 on GPU compute and maybe a day of training data generation to train a T5 which I then “own”.
Also, running your own specialized model locally can be much faster than using someone’s API.
- specproc 4y agoSure, purely a time issue for me. I'm not the most skilled in this area, and I've got a load of core stuff I need to keep on top of. I think we're not far off having something equivalent that can be pulled from Huggingface and run on a near consumer grade GPU. For now, I'll hang tight and see how things progress. Don't disagree.
- leobg 4y agoMaybe one day you’ll be able to tell ChatGPT what kind of model you need and it’ll automatically select the right architecture, gather the training data, and commission the training using the cheapest and/or fastest provider. :)