2 ms·
> If it turns out that you, in fact, don't need a gazillion GPUs to build SOTA models it destroys a lot of perceived value. Correct me if I'm wrong, but couldn
by aprilthird2021 2y ago
> If it turns out that you, in fact, don't need a gazillion GPUs to build SOTA models it destroys a lot of perceived value.
Correct me if I'm wrong, but couldn't you take the optimization and tricks for training, inference, etc. from this model and apply to the Big Corps' huge AI data centers and get an even better model?
I'll preface this by saying, better and better models may not actually unlock the economic value they are hoping for. It might be a thing where the last 10% takes 90% of the effort so to speak