3 ms·
> how much compute can be used to train a model I mean is there even a way to verify this? Even if you monitor someone's GPU usage anyone could just lie about
by moffkalast 2y ago
> how much compute can be used to train a model
I mean is there even a way to verify this? Even if you monitor someone's GPU usage anyone could just lie about the number of times they had to revert to previous checkpoints. From the raw physical perspective any model you look at could just be a series of randomly initialized weights.