2 ms·
Backprop has significant costs, if a local solution truly matches its performance, it will be dropped like a hot potato.
by Tuna-Fish 27d ago
Backprop has significant costs, if a local solution truly matches its performance, it will be dropped like a hot potato.
- erichocean 27d agoAgreed, but how will we find out? Pre-training alone on frontier-class models costs billions of dollars.