3 ms·
Hmm, so the guy who said more data and compute will outperform any adhoc heuristics has shared a three step adhoc heuristic?
by premieroncall 4mo ago
Hmm, so the guy who said more data and compute will outperform any adhoc heuristics has shared a three step adhoc heuristic?
- deleted 4mo ago[deleted]
- visarga 4mo agoThe ad hoc heuristics are the domain knowledge baked into the model by human experts, like features, architecture and loss function. "Evaluation" means environments or datasets, the model is supposed to discover its representations from scaled up experience. That was the bitter lesson - more data and compute beat heuristics.
- dang 4mo agoCan you please make your substantive points thoughtfully and without snark? I'm sure there is one here, but it's hard to make out what it is, and in any case the poison does more harm than the information does good. I'd link to the HN guidelines here but I'm on my phone!
- fragebogen 4mo agoAssuming OP meant "the bitter lesson" https://www.cs.utexas.edu/~eunsol/courses/data/bitter_lesson.pdf https://www.cs.utexas.edu/~eunsol/courses/data/bitter_lesson...
- dang 4mo agoI assume so as well but there isn't enough information in the comment to make a substantive point about it.