4 ms·
dropout has sort of dropped out... not used much in LLM training anymore
by danielmarkbruce 1y ago
dropout has sort of dropped out... not used much in LLM training anymore
- cma 1y agoI didn't realize that, looks like it isn't used much at all anymore except in finetuning