Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
boomerang90
searching PlanetScale…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
3 ms
·
1.
▲
by
boomerang90
4y ago
I agree fine-tuning for task will give better results. Cerebras actually showed some research recently on this front. Sparse pre-training and dense fine-tuning ( https://arxiv.org/abs/2303.10464 ). You can recover the ac