3 ms·
They had to largely use alpha fold for the data part of the transformer scaling laws so not quite a bitter lesson, but still interesting.
by cma 1y ago
They had to largely use alpha fold for the data part of the transformer scaling laws so not quite a bitter lesson, but still interesting.