3 ms·
> The fundamentals actually haven't changed that much in the last 3 years Even said fundamentals don't have much in the way to foundations. It's just brute for
by checker659 10mo ago
> The fundamentals actually haven't changed that much in the last 3 years
Even said fundamentals don't have much in the way to foundations. It's just brute forcing your way using a O(n^3) algorithm using a lot of data and compute.
- tech_ken 10mo agoO(n^(~2.8)) because fast matrix mult?
- 1x_engineer 10mo agoBrute force!? Language modeling is a factorial time and memory problem. Someone comes up with a successful method that’s quadratic in the input sequence length and you’re complaining…?