3 ms·
you should see my rants about why normalizing weights is a bad idea and how a limited context window is effectively random interpolation
by h2odragon 3y ago
you should see my rants about why normalizing weights is a bad idea and how a limited context window is effectively random interpolation