4 ms·
after you go from from millions of params to billions+ models start to get weird (depending on training) just look at any number of interpretability research pa
by electroglyph 6mo ago
after you go from from millions of params to billions+ models start to get weird (depending on training) just look at any number of interpretability research papers. Anthropic has some good ones.
- DrewADesign 6mo agoGetting weird doesn’t mean calling it text prediction is actually ‘bullshit’? Text prediction isn’t pejorative…
- HumanOstrich 6mo ago> things start to get weird > just look at research papers You didn't add anything other than vibes either.
- Barbing 6mo agoInteresting, what kind of weird?