4 ms·
> beyond the ad-hominem Note that the "ad-hominem" pertains to only those who care about extinction risk, not AI developers in general. > which have nothing t
by ADeerAppeared 2y ago
> beyond the ad-hominem
Note that the "ad-hominem" pertains to only those who care about extinction risk, not AI developers in general.
> which have nothing to do with scaling
Except they are. There's no fundamental change in architecture, it's all transformers. OpenAI's "multi-modal" capabilities are not a redesign of their AI, it's systems bolted together.
Bolting a text-to-image generator & image-to-text describer to an LLM doesn't approach "General Intelligence", it's a system of three specific capabilities.
You could consider that new system "more general" than a lone LLM, but it only approaches General Intelligence in the same way that the series "1+1+1+1+..." approaches infinity. Is each individual step "closer to infinity"? Sure. Is it a useful way to achieve infinity? No, because you'll be stuck adding new steps forever the same as a conventional computer software.
> And it's very blatantly not the case that the entire field is 'only really trying to make them bigger'.
There are some, not many but I'll grant you some, researchers working on actually generalizing these systems.
Their funding is a rounding error to AI spending, their work isn't going to hit production for years. It's not an extinction risk.
- MrScruff 2y agoI was talking about Q*/Strawberry which (from the leaked info) is more about self improvement via RL.