3 ms·
"automated experimentation so it's able to generate new types of data to train itself" AIs don't understand reality. This type of data generation would need a
by AtlasBarfed 1y ago
"automated experimentation so it's able to generate new types of data to train itself"
AIs don't understand reality. This type of data generation would need a specific sort of validator function to work: we call this reality. That's what "experimentation" requires: reality.
We already have this right now, with the AI training ingesting AI crapgen, with StackOverflow posts no longer happening. That would seem to point to a degrading AI training set, not an improving one.
- DocSavage 1y agoA number of startups are working in verifiable domains where they can provide realistic data. This is an interesting thread from one of those startups: https://x.com/khoomeik/status/1973056771515138175 https://x.com/khoomeik/status/1973056771515138175 Here's a discussion with Isomorphic Labs (Google DeepMind spinoff) on this line of thinking: https://www.youtube.com/watch?v=XpIMuCeEtSk https://www.youtube.com/watch?v=XpIMuCeEtSk
- ethagnawl 1y agoSide note: I happened to look at the SO "Community activity" widget earlier this week and was quite surprised to see just how far engagement has fallen off. I don't have historical entries to reference but I'm _fairly certain_ there used to be hundreds of thousands of users (if not more) online during the middle of an average work day (I'm in America/New_York) and there are currently ... 16,785.
- deleted 1y ago[deleted]