5 ms·
How likely this problem is already on the training set by now?
by Manabu-eo 8mo ago
How likely this problem is already on the training set by now?
- deleted 8mo ago[deleted]
- verdverm 8mo agoI've heard it posited that the reason the frontier companies are frontier is because they have custom data and evals. This is what I would do too
- throwup238 8mo agoFor every combination of animal and vehicle? Very unlikely. The beauty of this benchmark is that it takes all of two seconds to come up with your own unique one. A seahorse on a unicycle. A platypus flying a glider. A man’o’war piloting a Portuguese man of war. Whatever you want.
- recursive 8mo agoNo, not every combination. The question is about the specific combination of a pelican on a bicycle. It might be easy to come up with another test, but we're looking at the results from a particular one here.
- svara 8mo agoMore likely you would just train for emitting svg for some description of a scene and create training data from raster images.
- recursive 8mo agoNone of this works if the testers are collaborating with the trainers. The tests ostensibly need to be arms-length from the training. If the trainers ever start over-fitting to the test, the tester would come up with some new test secretly.
- ebonnafoux 8mo agoYou can easily make a RLAIF loop. - Take a list of n animals * m vehicule - Ask a LLM to generate SVG for this n*m options - Generate png from the svg - Ask a Model with vision to grade the result - Change your weight accordingly No need to human to draw the dataset, no need of human to evaluate.
- zarzavat 8mo agoYou can always ask for a tyrannosaurus driving a tank.
- simonw 8mo agoIf anyone trains a model on https://simonwillison.net/tags/pelican-riding-a-bicycle/ https://simonwillison.net/tags/pelican-riding-a-bicycle/ they're going to get some VERY weird looking pelicans.
- suddenlybananas 8mo agoWhy would they train on that? Why not just hire someone to make a few examples.
- simonw 8mo agoI look forward to them trying. I'll know when the pelican riding a bicycle is good but the ocelot riding a skateboard sucks.
- suddenlybananas 8mo agoBut they could just train on an assortment of animals and vehicles. It's the kind of relatively narrow domain where NNs could reasonably interpolate.
- simonw 8mo agoThe idea that an AI lab would pay a small army of human artists to create training data for $animal on $transport just to cheat on my stupid benchmark delights me.
- suddenlybananas 8mo agoWhen you're spending trillions on capex, paying a couple of people to make some doodles in SVGs would not be a big expense.
- simonw 8mo agoThe embarrassment of getting caught doing that would be expensive.