3 ms·
Our "testing" involves sending it 50 prompts and seeing if it bullshits too much and revising the prompt until it bullshits to acceptable levels. I suspect tha
by sensanaty 2y ago
Our "testing" involves sending it 50 prompts and seeing if it bullshits too much and revising the prompt until it bullshits to acceptable levels.
I suspect that's how the model makers test it as well, just fling crap at the wall and see which wall lets the most crap slide off of it (but never all of it)
- ksaj 2y agoThis is called Fuzzing. And it is a major component of software testing. Especially in infosec, but I digress. The reasoning behind it is exactly the same.