3 ms·
I like the approach. I think we will need a lot of tests like these in the near future, comparing AI performance on its actual edge cases rather than on the sta
by scrollaway 4y ago
I like the approach. I think we will need a lot of tests like these in the near future, comparing AI performance on its actual edge cases rather than on the standard stuff we test it for right now.
Hallucinations are a big one. “Obedience” is the next one that comes to my mind (how willing or unwilling the model is to comply with requests).
- manyoso 4y agoThanks. Before creating I looked for hallucination specific tests but couldn't find any. If anyone else knows of other tests I'd love to hear about them.