3 ms·
One reason for unit tests is to know when you've won. For example ChatGPT is already a limited form of general AI, but makes some silly mistakes for certain ki
by logicallee 4y ago
One reason for unit tests is to know when you've won. For example ChatGPT is already a limited form of general AI, but makes some silly mistakes for certain kinds of thinking.
An example would be - oh wait, it just passed it, nevermind. (I wanted to quote a kind of numerical thinking test it fails at it but it just passed.)
If this had been a test previous GPT's failed at, but it was coded up in a unit test, then maybe more people would get it. At some point AI will just pass all the tests we throw at it. It would be nice to have a spreadsheet of tests to 1) know whether we're there 2) show people that we're there.