3 ms·
As proposed by another HN user, a score system should be added to indicate the confidence the model has about its answers. When I was a high school student, ou
by w1nst0nsm1th 4y ago
As proposed by another HN user, a score system should be added to indicate the confidence the model has about its answers.
When I was a high school student, our physic teacher had put a test system where the student had to choose a confidence score for every answer in a test examination, from 1 to 5.
According to that confidence score, you were awarded or retired a specific number of points for every answer in the test.
For example at confidence '1' you were awarded 1 point if your answer was right and 0 if your answer was wrong.
At confidence '2', you were awarded 2 point if your answer was right and -1 if your answer was wrong.
And so on.
The consequence of this system is you could have above 100% in the test even without answering all question or having some question wrong ; below 0% even with 1 right answer and only 60% if you had all good answers for all questions but played security all along and choose a confidence score of 1 for each question.