3 ms·
But actually whenever this happens you get rich signal about the hidden didactic assumptions of your method of prompting it about things you yourself are unsure
by pizza 2y ago
But actually whenever this happens you get rich signal about the hidden didactic assumptions of your method of prompting it about things you yourself are unsure you can verify for yourself, and also of how you thought the tool worked. This is a good meta skill to hone.
- dartos 2y agoIn the same way going to a fortune teller can give me rich insight about my love life and work life balance, sure.
- pizza 2y agoA visitor to physicist Niels Bohr's country cottage, noticing a horseshoe hanging on the wall, teased the eminent scientist about this ancient superstition. "Can it be true that you, of all people, believe it will bring you luck?" "Of course not," replied Bohr, "but I understand it brings you luck whether you believe it or not." s/luck/lower negative log likelihood. Besides, a participant can still think about and glean truths from their reflections about a conversation they had which contained only false statements.
- dartos 2y agoWhat point are you trying to make? That it’s better to be superstitious than not, because maybe it matters?
- pizza 2y agoThe internal mechanisms by which a model achieves a low negative log likelihood become irrelevant as it approaches perfect simulation of the true data distribution.
- memhole 2y agoThis is how I think about it as well. It’s like the equivalent of trying to build an ML model with only positive examples otherwise