3 ms·
AB testing on what? AB tests need to produce some results which are then compared. How would releasing different versions in production help with that? It woul
by willsmith72 3y ago
AB testing on what? AB tests need to produce some results which are then compared. How would releasing different versions in production help with that?
It would make more sense if that was internal and the responses were then graded.
A failed canary release would be more likely, where they released this version to a small amount of people not realising it was bad
- timthelion 3y agoThere are the up down thumbs and automatic sentiment analysis as a test.
- lazysheepherd 3y agoOn top of my mind: responses have feedback buttons below them. You can simply deploy different versions and compare the neutral + positive / negative feeback ratio. It would be sinful if they did not add other metrics like how many times the user had to correct and update their prompt before ending the chat, etc. Data, data, data...