3 ms·
What would be interesting is if Google took the chat GPT approach to better train itself. For instance, every time you speak to Google, it doesn't just 'guess'
by unicoded 3y ago
What would be interesting is if Google took the chat GPT approach to better train itself.
For instance, every time you speak to Google, it doesn't just 'guess' what you're saying, rather, it will present you with 3 options of the most closely sounding things for you to pick from. And by picking, you train the model.
- seanhunter 3y agoReinforcement learning from human feedback (RLHF) as you have described here is pretty common in voice recognition.[1] I don't have any inside scoop but I'd be very surprised if there isn't any RLHF going on in these applications. edit to add: The whisper paper mentions using RLHF as a possible path to improve accuracy[2] [1] https://link.springer.com/article/10.1007/s10462-022-10224-2 https://link.springer.com/article/10.1007/s10462-022-10224-2 gives many examples [2] https://cdn.openai.com/papers/whisper.pdf https://cdn.openai.com/papers/whisper.pdf