4 ms·
ChatGPT is a transformer model. Google pioneered transformer models specifically for translation. If ChatGPT outperforms google translate, I'd guess it's sim
by londons_explore 3y ago
ChatGPT is a transformer model. Google pioneered transformer models specifically for translation.
If ChatGPT outperforms google translate, I'd guess it's simply because chatGPT is a bigger model with more training data.
- danwee 3y agoMust be something else, don't you think? If there's a company in the world who can just "adjust their model to make it bigger" that's Google. But they haven't done so. Perhaps Google doesn't care.
- londons_explore 3y agoGoogle Translate is a relatively small product with a relatively small budget. It doesn't bring in a huge amount of users or revenue. The engineers working on it seem to be focussing on supporting small languages (ie. languages that only a few million people speak - africa and india have lots of those, both big growth markets). They're also working on better apps - for example being to translate text inside images, text from a video feed, live translation of captions, etc. It makes sense that they probably wouldn't be deploying a huge chunk of compute there to get a few marginal quality gains.
- glandium 3y agoIronically, the amount of training data in non-English languages for ChatGPT is tiny. In the order of 10% for all of them (IIRC).