3 ms·
Are any companies with the largest most capable models doing these things? Maybe OpenAI has used some of them for GPT-4. But also maybe there is another compan
by ilaksh 4y ago
Are any companies with the largest most capable models doing these things? Maybe OpenAI has used some of them for GPT-4.
But also maybe there is another company using a very large dataset and some optimizations. I would love to have an alternative so I wasn't 100% reliant on OpenAI.
- jayalammar 4y agoWe train and serve large models at cohere.ai. We've shared some optimization techniques here: https://txt.cohere.ai/running-large-language-models-in-production-a-look-at-the-inference-framework-tif/ https://txt.cohere.ai/running-large-language-models-in-produ...
- ilaksh 4y agoAwesome! Can your models write code?
- jayalammar 4y agoThey're trained and focused on language data, actually, not code specifically. There are both generation models and multilingual text embedding models (100+ languages, single model).
- localhost 4y agoThe author of this paper runs the inference team at OpenAI. So I would imagine that this is a record of her experiments without necessarily revealing which ones they're actually using in production.