3 ms·
Is there any indication from OpenAI people that there are low hanging fruits to be picked in this direction?
by mathematicaster 3y ago
Is there any indication from OpenAI people that there are low hanging fruits to be picked in this direction?
- summarity 3y agoIt’s the indication data of current research: train more and better, current models are oversized and undertrained. A good foundation model can exhibit massive quality differences with just a tiny bit of quality fine tuning (e.g. Alpaca vs Koala) Personal opinion, not OAI/GH/MSFT’s