2 ms·
Wow I continue being amazed by the progress being made on language models in the scope of weeks. I didn't expect optimisations to move this quickly. Only a few
by wkat4242 4y ago
Wow I continue being amazed by the progress being made on language models in the scope of weeks. I didn't expect optimisations to move this quickly. Only a few weeks ago we were amazed with ChatGPT knowing it would never be something to run at home, requiring $100.000 in hardware (8xA100 card).
- smoldesu 4y agoBefore ChatGPT was in beta, there were already models that fit into 2gb and smaller. They were complete shit, but they did exist.
- wkat4242 4y agoI know but what's changing is that they aren't shit now. Not on par with GPT but getting much closer. Especially with a little massaging like Stanford has done.