4 ms·
> unlike what I am seeing in AI and deep neural networks for decades which that still has not changed with the way on how models continue to get larger and req
by humanistbot 4y ago
> unlike what I am seeing in AI and deep neural networks for decades which that still has not changed with the way on how models continue to get larger and require more planet incinerating power and will currently require millions and in the future, billions. As long as they stay inefficient, Nvidia will continue smiling knowing that.
What are you talking about? The inaccessibility of the models and the heavy gatekeeping by the big players is leading to more and more open source models that can run on an average gaming GPU or a Mac M1. It seems like every day on HN there is another post on another super-optimized version of something that was once only accessible to those with huge server farms or cloud budgets. You're seeing announcements like Stanford's Alpaca that specifically mention how it can run on low-budget commodity hardware or a few hundred dollars in the cloud.
I'd say efficiency and optimization is one of the hottest areas in large language models right now, although the motivation is less for climate reasons and more for 'I want to do this on my own hardware and have no safety censors' reasons.
- kkielhofner 4y agoI'm convinced that with the efforts you speak of we're seeing history repeat itself (as it often does). In the late 90s/early 2000s when the internet/web was really picking up steam powerful and entrenched players like Microsoft were throwing their weight around and trying to dominate the space like they did personal computers. Ditto Sun, etc. Then the open source community got together and ate their lunch. Who remembers Netcraft statistics for Windows + IIS vs Linux + Apache? OpenAI, Meta, Google, to some extent Nvidia, etc are doing their best to go the closed/commercial/proprietary/gated/costly route (again) - and open source is already hitting back hard against all of these and as has been shown before, starting to catch-up/outpace them at incredible speed.