3 ms·
The ugly truth behind ChatGPT: AI is guzzling resources at planet-eating rates
- airbreather 2y agoyeah so that is why something like edge impulse, that extracts just enough of the LLM needed for a specific task, is very important for instance, running on an M0 at ten frames a second a cut down LLM with a camera, can recognise childrens toys (like hot dog/not hot dog) at 95% accuracy and use only 367kb of memory. yes, that is three hundred and sixty seven kilobytes (ymmv), and that could still be tweaked by possibly dropping the resolution of the real time imaging only use what you need - old hippy saying
- az09mugen 2y agoIf people didn't use gpt for silly things such as generate commit messages (sic), maybe it will consume less resources.
- bdavbdav 2y agoI feel like the API charging should reflect the cost/impact, and solve for this.