6 ms·
It's worth recognising that a year ago gpt-4 was the cutting edge, and today you can now run a gpt-4 class model on a macbook pro (with lots of ram, sure).
by crimsoneer 2y ago
It's worth recognising that a year ago gpt-4 was the cutting edge, and today you can now run a gpt-4 class model on a macbook pro (with lots of ram, sure).
- EVa5I7bHFq9mnYK 2y agoA year ago gpt-4 was the cutting edge, the new cutting edge model takes 11.2 MWh of energy to answer a single question (enough to power a home for 4 years).
- PittleyDunkin 2y agoYea but gpt-4 is also only very slightly marginally useful in terms of productivity as it stands today. I highly doubt we're going to get returns on this without huge structural changes to how chatbots work.
- crimsoneer 2y agoSure, I think that's fair - the tech is only one part of the whole equation. Just pointing out that power demands are really quite a small (and actually quite surmountable) part of the problem.
- gopher_space 2y agoIt's interesting to look at how hardware requirements change alongside acceptable response time. Knowing when you need a reply seems like it might save a lot of money.