2 ms·
This is insanely expensive to run though. Looks like it cost around $1 million of compute to get that result. Doesn't seem like such a massive breakthrough whe
by ChildOfChaos 2y ago
This is insanely expensive to run though. Looks like it cost around $1 million of compute to get that result.
Doesn't seem like such a massive breakthrough when they are throwing so much compute at it, particularly as this is test time compute, it just isn't practical at all, you are not getting this level with a ChatGPT subscription, even the new $200 a month option.
- evouga 2y agoSure but... this is the technology at the most expensive it will ever be. I'm impressed that o3 was able to achieve such high performance at all, and am not too pessimistic about costs decreasing over time.
- MVissers 2y agoWe've seen 10-100x cost decrease per year since GPT-3 came out for the same capabilities. So... Next year this tech will most likely be quite a bit cheaper.
- ChildOfChaos 2y agoEven at 100x cost decrease this will still cost $10,000 to beat a benchmark. It won't scale when you have that amount of compute requirements and power. GPT-3 may massively reduced in cost, but it's requirements were not anyway extreme compared to this.