18 ms·
They are in “survive until GPUs have enough RAM for break even costs” mode right now. It’s why I don’t think we’ll see any big significant changes in parameter
by hesdeadjim 3y ago
They are in “survive until GPUs have enough RAM for break even costs” mode right now. It’s why I don’t think we’ll see any big significant changes in parameter count for a while because it’s just too damned expensive.
I would however be happy to pay waaaaay more than $20/mo for a “gpt-5” evolved model.