6 ms·Admitting my last comment is a bit false. Turns out ChatGPT is running on GPUs.by hpen 4y agoAdmitting my last comment is a bit false. Turns out ChatGPT is running on GPUs.astrange 4y agoIt is, but especially high memory ones, and presumably it's loaded on a bunch of them since it supports simultaneous queries.hpen 4y agoTrue, but surely the cost of multiple machines is amortized by simultaneous queries?