3 ms·Silly question: how does OpenAI host/serve it?by kurtoid 4y agoSilly question: how does OpenAI host/serve it?magixx 4y agoI think on professional hardware you can get 80G of memory per GPU and they can likely do memory pooling.