4 ms·
> Sure, they have huge GPU clusters That's a really, really big "sure." Almost every trick to run a LLM at OpenAI's scale is a trade secret and may not be eas
by minimaxir 1y ago
> Sure, they have huge GPU clusters
That's a really, really big "sure."
Almost every trick to run a LLM at OpenAI's scale is a trade secret and may not be easily understood by mere mortals anyways (e.g. bare-metal CUDA optimizations)
- v5v3 1y agoTrade secret? With all the staff poaching the trade secrets may have now leaked?
- minimaxir 1y agoThat's half the reason tech companies poach.
- thrown-0825 1y agoIt's the entire reason. It's also the reason John Carmack got sued by zenimax when he went to oculus.
- handfuloflight 1y agoTrade secrets also exist to hide faults and blemishes.