3 ms·
What is ChatGPT written in? Because it would be hilarious if ChatGPT was itself written in Python.
by yen223 2y ago
What is ChatGPT written in?
Because it would be hilarious if ChatGPT was itself written in Python.
- josephg 2y agoI have no inside knowledge. But given the performance and scale chatgpt runs at (and the caliber of the team), I think it’s safe to assume a lot of their production code is written in C++ / cuda.
- binary132 2y agoPython is really popular for both training and inference, and in both cases it uses native-compiled libs under the hood to ameliorate performance problems. I mean, maybe they’re chasing the last few % now, but it looks to me like most of their R&D is focused on their models and their interactive capabilities.