4 ms·
I have worked on a team which trains foundation models
by thatguysaguy 2y ago
I have worked on a team which trains foundation models
- JSDevOps 2y agoAnd no one’s used anything other than Python? The core of Tensorflow uses C++
- thatguysaguy 2y agoThe claim was that Python is only used for prototyping at Google, not that people are writing the AI frameworks themselves in pure Python. JAX is obviously implemented in C++, but the scientists running the training runs which cost millions of dollars are writing lots of python.
- mihai_maruseac 2y agoRather than repeat myself: https://news.ycombinator.com/item?id=40182940 https://news.ycombinator.com/item?id=40182940
- dekhn 2y agoMany parts of tensorflow required Python- at least when I worked there a few years ago, it was nearly impossible to compile XLA into a saved model and execute it from pure C++ code.