2 ms·
> That basically the whole AI revolution is powered by CPython of all things (not even PyPy) is the 100 megaton nuke that should end language warring forever.
by minimaxir 4y ago
> That basically the whole AI revolution is powered by CPython of all things (not even PyPy) is the 100 megaton nuke that should end language warring forever.
And a lot of new AI tooling such as tokenization has been developed for Python using Rust (pyo3)
- Const-me 4y agoThe original llama uses google's tooling for that, written in C++ https://github.com/google/sentencepiece https://github.com/google/sentencepiece