2 ms·This is so great. 1. Name 2. OpenAI is releasing useful stuff 3. Rust in AI!by echelon 4y agoThis is so great. 1. Name 2. OpenAI is releasing useful stuff 3. Rust in AI!Vetch 4y agoNB: huggingface has long had a rust based tokenizer.