3 ms·
Just curious whether it's possible to push any of your performance improvements to tiktoken itself?
by pamelafox 1y ago
Just curious whether it's possible to push any of your performance improvements to tiktoken itself?
- matthewolfe 1y agoI probably will. Was hesitant initially, because adding PCRE2 as a dependency might cause issues to existing projects. I believe this was discussed briefly in a closed PR with other performance improvements.