4 ms·
Would anybody be interested in this for Rust? I already do everything this library does with the exception of returning the price in my LLM utils crate [1]. I d
by J_Shelby_J 2y ago
Would anybody be interested in this for Rust? I already do everything this library does with the exception of returning the price in my LLM utils crate [1]. I do this just to count tokens to ensure prompts stay within limits. And I also support non-open ai tokenizers. So adding a price calculator function would be trivial.
[1] https://github.com/ShelbyJenkins/llm_utils https://github.com/ShelbyJenkins/llm_utils