3 ms·
import tiktoken enc = tiktoken.encoding_for_model('o1-mini') len(enc.encode('some string'))
by sva_ 2y ago
import tiktoken
enc = tiktoken.encoding_for_model('o1-mini')
len(enc.encode('some string'))
- NitpickLawyer 2y agoDoes that work on anything other than openai?
- topicseed 2y agoNo but most models have their own libs you can use