3 ms·
Why do Sol and Terra use 26 input tokens when the others use 16?
by mkl 1mo ago
Why do Sol and Terra use 26 input tokens when the others use 16?
- simonw 1mo agoI don't know and I'm really Interested in the answer. I heard a rumor that Luna is a slightly different architecture from Sol and Terra, which makes me wonder if Luna and Astra might be more related to each other than to Sol and Terra. Bit of a big leap to make from a token count though! I just checked the tiktoken library and couldn't see any changes relating to Luna: https://github.com/openai/tiktoken https://github.com/openai/tiktoken