3 ms·
I was thinking that LLMs could benefit from knowledge about their tokenization, particularly if you are using them for LLM development.
by PaulHoule 2y ago
I was thinking that LLMs could benefit from knowledge about their tokenization, particularly if you are using them for LLM development.