3 ms·
Can't we tokenize numbers always as single digits and give the LLM an <thinking> scratchpad invisible to the user?
by threatripper 2y ago
Can't we tokenize numbers always as single digits and give the LLM an <thinking> scratchpad invisible to the user?
- threeducks 2y agoYes, but we could also give the LLM access to a Python interpreter and solve a much larger class of problems with correctness guarantees and around a billion times less compute.