3 ms·
A hammer is a finished product. LLMs as a technology are in their infancy and see groundbreaking developments every month. There are models trained on charact
by stevenhuang 3y ago
A hammer is a finished product.
LLMs as a technology are in their infancy and see groundbreaking developments every month.
There are models trained on character level tokens that handle precisely these issues.
https://arxiv.org/abs/2311.06158 https://arxiv.org/abs/2311.06158
https://www.reddit.com/r/LocalLLaMA/comments/17xj8wl/training_llms_to_follow_procedure_for_math_gives/ https://www.reddit.com/r/LocalLLaMA/comments/17xj8wl/trainin...
The fact LLMs can't currently handle character-level changes tell us nothing about whether or not they truly understand meaning.
The parent commentator is not probing the right things to answer his question.