4 ms·
I think somehow there were a series of miscommunications. This kind of sub token manipulation task is hard for an LLM for somewhat predictable reasons. Knowing
by space_fountain 2y ago
I think somehow there were a series of miscommunications. This kind of sub token manipulation task is hard for an LLM for somewhat predictable reasons. Knowing those limitations are important, but don't come up too often in practical circumstances. Outside of contrived examples counting the number of letters in a long word is pretty rare.
I took your response to be arguing against a message I'd read to be saying something like the above. Especially when you basically seemed to be saying that limitations like this are important in everything but toy applications. It's uninteresting because it doesn't point towards larger problems with their use in the kind of application they're being used for and are intended for unlike prompts that point to weakness in logic or propensity to hallucinate.