2 ms·
Interesting. Upshot - right to left eval means you generally must start at the end, or at least hold an expression in working memory - LLMs - not so good at thi
by vessenes 1y ago
Interesting. Upshot - right to left eval means you generally must start at the end, or at least hold an expression in working memory - LLMs - not so good at this.
I wonder if diffusion models would be better at this; most start out as sequential token generators and then get finetuned.
- jsemrau 1y agoTry it out? https://deepmind.google/models/gemini-diffusion/ https://deepmind.google/models/gemini-diffusion/