3 ms·
Meaning and intent can only be applied if structure can be captured. I'm not proposing building some god-machine that has a library of all possible regular expr
by alexahn 4y ago
Meaning and intent can only be applied if structure can be captured. I'm not proposing building some god-machine that has a library of all possible regular expressions. I'm merely saying that it could be helpful to nudge something like a neural network towards looking for these types of structures, such that they can be a basis for probabilistic encoding. It may be possible that the meaning that gets abstracted thereafter might actually be more concise and generalized.
- famouswaffles 4y agoPart of the breakthrough with LLMs has precisely been about encoding nothing at all about language and letting the transformer figure it out from scratch. We don't know what is necessary for learning language.