44 ms·
To me it feels like an unsolved challenge. Sure there is finetuning and various post-training stuff but it still feels like there should be a tool to directly c
by tpm 1y ago
To me it feels like an unsolved challenge. Sure there is finetuning and various post-training stuff but it still feels like there should be a tool to directly change some behavior, like editing a binary with a hex editor. There are many efforts to do that and I'm hopeful we will get there eventually.
- Chabsff 1y agoI've been bearish of these efforts over the years, and remain so. In my more cynical moments, I even entertain the thought that it's mostly a means to delay aggressive regulatory oversight by way of empty promises. Time and time again, opaque end-to-end models keep outperforming any attempt to enforce structure, which is needed to _some_ degree to achieve this in non-prompting manners. And in a vague intuitive way, that makes sense. The whole point of training-based AI is to achieve stuff you can't practically from a pure algorithmic approach. Edit: before the pedants lash out. Yes, model structure matters. I'm oversimplifying here.