2 ms·
Does this actually modify the weights? It submits prompts that get refused, then detects and modifies the weights responsible? Like brain surgery?
by FrustratedMonky 2mo ago
Does this actually modify the weights?
It submits prompts that get refused, then detects and modifies the weights responsible?
Like brain surgery?
- StevenWaterman 2mo agoYes, it submits lots of varied prompts that get refused, and then lots of varied prompts that don't get refused, then iteratively edits weights so those two groups end up in roughly the same latent space.
- kbelder 2mo agoI wonder, if we could accurately resolve discrete neural signals in the human brain, if a similar process would work.