3 ms·
By inspecting the internal state of the 'attention' heads within the network, you can see if the network is 'reading' from the prompt in a linear fashion. If i
by londons_explore 4y ago
By inspecting the internal state of the 'attention' heads within the network, you can see if the network is 'reading' from the prompt in a linear fashion.
If it is, then there is probably an attempt underway to leak the prompt.