3 ms·
I think there are some good strategies for avoiding this, like setting an extremely low learning rate, or not allowing gradient updates that would result in mor
by eigenvalue 4y ago
I think there are some good strategies for avoiding this, like setting an extremely low learning rate, or not allowing gradient updates that would result in more than N weights changing by more than K%, things like that.
- PaulHoule 4y agoThe right approach might be something retrieval based where your own code gets embedded and then searched with some combination of dense similarity and keyword index.