3 ms·
It might not be stable. Sometimes fine-tuning can throw things out.
by theGnuMe 4y ago
It might not be stable. Sometimes fine-tuning can throw things out.
- eigenvalue 4y agoI think there are some good strategies for avoiding this, like setting an extremely low learning rate, or not allowing gradient updates that would result in more than N weights changing by more than K%, things like that.
- PaulHoule 4y agoThe right approach might be something retrieval based where your own code gets embedded and then searched with some combination of dense similarity and keyword index.