4 ms·
Right, that's why I'm really surprised they aren't doing something like that. Especially because they presumably have some amount of idle compute at Azure that
by eigenvalue 4y ago
Right, that's why I'm really surprised they aren't doing something like that. Especially because they presumably have some amount of idle compute at Azure that could be used to work on this when it's not needed for something else.
- theGnuMe 4y agoIt might not be stable. Sometimes fine-tuning can throw things out.
- eigenvalue 4y agoI think there are some good strategies for avoiding this, like setting an extremely low learning rate, or not allowing gradient updates that would result in more than N weights changing by more than K%, things like that.
- PaulHoule 4y agoThe right approach might be something retrieval based where your own code gets embedded and then searched with some combination of dense similarity and keyword index.