This is very helpful, thank you! We are doing a fair bit of task-specific fine-tuning for an asymmetric embeddings model (connecting user-entered descriptions

This is very helpful, thank you! We are doing a fair bit of task-specific fine-tuning for an asymmetric embeddings model (connecting user-entered descriptions of symptoms with the service solutions that resolved their issues). I would like to run more experiments with this and see if introducing typos into the user-entered descriptions will help it not forget as much. Thank you again!