If you want to keep the embeddings relevant, you could train new models with the cosine distance to the current embeddings as part of the cost function, it woul

If you want to keep the embeddings relevant, you could train new models with the cosine distance to the current embeddings as part of the cost function, it would then get the new embeddings as close to the current ones as possible, like curve fitting.