Thank you for the link and I agree with your scepticism towards the analogy tasks. I have had a beef with intrinsic evaluation for years, but never found the t

Thank you for the link and I agree with your scepticism towards the analogy tasks. I have had a beef with intrinsic evaluation for years, but never found the time to pursue this line of research. However, there is a consensus at this point among many NLP practitioners that they are flaky at best. There is also research indicating that this is very much the case [1]. [1]: http://www.aclweb.org/anthology/W/W16/W16-2501.pdf http://www.aclweb.org/anthology/W/W16/W16-2501.pdf