If my memory serves me right, there was quite a bit of discussion about this paper on twitter and François Chollet pointed out that linear interpolation in thes

If my memory serves me right, there was quite a bit of discussion about this paper on twitter and François Chollet pointed out that linear interpolation in these vector spaces is far from the conceptual interpolation and data points might not even land on the desired manifold. So this paper is not as deeply insightful/strongly relevant as it might sound.