The models tested are extremely small, a few thousand parameters and the performance is of course not great, I don't think we can extrapolate much from this. I

The models tested are extremely small, a few thousand parameters and the performance is of course not great, I don't think we can extrapolate much from this. I don't understand why they chose such small models when you can train much larger ones for free on Colab or Kaggle if you really need it.