Don't misunderstand me - I think there is real potential in to make an impact in the area but there are systemic and cost issues to doing it well. That said, t

Don't misunderstand me - I think there is real potential in to make an impact in the area but there are systemic and cost issues to doing it well. That said, the problems are harder than appears to your typical ML grad student, and structurally we aren't there with data. There is no reason currently to think self supervised with "get there" in the near term, but even if you've assumed infinite labeling resources the data sets are for the most part still too disjoint and unavailable. Some strides have been made in some areas recently, but a long way to go. The algorithms part isn't necessarily that interesting really, building up the supporting infrastructure is the real problem.