4 ms·

I'll admit I'm not an expert in this area, but can't this introduce a pernicious sort of bias on the downstream model, since the input data is being curated by

• isusmelj 5y ago
  Whether you introduce or reduce bias using Lightly depends on how you use the software. What we ideally want, is that the data we collect for training, validating, and testing our model represents the environment the trained model will operate in. However, collecting this data can be super difficult. E.g. for autonomous driving systems that would mean collecting data from every corner of the world, at every time of the day, during all kinds of weather conditions, in all 4 seasons... However, this is a really difficult task. You will very likely end up having more data collected from one city (e.g. because your fleet is much bigger in city A than city B)