3 ms·

Definitely not realtime, but perhaps it could work as a preprocessing step?

• PaulHoule 4y ago
  I worked for a startup that developed CNN models https://www.davidsbatista.net/blog/2018/03/31/SentenceClassificationConvNets/ https://www.davidsbatista.net/blog/2018/03/31/SentenceClassi... for early processing of data, you can think of it as a profiling tool that works at the level of an individual “cell” in a table, so given a number like 90214 it will guess that it could be a zip code, given “John” it would guess it is a proper name, etc. I’d contrast that to tools that profile a whole column at a time (funny… these are all 5 digit zero padded numbers) but that column is full of numbers consistent with https://en.wikipedia.org/wiki/Benford%27s_law https://en.wikipedia.org/wiki/Benford%27s_law This system was successful for a few customers including a major telecom and ultimately the company got bought by a major shoe and clothing brand. We had an “MLOps” system we developed internally for training those CNN models and we trained some for that task and trained some for other tasks. There were numerous problems with the models that we were concerned about then, most of them have been solved by transformer models which we were just starting to read about then.