4 ms·
"Note: The Data Profiler comes with a pre-trained deep learning model, used to efficiently identify sensitive data (PII / NPI). If desired, it's easy to add new
by ZeroCool2u 5y ago
"Note: The Data Profiler comes with a pre-trained deep learning model, used to efficiently identify sensitive data (PII / NPI). If desired, it's easy to add new entities to the existing pre-trained model or insert an entire new pipeline for entity recognition."
No, they seem to use the ML model for identifying data that typically may be considered private, sensitive, or PII, which can be very difficult to define depending on your data and your organization. For example, identifying phone numbers, social security numbers, addresses, etc. All of those things can take a variety of formats and writing a regex or something to identify them feels a bit silly when you can easily train a decent classification model to do this mostly automatically and then catch this kind of data in new use cases where the recognition pattern you may have written before doesn't necessarily work.