4 ms·

I don’t actually think that work is boring at all. Moreover I think it behooves us all to change the prevailing attitude and perception of this type of work; it

I don’t actually think that work is boring at all. Moreover I think it behooves us all to change the prevailing attitude and perception of this type of work; it can be quite technically complex and it is very impactful both to the business as well as more importantly on the moral/ethical front. I am biased of course as I work on various aspects of GDPR compliance, data retention and deletion, encryption compliance, etc. I used to think this stuff was really boring compared to high scalability, graphics, schedulers etc. (all of which I have worked on in past lives); lately I think it is both interesting and crucially important hence my comment.

xiphias2 7y ago
It is important and complex and hard work, I never questend that. I questioned the ,,just a quick script'' part actually. But I doubt that it can be as interesting as working on the game engine where you get visual feedback. If you look at the software market, there are lots of stories about game programmers being underpayed compared to other programmers even when they have better knowledge about the inner workings of the computer hardware. There is a valid reason for it.
marmaduke 7y ago
I'm curious what you think about GDPR compliance when user data has made its way into a ML model via training. Do we have to retrain without?, etc
- xiphias2 7y ago
  Generally there are rules about using only anonymized and aggregated data in ML systems inside corporations that are reviewed by lawyers. Also if you are using the data to help the user, and it's explained to the user, it is legal. But I'm not a GDPR expert, others here on HN know much more about it.
- DoubleMalt 7y ago
  That's simple. If it is a model that was trained with only that person's data and is therefore connected to it, it is PII (personally identifiable data) and must be deleted. If the model aggregates the data of multiple people and is disconnected from the individual it does not constitute PII and can be kept.

xiphias2 7y ago

It is important and complex and hard work, I never questend that. I questioned the ,,just a quick script'' part actually. But I doubt that it can be as interesting as working on the game engine where you get visual feedback. If you look at the software market, there are lots of stories about game programmers being underpayed compared to other programmers even when they have better knowledge about the inner workings of the computer hardware. There is a valid reason for it.

marmaduke 7y ago

I'm curious what you think about GDPR compliance when user data has made its way into a ML model via training. Do we have to retrain without?, etc

xiphias2 7y ago
Generally there are rules about using only anonymized and aggregated data in ML systems inside corporations that are reviewed by lawyers. Also if you are using the data to help the user, and it's explained to the user, it is legal. But I'm not a GDPR expert, others here on HN know much more about it.
DoubleMalt 7y ago
That's simple. If it is a model that was trained with only that person's data and is therefore connected to it, it is PII (personally identifiable data) and must be deleted. If the model aggregates the data of multiple people and is disconnected from the individual it does not constitute PII and can be kept.