3 ms·
CSV file in git with paths to all of the files, all the training settings, and the path to the training artifacts (snapshots, loss stats etc). The training arti
by snovv_crash 3y ago
CSV file in git with paths to all of the files, all the training settings, and the path to the training artifacts (snapshots, loss stats etc). The training artifacts get filled in by CI when you commit. Files can be anywhere, for us it was a NAS due to PII in the data we were training on so "someone else's computer" AKA cloud wasn't an option.
- hhh 3y agoWhy would having PII rule out cloud?
- michaelt 3y agoMost cloud providers are "secure" in the sense that they lock up your data and leave the key in the door so you can access it easily. A salesman will swear, hand on heart, that they'd never abuse this. An auditor has also certified that they meet the highest standard of the check clearing. This is enough to meet the legal requirements, as I understand things. Some people are not credulous enough to take the salesman at his word.
- snovv_crash 3y agoIt depends on how sensitive the PII is. Medical data and ID documents are two that I know which are particularly sensitive.