3 ms·
Google's legal team would be freaking out if any of its engineers propose open sourcing model weights. This is a mine field full of legal and privacy headaches
by summerlight 6y ago
Google's legal team would be freaking out if any of its engineers propose open sourcing model weights. This is a mine field full of legal and privacy headaches and I guess it is infeasible to audit 1.6T parameters anyway...
- Closi 6y agoThis is a really good point, and also depends on what the training data is - although arguably if they are using this model to power their services and it can leak personal data that might be an issue in it's own right.
- robkop 6y agoI have to say that I really doubt this as they've released model weights for their several last few models that have been of nearly this size (and have been trained on the same dataset). See https://github.com/google-research/text-to-text-transfer-transformer https://github.com/google-research/text-to-text-transfer-tra...
- deleted 6y ago[deleted]
- GrantZvolsky 6y agoI'm not sure whether I'd call 10e10 nearly the size of 10e12, but the dataset is open, so it shouldn't be an issue. https://github.com/google-research/text-to-text-transfer-transformer/blob/master/released_checkpoints.md https://github.com/google-research/text-to-text-transfer-tra...