4 ms·

data (the website) is being 'seen' by a model. training data is NOT the model. there is NO text from any website in any LLM model. The website is not being cop

data (the website) is being 'seen' by a model. training data is NOT the model. there is NO text from any website in any LLM model. The website is not being copied to an internal model anywhere, it is being looked (processed through an LLM) at and trained on... If you can find it on the (open and public facing) internet, then it's fair game to everyone (and everything) to 'see'.

dragonwriter 3y ago
> data (the website) is being 'seen' by a model. The quotes around “seen” are appropriate since its at best a metaphor. A literal copy is made of the data (along with other data) to create the training set, and then a process is run which creates a lossy compressed representation of all the data in that training set, and that lossy compressed representation is called a model. > there is NO text from any website in any LLM model. There is, just as if you make a collage out of a series of pictures and then apply a lossy image compression algorithm visual data from those pictures is included in the compressed reperesentation. > The website is not being copied to an internal model This is simply false. That's exactly what is happening. > it is being looked (processed through an LLM) at and trained on... That is (lossily) copying into the trained model. > If you can find it on the (open and public facing) internet, then it's fair game to everyone (and everything) to 'see'. It is not free to those who see it to reproduce it; public display of a copyright-protected work doesn't waive protection, and even where seeing is a literal rather than metaphorical description, as for a human reader of a protected work, reproduction of the work or creationnof derivative after having seen it is prohibited.
xigoi 3y ago
> training data is NOT the model. there is NO text from any website in any LLM model. The model is a (lossily) compressed form of the training data.

dragonwriter 3y ago

> data (the website) is being 'seen' by a model. The quotes around “seen” are appropriate since its at best a metaphor. A literal copy is made of the data (along with other data) to create the training set, and then a process is run which creates a lossy compressed representation of all the data in that training set, and that lossy compressed representation is called a model. > there is NO text from any website in any LLM model. There is, just as if you make a collage out of a series of pictures and then apply a lossy image compression algorithm visual data from those pictures is included in the compressed reperesentation. > The website is not being copied to an internal model This is simply false. That's exactly what is happening. > it is being looked (processed through an LLM) at and trained on... That is (lossily) copying into the trained model. > If you can find it on the (open and public facing) internet, then it's fair game to everyone (and everything) to 'see'. It is not free to those who see it to reproduce it; public display of a copyright-protected work doesn't waive protection, and even where seeing is a literal rather than metaphorical description, as for a human reader of a protected work, reproduction of the work or creationnof derivative after having seen it is prohibited.

xigoi 3y ago

> training data is NOT the model. there is NO text from any website in any LLM model. The model is a (lossily) compressed form of the training data.