2 ms·
> OpenAI are working on watermarking their generated content so other platforms can detect it automatically So when is this technology gonna be advanced enough
by matheusmoreira 4y ago
> OpenAI are working on watermarking their generated content so other platforms can detect it automatically
So when is this technology gonna be advanced enough for us mere mortals to run it on our own computers with our own models free from pointless restrictions that exist purely to appease threatened stakeholders?
- xenospn 4y agoRead up on the datacenter OpenAI had to spin-up within Azure in order to train GPT3. A little out of reach for now - but in 10 years, who knows.
- jchw 4y agoTo be fair, training is a lot more intensive than inference. Though if open source models are any indication, the big issue is actually VRAM requirements.
- jwie 4y agoThe restrictions are not pointless. People shouldn't have to endure AI generated spam, no matter how well-formatted. I can opt out of robocalls, email spam, programmatic texts, even take legal action against people who make them outside the law. Similar legal protections should exist to protect people from AI spam. If there's a good technical solution to this problem then the laws banning it become less necessary.
- macrolime 4y agoAccording to this link that was posted on hn a couple days ago it currently costs around 10 million dollars to train something like GPT-3. https://www.nextplatform.com/2022/12/01/counting-the-cost-of-training-large-language-models/ https://www.nextplatform.com/2022/12/01/counting-the-cost-of...
- Keyframe 4y agoTrained on what though? Procuring training material ain't no trivial feat., in-fact it might be even more elaborate to do. This is where Google has home advantage. They have their own copy of the internet.