5 ms·
I think the even bigger issue than something like GPT-3 is how inaccessible a lot of these ML techniques are without huge datasets that are only available to hu
by slaymaker1907 6y ago
I think the even bigger issue than something like GPT-3 is how inaccessible a lot of these ML techniques are without huge datasets that are only available to huge companies like FAANG and social media companies. While Twitter is definitely not the best site for a lot of research, it ends up getting used for tons of research because it is one of the only companies that allows others to access even a sample of its data without going through lots of hoops.
I think opening up the models is a good start, but I think it is even more important that we allow responsible use of these huge datasets. I also think that ensuring responsibility probably needs to be done by governments rather than companies since allowing companies to apply a lot of restrictions to data access leads to them cutting access off to everyone. If we need to restrict access to certain data because it might be abused, either the collection of that data needs to be banned for all companies or maybe we need to place restrictions on how that data is processed/used rather than restricting its access to a few people.
Disclosure: I work as a SE at Microsoft.
- amelius 6y agoYes, I think the people should be in charge of their data. And if a company grows because of user data, then that company should be owned by the people who fed it that data. In the old days we would use telephony to talk to each other, and even the thought of a company listening in on the conversation was abhorrent. But nowadays it seems like it's business as usual. What went wrong?
- logicslave 6y agoActually its not the dataset that matters, its the access to unbounded compute. GPT-3 is trained on data scraped from the web...