4 ms·
"Mark Dingemanse, a coauthor of this report, had a particularly strong assessment of the Llama 2 model: "Meta using the term `open source' for this is positivel
by 1vuio0pswjnm7 3y ago
"Mark Dingemanse, a coauthor of this report, had a particularly strong assessment of the Llama 2 model: "Meta using the term `open source' for this is positively misleading: There is no source to be seen, the training data is entirely undocumented, and beyond the glossy charts the technical documentation is really rather poor. We do not know why Meta is so intent on getting everyone into this model, but the history of this company's choices does not inspire confidence. Users beware.""
- aalimov_ 3y agoDoes anyone have an idea of what (if anything) is being implied by the last two sentences?
- smoldesu 3y agoBad company scary, I guess. Normally I'm sympathetic to those types, but given how Llama works without a network connection I'm not sure what I have to fear. The "history of this company's choices" has generally been pretty good with AI, so it sounds like speculation on their part.
- pedrosorio 3y agoSee my sibling comment. Very unlikely the author has any familiarity with Meta's history of releasing open source software for ML/AI.
- pedrosorio 3y ago> He is an associate professor in Language and Communication at the Centre for Language Studies of Radboud University Nijmegen. Dingemanse obtained a MA degree in African Languages and Cultures at Leiden University in 2006, and a PhD degree in arts in 2011 at Radboud University Nijmegen https://en.wikipedia.org/wiki/Mark_Dingemanse https://en.wikipedia.org/wiki/Mark_Dingemanse This co-author? Given the relevance of their academic background, I'd take their opinion on "the dangers of using LLMs released by the untrustworthy Meta" with a grain of salt.
- reverius42 3y agoSince their academic background is so relevant (language studies and cultures being the exact domain of the impact of LLMs on society), I don't see why a grain of salt is needed.
- pedrosorio 3y ago> Since their academic background is so relevant If their academic background were relevant, they would have provided specific negative outcomes that may result from the usage of Llama 2, rather than a vague "the history of this company's choices does not inspire confidence". What, of the many open source software releases by that company in the ML/AI field "does not inspire confidence"?
- hmcq6 3y ago> What, of the many open source software releases by that company in the ML/AI field "does not inspire confidence"? Didn't Facebook get it's start by Zucc populating it with his classmates without their knowledge or consent? > Zuckerberg found himself brought before the Administrative Board for breaching security, violating copyrights and violating individuals’ privacy by using students’ online facebook photos without permission. https://www.thecrimson.com/article/2004/6/10/mark-e-zuckerberg-06-the-whiz/ https://www.thecrimson.com/article/2004/6/10/mark-e-zuckerbe...
- 1vuio0pswjnm7 3y agoFor some background on the comment, see the following paper. Title: Opening up ChatGPT: Tracking openness, transparency, and accountability in instruction-tuned text generators Authors: Andreas Liesenfeld, Alianda Lopez, Mark Dingemanse Abstract: Large language models that exhibit instruction-following behaviour represent one of the biggest recent upheavals in conversational interfaces, a trend in large part fuelled by the release of OpenAI's ChatGPT, a proprietary large language model for text generation fine-tuned through reinforcement learning from human feedback (LLM+RLHF). We review the risks of relying on proprietary software and survey the first crop of open-source projects of comparable architecture and functionality. The main contribution of this paper is to show that openness is differentiated, and to offer scientific documentation of degrees of openness in this fast-moving field. We evaluate projects in terms of openness of code, training data, model weights, RLHF data, licensing, scientific documentation, and access methods. We find that while there is a fast-growing list of projects billing themselves as 'open source', many inherit undocumented data of dubious legality, few share the all-important instruction-tuning (a key site where human annotation labour is involved), and careful scientific documentation is exceedingly rare. Degrees of openness are relevant to fairness and accountability at all points, from data collection and curation to model architecture, and from training and fine-tuning to release and deployment. https://arxiv.org/abs/2307.05532 https://arxiv.org/abs/2307.05532 https://arxiv.org/pdf/2307.05532.pdf https://arxiv.org/pdf/2307.05532.pdf
- 1vuio0pswjnm7 3y agoIt seems Dr Dingemanse understands the problems introduced by so-called "tech" companies, e.g., Google. "For basic visitor statistics I use Matomo, an excellent open source alternative for Google Analytics. IP addresses are anonymized and data never leaves the server." https://markdingemanse.net/credits https://markdingemanse.net/credits
- uhhyeahdude 3y agoEdit: removed unreasonable tirade