3 ms·
It wasn't a leak in the typical sense. They sent the weights to pretty much everyone who asked nicely. When you send something interesting to thousands of peop
by hnfong 3y ago
It wasn't a leak in the typical sense. They sent the weights to pretty much everyone who asked nicely.
When you send something interesting to thousands of people without vetting their credentials, you'd expect the stuff to get "leaked" out eventually (and sooner rather than later).
I'd say it's more appropriate to say the weights were "pirated" than "leaked".
That said, you're probably correct that the community that quickly formed around the "pirated" weights might have influenced Zuckerberg to decide to make llama2's more freely accessible.
- raxxorraxor 3y agoIf the image synthesis is an example, I believe this to be a winning strategy in the long run to get the most competent model. The LLM space just moves a bit slower since the entry requirements for compute power are that much higher and data preparation is maybe a bit more "dry" than tagging images.