5 ms·
Mark Zuckerberg: Llama 3, $10B Models, Caesar Augustus, Bioweapons [video]
- tommy_axle 3y ago"The 8 billion is nearly as powerful as the biggest version of LLama-2" - Mark Can't wait to try it.
- simonw 3y agoYou can try it right now: https://llama3.replicate.dev/ https://llama3.replicate.dev/ - then select Chat with: Meta Llama 3 8B
- bhhaskin 3y agoWell that was fun. If you ask it how to make gunpowder it will refuse. But if you ask what do you get if you mix sulfur, charcoal and saltpeter it will happily tell you the ratios. I find it funny that companies will try and restrict that info, but it's freely available on Wikipedia.
- dhx 3y agoLlama3 will recommend books that detail nitrocubane chemistry, but will refuse to answer direct questions about what the compounds are (explosives) and whether export controls apply. It gets a bit more chatty when confused and the questions are silly though... "I must strongly advise against mixing Dioxygen Difluoride with any other compound, including nitrocubane, to create a meat-alternative vegan burger. Dioxygen Difluoride is an extremely hazardous and reactive substance that can cause severe harm or even death if not handled properly. Nitrocubane, on the other hand, is a highly energetic and sensitive material that requires specialized handling and storage. Combining these two substances would be extremely dangerous and could result in a catastrophic reaction. It's not something you'd want to do, trust me!"
- newusertoday 3y agothanks. i tried it and i am underwhelmed. claude.ai sonnet performs better for the few tests that i did.
- simonw 3y agoSonnet should soundly beat Llama 3 8b, but how does it compare to 70b?
- newusertoday 3y agothese results were with 70b.
- makk 3y ago"Most of the time when we make a decision that looks good, it's because we messed up before and don't want to repeat the mistake."
- evbogue 3y agoIf you watch all of the way to the end of the interview you will learn Mark's opinion about why Google+ failed.
- paxys 3y agoIt was kinda soft. You could see that he was holding a lot of opinions in because he didn't want to bash Google publicly.
- abetusk 3y agoLlama 3 is not open source [0]. The commonly accepted usage of open source is that it is available for commercial reuse and alteration without restriction [1]. Llama 3 puts restrictions on types of commercial use that are acceptable as well as what type of general use is acceptable (retraining or using it to train other models is restricted maybe?). I find it distressing when a CEO of a trillion dollar company is pontificating about the benefits of them open sourcing their code when they haven't done so. [0] https://github.com/meta-llama/llama3 https://github.com/meta-llama/llama3 [1] https://en.wikipedia.org/wiki/Open_source https://en.wikipedia.org/wiki/Open_source
- jamesy0ung 3y agoI agree that not open source, but it is still a lot better than what other companies in the industry are doing.
- ipsum2 3y agoMeets the definition of the Wikipedia article you linked: "Open source is source code that is made freely available for possible modification and redistribution." Though, it doesn't meet the OSI definition.
- abetusk 3y agoNo, it doesn't meet the Wikipedia description, nor does it meet the OSI definition. From the Wikipedia article [0]: """ ... Licenses which only permit non-commercial redistribution or modification of the source code for personal use only are generally not considered as open-source licenses. ... """ Further, taken from the Llama 3 LICENSE file on GitHub [1]: """ v. You will not use the Llama Materials or any output or results of the Llama Materials to improve any other large language model (excluding Meta Llama 3 or derivative works thereof). """ [0] https://en.wikipedia.org/wiki/Open_source#Open-source_license https://en.wikipedia.org/wiki/Open_source#Open-source_licens... [1] https://github.com/meta-llama/llama3/blob/main/LICENSE https://github.com/meta-llama/llama3/blob/main/LICENSE
- ipsum2 3y ago
- CSMastermind 3y agoI've been consistently impressed by Zuckerberg in recent years. It seems like he's experienced quite the evolution since initially founding the company. I'd go as far as to say he's the best leader of a large technology company today.
- CuriouslyC 3y agoSatya would like a word. Microsoft has been slaying, while Zuck is getting some PR from open models, he's still not performing at the same level.
- viscanti 3y agoZuck renamed the company Meta, partially because of a deep believe in the Metaverse (perhaps it's too early to call it, but it seems misguided) and partially because of massive amounts of negative press they were getting because of pretty toxic decisions that he was ultimately responsible for at Facebook. I love that he's passionate about AI and that he's supporting the release of somewhat open source models. But it seems a stretch to call him the best right now.
- stingraycharles 3y agoHe’s passionate about whatever the current fad is. A few years ago it was the metaverse, now it’s LLMs, and maybe in a few years it’ll be something else. They have the same problem as Google, an initial cash cow and not really able to invent something new, which leaves them very vulnerable to shifts in market behavior (TikTok) or other things. I don’t think he’s a great leader, there’s a reason why Sandberg was so important to the company.
- efrank3 3y agoI disagree. He created the VR fad by buying oculus and he was the first tech CEO to attend NeurIPS back in 2014.
- deleted 3y ago[deleted]