3 ms·
Llama 3.2 released: Multimodal, 1B to 90B sizes
- deleted 2y ago[deleted]
- artninja1988 2y agoAre users in the EU not allowed to use it, like they threatened to do so recently?
- btdmaster 2y agoThey are not allowed indeed: https://github.com/meta-llama/llama-models/blob/main/models/llama3_2/USE_POLICY.md https://github.com/meta-llama/llama-models/blob/main/models/... > With respect to any multimodal models included in Llama 3.2, the rights granted under Section 1(a) of the Llama 3.2 Community License Agreement are not being granted to you if you are an individual domiciled in, or a company with a principal place of business in, the European Union. This restriction does not apply to end users of a product or service that incorporates any such multimodal models. Interesting though, since (some) EU law applies outside the EU anyway, so I'm not sure how much lawyer there is in the text.
- hiAndrewQuinn 2y agoThis would not apply to the smaller 1B and 3B models, though, if I'm reading this right, since they are text only, not multimodal. Is that correct?
- btdmaster 2y agoYes, only the multimodal ones.
- wesleyyue 2y agoInteresting observations: * Llama 3.2 multimodal actually still ranks below Molmo from ai2 released this morning. * AI2D: 92.3 (3.2 90B) vs 96.3 (of Molmo 72B) * Llama 3.2 1B and 3B is pruned from 3.1 8B so no leapfrogging unlike 3 -> 3.1. * Notably no code benchmarks. Deliberate exclusion of code data in distillation to maximize mobile on-device use cases? Was hoping there would be some interesting models I can add to https://double.bot https://double.bot but doesn't seem like any improvements to frontier performance on coding.
- idiliv 2y agoWhere do you see the MMLU-Pro evaluation for Llama 3.2 90B? On the link I only see Llama 3.2 90B evaluated against multimodal benchmarks.
- wesleyyue 2y agoAh you're right I totally misread that!
- daemonologist 2y agoOn the second point, you're comparing MMMU-Pro (multimodal) to MMLU-Pro (text only). I don't think they published scores on MMLU-Pro for 3.2. (Edit: parent comment was corrected, thanks!)
- wesleyyue 2y agoYep you're right, thanks for catching (sorry for the ninja edit!)
- oriettaxx 2y agodo you have an idea how long will take to have it available in ollama ?
- oriettaxx 2y agojust arrived :) https://ollama.com/library/llama3.2 https://ollama.com/library/llama3.2
- rahimnathwani 2y agoNo multimodal yet :(
- Patrick_Devine 2y agoSoon! We're working on it, and it's almost there.
- rahimnathwani 2y agoIt seems like the weights for Llama3.2-11B-Vision-Instruct are about 20GB. Will ollama run that on an M1 Mac with 32GB RAM? Will the ollama model library have quantized models?
- Patrick_Devine 2y agoI think it should run fine. Yes, there will be quantized versions.
- jarbus 2y agoI’m more excited about Llama stack, I can’t wait for local models to be able to use tools in a standard way.
- ChrisArchitect 2y agoAnnouncement post instead of general top-level domain: https://ai.meta.com/blog/llama-3-2-connect-2024-vision-edge-mobile-devices/ https://ai.meta.com/blog/llama-3-2-connect-2024-vision-edge-... (https://news.ycombinator.com/item?id=41649763 https://news.ycombinator.com/item?id=41649763)
- pheeney 2y agoWhat is the best provider for API use of llama frontier models considering pricing / reputation?
- fulladder 2y agoWhen will it come to ollama? That's my preferred quantization platform.