3 ms·
New Mistral AI Weights
- WhatsName 2y agoThe name ist pixtral_12b_240910, size is 24gb. My best guess would be it's a multi modal LLM.
- meetpateltech 2y agoIt is vision only (not multimodal) https://github.com/mistralai/mistral-common/releases/tag/v1.4.0 https://github.com/mistralai/mistral-common/releases/tag/v1.... https://github.com/mistralai/mistral-common/pull/45 https://github.com/mistralai/mistral-common/pull/45
- kristianp 2y agoFrom the 1st link: Pixtral is out! Mistral common has image support! You can now pass images and URLs alongside text into the user message.
- meetpateltech 2y agoI mean, it supports text+images, not documents or audio
- moralestapia 2y ago>text+images So, it's multimodal then.
- fsndz 2y ago[flagged]
- deleted 2y ago[deleted]
- 19h 2y agoYou should explicitly mention that this is your blog post, and that this is a "members-only" post?
- moralestapia 2y agoThis is borderline spam.
- danielhanchen 2y agoDownloaded params.json - GeLU & 2D RoPE are used for the vision adapter. The vocab size also got larger - 131072 in size. Also Mistral's latest tokenizer PR shows 3 extra new tokens (the image, the start & end). The torrent is 24GB, and I guess the implementation will be up in HF in a few days! Exciting times!
- generalizations 2y agoAt 24gb, I wonder how small the quantized models will go.
- julius-ceasar 2y agowill this be supported in ollama?
- An0nymousHacker 2y ago[flagged]
- WaduHECK 2y ago[flagged]
- siggalucci 2y agowhat's the hostility against Ollama?
- krasin 2y agoHere is the feature request to support Pixtral on llama.cpp: https://github.com/ggerganov/llama.cpp/issues/9440 https://github.com/ggerganov/llama.cpp/issues/9440 - once it's implemented in the upstream, ollama will be able to pick it up.