3 ms·
> or Mistral on almost any iPhone device > "Small" requires iPhone 14 and 15 Pros > "Small" and "Medium" models are based on Mistral 7B 0.2 So no, also that
by KomoD 2y ago
> or Mistral on almost any iPhone device
> "Small" requires iPhone 14 and 15 Pros
> "Small" and "Medium" models are based on Mistral 7B 0.2
So no, also that app wouldn't work on an iPhone 8 either since it requires iOS 17 or later
- imranq 2y agoYou could even go up a few iPhone versions and still be <$199. iPhone 12 used ~$190 supports iOS 17 and can run the Tiny models (phi-2). For small models, today a used iphone 14 costs ~$300. Which means next year it will by down to ~$200. I'm pretty sure by 2026, we will be able to inference "medium" models like Mistral/Llama3 8B on a <$199 device. That's not even factoring in how much better models will get by that time