3 ms·

> are you an Apple fanboy/fan girl? Nope. Would that invalidate the facts? Are you an Applephobe? They stated that apple phones are essentially the same as th

> are you an Apple fanboy/fan girl? Nope. Would that invalidate the facts? Are you an Applephobe? They stated that apple phones are essentially the same as they were years ago, when it is very clear that the hardware is considerably more powerful. Their devices are now capable of on-device inference of a 3B parameter language model. The commenters device is not capable of such a thing, as it is old hardware, which is counter to his position that there is little difference between the new and old phones.

theGeatZhopa 2y ago
Nope, I'm also not a applephobe. I like their devices and software, but I don't like their politics. I think we're aligned here in our thinking may the best product prosper! Your question wasn't that clear. Also, I think Mi11 will be capable of doing such things, because Google is also eager to have their Models running locally. I remember a news from January of this year, that Google brings their Gemma 2B locally on devices. Other LLMs are also eager to achieve that. It's not like you stated, Mi11 is an old hardware and nothing will run on it. The next thing to consider is, is really 3B model is running on (only new) devices or is it just a mockup because openAI is in behind doing some magic? What about your comparison, that Apple is capable to do 3B and Mi11 not because it's old hardware.. we just learned, that over 90 percent of all Apple devices can't do 3B.. isn't it the same like to say over 90 percent of all androids can't run 3B? ... Yes.. because their not built to do so. In Future you can assume, all of the new devices of certain price will be able to.. in fact, I didn't see the statistics, but more/less than 10 percent are capable right now and will get the software update soon for ... So, how to counter that arguments? :) Edit: Not from January, but from a month ago: https://medium.com/@samvardhan777/running-lightweight-llms-on-android-devices-b2ee4082557e https://medium.com/@samvardhan777/running-lightweight-llms-o...
- supermatt 2y ago
  How to counter what argument? That old hardware can’t run some recent stuff? That’s exactly what I said…
  - theGeatZhopa 2y ago
    When it's about RAM, Mi11 have 8gb of RAM.. the Mi11 pro has 12gb RAM. And both have sd slot for upto 256 GB.. so plenty of space.. Snapdragon 888 is also not the baddest one. Let's wait what community will bring us. But with 90 percent of apple old hardware also can't run it, so there also won't be a community to hack on the old hardware.. so what?

theGeatZhopa 2y ago

Nope, I'm also not a applephobe. I like their devices and software, but I don't like their politics. I think we're aligned here in our thinking may the best product prosper! Your question wasn't that clear. Also, I think Mi11 will be capable of doing such things, because Google is also eager to have their Models running locally. I remember a news from January of this year, that Google brings their Gemma 2B locally on devices. Other LLMs are also eager to achieve that. It's not like you stated, Mi11 is an old hardware and nothing will run on it. The next thing to consider is, is really 3B model is running on (only new) devices or is it just a mockup because openAI is in behind doing some magic? What about your comparison, that Apple is capable to do 3B and Mi11 not because it's old hardware.. we just learned, that over 90 percent of all Apple devices can't do 3B.. isn't it the same like to say over 90 percent of all androids can't run 3B? ... Yes.. because their not built to do so. In Future you can assume, all of the new devices of certain price will be able to.. in fact, I didn't see the statistics, but more/less than 10 percent are capable right now and will get the software update soon for ... So, how to counter that arguments? :) Edit: Not from January, but from a month ago: https://medium.com/@samvardhan777/running-lightweight-llms-on-android-devices-b2ee4082557e https://medium.com/@samvardhan777/running-lightweight-llms-o...

supermatt 2y ago
How to counter what argument? That old hardware can’t run some recent stuff? That’s exactly what I said…
- theGeatZhopa 2y ago
  When it's about RAM, Mi11 have 8gb of RAM.. the Mi11 pro has 12gb RAM. And both have sd slot for upto 256 GB.. so plenty of space.. Snapdragon 888 is also not the baddest one. Let's wait what community will bring us. But with 90 percent of apple old hardware also can't run it, so there also won't be a community to hack on the old hardware.. so what?