True, the fact we now also have LLM models at 2.7B parameters that are "actually coherent and useful for niche work" like PHI-2 on my Macbook Air running super

True, the fact we now also have LLM models at 2.7B parameters that are "actually coherent and useful for niche work" like PHI-2 on my Macbook Air running super fast at 25 t/s or 12 t/s for Mistral_0.2 as an _somewhat_ knowledgable assistant / coder - is crazy! Coherent models required dozens of billions of parameters just a year ago and something like Mistral was closer to 70B and reserved for server farms or crazy setups. Locallama on Reddit has outdated info in from just a few months ago.