4 ms·
Microsoft launches Phi-3, its smallest AI model yet
- pcdoodle 3y agoIt's pretty good (Tested on i5-6600 / 8GB). A small slight to MS: If this was still the balmer era, we'd be clapping "Developers" and making cool windows apps with this today. It doesn't feel right anymore: This PC vs. My Computer...
- wizzwizz4 3y agoThis headline is simply false, no matter how you interpret it. > Phi-3 Mini measures 3.8 billion parameters > The whole model contains 155 million weight parameters and the three transformers consume 128 million parameters, or 82.6 percent of the total.[0] > Phi 1.5 has 1.3 billion parameters.[1] I feel sorry for the reporter, who must know the headline's wrong (if she's read it) given I got to the second link from her article. [0]: https://www.microsoft.com/en-us/research/blog/microsoft-and-nvidia-introduce-parameter-efficient-multimodal-transformers-for-video-representation-learning/ https://www.microsoft.com/en-us/research/blog/microsoft-and-... [1]: https://www.semafor.com/article/11/01/2023/microsoft-pushes-the-boundaries-of-small-ai-models https://www.semafor.com/article/11/01/2023/microsoft-pushes-...
- Havoc 3y agoNot sure about the article but the model is really good for its size. I really hope they release the 14B one on same MIT license