4 ms·
The Simon Willison coverage is great. Simon is cited in the "why we should have seen it coming" section, for his Stable Diffusion Moment piece. He nicely covers
by rektide 3y ago
The Simon Willison coverage is great. Simon is cited in the "why we should have seen it coming" section, for his Stable Diffusion Moment piece. He nicely covers the key points of this paper:
> The premise of the paper is that while OpenAI and Google continue to race to build the most powerful language models, their efforts are rapidly being eclipsed by the work happening in the open source community.
Not to dilute from this beloved point, but also covers other key notes well too:
> Where things get really interesting is where they talk about “What We Missed”. The author is extremely bullish on LoRA—a technique that allows models to be fine-tuned in just a few hours of consumer hardware, producing improvements that can then be stacked on top of each other
https://simonwillison.net/2023/May/4/no-moat/ https://simonwillison.net/2023/May/4/no-moat/
Overall I take this as fairly happy news. It's a trend humanity stubbornly keeps trying to resist: open source wins.
It's great the barrier to innovation is so much less than expected, that so much experimentation is possible from atop the existing models.