2 ms·
They’re selling a lot of steel and wooden handles to the shovel makers right now. No doubt if they see an open design like this one they like they’ll iterate on
by mattnewton 3y ago
They’re selling a lot of steel and wooden handles to the shovel makers right now. No doubt if they see an open design like this one they like they’ll iterate on it and offer it too, that seems to be the “bedrock” branded stable diffusion and similar.
Maybe they think, why train the foundational model from scratch when you can get some company to rent your sever to do it, and then license it to you for free anyways?
- ttul 3y agoPartly they do this to keep their ML researchers entertained after the glitz of their $1M compensation wears off. And partly they do this to develop products for their customers. Although they partnered with Anthropic, whose arguably SOTA models are vastly superior, AWS has an extremely diverse set of customers with simpler requirements that may be quite thoroughly satisfied with a 7B parameter model.
- brucethemoose2 3y agoA 7B model must be cheaper and faster than Anthropic's huge model. To me, it feels good enough for retrieval/summarization tasks Amazon could sell, especially with grammar based sampling.