4 ms·
Partly they do this to keep their ML researchers entertained after the glitz of their $1M compensation wears off. And partly they do this to develop products fo
by ttul 3y ago
Partly they do this to keep their ML researchers entertained after the glitz of their $1M compensation wears off. And partly they do this to develop products for their customers. Although they partnered with Anthropic, whose arguably SOTA models are vastly superior, AWS has an extremely diverse set of customers with simpler requirements that may be quite thoroughly satisfied with a 7B parameter model.
- brucethemoose2 3y agoA 7B model must be cheaper and faster than Anthropic's huge model. To me, it feels good enough for retrieval/summarization tasks Amazon could sell, especially with grammar based sampling.