25 ms·
A 7B model must be cheaper and faster than Anthropic's huge model. To me, it feels good enough for retrieval/summarization tasks Amazon could sell, especially
by brucethemoose2 3y ago
A 7B model must be cheaper and faster than Anthropic's huge model.
To me, it feels good enough for retrieval/summarization tasks Amazon could sell, especially with grammar based sampling.