4 ms·
> However, the hardware requirements and cost make this inaccessible for anyone but large companies. When do you envision that the price could be affordable for
by tome 3y ago
> However, the hardware requirements and cost make this inaccessible for anyone but large companies. When do you envision that the price could be affordable for hobbyists?
For API access to our tokens as a service we guarantee to beat any other provider on cost per token (see https://wow.groq.com https://wow.groq.com). In terms of selling hardware, we're focused on selling whole systems, and they're only really suitable for corporations or research institutions.
- pwillia7 3y agoDo you have any data on how many more tokens I would use with the increased speed? In the demo alone I just used way more tokens than I normally would testing an LLM since it was so amazingly fast.
- tome 3y agoInteresting question! Hopefully being faster is so much more useful to you that you use a lot more :)
- dsrtslnd23 3y agoHow open is your early access? i.e. likelihood to get API access granted right now
- tome 3y agoWe are absolutely slammed with requests right now, so I don't know, sorry.