5 ms·
Llama3 on Groq
- Oras 2y agoThat's impressive. I asked to summarise an article in 5 bullet points, and the output was 812.81 T/s on Llama 3 8B.
- deleted 2y ago[deleted]
- WhatsName 2y agoWhat is tbe cost per Mio. Token for llama3 70b on groq?
- matanyall 2y ago$0.59 input, $0.79 output (https://wow.groq.com/ https://wow.groq.com/)
- jacooper 2y agoWhen is Mixtral 8x22b coming?
- frozenport 2y agoLLama3 looks particularly good at tool calling Groq's low latency is particularly good for tool calling Seems like two techs that will make coding obsolete :-)
- Alifatisk 2y agoIs the python lib open-source? I could only find the ja lib for Groq.
- Alifatisk 2y agoNvm https://github.com/groq/groq-python https://github.com/groq/groq-python