5 ms·
Did you try using the the talaas chat? Something stupid like 18k tokens/second. Think it's called Askjimmy or similar.
by lelanthran 2mo ago
Did you try using the the talaas chat? Something stupid like 18k tokens/second.
Think it's called Askjimmy or similar.
- jgilias 2mo agoOh boy, thanks for sharing this, truly mind blowing. It was chatjimmy.ai
- TeMPOraL 2mo agoWhat is the model they're using there though? Interrogated, it claims it's a BERT variant and has capabilities around GPT-3 and below GPT-4. (Not that I believe it, it writes too well for GPT-3.) Hosted frontier models from two years ago would be much faster today, too.
- egorfine 2mo agoThey run Llama 3.1 8B.