4 ms·
Quickly reading the article, one notable limitation seems to be that these checkpoints are 512-1024 tokens context size models, while Jev is seemingly 32k. Tha
by cube2222 16d ago
Quickly reading the article, one notable limitation seems to be that these checkpoints are 512-1024 tokens context size models, while Jev is seemingly 32k.
That's a pretty big limitation, I would argue, unless I'm misunderstanding and it can be worked around easily somehow? I'm surprised it isn't surfaced more prominently in the comparison.
- bjt12345 16d agoJev has 64k total token request budget and I do wonder how it will handle highly specialised inputs. This Jev waitlist that Typesafe AI are utilising is surely going to raise questions pretty soon - it's hard to sell this to bosses when it looks like a pop-up restaurant
- thomashop 16d agoIt's already on Openrouter
- Havoc 16d agoI just got my invite so the waitlist doesn't seem to be particularly long
- Foobar8568 16d agoI am more curious about a 60k prompt... I haven't seen much discussion about large prompts, is it still < 500ms?
- druskacik 16d agoYeah, it's weird, considering ModernBERT, which the Laya models are based on, supports 8192 context window.