3 ms·
This sounds good but so far all claims just sound like marketing terms. I'd love to see real proof. e.g. "RLCD" and "parallel sampling" have nothing to back it
by ramon156 19d ago
This sounds good but so far all claims just sound like marketing terms. I'd love to see real proof. e.g. "RLCD" and "parallel sampling" have nothing to back it up.
also "70-500ms vs 3-329 seconds" are apples-to-oranges unless the LLM baseline is doing comparable work (e.g., long chain-of-thought). If Jev is skipping generation entirely for a narrow structured task, of course it's faster.
Nonetheless i want this to be true, so I'm looking forward to Jev
Edit: I really have to say that I like their manifesto https://typesafe.ai/manifesto https://typesafe.ai/manifesto
- why_only_15 19d agoThey have various benchmarks, e.g. how much time it takes them to do wikipedia page -> page games. Jev seems to take the same or fewer hops but in ~10x less time and for ~10x less money. It's totally reasonable to compare against LLMs doing chain of thought if it gets comparable performance.
- vatsachak 19d agoIt's not an LLM though it's a frontier model on structured data
- BoorishBears 19d agoDid you see the video where it plays Doom, it made it click for me
- simianwords 19d agoBTW it was not multi model playing doom, it was passing structured input and getting structured output. Its not what I thought: frames of video passed and real time game play.
- yieldcrv 19d agoso what? put an LLM on Cerebras and get its responses faster, and put Jev on Cerebras and gets its responses even faster
- zergrush 19d agoi've seen it play minecraft as well, what im not sure here is what is the thing that produces the JSON and keeps track of the objects can jev play battlefield six for example
- CompleteSkeptic 19d agolove that you love the manifesto! letting the first batches off the waitlist now, but we do have some early users describing their experience (https://x.com/danshipper/status/2099947471518474522 https://x.com/danshipper/status/2099947471518474522)
- varenc 19d agoCongrats ! Really excited for the team.
- yunwal 19d ago> If Jev is skipping generation entirely for a narrow structured task, of course it's faster I think this is reasonable if people are actually using LLMs to solve this type of narrow structured task, which they are. The evidence is that every LLM provider has some method of forcing the output to conform to a json schema in their documentation.
- bigglebear 19d ago> I really have to say that I like their manifesto Their manifesto: "you only build on top of it if it's trustworthy." - the irony of this while putting out the most misleading, dishonest marketing campaign I've seen in months for their first public appearance doesn't exactly scream "trustworthy" to me.
- alchemist1e9 19d agoWhat do you find dishonest?
- arbayi 19d agoComments under the x post.