3 ms·
Spent a lot of time - but this makes zero sense to me. It can, maybe, return type safe outputs faster than larger llms - but there is little reason to believe t
by sonink 19d ago
Spent a lot of time - but this makes zero sense to me. It can, maybe, return type safe outputs faster than larger llms - but there is little reason to believe that it will be more accurate. It does absolutely hallucinate - and seems to me that the claim is largely misleading.
You architect your systems with typesafe - because it is marginally faster, but inaccurate - to do what ? You can just wait for the next version of LLM's to get more accuracy at the same cost - or just use a faster model right now from a different provider.
- brooksy 19d agoFor certain tasks, a model like Jev may be intrinsically more efficient than an LLM because it doesn't have to predict a token distribution and can instead focus solely on the probability of a single question/action
- bigmadshoe 19d agoIt isn't marginally faster, it seems to be approx 100x faster and 10-100x cheaper.
- lostmsu 16d agoAccording to https://goodstartlabs.com/research/verification-is-the-bottleneck https://goodstartlabs.com/research/verification-is-the-bottl... it is only 2.6x cheaper than DeepSeek V4.1 Flash, and they did not test v4.0 Flash, which would have been same price.