2 ms·
> open source project further and beat the Jev-ers That is a seriously good idea. I tested Jev against local models. Confirmed that local architecture outperf
by azterizm 11d ago
> open source project further and beat the Jev-ers
That is a seriously good idea.
I tested Jev against local models. Confirmed that local architecture outperforms the closed cloud one marginally.
Limits mostly come from the cloud model. We are talking 712ms P50 latency versus 0.14ms locally on intent routing. Scoring costs linearly with volume. Cloud got its own limits.
An open source Jev would resolve all this immediately. Network, billing, RPM ceiling, all resolved. Additionally, we can do fine tuning, scale with hardware and freeze weights.