4 ms·
I've been deeply impressed with Jev as it made a bunch of workloads we had on Luna or Gemini 10x cheaper and 2x faster (previously used non reasoning version fo
by zurfer 7d ago
I've been deeply impressed with Jev as it made a bunch of workloads we had on Luna or Gemini 10x cheaper and 2x faster (previously used non reasoning version for latency reasons).
Now Laya promises another speed up and it's open source. Tbh if it can't run on a CPU I anyway want to buy it from an inference provider. Managing gpus in production is a non trivial problem.
What I also wondered about Jev is how different it is from something like tabular foundation models. They seem to overlap in use cases. Which then leads to the question, what is actually learned? A lot of people in machine learning spend time to making things explainable and always struggled to move beyond data induced biases.
Having it open source is awesome as fine tuning might give additional performance on the task we care about.
- dominotw 7d agoThis is your brain on ai influencer twitter
- Axsuul 7d agoCan you give some examples of workloads?
- sharms 7d agoI have 10000+ inventory items to categorize but I need an intelligent model (not just if statements). Using LLMs has been slow and expensive and I needed to queue it to run for hours. Jev did it in minutes and for less than 1 cent