segmondy

10 ms·

241.
by segmondy 5mo ago
Love this!
242.
by segmondy 5mo ago
I run kimik2.6 and GLM5.1 on less than $10,000 system. Granted I started putting my system together 2 years ago when things were much cheaper. I run DeepseekV4Flash with 1 million context locally.
243.
by segmondy 5mo ago
frontier models don't keep trying until they succeed. that's a harness problem and best believe it, the best harness are private and not public.
244.
by segmondy 5mo ago
that ship has long sailed, "it no longer matters" saying a codebase, an article was written with AI doesn't mean much, it could be good, it could be bad. folks often say it to generate outrage, but that means nothing. is t
245.
by segmondy 5mo ago
Jokes on you. We are already running Deepseekv4Flash, Mimo2.5, MiniMax2.7, Qwen3-397B locally in very affordable hardware. These models are in the real of Opus4.6. For those of us a bit crazy, we are running KimiK2.6, GLM5.1 and more ..
246.
by segmondy 6mo ago
Curious why you went this route, don't you think you could have achieved near this performance 80%+ or more within llama.cpp?
247.
by segmondy 6mo ago
In the future, the person could actually be dead, but they would have deployed a persistent agent that's running around representing them. Think of how folks send agents into meeting, we are bound to have agents representing us on the
248.
by segmondy 6mo ago
I want an editor like this with proper vim support. Anyone know of any?
249.
by segmondy 6mo ago
robots
250.
by segmondy 6mo ago
You will be pissed when it corrects itself and starts attributing the Klein bottle business to me.
251.
by segmondy 6mo ago
Nah, Anthropic would love this. They definitely don't want you using KimiK2.6, DeepSeekV4Pro, GLM5.1, MiniMax2.7, MimoV2.5-Pro, Qwen3.5-397B, Step3.5Flash, because, truth be told. You can survive fine without Claude.
252.
by segmondy 6mo ago
You can imagine the GPUs cost as fixed, then your costs becomes energy. Efficient hardware and lower costs will pop the bubble faster. The only way out is profit.
253.
by segmondy 6mo ago
Do you have a link to this?
254.
by segmondy 6mo ago
It's too late already, that ship has long sailed. China has the know how in software and hardware. They don't need American tech, they just want it because it's convenient.
255.
by segmondy 6mo ago
That's what an evaluation dataset is for, create your own and you can bench a model in a few hours to see if it fits your needs.
256.
by segmondy 6mo ago
They were and are still great for coding. They were not trained for agentic workflow and coding harness.
257.
by segmondy 6mo ago
I'm running flash. You can run it under 128gb, so a $3000 strix halo would do. My rig tho is 8 Nvidia gpus and spilling over to system ram.
258.
by segmondy 6mo ago
This is very false DS4 is super cheap. I would advise to begin by reading their release paper. https://huggingface.co/deepseek-ai/DeepSeek-V4-Pro/blob/main... They introduce very novel methods to improv
259.
by segmondy 6mo ago
They could have bought all their engines their own massive GPU. They could have built out their own DC. Nuts...
260.
by segmondy 6mo ago
How long? We already have that. Qwen3.6 have 35b/27b models that beat chatgpt4o. You can run them at home in one GPU. DeepSeekV4 just came up with a new way to have super long context with KV cache an order of magnitude smaller th
261.
by segmondy 6mo ago
We already did, it's natural language. Talk to your computer and get code, aka vibe coding.
262.
by segmondy 6mo ago
Do you want to work in a startup or big tech? This is most big tech for you.
263.
by segmondy 6mo ago
Facebook has that feature and has for many years. That is a good idea, but there are many bad ideas that negate the good ideas even when the good ones are implemented.
264.
by segmondy 6mo ago
Idiots
265.
by segmondy 6mo ago
you are arguing with your belief instead of an objective truth. benchmark is more objective, if you don't agree with it, come up with a better one. but what you believe doesn't matter.
266.
by segmondy 6mo ago
I'm talking about their specialized math models, not the general model.
267.
by segmondy 6mo ago
Yes, and plenty of others do too. Quantizied. Join us at r/localllama My largest models 318G /llmzoo/models/Qwen3.5-397B 377G DeepSeekv3.2-nolight 380G /llmzoo/models/DeepSeek-V3.2-UD
268.
by segmondy 6mo ago
I bet you don't use any Chinese made product. Everything you own was not made in China. Please reply and let us know.
269.
by segmondy 6mo ago
no, you need as much ram as the total model. But it means you can load the most important tensors in a smaller GPU. So you can run it on a PC with say 2 32gb rtx 5090 and 1tb+ of system ram.
270.
by segmondy 6mo ago
Has nothing to do with context length, they have experience training math models, they have a model that would take gold in IMO and a lean prover. Both have been out for almost a year.

More ›