segmondy

4 ms·

61.
by segmondy 2mo ago
exciting. it's almost like 3 models in one. that variety would matter when trying to solve a creative problem.
62.
by segmondy 2mo ago
It isn't. I run both at home. GLM5.2 Q4 crushes DSv4Flash0731 Q8. I reach for DS for speed and for medium effort level work. If I care about quality I'll reach for GLM5.2 Looking at this release, I'm comparing it to GLM
63.
by segmondy 2mo ago
... and mere mortals can run this at home or rent a GPU, you can't do so with Sol or Fable.
64.
by segmondy 2mo ago
you're thinking of one shot. if they are running an agentic loop then they don't need multiple passes. an agentic loop is multiple passes with tool calls and tools could fail and agent would correct from seeing the failure. a ba
65.
by segmondy 2mo ago
Much easier & cheaper to run than Kimi
66.
by segmondy 2mo ago
This! It's always amusing when folks say "But China", my data in the hands of my government and their billionaire friends is more than dangerous than in China. I mean, if it's an IP sort of thing then go local.
67.
by segmondy 2mo ago
The answer is you should, that's what hacker news is all about.
68.
by segmondy 2mo ago
Many people don't have $5000 for DGX Sparks. With that said, it doesn't take much to run Deepseek. I run it on a sub $1000 system 128gb 2 3060 at 6-7tk/sec and then on a $1000 system with 10 MI50 GPUs built when the price wa
69.
by segmondy 2mo ago
Running Kimi K3 locally.
70.
by segmondy 2mo ago
From the article, "One guide this summer was literally titled “Open Weights You Can’t Run.”" I ran Kimi a few days ago at 1/2token per second. I only get to play with it during the weekend when i have time, but I'm cert
71.
by segmondy 2mo ago
older taxi drivers from the past I guess, these days the modern taxi drivers are almost all GPS reliant.
72.
by segmondy 2mo ago
This is normal. Almost 3 decades in the industry and sales get very nice vacation to tropical paradise all the time. At best we go some decent conference.
73.
by segmondy 2mo ago
Actually it's a shame that motherboards don't provide a battery that will allow the system to save file, even if the battery life is just 30 seconds.
74.
by segmondy 2mo ago
yeah, after all these years, they are waiting for your contribution. you really should go at it with Fable.
75.
by segmondy 2mo ago
It was leaked which put it in the open, it got widely popular and they rode the wave. I'm not so such if they would have widely released it if it wasn't leak. Nevertheless mucho credits to them for following up with llama2, llam
76.
by segmondy 2mo ago
There's an inkling branch, go to unsloth, read - https://unsloth.ai/docs/models/inkling
77.
by segmondy 2mo ago
Yeah, but if it's huge, how many can run it? Many folks struggle to run 200B+ models
78.
by segmondy 2mo ago
20 watts huh? How much energy has nature sure is required for lift? Does the same amount of energy scale by size for airplanes?
79.
by segmondy 2mo ago
everything in AI is not focused on LLM, if you think so then that's because you are in LLM bubble. The big idea with LLM is that it's generative AI, the generative could be anything! Not just large languages, we have seen bre
80.
by segmondy 2mo ago
and your point?
81.
by segmondy 2mo ago
You can't make this ish up. In the era of AI when we need as much energy as possible, this admin is pulling this ridiculous stunt. Yeah, I'm not wagering that USA wins the AI race.
82.
by segmondy 2mo ago
I feel it's image management and a bet. If they succeed, Google profits. If they don't succeed it doesn't matter, it's still a signal to the market/wallstreet that there's no "bad blood" between the
83.
by segmondy 2mo ago
I have often heard, "ignorance of the law is no excuse" so I always imagined that if you broke the law, you committed a crime, but I suppose it makes sense, if you break the law and you have no idea and no intent, you have broken
84.
by segmondy 2mo ago
End of an era for Alphabet.
85.
by segmondy 2mo ago
they are not going to get rewarded as much as they will make going to openai or anthropic. Google is not insane to pay tens and hundreds of millions to individuals like Zuck is. Crazy as it seems, Zuck might have been right, they seem to
86.
by segmondy 2mo ago
Someone that is innocent is going to get killed soon because flock flagged them incorrectly. I recall reading the auto journalist that got flagged for a stolen car while test driving a car. We have seen how often pull over/arrests can
87.
by segmondy 2mo ago
so if you don't use skill, harness and memory systems, what do you use?
88.
by segmondy 2mo ago
Makes sense, thanks for explaining. I guess I have often conflated civil liability with being equivalent to a crime as well.
89.
by segmondy 2mo ago
"Without whatever intent the crime requires, they haven't committed a crime." I'm not a lawyer, but I don't believe this. There is definitely negligence, these companies have often talked about the danger of AI. T
90.
by segmondy 3mo ago
Sounds good in theory. But your own personal AI agent that guards you can't do so just defensively, it must also have offensive capability. If personal AI agents have offensive capability then we are going to eventually end up with

More ›