gaigalas

4 ms·

31.
by gaigalas 2mo ago
Maybe I'm not seeing the speed improvements because it's a dense model, and I'm comparing it to the 3.6 MoE with MTP. Likely, I'm attributing the speed I see to something else. Honestly, if MTP is available, I don't
32.
by gaigalas 2mo ago
I don't see an MTP entry on Unsloth though. Maybe it's not available in a lower quant I need for my poor GPU.
33.
by gaigalas 2mo ago
I have an idea for AI companies for tremendous scale, with privacy and all nice things accounted for: - Unstarve the GPU and RAM consumer market. - Let enthusiasts and volunteers quickly ramp up local AI. - Reap the results that the communi
34.
by gaigalas 2mo ago
Waiting for the MTP version to pop up on Unsloth. Speculative decoding makes a huge difference. Been running quantized 3.6 at 110t/s on a cheap 5060Ti and quite happy with it. If 3.8 improves on it, it would be awesome.
35.
Wasi-sh, run limited shell scripts on the browser(github.com)
3 points by gaigalas 2mo ago|1 comments
36.
by gaigalas 2mo ago
This is the engine behind my blog's terminal view, which I just open sourced. More info: https://alganet.github.io/blog/2026-07-21-00-Bash-for-Browse... It is fairly fast, runs on node and browser, and can serve a
37.
by gaigalas 2mo ago
Go hard boring on 80% of what you do. Go hard exciting on the 20% else. Don't let one affect the other.
38.
by gaigalas 2mo ago
If someone is ignoring basic instructions like "don't worry about the scriptures", then it doesn't matter anyway. Basic text interpretation skills are missing in the interaction.
39.
by gaigalas 2mo ago
Muse clearly does it to some extent. Saw a lot of that running Glimmer locally.
40.
by gaigalas 2mo ago
Each die on the wafer is kind of different. Light is not all the same, usually dies on the center of the wafer are better and it gets worse as you move outside. That plays out in binning, and it involves even design (laying out dies on the
41.
by gaigalas 2mo ago
Perhaps we should let the content economy crash so that the big monsters eating it starve and die. A new content economy could be built on their carcasses instead.
42.
by gaigalas 2mo ago
I said "Don't worry about the scriptures". It's not my bible, I'm an atheist. I see the book as a heavily altered collection of multiple historical sources, not as a holy monolith.
43.
by gaigalas 2mo ago
My mistake, I disregarded shareholders . One must always think of them when recalling ancient wisdom.
44.
by gaigalas 2mo ago
Psalm 135:15-18 is my favorite version of it, the most clear-headed. It reads more as a warning "if you do this, then this will happen" than an unreasonable commandment. The idols of the nations are silver and gold, made by hu
45.
by gaigalas 2mo ago
We should consider if my use of the quote was really a hook for talking about the script or a metaphor for something else. I won't spoil it by explaining too much though, let our imaginations run free on this one.
46.
by gaigalas 2mo ago
> Everyone will have an exceptionally capable personal agent that understands you, your goals, and everything you care about. "One machine for every man, woman and children of Zion. Sounds exactly like the thinking of a machine to m
47.
by gaigalas 2mo ago
> There's no evidence of anything artificial here, except to the extent that the data center-driven demand could be called "artificial" I'm sorry. Can you summarize that part in a more concise phrase?
48.
by gaigalas 2mo ago
> packaging (before dicing) packaging before dicing? That makes no sense.
49.
by gaigalas 2mo ago
> "Consider two categories of people:" That's precisely how crazy ideologies form.
50.
by gaigalas 2mo ago
Sci-fi works are surfaces in which you can project future realities allegorically. Every single person has the right to project what they want. The issue here is that people don't have the education to make those projections, so they b
51.
by gaigalas 2mo ago
> sense of purpose and meaning that you put so much time, blood, sweat and tears But is that what you really feel? It seems like a repackaged cliché. I read your text a couple of times, and I still don't understand what makes you fe
52.
by gaigalas 2mo ago
Why is there an Artifactory instance available to the agents during RL? It makes no sense. This leads me to conclude this is sloppy sandboxing. A safer sandbox with zero downsides that exchanges files before/after the agent runs would
53.
by gaigalas 2mo ago
> If deciding what to build is the hard part, why do so many product managers seem clueless? The divide between product managers and developers mimics the artificial divide between humanities and STEM. You divide workers into competing g
54.
by gaigalas 2mo ago
You think IT professionals lost faith? You should look at teachers. Hate to break it to you, but we're on a dark age, and this whole thing is just another unremarkable development that follows a trend that has been going on for about t
55.
by gaigalas 2mo ago
That is somehow inaccurate. DDR5 has significantly more challenging requirements. The inspection and quality control equipment is one of those that you can't just reuse without careful transitioning. DDR5 has much higher speeds, on-d
56.
by gaigalas 2mo ago
My comment was in the context of fabrication and how that affects the price of DDR4. DDR5 fabrication requires a sub 15mm process, much more complex mounting and lots more testing equipment. It means you can't just quickly convert a DD
57.
by gaigalas 2mo ago
Clicking out to close a dictionary popup only works if you click empty space within the layout center. This is annoying. On a wide monitor, most empty space is on the sides (where clicking doesn't close). It seems some books are missin
58.
by gaigalas 2mo ago
How to make a people problem worse: - Umbrellas are about people, not rain. - But your umbrella will keep me dry, right? - The materials, the shape, none of it is really important. - I'm not sure what you mean. Give me some hard number
59.
by gaigalas 2mo ago
That's it. Which is insane. We used to buy used DDR4 from obsolete servers in buckets before it was going to become e-waste. Now even that one is expensive.
60.
by gaigalas 2mo ago
Isn't DDR4 like, old and obsolete? From my knowledge, you can't just take a fab that produces DDR4 and make it produce DDR5 or higher. It's kind of a leap that requires replacing a lot of stuff. I would expect that old DDR4 m

More ›