zargon

7 ms·

91.
by zargon 7mo ago
> in many MBs that will halve the bandwidth of the PCIe slots Not on boards that have 12 channels of DDR5. But yeah, squeezing an LLM from RAM through the PCIe bus is silly. I would expect it would be faster to just run a portion of the
92.
by zargon 7mo ago
They appear to be using Ollama as a data source. Ollama does that sort of thing regularly.
93.
by zargon 7mo ago
That's 3 times the heart rate of a hummingbird.
94.
by zargon 7mo ago
What key would be a good candidate as a default though? Imagine the memes for exiting vim if you needed a modifier to get into normal mode. Caps lock is truly a useless key and should be escape anyway.
95.
by zargon 7mo ago
Yes. And if we don't also stop burning fossil fuels then we'll never even break even.
96.
by zargon 7mo ago
You should question this and advocate for yourself. The important number is total lifetime exposure to LDL (actually apoB, but doctors aren't routinely testing that yet). The arterial damage is cumulative. You shouldn't wait until
97.
by zargon 7mo ago
"You could parachute [Sam Altman] into an island full of cannibals and come back in 5 years and he'd be the king." --Paul Graham, 2008
98.
by zargon 7mo ago
Quant choice depends on your vram, use case, need for speed, etc. For coding I would not go below Q4_K_M (though for Q4, unsloth XL or ik_llama IQ quants are usually better at the same size). Preferably Q5 or even Q6.
99.
by zargon 7mo ago
Explain what about that statement is false. Your original Q4_K_XL quant was broken. People noticing that it was a total outlier among other quants is what prompted this "research". Your own data proves that your new release fixes
100.
by zargon 8mo ago
You may be interested in the ClearURLs extension: https://addons.mozilla.org/en-US/firefox/addon/clearurls/
101.
by zargon 8mo ago
The best time to plant a tree was 20 years ago.
102.
by zargon 8mo ago
Total parameters, not active parameters, is the property that matters for model robustness under extreme quantization. Once you're swapping from disk, the performance will be quite unusable for most people. And for local inference, KV
103.
by zargon 8mo ago
I agree that genetics can protect you from developing myopia. For people who are genetically susceptible, outdoor exposure is critically important. Most people won't know which group their children are in.
104.
by zargon 8mo ago
Significant outdoor exposure is essentially the only relevant factor for preventing myopia. I would be interested in seeing any studies that showed any meaningful relevance of low light reading, while controlling for time spent outdoors.
105.
by zargon 8mo ago
A large model (100B+, the more the better) may be acceptable at 2-bit quantization, depending on the task. But not a small model. Especially not for technical tasks. On top of that, one still needs room for OS, software and KV cache. 8GB is
106.
by zargon 8mo ago
Comcast.
107.
by zargon 8mo ago
Controls were great, didn't see whatever it is that people love about the story, and the game loop made me quit.
108.
by zargon 9mo ago
Before we can survive "powerful AI", which we haven't even the faintest idea how to create, we have to survive the present era of mega-billionaires, Facebook, Twitter, and the propaganda capture of thereof. I want to know the
109.
by zargon 9mo ago
I ditched Pinboard a few years ago because I had a lot of difficulty getting my data out and there is no support. Marciej (idlewords) snarkily brags about not answering email ( https://news.ycombinator.com/item?id=23789426 ).
110.
by zargon 9mo ago
I *do* have a home theater with calibrated receiver, etc etc. Nolan sound mixes are still atrocious.
111.
by zargon 9mo ago
As someone with a dedicated center speaker, people doing audio mixing do not effectively use it. I even have it manually boosted. Sometimes it's 10% better than without one, but nowhere near enough to make a real difference.
112.
by zargon 10mo ago
I guess he really likes litrpg and gets plenty of work from that genre, perhaps? Maybe as he achieves minor fame from DCC he will find broader opportunities.
113.
by zargon 10mo ago
I revisited Assassin's Apprentice recently, as an audiobook, having read the series 20 years ago. Personally, I will not be continuing. The best term I came across to describe it is "injustice porn" or "misery porn.&quot
114.
by zargon 10mo ago
Jeff Hays is an incredible narrator. It appears he only narrates LitRPG. Of which, DCC seems to be basically the only readable series. Would love to see him branch out.
115.
by zargon 10mo ago
Sleep brokenness is ecosystem-wide. My Thinkpad crashes/freezes during sleep 3 times a week. Lenovo serviced/replaced it 3 times to no avail.
116.
by zargon 10mo ago
It's not about parametric functionality being obvious, it's that you can't draw something that isn't parametric in the sense described. At least I don't think I would be able to if I tried.
117.
by zargon 10mo ago
> Every time I've used as a CAD GUI program I would get to this point where I would need to alter a single dimension by 0.25mm and realize that _all_ of my fastener holes, cutouts, etc have to be nudged with the keyboard or mouse to
118.
by zargon 10mo ago
Almost like a, gasp, scroll bar? Who could have imagined those things might have some sort of purpose??
119.
by zargon 10mo ago
I'm grandfathered in at $200/year from the Safari days. The main advantage of the subscription to me is being able to evaluate several books on a topic to pick the one that is the best fit for what I need. If I knew which books we
120.
by zargon 10mo ago
Fanatical also has tech book bundles.

More ›