reliabilityguy

4 ms·

1.
by reliabilityguy 6d ago
HBM is a stack of DRAMs, so there is no “instead”.
2.
by reliabilityguy 16d ago
> They're still recording everywhere and sending a transcription to iCloud and they're doing it without consent. Plenty of jurisdictions are single consent. Moreover, what is the difference with using your phone to record?
3.
by reliabilityguy 25d ago
> when it is in fact a well-documented and pretty mundane practice Practiced by Apple? Just because someone is doing it doesn’t mean that every company does it.
4.
by reliabilityguy 25d ago
I am not the one making claims here. You can’t claim A, and then when someone asks you for a proof reply with “prove that it’s not A”.
5.
by reliabilityguy 25d ago
There is no factual accuracy at all, only speculation and empty claims. Do you have a proof that Apple has bot farms to push its narrative?
6.
by reliabilityguy 27d ago
> load all the LLM parameters or KV cache in RAM and exclusively let it perform GEMV and let it rip. Won’t you have a bunch of extra reads/writes via the CPU because these DIMMs won’t be able to compute matrix multiplications?
7.
by reliabilityguy 27d ago
Rollie calculation, like the online softmax in FA, implies a centralized computing unit that does the compute and stores the intermediate results in its registers. With PIM you have no centralized compute unit, you have a bunch of memory, a
8.
by reliabilityguy 28d ago
How exactly the map-reduce will happen though? Won’t you need to do it host-side, or make a lot of reads and writes? Also, doesn’t it mean that you forgo batching?
9.
by reliabilityguy 28d ago
> You could run MACs directly in RAM Sure, MACs are nice. However, unless there other, PIM-specific/optimal, algorithms, regular matrix multiplication algorithms like tiling-based won’t work here I think — how would the tile be shar
10.
by reliabilityguy 28d ago
Interesting that Samsung still pursues PIM. IIRC they had a paper in ISCA21 or 22 where they showed HBM2 module with PIM, which back then impressed me quite a lot. That being said, I am not sure what’s the killer application for this techno
11.
by reliabilityguy 28d ago
I am not sure a vote of non-confidence would have helped here — there are only two parties.
12.
by reliabilityguy 28d ago
Can you elaborate what you mean?
13.
by reliabilityguy 1mo ago
I am not sure we are arguing here on the merit of the argument itself. You are fine with China’s genocide TODAY because China is the “lesser of two evils”? I do not understand this. It sounds like a cultist/religious position.
14.
by reliabilityguy 1mo ago
No, I mean licenses to use the ISA. The act of paying for the license has nothing to with Apple being or not being one of the founders.
15.
by reliabilityguy 1mo ago
> Sure, but not the way West conducted it, by going and killing generations of people. Ridiculous statement. China is doing it today — uighurs are actively erased bit by bit. > Look at India, before British colonization they accounted
16.
by reliabilityguy 1mo ago
China is imperialist as any other country. They extract resources from others like the British 100 years ago. This is hilarious that this whole “west is bad” makes people blind. > Imperialism costed millions of lives Chinese policies res
17.
by reliabilityguy 1mo ago
> I'd call it a whataboutism I would say that saying about anything “whataboutism” is a cheap way out. China does industrial espionage for the same end goals as American companies work on new things: market domination. So, I find it
18.
by reliabilityguy 1mo ago
> all for profit companies are greedy by their nature, but US companies are on a different level because you can 'buy' the government by lobbying or supporting their election campaigns How would you call decades of chinese stat
19.
by reliabilityguy 1mo ago
> I don't care about internal politics of a state, as long as they are not killing people deliberately What about forced cultural assimilation and re-education camps? Or, as long as it’s confined to the borders of a country doing so
20.
by reliabilityguy 1mo ago
> I wonder just how different their processes really are Night and day. Apples has in-house silicon dev groups starting (at least) 2008 w/ acquisition of PA semi for their low power CPUs, followed by the acquisition of Anobit in 201
21.
by reliabilityguy 2mo ago
> you're describing a system in which a refresh causes so much disturbance that another refresh is immediately required. Well, if you need to refresh a bunch of rows after any other read, you will spend more time refreshing things
22.
by reliabilityguy 2mo ago
They are, that’s why ECC exists, and those who are willing to pay for it, can get it.
23.
by reliabilityguy 2mo ago
> It's my long standing opinion[1] that we shouldn't accept any RAM that can be subject to random bit flips. Every system fails eventually.
24.
by reliabilityguy 2mo ago
> Okay then refresh the whole thing and not just a single row whenever TRR is triggered. How would you refresh the whole DRAM? Refresh is simply reading the row and writing it back, it is sequential in nature. > Or interleave activati
25.
by reliabilityguy 2mo ago
Interesting read. To his defense: the argument is not that Optionals are too complicated, but that it’s a wrong path for language design — instead programmers have to test their code properly. I like optionals, but I see his point too.
26.
by reliabilityguy 2mo ago
> Doing both at once is much harder. I think with sequential approach (translate -> make idiomatic) it is easier. However, I am not sure that monetary difference is going to be as stark as $165k vs 3 engineers/year. Especially, i
27.
by reliabilityguy 2mo ago
Many repeat the point of “$165k is cheaper than team of multiple engineers working on the rewrite for a year”, which I think is flawed — the team of engineers would have produced idiomatic rust, and it would take probably 100k+ of tokens mo
28.
by reliabilityguy 2mo ago
> We use canary values to detect the resellers, and I believe that's the only approach that will actually work at scale. Can you elaborate how it works? Specific sequence of tokens acts as a canary?
29.
by reliabilityguy 2mo ago
The US didn’t install the shah to torture and murder civilians. It was shahs choice to do so. To blow up civilian target is a choice. I know nuance is unpopular nowadays but I do see a difference between bad decisions with unintended conseq
30.
by reliabilityguy 2mo ago
I would say that as the form of government and the legal landscape of a country as a whole US fares much better than the Islamic Republic.

More ›