12 ms·
Getting 50 GB/S Back from the Apple Neural Engine
RTL performance erratum in the Apple M3 Neural Engine throttles DRAM weight streaming throughput down to 17–19 GB/s from the nominal 45–60 GB/s. Avoiding the problematic path in the kernel DMA engine's speculative prefetch ring increased Llama 3.2 1B token throughput from 10.0 to 24.3 tokens/s.
- deleted 2mo ago[deleted]
- Neywiny 2mo agoJust checking here- this systemverilog is a hypothetical telling of what you think is going on? Or do you have the actual source of the RTL?
- VladVladikoff 2mo agoThis website hijacked my back button during a simple page load. You should fix that, it’s not an acceptable way to behave.
- switchbak 2mo agoI’m shocked that’s still possible, shouldn’t we be able to fix that at the browser level?
- busymom0 2mo agoJust like how browsers disable or mute auto playing videos, they should be able to prevent back button hijacking until user has clicking a link or button.
- jchw 2mo agoSome websites like PC Gamer have some shitty middleware (that seems to be very careful to hide its identity, only appear once per session, and not immediately register on page load, probably to try to delay browsers banning the ever loving fuck out of their practices) that uses pushState to hijack the back button to try to SPAM more articles at you, probably in hopes of grabbing your attention. I would be in favor of permanently banning domains that do this even once (intentionally and not just getting hacked) from ever executing JavaScript ever again and forcing them to switch domains and lose their SEO.
- switchbak 2mo agoYeah you'd think this is something Google's stuff would detect and strongly punish, but somehow we ended up in this dystopian crapified parallel universe instead.
- vesrah 2mo agoSomehow some sites are able to get around the video autoplay, I especially notice it on news sites.
- sunaookami 2mo agoThey autoplay the video on mute which is not banned. I don't know why news websites do it, seems like wasting traffic and should cost more than the hypothetical income from video ads?
- orbital-decay 2mo agoWe should, in the alternative timeline where apps never invaded web.
- QuantumNomad_ 2mo agoMy habit of nearly always opening links to other sites in a new tab helps me avoid that annoyance for the most part. For example, if I browse HN, I open the linked article in a new tab instead of in the same one where the comments are. And I close the tab as soon as I’m done looking at it. Whether that be a couple of seconds because of annoying dark patterns, or a long time thanks to being actually readable and interesting. From that tab I might navigate to another page on the same site if the site seems good. If they then pull horse crap with the browser history in that tab I will most likely close the tab and not read anything more on that site. If I repeatedly get annoyed by a domain from having gone to it and found dark patterns I will eventually remember that the whole site is bad and stop clicking any links to it either. But mostly I don’t have to remember so many sites to actively avoid. Closing a tab is cheap when all of the history is from the same site that tab was opened for in the first place. It’s unfortunate and annoying that they get to play tricks with dark patterns still, and I wish nobody did that / could do that in the first place. In general I mean. I dont know if this particular page does it intentionally or accidentally. I usually try to not comment on it even if I do come across that. As I know many consider it off topic, and even the HN guidelines say to not comment on it [1]. But I still appreciate when others, like your comment here, point those things out and I then don’t click on to the linked article in the first place when I see comments about that unless other comments are indicating that the content itself is particularly interesting. [1]: https://news.ycombinator.com/newsguidelines.html https://news.ycombinator.com/newsguidelines.html > Please don't complain about tangential annoyances—e.g. article or website formats, name collisions, or back-button breakage. They're too common to be interesting.
- dpkirchner 2mo agoI think this rule is quite unfortunate. Wouldn't we all be better off if sites that hijacked back buttons were just banned or at least had their posts hidden until they're fixed? Sure, they're somewhat common issues, but so are ads for malware served by Google. Surely we should call those out?
- dghlsakjg 2mo agoHonestly, I feel like browsers should handle this. Sites are always going to do malicious shit. The browser should know that when I hit the back button I want to go to the place I clicked that brought me here. SPAs have severely perverted this simple idea, but I’m sure browser devs can figure it out.
- joecool1029 2mo agoThis only appeared to happen with Safari on my end. Edge and Firefox didn't appear to have the back button hijacked here. Maybe some browsers do block the behavior now? (or maybe ublock origin blocked it, I'm not sure)
- ProAm 2mo agoDon't tell us, tell them.
- fulafel 2mo agoWhat browser are you using an what does the back button do for you instead of going back?
- RantyDave 2mo agoUmmm, wow. That's really bad.
- foobar1962 2mo agoThe fit is (almost) trivial.
- bee_rider 2mo agoNice investigation. It is always surprising to me when a nice round number like 1MiB results in the “bad performance” configuration (although it happens). Are you sure erratum is the right word in this context? I usually see it used to describe the notice that a document has an error in it.
- Someone 2mo agohttps://en.wikipedia.org/wiki/Erratum#Errata_associated_with_integrated_circuits https://en.wikipedia.org/wiki/Erratum#Errata_associated_with...: “Design errors and mistakes in a microprocessor's hardwired logic may also be documented and described as errata. One well-publicized example is Intel's "FDIV" erratum in early Pentium processors, known as the Pentium FDIV bug. This gave incorrect answers to a floating-point division instruction (FDIV) for a small set of numbers, due to an incorrect lookup table inside the Pentium chip. Similarly, design errors in peripheral devices, such as disk controllers and video display units, can result in abnormal operation under certain conditions.”
- bee_rider 2mo agoThe rest of the Wikipedia page discusses errata as the documents issued to describe the errors, not the errors themselves. The section you’ve linked is… a bit weirdly written. I don’t think they meant to suggest an alternative definition there. For example the first sentence could reasonably be read as saying the bugs are being “described as errata” but I think the more likely reading (and the one that is compatible with the rest of the article) is that they were trying to say that the process of documenting and describing the bug is what’s being done “as errata.”
- jasomill 2mo agoThat's a more common use, but the article's use is supported by dictionaries as acceptable. I'd personally prefer "bug" as a matter of style.
- bee_rider 2mo agoHuh, interesting. After looking it up I guess I was wrong.
- thenewwazoo 2mo ago"Apparently the memory controller's throughput has a dominant harmonic with wavelength 2048 in tensor-dimension space." That got a laugh out of me.
- anemll 2mo agoNot all systems affected M1 and M5MAX are OK https://x.com/anemll/status/2098454204478366132?s=20 https://x.com/anemll/status/2098454204478366132?s=20
- nelsonfigueroa 2mo agoThis goes way over my head and I don't understand most of it lol. I noticed you're still in the middle of getting your B.S. degree and you're already writing things like this...amazing.
- vist_orn 2mo ago[flagged]
- ComputerGuru 2mo agoDamn bots copy and pasting a single sentence from the article as a comment.
- bee_rider 2mo agoI think that’s the poster of the link and also the person whose github it is
- deleted 2mo ago[deleted]
- vdbijl 2mo agoNice read detective
- msephton 2mo agoI guess any processes affected by this will solve this in software as time goes on?
- londons_explore 2mo agosurely someone in apple would have run some common neural net architectures through the rtl simulator before tapeout and checked that the performance meets expectations??
- imnotr0b0t 2mo agoThis is kinda nuts. Can this mostly be fixed in software, or are M3 users basically stuck unless apps work around it themselves? Going from 10 to 24 tok/s just from a workaround is a pretty crazy jump.