marginalia_nu

6 ms·

31.
by marginalia_nu 1mo ago
Where pooling does sometimes win is for stuff like intermediate buffers for compression or decompression, since a Java alloc will zero the memory, which for sufficiently large buffers is much costlier than the allocation itself, and in such
32.
by marginalia_nu 1mo ago
Object pooling still has its place, but like any optimization it needs to be based on benchmarks and shouldn't be done haphazardly. Blindly pooling objects will lead to regressions and resource contention more often than improvements.
33.
by marginalia_nu 1mo ago
The entire industry runs on IOUs for compute and bills paid in cloud credits, could be anywhere. Could of course also be a a plain old DDoS.
34.
by marginalia_nu 1mo ago
Birds of the air, lilies of the field, and so on.
35.
by marginalia_nu 1mo ago
NG Resonance from Deus Ex II is arguably an even more on-point comparison.
36.
by marginalia_nu 1mo ago
Both are pretty good, but if you go into the former expecting the latter, you're in for a disappointment. The former is best enjoyed as a separate experience.
37.
by marginalia_nu 1mo ago
??? The only configuration that will allow disk reads at 10 GB/s is if you're using PCIe 5.0. PCIe 4.0 or lower, and SATA will not drop out long before that. He's very clearly hauling data straight from the page cache.
38.
by marginalia_nu 1mo ago
If you send people to the optimal website containing exactly the information they are after, then you get fewer ad impressions than if you send them to a suboptimal website that has them going back and clicking on more links.
39.
by marginalia_nu 1mo ago
It does seem rather impactful. I've seen an extremely aggressive uptick in API key requests and sales that I'm not sure where it's coming from. Like it's up 5x over the summer. Been a bit confused about this since I do
40.
by marginalia_nu 1mo ago
Hard to conclusively beat spam when your primary means of making money is selling the very ads that the spammers are using to make money.
41.
by marginalia_nu 1mo ago
It doesn't have to, but shifting the y-axis to exaggerate differences is like the most textbook example of deception in statistics. In that sense, if you want your work to be taken seriously, especially when it purports to be more a
42.
by marginalia_nu 1mo ago
The races, as seen in american sociology have a socioeconomic and historical reality which makes them interesting to track regardless. The racial segregation laws of the past were real, and this has had consequences that are still very rea
43.
by marginalia_nu 1mo ago
Why is the y-axis not starting at 0% for all measures? Seems like they're attempting to exaggerate the race and gender differences, even though they'd be perfectly obvious even with a fair graph. Real credibility own-goal, espec
44.
by marginalia_nu 1mo ago
DBMS workloads aren't asynchronous like that though. There generally isn't anything you can do while you wait for the buffer pool to execute a read, since what you want to do next depends on the data being read.
45.
by marginalia_nu 1mo ago
Yes that is correct. You can look at 'rrqm/s' and '%rrqm' in `iostat -x` to get statistics for how many requests are merged, and `rareq-sz` for the average request size.
46.
by marginalia_nu 1mo ago
io_uring is significantly faster for certain workloads, but you can't expect that merely running a syscall via io_uring will somehow magically make it faster. Replacing single sycalls with their equivalents in io_uring is generally slo
47.
by marginalia_nu 1mo ago
If you submit 16 contiguous read requests the system will just merge them into one large read request. Modern SSDs tolerate moderate queue depths very well, but piling on the I/O queue also incurs tail latency jitter unless you're
48.
by marginalia_nu 1mo ago
Though at that point you can just use FADV_WILLNEED.
49.
by marginalia_nu 1mo ago
Depends a lot on the memory pressure. If you can be fairly certain the data is (or will be) resident in memory, mmap is basically unbeatable. If you can't (because the data is larger than RAM or there's other stuff competing for
50.
by marginalia_nu 1mo ago
So I have a buffer pool with O_DIRECT reads. I implement read-ahead in the application by (optionally) preadv:ing a single read into multiple destination buffers in the pool, leaving them unpinned, since as long as you aren't up agains
51.
by marginalia_nu 1mo ago
If you're doing contiguous readahead in userspace, why not just use preadv? It'll limit you to doing readahead up until the next resident page, but at least in my experiments in Marginalia's index, preadv beats io_uring in a
52.
by marginalia_nu 1mo ago
We've laid claim to one of Jupiter's moons though.
53.
by marginalia_nu 1mo ago
No I think this is the same case. It seems to just be following local links on the SERP. From a search for jack parsons, you can find hyperlinks to the sorts of requests it's making.
54.
by marginalia_nu 1mo ago
It's very likely the last few years of bot behavior is the consequence of the residential proxy business booming. This is indirectly due to AI company crawling, but the fact that they are as cheap and available as they are changes the
55.
by marginalia_nu 1mo ago
FWIW, git hosts have always interacted very poorly with crawlers, to the point where you have to actively code in git host detection to avoid getting stuck in an accidental crawler trap if you want to run a well behaved crawler. Easiest is
56.
by marginalia_nu 1mo ago
I've had a fair bit of success with increasing the bot mitigation based on a global rate limit. During periods of high request rates, I throw progressively more hurdles at the bots, and during periods of low request rates I disable th
57.
by marginalia_nu 1mo ago
Yeah my search engine saw traffic of up to 160 queries per second the other day from some bot that was ostensibly searching for information on Jack Parsons. Just variations on the same query in different permutations of filters and site:-t
58.
by marginalia_nu 2mo ago
I think the biggest claudism is adjectiveing nouns. "Foo is byte-identical to bar" is weird. "Foo has an identical byte representation to bar" is I think closer to what most humans would write. AI in general, both visual
59.
by marginalia_nu 2mo ago
Isn't that just programming terminology? Here it's used in 2016: https://internals.rust-lang.org/t/random-thought-of-the-day-...
60.
by marginalia_nu 2mo ago
It's always been pretty common in programming discussions. Here's a blog post I wrote in 2021 that uses the term shape to describe an algorithm: https://www.marginalia.nu/log/40-wasted-resources/ And aga

More ›