SUPERCILEX

7 ms·

1.
by SUPERCILEX 1y ago
Fair point, though I'm not sure I agree. MPMC channels underpin pretty much every general task scheduler (take a peek inside tokio or rayon for example). And SPSCs are quite useful for designing custom pipelines. Though I agree that MP
2.
by SUPERCILEX 1y ago
As noted by other commenters, the point I was trying to get across is that the way we implement lockless channels is suboptimal and could be made faster from a theoretical standpoint. In my benchmarks[1], the average processing time for an
3.
by SUPERCILEX 1y ago
Thanks for sharing, I had not! It sounds like "processor sharing" would be the expected mode of operation for lockless queues. But see my comment to the parent, this is not how they work.
4.
by SUPERCILEX 1y ago
This is actually a great analogy because it exemplifies the misconceptions people have about lockless queues. In the example with multiple counters, in real life each counter could shout out a number and have people approach their respectiv
5.
Lockless MPSC/SPMC/MPMC queues are not queues(alexsaveau.dev)
39 points by SUPERCILEX 1y ago|31 comments
6.
The need for new instructions: atomic bit fill and drain(alexsaveau.dev)
3 points by SUPERCILEX 1y ago|0 comments
7.
by SUPERCILEX 2y ago
So you have to use probabilistic methods, makes sense thanks!
8.
by SUPERCILEX 2y ago
Thanks for the links!
9.
Ask HN: Is trusted client compute possible?
3 points by SUPERCILEX 2y ago|4 comments
10.
Show HN: A scalable clipboard manager for Linux(alexsaveau.dev)
6 points by SUPERCILEX 2y ago|1 comments
11.
by SUPERCILEX 3y ago
I made something similar a while back where you can set your own start and end time for the "day": https://alexsaveau.dev/10hrday The point was to be able to divide the day into nicely sized bites for getting stuf
12.
by SUPERCILEX 3y ago
https://alexsaveau.dev/blog Mostly about performance and project internals.
13.
by SUPERCILEX 4y ago
Except they are and your claims are trivial to disprove: simply run the benchmarks under perf. You'll find that most of the time is spent on the rwsem which is described here onwards: https://www.kernel.org/doc/htm
14.
by SUPERCILEX 4y ago
No. Run the benchmark on a tmpfs: $ hyperfine --warmup 3 -N "./test /dev/shm 8 zip" "./test /dev/shm 8 chain" Benchmark 1: ./test /dev/shm 8 zip Time (mean ± σ): 118.5 m
15.
by SUPERCILEX 4y ago
> is disk IO bottlenecked by NVMe/PCIe limits, or by disk iops limits? Note that I'm out of my depth here, so this is all speculation. Until we hit hardware limitations (which will be PCIe 6 if I had to guess), I'm pretty
16.
by SUPERCILEX 4y ago
A directory is a file like anything else that contains a map of names to inodes. If you're trying to add or remove mappings (create or delete files), then clearly some synchronization must occur or the contents of the file will contain
17.
by SUPERCILEX 4y ago
Added a small clarification: "The intuition here is that directories are a shared resource for their direct children and must therefore serialize concurrent directory-modifying operations, causing contention. In brief, file creation or
18.
by SUPERCILEX 4y ago
We're working on this! https://github.com/axboe/liburing/issues/830
19.
by SUPERCILEX 4y ago
I added a clarification to the benchmarks section: "The macOS/Windows implementations are currently equivalent to the *_rayon implementations shown in the benchmarks." Rayon is pretty good, but clearly suboptimal as evidenced
20.
The fastest rm command and one of the fastest cp commands(alexsaveau.dev)
86 points by SUPERCILEX 4y ago|81 comments
21.
A CLI app that sandboxes processes’ file operations(alexsaveau.dev)
1 points by SUPERCILEX 4y ago|0 comments
22.
First commit tests for broken behavior and then fix it(alexsaveau.dev)
3 points by SUPERCILEX 4y ago|0 comments
23.
by SUPERCILEX 4y ago
We're building a small game that runs on the web: https://supercilex.github.io/grocery_bagger_9000/
24.
by SUPERCILEX 4y ago
Ok, based on this response and others it seems like this might be something on my end... I'll look into getting a bug report to support.
25.
by SUPERCILEX 4y ago
That looks cool (especially sponsorblock), thanks for the tip!
26.
Ask HN: Has YouTube been defaulting every video to 360p for you?
2 points by SUPERCILEX 4y ago|9 comments
27.
Compacting log storage for clipboard history(alexsaveau.dev)
11 points by SUPERCILEX 5y ago|0 comments
28.
by SUPERCILEX 5y ago
The story around this project is a bit of a weird tangent. I'm working on another project (not ready to share) that uses tokio and needs to delete a bunch of files. I was surprised to discover that tokio's remove_dir_all implement
29.
Show HN: A pseudo-random directory hierarchy generator written in Rust(github.com)
1 points by SUPERCILEX 5y ago|1 comments
30.
by SUPERCILEX 5y ago
Whoops, author here. That was a mistake, I meant to say the copy_file_range syscall since that's what Rust uses by default under the hood on Linux (or copyfile on macOS). Updated the article with those corrections.

More ›