4 ms·
Io_uring capable? That'd be cool. "async Io" doesn't mean a ton to me, other than hopefully not blocking. It'd be cool to have a great well integrated terminal
by jauntywundrkind 3y ago
Io_uring capable? That'd be cool.
"async Io" doesn't mean a ton to me, other than hopefully not blocking. It'd be cool to have a great well integrated terminal file manager that uses high performance io_uring.
That said, I have a hard time figuring out when & where I'd want to use terminal file managers. I like the idea, but the flexibility of the shell is so unparalleled.
- pxeger1 3y agoHow would the performance of io_uring would merit its complexity for a terminal file manager?
- ithkuil 3y agoWouldn't io_uring complexity be hidden behind the async io abstraction? Would the file manager even have to bother what underlying mechanism provides the async IO interface with the kernel? (epoll, kqueue, io_uring, etc) Are there know ways that io_uring would leak through such an abstraction?
- pxeger1 3y agoI was assuming the file manager would have to include the code for the async abstraction. But of course it could be just part of the async runtime / standard library. Still, a file manager doesn't seem like it would really need the ability to be so massively concurrent.
- remram 3y agoI'm also lost. Does it just mean that the UI stays responsive while a file copy happens in the background? It says "CPU tasks are spread across multiple threads", but what CPU tasks does a file manager perform?
- samus 3y agoAlmost every UI framework out there is single-threaded and has facilities to help offloading such tasks into the background. Usually, to a worker thread pool. It's a bit fiddly, especially in a non-managed language that doesn't protect from dumb mistakes, but it can be easily done. io_uring is for use cases where the context switch overhead of system calls starts to matter. While async I/O can be justified for U/I programming, it's safe to say that a file manager won't ever benefit from io_uring.
- sxyazi 3y agoThere is a Reddit post discussing this point: https://www.reddit.com/r/rust/comments/16fxr58/comment/k04u7z8/?context=3 https://www.reddit.com/r/rust/comments/16fxr58/comment/k04u7... > There are many scenarios that require CPU, such as image downscaling, image encoding, code highlighting, sorting large directories, etc. If you want to delve further into Yazi's inner workings, you can see https://github.com/sxyazi/yazi/issues/143 https://github.com/sxyazi/yazi/issues/143
- remram 3y agoWhat advantage does thread pool + io_uring have over just thread pool? Unless you have millions of CPU cores and therefore many downscaling/encoding/highlighting tasks starting/finishing every second, I still don't see what io_uring brings to the table. Running tasks in the background does NOT require io_uring.
- sxyazi 3y agoHey, Yazi currently is NOT using io_uring, and the link provided above explains it thoroughly, please take a careful look.
- alpaca128 3y agoThe reason I use a term file manager is because it makes some cumbersome things much smoother. With nnn I can navigate directories at least as quickly as with a mouse in a GUI, can create new directories/files by pressing just two keys, and batch rename selected files in a Vim textbuffer. Also it's useful as file browser in Vim. I don't use it for everything and I still copy/move files a lot without it. But it accelerates some things and is simple to use.
- sxyazi 3y agoHi, based on the current architecture of Yazi, I don't think it would be difficult to add io_uring to it. This is something we can consider for our future work, as it's not the current performance bottleneck. For more details: https://github.com/sxyazi/yazi/issues/143 https://github.com/sxyazi/yazi/issues/143
- samus 3y agoNice write-up! It shows that you didn't just use async for the sake of it, but that you thought about the kind of user experience that you want to have, and how async helps you to get there.