4 ms·
There are some benchmarks that show io_uring as a significant boost over aio: https://www.phoronix.com/scan.php?page=news_item&px=Linux-5.6-IO-uring-Tests https
by tyingq 7y ago
There are some benchmarks that show io_uring as a significant boost over aio: https://www.phoronix.com/scan.php?page=news_item&px=Linux-5.6-IO-uring-Tests https://www.phoronix.com/scan.php?page=news_item&px=Linux-5....
I see that nginx accepted a pull request to use it, mid last year: https://github.com/hakasenyang/openssl-patch/issues/21 https://github.com/hakasenyang/openssl-patch/issues/21
Curious if it's also been adopted by other popular IO intensive software.
- shuss 7y agoOh, yeah. QEMU 5.0 already uses io_uring. In fact, it uses liburing. Check out the changelog: https://wiki.qemu.org/ChangeLog/5.0 https://wiki.qemu.org/ChangeLog/5.0
- Twirrim 7y agoTo save people time, there's a single reference to it on the changelog: > The file-posix driver can now use the io_uring interface of Linux with aio=io_uring side note: I did note a change we built made it in to a released version of qemu: > qemu-img convert -n now understands a --target-is-zero option, which tells it that the target image is completely zero, so it does not need to be zeroed again. That's saving us so much time and I/O
- jandrewrogers 7y agoI have not adopted io_uring yet because it isn't clear that it will provide useful performance improvements over linux aio in cases where the disk I/O subsystem is already highly optimized. Where io_uring seems to show a benefit relative to linux aio is more naive software design, which adds a lot of value but is a somewhat different value proposition than has been expressed. For software that is already capable of driving storage hardware at its theoretical limit, the benefit is less immediate and offset by the requirement of having a very recent Linux kernel.
- tyingq 7y agoIf I understand the premise right, it should be fewer syscalls per IO. So even if it doesn't improve disk I/O, it might reduce CPU utilization.
- matheusmoreira 7y agoIt could also be nearly zero system calls per I/O operation. The kernel can poll the submission queue for new entries. This eliminates system call overhead at the cost of higher CPU utilization.
- jandrewrogers 7y agoThis is true, but for most intentionally optimized storage engines that syscall overhead is below the noise floor in practice, even on NVMe storage. A single core can easily drive gigabytes per second using the old Linux AIO interface. It appears to primarily be an optimization for storage that was not well-optimized to begin with. It is not obvious that it would make high-performance storage engines faster.
- shuss 7y agoFor regular files, aio works async only if they are opened in unbuffered mode. I think this is a huge limitation. io_uring on the other hand, can provide a uniform interface for all file descriptors whether they are sockets or regular files. This should be a decent win, IMO.
- wbl 7y agoAnd works is used advisedly. Certain filesystem edge conditions particularly metadata changes due to block allocation can result in blocking behavior.
- jandrewrogers 7y agoThat was kind of my point. While all of this is true, these are not material limitations for the implementation of high-performance storage engines. For example, using unbuffered file descriptors is a standard design element of databases for performance reasons that remain true. Being able to drive networking over io_uring would be a big advantage but my understanding from people using it is that part is still a bit broken.
- jra_samba 7y agoSamba can optionally use it if you explicitly load the vfs_io_uring module, but it exposed a bug for us (see my comment above). We're fixing it right now.
- frevib 7y agoEcho server benchmarks, io_uring vs epoll: https://github.com/frevib/io_uring-echo-server/blob/io-uring-op-provide-buffers/benchmarks/benchmarks.md https://github.com/frevib/io_uring-echo-server/blob/io-uring...
- tele_ski 7y agoNice, reading through the epoll implementation shouldn't it re-register to make sure the send() call won't block? Looks like it only non-blocks on the accept socket and then a single read register
- frevib 7y agoCould elaborate on “re-register”? It does not do short writes, if that’s what you mean.
- tele_ski 7y agoNormally I'd expect an epoll implementation to epoll_ctl to make sure the socket can be written to without blocking. In this benchmark it probably makes no difference but I would think it would make the results a little more inline with a real applications usage of epoll.
- frevib 7y agoThis a bare minimal echo server for educational purposes. It is not inline with a real world event loop.
- tele_ski 7y agoYeah I understand that, but if you are going for identical performance characteristics of how epoll would normally be used then I would expect it to re-register. Thats all I was getting at.