3 ms·
PipesFS: Fast Linux I/O in the Unix Tradition (2008)
- navaati 8y agoThis is probably very interesting but I would need to pay for access to the article...
- htor 8y agoooh, this sounds wicked cool! unix pipelines and unix tools is what made me like computers.
- amckinlay 8y agoStill wish the Linux kernel had zero-copy IPC with pipes. vmsplice(1) can zero-copy data into the pipe, but the destination process cannot vmsplice(1) the data out of the pipe without incurring a copy.
- en4bz 8y agoModifying virtual mappings tends to be just as expensive as copying.
- voidlogic 8y agoI'd be curious to see if this is still true with large page sizes and to see on current processors where the cross over point is.
- gpderetta 8y agoI've never tried it, but shouldn't you be able to vmsplice into the pipe, splice from pipe to an actual file and mmap the file? Probably the cost of the additional splice call offsets the saved copy. It is possible to implement a simple shared memory queue which does not requires syscalls unless empty or full, and the time saved avoiding system calls (and expensive VM manipulation) might be more than the cost of copying data in and out for many applications.
- LukeShu 8y agoThe paper mentions that the source code is available at netstreamline.net, which is now a spam domain. Here's the most recent IA link: https://web.archive.org/web/20130624173559/http://netstreamline.org/ https://web.archive.org/web/20130624173559/http://netstreaml... If the topic of the paper is interesting to you, you will likely be interested in other parts of the Streamline project.
- justinjlynn 8y agoLooks like it's been re-hosted to university services: https://www.cs.vu.nl/~herbertb/projects/streamline/index.html https://www.cs.vu.nl/~herbertb/projects/streamline/index.htm... Unfortunately, it appears that the institution's internal project hosting system (that would hold the source code I'm after) is down -- I suppose an e-mail to the department would be in order.
- deleted 8y ago[deleted]
- guilt 8y agoLove it. I'd opt for a no-copy framework any time of the day.