4 ms·
We use a similar approach with TrailDB. You can make S3 access totally seamless with user-space page fault handling, which is pretty cool: http://tech.adroll.co
by vtuulos 9y ago
We use a similar approach with TrailDB. You can make S3 access totally seamless with user-space page fault handling, which is pretty cool: http://tech.adroll.com/blog/data/2016/11/29/traildb-mmap-s3.html http://tech.adroll.com/blog/data/2016/11/29/traildb-mmap-s3....
- sajal83 9y agoThis is pretty cool. Do you invalidate all pages if the file changes upstream on S3?
- vtuulos 9y agoIn our case all blobs in S3 are immutable, so no need to invalidate anything.
- rakoo 9y agoNext level, same idea but with SQLite: https://github.com/lmatteis/torrent-net https://github.com/lmatteis/torrent-net