4 ms·

I built one recently. We have a SQLite VFS built on top of Zookeeper for doing metadata-like stuff. We can pull between 1000-100000 reads per seconds out of it.

by sargun 11y ago

I built one recently. We have a SQLite VFS built on top of Zookeeper for doing metadata-like stuff. We can pull between 1000-100000 reads per seconds out of it. I realize that this is a total abuse of what Zookeeper does, and how it is supposed to work, but hey, this is a solution that's _simple_ and _correct_. Here are the benchmarks comparing the traditional VFS with the ZK VFS: https://gist.github.com/sargun/7503ba636c1a0eb2e2f5cda7a6a23db2 https://gist.github.com/sargun/7503ba636c1a0eb2e2f5cda7a6a23... PS: Feel free to ask me any questions

otoolep 11y ago
Pretty interesting. Do you have source code you can share?
- sargun 11y ago
  Not yet open source, and it probably wont be for a while, given it's in $EMPLOYER's proprietary product.
tyingq 11y ago
That's the sort of thing I was interested in. Did you split the data up into kv pairs somewhat like this shim: http://www.sqlite.org/src/doc/trunk/src/test_multiplex.c http://www.sqlite.org/src/doc/trunk/src/test_multiplex.c ? Or is just a small database where 1 sqlite file == 1 key?