2 ms·
It surprises me that Tokyo Cabinet is so slow to load, as I've had great success with it on my own, but I've not used Tyrant/pytyrant. I'd love to see some inf
by daeken 17y ago
It surprises me that Tokyo Cabinet is so slow to load, as I've had great success with it on my own, but I've not used Tyrant/pytyrant. I'd love to see some information on where the bottlenecks are in the loading process, as it seems to me that there's something funky going on that can likely be improved pretty easily.
Edit: He notes in the comments that a switch to pytc (direct Tokyo Cabinet bindings rather than going through Tyrant) would improve things, but that he wanted to keep it distributed. I'd still like to see where the bottlenecks are, though.
- greendestiny 17y agoIt was probably compressed, hence the size load/time tradeoff.
- chapmanb 17y agoYes, that's right. For the test I ran the tyrant server with: ttserver test.tcb#opts=ld#bnum=1000000#lcnum=10000 d specifies a deflate encoding. The type of database may also make a difference on loading times; in this case it was a B+ tree.