5 ms·
Did some benchmarks, not too bad. Benchmark finished! block-size: 4.0 MiB, big-object-size: 1.0 GiB, small-object-size: 128 KiB, small-objects: 100, NumThrea
by ChocolateGod 2y ago
Did some benchmarks, not too bad.
Benchmark finished! block-size: 4.0 MiB, big-object-size: 1.0 GiB, small-object-size: 128 KiB, small-objects: 100, NumThreads: 6
+--------------------+--------------------+------------------+
| ITEM | VALUE | COST |
+--------------------+--------------------+------------------+
| upload objects | 207.02 MiB/s | 115.93 ms/object |
| download objects | 405.78 MiB/s | 59.14 ms/object |
| put small objects | 278.4 objects/s | 21.55 ms/object |
| get small objects | 498.5 objects/s | 12.04 ms/object |
| list objects | 40977.06 objects/s | 14.64 ms/op |
| head objects | 1995.4 objects/s | 3.01 ms/object |
| delete objects | 312.1 objects/s | 19.22 ms/object |
| change permissions | not support | not support |
| change owner/group | not support | not support |
| update mtime | not support | not support |
+--------------------+--------------------+------------------+
Currently have a project using OVH, which is slower, but than I guess there's currently less load on Hetzner.
Benchmark finished! block-size: 4.0 MiB, big-object-size: 1.0 GiB, small-object-size: 128 KiB, small-objects: 100, NumThreads: 6
+--------------------+-------------------+------------------+
| ITEM | VALUE | COST |
+--------------------+-------------------+------------------+
| upload objects | 80.82 MiB/s | 296.94 ms/object |
| download objects | 274.61 MiB/s | 87.40 ms/object |
| put small objects | 31.6 objects/s | 189.98 ms/object |
| get small objects | 145.1 objects/s | 41.36 ms/object |
| list objects | 6293.39 objects/s | 95.34 ms/op |
| head objects | 177.7 objects/s | 33.76 ms/object |
| delete objects | 136.6 objects/s | 43.93 ms/object |
| change permissions | not support | not support |
| change owner/group | not support | not support |
| update mtime | not support | not support |
+--------------------+-------------------+------------------+
- teknopurge 2y agowhat tool are you using for this wonderful data?
- aqfamnzc 2y agoLooks like juicefs objbench. https://juicefs.com/docs/community/performance_evaluation_guide#juicefs-objbench https://juicefs.com/docs/community/performance_evaluation_gu...
- lionkor 2y agomissed opportunity to call it JuiceFS' OJBench
- rtaylorgarlock 2y agoseriously, with an opportunity like that it ABSOLUTELY does not matter if your acronym matches. They must now suffer publicly, forever, for we know where their unpoetic hearts lie.
- ChocolateGod 2y agoYes, it's juicefs objbench. Wonderful tool. Useful for figuring out where some of these cheaper S3 alternatives make their cuts.
- diggan 2y agoSearched for "Benchmark finished! block-size" and seems to be https://github.com/juicedata/juicefs?tab=readme-ov-file#performance-benchmark https://github.com/juicedata/juicefs?tab=readme-ov-file#perf...
- preisschild 2y agoWhich OVH storage class were you using? Theres a slow (io) and a fast (highperf) one.
- deleted 2y ago[deleted]
- justus_bluemer 2y agoFor comparison, here are the results for Scaleway Object Storage (https://www.scaleway.com/en/object-storage/ https://www.scaleway.com/en/object-storage/), competing offer from another european S3 provider: +--------------------+-------------------+------------------+ | ITEM | VALUE | COST | +--------------------+-------------------+------------------+ | upload objects | 16.72 MiB/s | 956.98 ms/object | | download objects | 109.01 MiB/s | 146.78 ms/object | | put small objects | 15.3 objects/s | 261.99 ms/object | | get small objects | 88.8 objects/s | 45.05 ms/object | | list objects | 6115.93 objects/s | 65.40 ms/op | | head objects | 164.3 objects/s | 24.34 ms/object | | delete objects | 157.9 objects/s | 25.33 ms/object | | change permissions | not support | not support | | change owner/group | not support | not support | | update mtime | not support | not support | +--------------------+-------------------+------------------+
- ChocolateGod 2y agoScaleway Paris is famously slow, used it before and it easily became the bottleneck of an application. Try the Amsterdam buckets.