5 ms·

Now that we're talking about B2, has or is anyone using them for latency-sensitive small-file object storage? I'm about to take the plunge and set up benchmarks

by heipei 6y ago

Now that we're talking about B2, has or is anyone using them for latency-sensitive small-file object storage? I'm about to take the plunge and set up benchmarks, my use-case is that I want to store and serve ~ 500k small files (30b-1MB) per day to website visitors. So far B2 support has told me that it shouldn't be a problem, and early benchmarking indicates the same, just curious if anyone had stories from the trenches.

willcodeforfoo 6y ago
We use B2 to store images on Vintage Aerial (https://vintageaerial.com https://vintageaerial.com), both high res scans and all kinds of thumbnail sizes. It is... a little slower than I'd like but with Cloudfront in front it has been manageable. I love tips from Backblaze on how to increase performance there beyond caching to CF.
- heipei 6y ago
  Can you go into detail what you mean by "slower than I'd like"? Are you talking about TTFB (Time-To-First-Byte) or sustained read or concurrent read performance? Are you using the API or the HTTP endpoints from a public bucket?
- qeternity 6y ago
  CloudFront or Cloudflare?
haywirez 6y ago
I'm seeing horrible TTFB from Europe. Most files are fast but sometimes a request is stuck for 10s or more...
- heipei 6y ago
  Is that to their US datacenter or the European (Amsterdam) one? So far the European one has been pretty snappy for me, ping is ~20ms from my home ISP (Germany) and TTFB is good enough that I can instantly saturate my 300MBit home ISP line with concurrency of ~ 500 downloading small objects (5b-1MB), but I haven't looked at min/max/avg/median yet. BIG gotcha btw: You have to choose between US and EU when you create your B2 account! You can't have buckets in the other location, so that means you'll need two accounts if you want to do that.
  - budmang 6y ago
    (backblaze ceo here) Just fyi, you can put both accounts into a single Group for easier management: https://help.backblaze.com/hc/en-us/articles/115000014914 https://help.backblaze.com/hc/en-us/articles/115000014914
ing33k 6y ago
It usually works , but we have had some issues with high loads, please check my other reply in this thread.

by heipei 6y ago

willcodeforfoo 6y ago

We use B2 to store images on Vintage Aerial (https://vintageaerial.com https://vintageaerial.com), both high res scans and all kinds of thumbnail sizes. It is... a little slower than I'd like but with Cloudfront in front it has been manageable. I love tips from Backblaze on how to increase performance there beyond caching to CF.

heipei 6y ago
Can you go into detail what you mean by "slower than I'd like"? Are you talking about TTFB (Time-To-First-Byte) or sustained read or concurrent read performance? Are you using the API or the HTTP endpoints from a public bucket?
qeternity 6y ago
CloudFront or Cloudflare?

haywirez 6y ago

I'm seeing horrible TTFB from Europe. Most files are fast but sometimes a request is stuck for 10s or more...

heipei 6y ago
Is that to their US datacenter or the European (Amsterdam) one? So far the European one has been pretty snappy for me, ping is ~20ms from my home ISP (Germany) and TTFB is good enough that I can instantly saturate my 300MBit home ISP line with concurrency of ~ 500 downloading small objects (5b-1MB), but I haven't looked at min/max/avg/median yet. BIG gotcha btw: You have to choose between US and EU when you create your B2 account! You can't have buckets in the other location, so that means you'll need two accounts if you want to do that.
- budmang 6y ago
  (backblaze ceo here) Just fyi, you can put both accounts into a single Group for easier management: https://help.backblaze.com/hc/en-us/articles/115000014914 https://help.backblaze.com/hc/en-us/articles/115000014914

ing33k 6y ago

It usually works , but we have had some issues with high loads, please check my other reply in this thread.