3 ms·

> It usually starts with NFS, which is a big huge single point of failure. NFS is just the protocol. Whether it's a single point of failure depends on the serv

by geertj 6y ago

> It usually starts with NFS, which is a big huge single point of failure. NFS is just the protocol. Whether it's a single point of failure depends on the server-side implementation. In Amazon EFS it is not. (disclaimer: I'm a PM-T on the EFS team)

ryanmarsh 6y ago
Hi, my use case for EFS Lambda is burts of small writes. Could you add a perf mode that favors bursts of small writes? We did some perf tests and just couldn’t make it fast enough.
- tw04 6y ago
  https://www.netapp.com/cloud-services/cloud-volumes-service-aws/ https://www.netapp.com/cloud-services/cloud-volumes-service-... You could try NetApp - it's significantly faster than EFS in my experience.
  - SteveNuts 6y ago
    This solution is at least 40k per year for just the disk controllers, so be prepared for that.
    - Proven 6y ago
      The small 24 drive all flash model (dual controller) is around $20k, based on a quick google search
    - scoot 6y ago
      $100/TB/mo for the cloud version. https://aws.amazon.com/marketplace/pp/B07MF4GHYW https://aws.amazon.com/marketplace/pp/B07MF4GHYW Depending on the use-case, Veritas InfoScale might be a better option. It can aggregate different tiers of storage, and present a multi-node shared-nothing file-system, with options for replication between AZs, regions, or different cloud providers. Priced by core not capacity. https://aws.amazon.com/marketplace/pp/B07CYGD14V https://aws.amazon.com/marketplace/pp/B07CYGD14V
    - tw04 6y ago
      First off we're talking about AWS, not on-premises. Second, if we were talking on-premises, you can get into a NetApp controller for FAR less than $40k a year, but that's not really relevant to OP. There are two options in AWS: one where you get an entire virtual storage system to yourself but also need to have some NetApp expertise (although less than on-premises). You can find pricing here: https://cloud.netapp.com/pricing https://cloud.netapp.com/pricing And one where you just consume the NFS/SMB shares more akin to EFS (pricing at the bottom of the page): https://cloud.netapp.com/cloud-volumes-service-for-aws https://cloud.netapp.com/cloud-volumes-service-for-aws In both instances you can get better pricing than what is on that page by working with a partner, but if you don't want to you can buy directly through AWS and pay a slight premium.
- redis_mlc 6y ago
  Everything is throttled in AWS because of people like you, so the answer is no.
- jamesblonde 6y ago
  What's a small write in your use case? How many KBs is the write op, and how many ops/sec? We can store small files on NVMe disks in metadata, so that you can read them with a latency of just a couple of ms, and can scale to 10s of thousands of concurrent reads/writes per second with small files. https://www.logicalclocks.com/blog/millions-and-millions-of-files-for-deep-learning-with-hopsfs https://www.logicalclocks.com/blog/millions-and-millions-of-...
- geertj 6y ago
  Hi, feel free to reach out with some details on your use case at gerardu at amazon.

by geertj 6y ago

ryanmarsh 6y ago

Hi, my use case for EFS Lambda is burts of small writes. Could you add a perf mode that favors bursts of small writes? We did some perf tests and just couldn’t make it fast enough.

tw04 6y ago
https://www.netapp.com/cloud-services/cloud-volumes-service-aws/ https://www.netapp.com/cloud-services/cloud-volumes-service-... You could try NetApp - it's significantly faster than EFS in my experience.
- SteveNuts 6y ago
  This solution is at least 40k per year for just the disk controllers, so be prepared for that.
  - Proven 6y ago
    The small 24 drive all flash model (dual controller) is around $20k, based on a quick google search
  - scoot 6y ago
    $100/TB/mo for the cloud version. https://aws.amazon.com/marketplace/pp/B07MF4GHYW https://aws.amazon.com/marketplace/pp/B07MF4GHYW Depending on the use-case, Veritas InfoScale might be a better option. It can aggregate different tiers of storage, and present a multi-node shared-nothing file-system, with options for replication between AZs, regions, or different cloud providers. Priced by core not capacity. https://aws.amazon.com/marketplace/pp/B07CYGD14V https://aws.amazon.com/marketplace/pp/B07CYGD14V
  - tw04 6y ago
    First off we're talking about AWS, not on-premises. Second, if we were talking on-premises, you can get into a NetApp controller for FAR less than $40k a year, but that's not really relevant to OP. There are two options in AWS: one where you get an entire virtual storage system to yourself but also need to have some NetApp expertise (although less than on-premises). You can find pricing here: https://cloud.netapp.com/pricing https://cloud.netapp.com/pricing And one where you just consume the NFS/SMB shares more akin to EFS (pricing at the bottom of the page): https://cloud.netapp.com/cloud-volumes-service-for-aws https://cloud.netapp.com/cloud-volumes-service-for-aws In both instances you can get better pricing than what is on that page by working with a partner, but if you don't want to you can buy directly through AWS and pay a slight premium.
redis_mlc 6y ago
Everything is throttled in AWS because of people like you, so the answer is no.
jamesblonde 6y ago
What's a small write in your use case? How many KBs is the write op, and how many ops/sec? We can store small files on NVMe disks in metadata, so that you can read them with a latency of just a couple of ms, and can scale to 10s of thousands of concurrent reads/writes per second with small files. https://www.logicalclocks.com/blog/millions-and-millions-of-files-for-deep-learning-with-hopsfs https://www.logicalclocks.com/blog/millions-and-millions-of-...
geertj 6y ago
Hi, feel free to reach out with some details on your use case at gerardu at amazon.