huntaub

9 ms·

1. 91.▲
   by huntaub 2y ago

   > What is then your initial latency if i start an AI job 'fresh'? You still need to hit the backend right? How long do you then keep this data in your cache? That's correct, and it's something that we can tune if ther
2. 92.▲
   by huntaub 2y ago

   Thanks for the feedback. If price is the single blocker for teams to try the product, I'd love to discuss more. Please send me an email at hleath [at] regattastorage.com. > If i'm on one cloud provider, the traffic between thei
3. 93.▲
   by huntaub 2y ago

   I know that I've answered this question a couple times in the thread, so I don't know if my words add extra value here. But, I agree that it would be interesting to hear what Davies is thinking.
4. 94.▲
   by huntaub 2y ago

   Well, I think this is the benefit that our customers are looking for. They aren’t interested in becoming storage administrators, and running Regatta as a service allows them to not. There are, of course, other teams who do want to do that.
5. 95.▲
   by huntaub 2y ago

   We don’t actually, but thanks for pointing that out!
6. 96.▲
   by huntaub 2y ago

   That’s correct — you pay for the storage yourself in S3, and then you pay for the storage when it’s in the Regatta cache. We may expose the ability to limit the cache size in the future for teams who need controllable costs more than the hi
7. 97.▲
   by huntaub 2y ago

   This is actually also interesting, in that I don’t think that the file system paradigm actually requires a global total ordering of operations (and, in fact, many file systems don’t provide this). I know that sounds like snapshots wouldn’
8. 98.▲
   by huntaub 2y ago

   I think we’re moving in that direction. I’m really interested to do more in the API space than traditional storage has allowed. Tell me a bit more what you mean by “transactional file system”?
9. 99.▲
   by huntaub 2y ago

   This is super dependent on the application, and not something that I could answer without being an expert in SQLite. If SQLite only allows a single reader or writer, then yes. This could still be a good choice for applications which elect a
10. 100.▲
    by huntaub 2y ago

    I think it depends which part of the public sector! AWS GovCloud is not airgapped, but I certainly know of deployments which are.
11. 101.▲
    by huntaub 2y ago

    All data cached in Regatta is also encrypted with AES-256 Re: bring your own compute: It’s certainly something we’re thinking about. We are in discussions with a lot of customers running GPU clusters with orphaned NVMe resources that they
12. 102.▲
    by huntaub 2y ago

    Ah, yes — there are some specific file locking concerns with NFSv3 (notably that locks aren’t built as leases like in NFSv4). Let me do a double click here, but I know we will be able to support locks correctly with our custom protocol when
13. 103.▲
    by huntaub 2y ago

    All connected file system clients see read-after-write consistency, so you see the up to date file data!
14. 104.▲
    by huntaub 2y ago

    Hey there! Today, we are replicating cache data within a single availability zone, but we’re working on a multi-availability zone product. If you have a need for multi-AZ, please shoot me an email at hleath [at] regattastorage.com, I’d love
15. 105.▲
    by huntaub 2y ago

    That would be my expectation, you need something in the middle to actually broker the file locks.
16. 106.▲
    by huntaub 2y ago

    Great to hear from you, I think cunoFS is doing a lot of things right! It’s certainly a fun problem space!
17. 107.▲
    by huntaub 2y ago

    Without getting too much into internals which could change at any time, yes. You have to replicate, partition, and serve consensus over data to achieve high-durability and availability. For concurrent updates, the standard practice for remo
18. 108.▲
    by huntaub 2y ago

    Hey, thanks for reaching out. The caching layer does return success before writing to S3 -- that's how we get good performance for all operations, including those which aren't possible to do in S3 efficiently (such as random write
19. 109.▲
    by huntaub 2y ago

    Wow, thanks for coming out! I hope that you're heartened to see the number of people who immediately think of JuiceFS when they see our launch. I totally agree with you, storage is such an interesting space to work in, and I'm exc
20. 110.▲
    by huntaub 2y ago

    Thanks for the question. Full disclosure, I'm grabbing this response from another comment: I have mutual friends with some of the Nasuni folks, and I have a lot of respect for what they do. In particular, Nasuni stores data in a propri
21. 111.▲
    by huntaub 2y ago

    We choose NFS purely because it's the fastest way to get broad compatibility with most operating systems (NFSv3, for example is supported on both Linux and Windows). However, I have great news for you! We're simultaneously working
22. 112.▲
    by huntaub 2y ago

    Hey, thanks for the question. From what I can tell (and this could be wrong), but it looks like s3ql is using S3 as a block layer. Regatta, on the other hand, allows you to read and write files in their native format. I agree that it's
23. 113.▲
    by huntaub 2y ago

    Hey there, thanks for your note. I think that the answer here (as with all good questions) is "it depends". I agree with you, Object Storage accels at making the storage interface super simple to use (POSIX is incredibly complex).
24. 114.▲
    by huntaub 2y ago

    Thanks for your note! We're really hopeful that our "local-like performance" is part of the story that distinguishes us from other file system solutions. I envision a world where people don't have to overprovision block
25. 115.▲
    by huntaub 2y ago

    Thank you! We have docs at https://docs.regattastorage.com . There is an architecture page which might answer your questions. If you have deeper questions, feel free to ask in the thread or shoot me an email at hleath [at] regatt
26. 116.▲
    by huntaub 2y ago

    Yes! I don't know of any reason why that wouldn't work. I've worked with lots of customers who need simple, low-cost storage for database backups.
27. 117.▲
    by huntaub 2y ago

    Thanks for the note, great to hear from you! I think that what Clickhouse does is great, and I expect that more applications want to take advantage of the low prices of S3 cold storage without needing to build their own application-level ab
28. 118.▲
    by huntaub 2y ago

    I don't think that I'm planning support for Android, did I mistakingly mention it somewhere?
29. 119.▲
    by huntaub 2y ago

    It is! Let me share some details in differences that I’ve posted elsewhere: It's similar to JuiceFS, but JuiceFS writes and reads data from S3 in a proprietary block format. This means that you cannot connect JuiceFS to existing data s
30. 120.▲
    by huntaub 2y ago

    Thank you! That’s exactly my hope! How can we make these technologies as easy as possible for teams to use so that they can build the best <training> <analysis> or whatever applications without becoming storage experts.