3 ms·

Like many smart people they focused on telling people the "how", and assume visitors to their wall of "AI"/hype text already understand the use-case "why". 1.

Like many smart people they focused on telling people the "how", and assume visitors to their wall of "AI"/hype text already understand the use-case "why". 1. I like that it is written in Go 2. I saw nothing above what Apache Spark+Hadoop with _consistent_ object stores already offers on Amazon (S3), Google Cloud (GCS), and or Microsoft (Azure Storage, ADLS Gen2) Best of luck, maybe folks should look around for that https://donate.apache.org/ https://donate.apache.org/ button before the tax year concludes =3

PunchyHamster 11mo ago
> I saw nothing above what Apache Spark+Hadoop with _consistent_ object stores already offers on Amazon (S3), Google Cloud (GCS), and or Microsoft (Azure Storage, ADLS Gen2) it was very simple to setup, and even if you just leased a bunch of servers off say OVH, far FAR cheaper to run your own than paying any of the big cloud providers. It also had pretty low requirements, ceph can do all that but setup is more complex and RAM requirements far, far higher
- Joel_Mckay 11mo ago
  MinIO still makes no sense, as Ceph is fundamentally already RADOS at its core (fully compatible with S3 API.) For a proper Ceph setup, even the 45drives budget configuration is still not "hobby" grade. I will have to dive into the MinIO manual at some point, as the value proposition still seems like a mystery. Cheers =3
  - dardeaup 11mo ago
    "Ceph is fundamentally already RADOS at its core (fully compatible with S3 API.)" Yes, Ceph is RADOS at its core. However, RADOS != S3. Ceph provides an S3 compatible backend with the RADOS Gateway (RGW).
    - Joel_Mckay 11mo ago
      My point was even 45drives virtualization of Ceph host roles to squeeze the entire setup into a single box was not a "hobby" grade project. I don't understand yet exactly what MinIO would add on top of that to make it relevant at any scale. I'll peruse the manual on the weekend, because their main site was not helpful. Thanks for trying though ¯\_(ツ)_/¯
      - dardeaup 11mo ago
        What I tried to say (perhaps not successfully) was that core Ceph knows nothing about S3. One gets S3 endpoint capability from the radosgw which is not a required component in a ceph cluster.
        Joel_Mckay 11mo ago
        The risk with mixing different subjects per thread. Cheers =3 https://docs.ceph.com/en/latest/radosgw/s3/ https://docs.ceph.com/en/latest/radosgw/s3/
  - PunchyHamster 11mo ago
    MinIO is far less complex than getting same functionality on Ceph stack. But that's kind of advantage only on the small companies and hobbyist market, big company either have enough needs to run big ceph cluster, or to buy it as a service. Minio is literally "point it at storage(s), done". And at far smaller RAM usage. Ceph is mon servers, osd servers, then rados gatway server on top of that.
    - Joel_Mckay 11mo ago
      It sounds a lot like SwiftOnFile with GlusterFS, but I would need to look at it more closely on personal time. =3

PunchyHamster 11mo ago

> I saw nothing above what Apache Spark+Hadoop with _consistent_ object stores already offers on Amazon (S3), Google Cloud (GCS), and or Microsoft (Azure Storage, ADLS Gen2) it was very simple to setup, and even if you just leased a bunch of servers off say OVH, far FAR cheaper to run your own than paying any of the big cloud providers. It also had pretty low requirements, ceph can do all that but setup is more complex and RAM requirements far, far higher

Joel_Mckay 11mo ago
MinIO still makes no sense, as Ceph is fundamentally already RADOS at its core (fully compatible with S3 API.) For a proper Ceph setup, even the 45drives budget configuration is still not "hobby" grade. I will have to dive into the MinIO manual at some point, as the value proposition still seems like a mystery. Cheers =3
- dardeaup 11mo ago
  "Ceph is fundamentally already RADOS at its core (fully compatible with S3 API.)" Yes, Ceph is RADOS at its core. However, RADOS != S3. Ceph provides an S3 compatible backend with the RADOS Gateway (RGW).
  - Joel_Mckay 11mo ago
    My point was even 45drives virtualization of Ceph host roles to squeeze the entire setup into a single box was not a "hobby" grade project. I don't understand yet exactly what MinIO would add on top of that to make it relevant at any scale. I'll peruse the manual on the weekend, because their main site was not helpful. Thanks for trying though ¯\_(ツ)_/¯
    - dardeaup 11mo ago
      What I tried to say (perhaps not successfully) was that core Ceph knows nothing about S3. One gets S3 endpoint capability from the radosgw which is not a required component in a ceph cluster.
      - Joel_Mckay 11mo ago
        The risk with mixing different subjects per thread. Cheers =3 https://docs.ceph.com/en/latest/radosgw/s3/ https://docs.ceph.com/en/latest/radosgw/s3/
- PunchyHamster 11mo ago
  MinIO is far less complex than getting same functionality on Ceph stack. But that's kind of advantage only on the small companies and hobbyist market, big company either have enough needs to run big ceph cluster, or to buy it as a service. Minio is literally "point it at storage(s), done". And at far smaller RAM usage. Ceph is mon servers, osd servers, then rados gatway server on top of that.
  - Joel_Mckay 11mo ago
    It sounds a lot like SwiftOnFile with GlusterFS, but I would need to look at it more closely on personal time. =3