4 ms·

It doesn’t appear to be a container-orchestration tool at all. It’s a distributed OLAP database of sorts. More like a snowflake/ ClickHouse/ Trino (nee Presto)

It doesn’t appear to be a container-orchestration tool at all. It’s a distributed OLAP database of sorts. More like a snowflake/ ClickHouse/ Trino (nee Presto).

chatmasta 3y ago
I think it's more generalized distributed compute, with OLAP being one of the use cases. There are a lot of videos on YouTube if you search "Bacalhau cluster" or similar, including what appears to be their legacy channel [0] (which I saw a year ago and found very impressive) and a newer one [1], but also conference talks from other channels. I haven't been following the project, but I remember finding the original demo to be very impressive - I don't remember the details off-hand, but IPFS was somehow involved. Seems like a lot of work has taken place since then. Docs are here [2] [0] https://www.youtube.com/@bacalhau3295 https://www.youtube.com/@bacalhau3295 [1] https://www.youtube.com/@bacalhauproject https://www.youtube.com/@bacalhauproject [2] https://docs.bacalhau.org/ https://docs.bacalhau.org/
- TheIronYuppie 3y ago
  Thank you very much! Yep you nailed it - OLAP is just one of the use cases. We support LOTS of different examples [1]. We also support NON-container workloads like arbitrary exeuctors [2] and WASM [3]. Our goal is to just make it just as easy to build complicated, distributed workloads as it is with Swarm, Kubernetes, Nomad, etc, but adding in cross network reliability and queueing. Oh, one other thing - we do support IPFS [4] natively but it's optional; we also support S3 [5], local disk, etc. [1] https://docs.bacalhau.org/examples https://docs.bacalhau.org/examples [2] https://blog.bacalhau.org/p/distributed-compute-platform-bacalhau https://blog.bacalhau.org/p/distributed-compute-platform-bac... <- look for pluggable executors (it's in beta) [3] https://docs.bacalhau.org/examples/workload-onboarding/rust-wasm/#running-wasm-on-bacalhau https://docs.bacalhau.org/examples/workload-onboarding/rust-... [4] https://docs.bacalhau.org/running-node/storage-providers/#ipfs-1 https://docs.bacalhau.org/running-node/storage-providers/#ip... [5] https://docs.bacalhau.org/references/job-specification/input-source https://docs.bacalhau.org/references/job-specification/input...

It doesn’t appear to be a container-orchestration tool at all. It’s a distributed OLAP database of sorts. More like a snowflake/ ClickHouse/ Trino (nee Presto).

chatmasta 3y ago

I think it's more generalized distributed compute, with OLAP being one of the use cases. There are a lot of videos on YouTube if you search "Bacalhau cluster" or similar, including what appears to be their legacy channel [0] (which I saw a year ago and found very impressive) and a newer one [1], but also conference talks from other channels. I haven't been following the project, but I remember finding the original demo to be very impressive - I don't remember the details off-hand, but IPFS was somehow involved. Seems like a lot of work has taken place since then. Docs are here [2] [0] https://www.youtube.com/@bacalhau3295 https://www.youtube.com/@bacalhau3295 [1] https://www.youtube.com/@bacalhauproject https://www.youtube.com/@bacalhauproject [2] https://docs.bacalhau.org/ https://docs.bacalhau.org/

TheIronYuppie 3y ago
Thank you very much! Yep you nailed it - OLAP is just one of the use cases. We support LOTS of different examples [1]. We also support NON-container workloads like arbitrary exeuctors [2] and WASM [3]. Our goal is to just make it just as easy to build complicated, distributed workloads as it is with Swarm, Kubernetes, Nomad, etc, but adding in cross network reliability and queueing. Oh, one other thing - we do support IPFS [4] natively but it's optional; we also support S3 [5], local disk, etc. [1] https://docs.bacalhau.org/examples https://docs.bacalhau.org/examples [2] https://blog.bacalhau.org/p/distributed-compute-platform-bacalhau https://blog.bacalhau.org/p/distributed-compute-platform-bac... <- look for pluggable executors (it's in beta) [3] https://docs.bacalhau.org/examples/workload-onboarding/rust-wasm/#running-wasm-on-bacalhau https://docs.bacalhau.org/examples/workload-onboarding/rust-... [4] https://docs.bacalhau.org/running-node/storage-providers/#ipfs-1 https://docs.bacalhau.org/running-node/storage-providers/#ip... [5] https://docs.bacalhau.org/references/job-specification/input-source https://docs.bacalhau.org/references/job-specification/input...