3 ms·
Disclosure: I work for AWS Off-the-shelf Cassandra has a fair amount of flexibility in its architecture. Open Source Cassandra is the thing that is in the fro
by _msw_ 7y ago
Disclosure: I work for AWS
Off-the-shelf Cassandra has a fair amount of flexibility in its architecture. Open Source Cassandra is the thing that is in the front end. And the team is excited about the idea of collaborating with the development community around some of the generally useful abstractions needed to build this managed database experience. More at https://aws.amazon.com/blogs/opensource/contributing-cassandra-community/ https://aws.amazon.com/blogs/opensource/contributing-cassand...
- enitihas 7y agoIf you don't mind, can you please elaborate about the backend too.
- sg47 7y agoHas Amazon ever contributed anything meaningful back to open source?
- manigandham 7y agoQuite a lot: https://aws.amazon.com/opensource/ https://aws.amazon.com/opensource/
- sg47 7y agoDo you have a list of open source committees accessible somewhere?
- manigandham 7y agoWhat do you mean by committees?
- sg47 7y agoSorry, I meant committers. I'm asking since the link you posted talks about open source events and has some job postings. I was looking for actual contributions by Amazon employees.
- manigandham 7y agoThere's far more listed there including entire projects, repos, videos and several blog posts detailing their contributions, including one describing what they're doing for Cassandra: https://aws.amazon.com/blogs/opensource/contributing-cassandra-community/ https://aws.amazon.com/blogs/opensource/contributing-cassand... Amazon, Microsoft, Google, Oracle, IBM and others are all major contributors to open-source software.
- sg47 7y agoLet me give you an example. "Amazon EMR has been adding Spark runtime improvements since EMR 5.24, and discussed them in Optimizing Spark Performance. EMR 5.28 features several new improvements." Have these improvements been contributed back to Spark? When I take a look at the improvements themselves, it looks like all Amazon did was upgrade Spark from 2.3 to 2.4.
- manigandham 7y agoThis seems completely random. EMR isn't an open-source project, it's a proprietary offering. The page I linked lists plenty of projects if you're looking for actual OSS work.
- sg47 7y agoEMR isn't open source but Spark is. What does the EMR Spark Runtime if not offer Spark as a service? And the changes to optimize spark runtime, why were they not contributed back to upstream Spark?
- manigandham 7y agoI'm sure some changes are upstreamed (assuming they're even accepted) but there's no requirement for them to do so. Again this seems like a random example. What is so important about this particular change over all the other open-source contributions?
- sg47 7y agoThis is just an example. I'm sure there are many others. The developers that take the time to contribute to Spark are making Spark a better product. Amazon is not making it better. Amazon should not claim they made improvements to Spark in a newer version. What they did was upgrade Spark to 2.4 and claim that the improvements were done by them whereas in reality they were done by the community.
- 7y ago
- jtoberon 7y agoDisclosure: I work at AWS. Here are some examples from my team’s 2019 work: We contributed numerous changes to containerd. We open sourced firecracker-containerd, and we also created a Go SDK that others are using to work with Firecracker. We contributed to Debian and the Debian kernel team. We contributed to Envoy. We collaborated with a number of communities, including Kata Containers, Red Hat’s Clair, and the Open Container Initiative. All of these examples are sustained investments, not one offs.
- sg47 7y agoSure, it's contributed where it's convenient. I still don't see a list of committers so that I can look at what those contributions were.