andygrove

12 ms·

61.
by andygrove 7y ago
"But claiming that "X software is written in Y language/framework" says nothing about efficiency or safety" Except for the fact that it does in some cases. Rust is definitely safer than C or C++ (unless the Rust cod
62.
by andygrove 7y ago
I admit I haven't benchmarked against COBOL blockchains.
63.
by andygrove 7y ago
Check out my previous benchmarks on Rust-based DataFusion vs JVM-based Apache Spark workloads. It isn't just about raw performance numbers but also about resource requirements (especially RAM requirements when using JVM or similar GC-b
64.
by andygrove 7y ago
This is for people who want to live in a future where we use efficient and safe system level languages for massively scalable distributed data processing. IMHO, Python and Java are not ideal language choices for these purposes. Rust offers
65.
by andygrove 7y ago
Me too. I have a JVM background for > 20 years and have been using Apache Spark for several years and while I have great respect for the engineering that has gone into Spark, I feel that they just started out with the wrong language. GC-
66.
by andygrove 7y ago
With further development, yes. It's just Docker containers. However, the current CLI is specific to Kubernetes. If you weren't using Kubernetes, what orchestrator would you be interested in?
67.
by andygrove 7y ago
Dremio is JVM based but with compilation down to LLVM and they contributed Gandiva to the Apache Arrow project. Dremio seems pretty impressive but I haven't personally used it. https://www.dremio.com/announcing-gandiva-
68.
by andygrove 7y ago
Although I know and work with some of the contributors from this project, I have no real world experience with Dask or Python data science tools in general. Thanks for the link. I will read about their Kubernetes support.
69.
by andygrove 7y ago
My goal is to kick start some things around the Rust language for data science / data analytics and projects like this help to showcase what Rust can do. See my original blog post for more context: https://andygrove.io/
70.
by andygrove 7y ago
No. Dremio is a mature product backed by a company. This is a two week old PoC right now. There could be overlap and collaboration for sure via the Apache Arrow project since Dremio are well represented there and I am an Arrow committer too
71.
Ballista: Distributed Compute with Rust, Apache Arrow, and Kubernetes(andygrove.io)
194 points by andygrove 7y ago|98 comments
72.
Looking for help with multi-threaded Rust code (Parallel query execution)(andygrove.io)
2 points by andygrove 7y ago|0 comments
73.
DataFusion (Rust Query Engine) Donated to Apache Arrow(arrow.apache.org)
16 points by andygrove 8y ago|0 comments
74.
My Dalek Needs a New Home (Denver/Boulder, CO Area)(theotherandygrove.com)
3 points by andygrove 8y ago|0 comments
75.
Apache Arrow 0.10.0 Release(arrow.apache.org)
3 points by andygrove 8y ago|0 comments
76.
Broom: sweeping out Garbage Collection from Big Data systems [pdf](usenix.org)
3 points by andygrove 8y ago|0 comments
77.
DataFusion (Rust) vs. Apache Spark – First Benchmarks(andygrove.io)
5 points by andygrove 9y ago|2 comments
78.
Ultrasonic Light Piano(ziyinzhang.com)
1 points by andygrove 9y ago|0 comments
79.
MIT-Stanford project uses LLVM to break big data bottlenecks(infoworld.com)
6 points by andygrove 9y ago|0 comments
80.
First Benchmark of DataFusion (Rust) vs. Apache Spark for a Trivial Workload(andygrove.io)
3 points by andygrove 9y ago|0 comments
81.
I’m Republican. I Appreciate Assault Weapons. And I Support a Ban(nytimes.com)
1 points by andygrove 9y ago|0 comments
82.
Be a UX Cybersecurity Hero(blog.secureset.com)
1 points by andygrove 9y ago|0 comments
83.
Polymorphism in Rust: Enum vs. Trait and Struct(keepcalmandlearnrust.com)
2 points by andygrove 10y ago|0 comments
84.
Zero-Knowledge Encryption for MySQL(agildata.com)
9 points by andygrove 10y ago|0 comments
85.
What languages would you like to replace with Rust? A just-for-fun survey(surveymonkey.com)
3 points by andygrove 10y ago|0 comments
86.
Building an Autonomous Vehicle with Rust and the Raspberry Pi(theotherandygrove.com)
3 points by andygrove 10y ago|0 comments
87.
Building a scalable MySQL proxy in Rust(agildata.com)
7 points by andygrove 10y ago|0 comments
88.
by andygrove 10y ago
Web site is down ... too much love for Rust :-) We're working on it ... check back soon!
89.
Rustconf 2016 – What was cool and what surprised me(agildata.com)
138 points by andygrove 10y ago|35 comments
90.
Implementing a Pratt parser in Rust(keepcalmandlearnrust.com)
1 points by andygrove 10y ago|0 comments

More ›