3 ms·
I am delighted by this. I tried hadoop in past and found it quite complex with badly designed APIs which changed drastically between ver 1.x and 2.x. I see Hado
by geodel 11y ago
I am delighted by this. I tried hadoop in past and found it quite complex with badly designed APIs which changed drastically between ver 1.x and 2.x. I see Hadoop as a manifestation of Java culture: big, complex, memory hog.
Since Pachyderm is written in Go I hope it promotes a Go culture: Simple, consistent and not a resource hog.
- jdoliner 11y agoI'm happy you're delighted! I agree very strongly with what you've written here too. I think it's unavoidable that programs wind up taking on some of the cultural qualities of the language that they're written. It's a very interesting phenomenon that I could probably talk about at length... but I digress. This was a very conscious part of our decision to use Go. Its simplicity, consistency and reasonable resource requirements have been hugely influential, but the biggest one has been its pragmatism. Go is laser focussed on actually getting things done, and the most prominent things written in it clearly have taken on this ethos, etcd, Docker, Kubernetes to name a few. All are relatively new tools with alternatives written in other languages that have existed for a while. But they've all found use because of how well they've embrace this ethos and how appealing tools like that are to people. We use those tools internally and have very much tried to make Pachyderm fit in with the ethos as well.