jaz46

24 ms·

151.
by jaz46 8y ago
Pachyderm --San Francisco -- Onsite only -- jobs@pachyderm.io Love Docker, Golang, and distributed systems? Pachyderm is an enterprise data science platform. Teams that find themselves struggling to maintain a growing mess of advance data s
152.
Pachyderm, enterprise data pipelining, is hiring our first sales role
1 points by jaz46 9y ago
153.
Pachyderm is hiring for our first Sales/Business role (SF)
1 points by jaz46 9y ago
154.
Pachyderm (YC W15) is hiring our first Sales/BD role (SF)
1 points by jaz46 9y ago
155.
by jaz46 9y ago
The answer is to use Docker to configure your data analysis runtime environment, but not actually your data. Especially since we're often dealing with large datasets, sticking with a simple storage solution like S3 works pretty well.
156.
by jaz46 9y ago
Pachyderm (my company) offers versioning large data sets in a similar fashion to git without having to deal with gitLFS. Pachyderm isn't Git under the hood, but we borrow some of the major concepts -- repos as versions data sets, commi
157.
by jaz46 9y ago
Deploying Pachyderm on-prem is very similar to deployment on a cloud provider, you just need Kubernetes and an object store. The challenging part in my experience is getting an on-prem Kubernetes cluster, but this is well-tested territory f
158.
by jaz46 9y ago
Have you checked out Pachyderm (disclaimer: my company) for data pipelining on Kubernetes? Our product has been available since the first Kubernetes release and is specifically designed for data analysis and pipelining tasks on Kubernetes.
159.
by jaz46 9y ago
Pachyderm (github.com/pachyderm/pachyderm) combines model versioning with data pipelining. It's basically Domino meets Luigi/Airflow. Pachyderm.io (I'm one of the founders)
160.
by jaz46 9y ago
This is hilarious! We did a similar project last year using the scripts from the show. http://docs.pachyderm.io/en/latest/examples/tensor_flow/read... Ours was not nearly as comprehensible, but still fu
161.
by jaz46 9y ago
Hi, I'm one of the creators of Pachyderm. We've been talking with the Quilt founders about various ways to work together and think there are some really exciting opportunities!
162.
by jaz46 9y ago
Pachyderm (github.com/pachyderm/pachyderm) is a great "medium data" tool. I'm biased of course because I'm one of the creators, but we build in data pipelining, data versioning, and you can use whatever languag
163.
by jaz46 9y ago
Kubernetes is actually getting a solid amount of large-tech and early adopter enterprise deployment. That's still pretty nascent, but it's picking up quickly. Happy to discuss in more details offline the adoption we're seeing
164.
by jaz46 9y ago
>It also strikes me that a lot of these problems in dissemination have been solved to a large degree in software development. Yeah, this is exactly how we feel too! Git solves this so well for software development which is why Pachyderm
165.
by jaz46 9y ago
You should also check out Pachyderm, github.com/pachyderm/pachyderm. Pachyderm builds provenance tracking directly into your data so every results has provenance through every bit of data and code that was used to create it.
166.
by jaz46 10y ago
Pachyderm (YC W15) -- San Francisco -- Onsite only -- jobs@pachyderm.io http://github.com/pachyderm/pachyderm https://medium.com/pachyderm-data/lets-build-a-modern-hadoop... What would data analyt
167.
by jaz46 10y ago
+1. Hats off to GitLab for being awesome!
168.
by jaz46 10y ago
So who's team-member-1 for the Amazon s3 outage a few weeks back? I'm sure they feel the same way and we'd love to send them gifts to support them just like the community supported GitLab.
169.
by jaz46 10y ago
Distributed Systems Engineer -- Pachyderm -- San Francisco -- Onsite only -- jobs@pachyderm.io http://github.com/pachyderm/pachyderm https://medium.com/pachyderm-data/lets-build-a-modern-hadoop...
170.
by jaz46 10y ago
Definitely agree that that is one of the great points with Luigi. Airflow's UI of course blows everything out of the water IMO. As for organizing your data, my personal and very biased opinion is that version control semantics similar
171.
by jaz46 10y ago
Does the other tool you're talking about that works with Airflow allow you to scale your Airflow tasks based on, for example, the amount of new input data that needs to be processed? That was one of the major challenges we see in bioin
172.
by jaz46 10y ago
One of the important paradigms that I think Luigi and Airflow miss is that they treat pipelines as a DAG of tasks, when it really should be thought of as a DAG of Data. It's a subtle difference, but has huge impacts when you're tr
173.
by jaz46 10y ago
Pachyderm -- San Francisco -- Onsite only -- jobs@pachyderm.io Core distributed systems/infrastructure engineer (Golang, Docker, Kubernetes) -- experience with any systems language is fine even if you don't know Go yet. Check out
174.
by jaz46 10y ago
I'm the guy from RethinkDB who found and hired Jeroen! I will say it's pretty rare, but when searching for a very particular skill set "Who wants to be hired" can totally work for finding new to mid-level devs.
175.
by jaz46 10y ago
Pachyderm --San Francisco -- Onsite only -- jobs@pachyderm.io Love Docker, Golang, and distributed systems? Check out http://pachyderm.io/jobs.html to see all positions and more detailed descriptions. http://gith
176.
by jaz46 10y ago
Pachyderm -- San Francisco -- Onsite only -- jobs@pachyderm.io Love Docker, Golang, data science and distributed systems? Check out http://pachyderm.io/jobs.html to see all positions and more detailed descriptions. http:&#
177.
Pachyderm: Love Golang, Docker and Distributed Systems
1 points by jaz46 10y ago
178.
Git for Data Science: Pachyderm Hits v1.2(medium.com)
2 points by jaz46 10y ago|0 comments
179.
by jaz46 10y ago
I think he just wants to encourage people to buy some of the logos quickly while the the prices are cheap. Forces immediate action instead of waiting and thinking about it. I doubt there's any expectation that he'll sell all or ev
180.
by jaz46 10y ago
Anyone else read this and think that those "moon landing was fake" conspiracy theorists are loving this finding? "Of course the moon rocks are indistinguishable -- they're not actually from the Moon!" Edit: I'm

More ›