4 ms·
AdRoll has done some very cool stuff using containers for data processing. Afaik they were some of the first people to use this approach, and I think it's worke
by jdoliner 10y ago
AdRoll has done some very cool stuff using containers for data processing. Afaik they were some of the first people to use this approach, and I think it's worked out quite well for them and given them quite an edge over their competitors.
If you're interested in building this type of infrastructure for yourself, I'd recommend taking a look at http://github.com/pachyderm/pachyderm http://github.com/pachyderm/pachyderm. I'm one of the founders so this is a somewhat shameless plug, but Pachyderm is designed to get people most of the way to what AdRoll has built without having to build as much of the "plumbing" from scratch. AdRoll was some of our earliest inspiration for the design of Pachyderm.
- vtuulos 10y agoThanks! Pachyderm's version control over datasets is a killer feature.