4 ms·

Taking Netflix’s Vector Performance Monitoring Tool for a Spin

48 points by Mojah 12y ago

jdrock 12y ago
Any word on integration with Graphite?
- Mojah 12y ago
  None that I'm aware of.
- ucsdrake 12y ago
  PCP's pmwebd can already export its metrics to Graphite. http://pcp.io/features.html#analyze http://pcp.io/features.html#analyze http://www.pcp.io/man/man1/pmwebd.1.html http://www.pcp.io/man/man1/pmwebd.1.html https://web.elastic.org/~fche/blog3/archive/2014/06/16/pcp-and-graphite-backwards https://web.elastic.org/~fche/blog3/archive/2014/06/16/pcp-a...
- sciurus 12y ago
  That's more a question about Performance Co-Pilot than about Vector. Netflix has another tool they use for collecting and working with time-series data, Atlas- http://techblog.netflix.com/2014/12/introducing-atlas-netflixs-primary.html http://techblog.netflix.com/2014/12/introducing-atlas-netfli... To see how Atlas and Vector fit together, read http://techblog.netflix.com/2015/02/a-microscope-on-microservices.html http://techblog.netflix.com/2015/02/a-microscope-on-microser...
billyhoffman 12y ago
So the author has to use yum (a package manager), to install node's npm (a package manager), to install bower (a package manager "for the web") to install Vector... wow
- yen223 12y ago
  Welcome to the future!
  - jdubs 12y ago
    A future with out signed packages is a scary future.
- edgan 12y ago
  My solution for npm is to use fpm to make rpms of node modules. But this is fucked by node modules pull in all their dependencies into their own tree, and because a module will want semvers > 3, but npm wants semvers < 2.2. Hence you can't make a sane package per node module, you have to have a module and all it's dependencies in one rpm. The best example I have seen was a module for imagemin that was 17mb, but if you took out the dependencies it was 5k. For bower, I am not aware of a tool. My solution so far, since I have only have seen it get used when running a gulp compile is to have my co-workers run bower install in their repo, and put the results in the repo.
tjbiddle 12y ago
Anyone aware of what benefits this would give someone on a pure-EC2/AWS platform over just using CloudMetrics?
- imperialWicket 12y ago
  Per-second metrics and a (claimed by netflix) pluggable system for custom metrics that's likely easier than pushing custom cloudmetrics data. Some data from Netflix employees here: https://news.ycombinator.com/item?id=9339698 https://news.ycombinator.com/item?id=9339698

48 points by Mojah 12y ago

jdrock 12y ago

Any word on integration with Graphite?

Mojah 12y ago
None that I'm aware of.
ucsdrake 12y ago
PCP's pmwebd can already export its metrics to Graphite. http://pcp.io/features.html#analyze http://pcp.io/features.html#analyze http://www.pcp.io/man/man1/pmwebd.1.html http://www.pcp.io/man/man1/pmwebd.1.html https://web.elastic.org/~fche/blog3/archive/2014/06/16/pcp-and-graphite-backwards https://web.elastic.org/~fche/blog3/archive/2014/06/16/pcp-a...
sciurus 12y ago
That's more a question about Performance Co-Pilot than about Vector. Netflix has another tool they use for collecting and working with time-series data, Atlas- http://techblog.netflix.com/2014/12/introducing-atlas-netflixs-primary.html http://techblog.netflix.com/2014/12/introducing-atlas-netfli... To see how Atlas and Vector fit together, read http://techblog.netflix.com/2015/02/a-microscope-on-microservices.html http://techblog.netflix.com/2015/02/a-microscope-on-microser...

billyhoffman 12y ago

So the author has to use yum (a package manager), to install node's npm (a package manager), to install bower (a package manager "for the web") to install Vector... wow

yen223 12y ago
Welcome to the future!
- jdubs 12y ago
  A future with out signed packages is a scary future.
edgan 12y ago
My solution for npm is to use fpm to make rpms of node modules. But this is fucked by node modules pull in all their dependencies into their own tree, and because a module will want semvers > 3, but npm wants semvers < 2.2. Hence you can't make a sane package per node module, you have to have a module and all it's dependencies in one rpm. The best example I have seen was a module for imagemin that was 17mb, but if you took out the dependencies it was 5k. For bower, I am not aware of a tool. My solution so far, since I have only have seen it get used when running a gulp compile is to have my co-workers run bower install in their repo, and put the results in the repo.

tjbiddle 12y ago

Anyone aware of what benefits this would give someone on a pure-EC2/AWS platform over just using CloudMetrics?

imperialWicket 12y ago
Per-second metrics and a (claimed by netflix) pluggable system for custom metrics that's likely easier than pushing custom cloudmetrics data. Some data from Netflix employees here: https://news.ycombinator.com/item?id=9339698 https://news.ycombinator.com/item?id=9339698