3 ms·
"Packetbeat agents sniff the traffic between your application processes, parse on the fly protocols like HTTP, MySQL or REDIS and correlate the messages into tr
by greenyoda 13y ago
"Packetbeat agents sniff the traffic between your application processes, parse on the fly protocols like HTTP, MySQL or REDIS and correlate the messages into transactions.
For each transaction, the agents insert a JSON document into Elasticsearch where they are stored and indexed."
How much performance degradation could be expected from constantly inspecting every packet on your network with libpcap, correlating the packets into transactions and then storing information on every transaction in Elasticsearch?
Also: I noticed that the link to Elasticsearch on the "Getting Started" page is broken (it's missing the ":" after "http"). Here's a working link: http://www.elasticsearch.org http://www.elasticsearch.org
- deeviant 13y agoThis is just a guess, but it shouldn't impact your performance at all. It's just a passive network capture mechanism like wireshark. It will need resources to do all the logging/categorizing/displaying and such, but the rest of the production environment should be unaffected.
- packetbeats 13y agoDepending on the traffic, the CPU usage of the agent could indeed be significant. We're thinking to implement sampling to reduce the effect of this. On the other hand, the agent is not "in-line" so it cannot introduce any latency, only steal CPU time from them. So, unless you have a single CPU core, it's pretty safe to run in production. It cannot affect the application performance by much. Thanks for noticing the broken link, we fixed it.
- zentrus 13y agoWhat happens if more traffic is coming in than Packetbeat can process? Either you are dropping that traffic or you are (perhaps unintentionally) blocking it, right?
- packetbeats 13y agoIt will drop traffic in that case.
- pyvpx 13y agoyou might look into sFlow and/or IPFIX.
- milkshakes 13y agonobody said the monitoring service has to run on the same machine as the application. you could mirror the app server port and feed the traffic into a completely different monitoring machine.