3 ms·
[Disclaimer: we're doing http://www.graphistry.com http://www.graphistry.com , which helps with graph views of big IT infrastructure and log data.] While doing
by lmeyerov 11y ago
[Disclaimer: we're doing http://www.graphistry.com http://www.graphistry.com , which helps with graph views of big IT infrastructure and log data.]
While doing research at Berkeley, and now building IT sec/ops visibility tools, several phases:
Basically:
-- Start simple: Excel :)
-- Advance to Python: pivot tables and plots via IPython/Jupyter notebooks with Pandas. (I used to do R but Python largely caught up, thankfully.) For bigger stuff, we started playing with PySpark.
-- For IT time series & logs: graphite/ganglia/ELK, and if you can afford it, significantly more polished tools like Splunk.
-- Network graphs are an evolving story. Small graphs are easy through something like Neo4j's built-in explorer. Alternatively, the Linkurious team is friendly, and Keylines is embedded all over the place. Big graphs are the problem: Gephi can do ~50K nodes and has a lot of features, but hard to use and showing its age. We're building something more scalable and analysis focused, and particularly focusing on sec/ops, so happy to share beta access. (We use GPUs and focus hard on smooth integrations, which let us change the rules a bit.) Let me know.