11 ms·
Show HN: Live visualization of Kafka streams
- bjoernw 10y agoIs the source available somewhere?
- yairwein 10y agoNot yet, we are still debating internally if to open source it or release it as a docker image. Feedback will be welcome!
- manojlds 10y agoHmmm, why not both?
- ChartsNGraffs 10y agoI immediately went to DockerHub to check for it
- thijsc 10y agoAwesome, please open source this :-)
- reacharavindh 10y agoAwesome work! Please open source this.
- BlackjackCF 10y agoI think most folks would love it if you were to open source it... although por que no los dos? ;)
- kkirsche 10y agoUm..why is it one or the other rather than both?
- rekwah 10y agoI like the color bomb when you switch away from the tab for a bit and come back to an onslaught of events get processed by the UI.
- olalonde 10y agoIs this a side effect of how the browser handles canvas rendering or did it have to be explicitly coded?
- peburrows 10y agoMany browsers throttle javascript performance (particularly looping timers) when the tab doesn't have focus. My guess is the "color bomb" is just a side effect of the JS performance returning to a normal level when focus returns to the tab.
- bubuli 10y agoi need this.
- yairwein 10y agoComing soon!
- alvaromuir 10y agoThat is effn' cool.
- yairwein 10y agoThanks
- shyrka 10y agoWant
- yairwein 10y agoComing soon!
- andrewvijay 10y agoMozilla in android crashed within 10s. But it was totally worth it.
- stav-stav 10y agoYOLO
- apazzolini 10y agoThis is _awesome_. Would love to be able to hook this up to our Kafka queues. Please open source it!
- Godel_unicode 10y agos/queues/topics
- znt 10y agoVery beautiful interface.
- iblaine 10y agoWhat does alooma generally charge? Just curious.
- yairwein 10y agoAlooma pricing varies greatly. Our customers are paying anywhere between $1000 and $15000 per month. Because the variance is so big, we prefer to have a conversation before providing a quote. There is a two weeks free trial though, to test things out.
- user5994461 10y agoCoincidence: I was checking out your product the other day and it seemed quite interesting. There was just one huge issue: Where is the price tag?
- yairwein 10y agoAlooma pricing varies greatly. Our customers are paying anywhere between $1000 and $15000 per month. Because the variance is so big, we prefer to have a conversation before providing a quote. There is a two weeks free trial though, to test things out.
- user5994461 10y ago1) What is the cost relating to: requests? GB ingested? unique users? sources? Too many variables... 2) On a different topic. There is one thing I'd like to see that would put you at a great advantage over all competitors: The ability to have the tracker appears under my own domain like "stats.mysite.com/whatever". Right now all client-side javascript scripts are expected to reside on a unique address and it's impossible to change (i.e. alooma.com or google-analytics.com/analytics.js or segment.com). The unique address are systematically blocked by all adblockers.
- yairwein 10y ago1. Mostly event volume, but also number of integrations 2. It's actually possible if you cname your domain eg. `alooma.user5994461.com` to `inputs.alooma.com`. However, SSL won't work as we don't support installing custom certificates at the moment.
- arcticfox 10y agoIt would be great if you have this on the pricing page. It's really frustrating for there to be nothing there. My startup has a ~$50 / mo Kafka ETL system hooked up to a few things and it seemed like a good candidate to move to hosted. But if your small clients are $1000 / mo... Noooope, not our scale! Good thing I saw this post or I might have spent a lot of time trying it out.
- ecesena 10y agoCurious, what do you use for mysql -> kafka?
- yairwein 10y agopymysqlreplication (https://github.com/noplay/python-mysql-replication https://github.com/noplay/python-mysql-replication) + home brew Kafka producer.
- jodrellblank 10y ago60 events per second and it's pretty but basically unfollowable. It's something I always wonder about visualizations - no human can follow the amount of data in even a small system. How much are they just hype and feelgood, and how much are they genuinely useful?
- jclulow 10y agoI think visualisations need to be a seriously terse summary, leaving out most of the detail apart from one or two critical dimensions where you're looking for the pattern or trend. A latency distribution heatmap can make a lot of data points visually useful, but you can't cram in five other dimensions and still make it work.
- itamarwe 10y agoThat's actually a challenge that we tried to overcome - being able to get the big picture on the one hand, while still being able to catch and filter a single event.
- vegabook 10y agoIn finance this is a classic problem and is why you see traders with proliferations of monitors, trying to track everything, and they are anyway outmatched by the machines. The irony is that the vast majority of tick data points do not contain much incremental information. They're very correlated. Think how most stocks tend to move in lockstep to the index. We use principal components analysis a lot to cut thousands of feeds and get the "big picture" in usually 4-6 "global" variables, and then we use PCA regression to find the "outliers" in the rest of the data and show those. Thus we get at least 2-3 orders of magnitude less data that allows mere humans to actually interpret - big picture + outliers - and it's very rare that using this simple technique we ever miss much. And it can literally cut thousands of feeds into a couple of dozen. We've found this to be much more effective than creating animated "dot swarms" which look beautiful but are very poor at conveying rich information.
- saint-loup 10y agoI thought it would be some kind of visualization of Franz Kafka's streams of consciousness. Oh well, another context collision.
- giaosudau 10y agoI want this deeply!