4 ms·
> I’ve seen lots of people who struggle to find the perfect balance between low-level visualization kernel (like d3), or black-box configurable charts (HighChar
by cpsempek 8y ago
> I’ve seen lots of people who struggle to find the perfect balance between low-level visualization kernel (like d3), or black-box configurable charts (HighCharts, FusionCharts)
This is the biggest pain point for me with most current solutions. Either development time is super fast (e.g., tableau, periscope) but going beyond 80% is difficult, or development time is much longer (e.g., d3 or apis thereof) but you get full customization and getting to 100% is straightforward. For me, there is certainly a need to develop an 80% solution fast, but I also am always wanting to then redo the whole thing with lower level solution. I would prefer that I can piggy back off the 80% solution to 100% in the same software. That's a huge win for me. Thanks for providing a solution to this end, will definitely play around with this.
- hglaser 8y agoHey `cpsempek, Periscope Data CEO here. In a perfect world, how would the charting in Periscope work? How would you want to go from getting 80% very fast, to going to 100%, in the same software?
- cpsempek 8y agoHi, thanks for the reply! Actually, apologies for throwing your name next to tableau like that. I think your product does a great job incorporating things like R/python scripting to allow more flexibility in how data can be manipulated within the product. In this sense I prefer periscope to tableau (an in many other senses actually). A problem I encountered (granted over a year ago) was creating grouped bar charts with confidence intervals. Bars were grouped on some discrete x axis labels. The suggested solution for confidence intervals on grouped bars was to use a scatter plot to draw the confidence intervals, but this clumped them all on the xlabel position, not in the center of each bar. matplotlib for example treats the visualization as an object, in which case it makes a lot of sense that to add confidence intervals just query the bar objects for their positions and place line segments of desired widths in the center of the tops of the bars (or wherever, you have full control over this). So in general, a marriage of these two paradigms, quick development of a visualization based on data, but then the ability to switch to viewing and manipulating the visualization as a collection of instantiated objects with full control over their attributes. I am open to revisiting over any development periscope has made to this end.
- hglaser 8y agoAppreciate the feedback! Yeah, the hack you described for CIs is typical of "80% charting". We have a list of probably thousands of longtail visualization requests and we're way past the 80/20 point. These days customers who want to go 100% use the Python/R editors and do their custom visualization there. So you do your SQL query like usual, but then pipe it to Python/R for the visualization. Have you tried that, and has it worked for you? Or do you prefer another model?
- pallavn 8y agoMaybe try Muze to be able to build all those long tail viz :) - given that you don't have to think of any viz in Muze as a chart type - but rather compositions through layers. Would love to talk to you guys!
- arama471 8y agoIf you don't mind, could you list the other things that make you prefer periscope to tableau? Also when you say R and python scripting, do you mean using them to prepare your data or to do something else?
- antisthenes 8y ago> The first 90 percent of the code accounts for the first 90 percent of the development time. The remaining 10 percent of the code accounts for the other 90 percent of the development time. Now, I'm not saying that directly applies to your problems, but there's good reason this is a saying. Going from 80% to 100% will take as long or longer as going from 0 to 80, because the last 20% is all edge cases that are a nightmare to test and mentally exhausting to comprehend. Sometimes, it's just never cost effective to go from 80 to 100, and it's best to just leave it as is, even if there is some manual work left over.
- pallavn 8y agoWould love to know what is scoped in that last 10%?
- antisthenes 8y agoI can't speak for others, but in my case it was uncovering an issue with a legacy feature that led to needing to rewrite a good chunk of the site logic.