4 ms·
Hi HN, co-founder here! We designed Marple for engineers to make visual analysis intuitive and powerful. Most of our users are control systems engineers or test
by NeroVanbierv 6y ago
Hi HN, co-founder here! We designed Marple for engineers to make visual analysis intuitive and powerful. Most of our users are control systems engineers or test engineers (but not the kind that tests software). They often have to draw conclusions from millions of time series data points. As a quick example: logging data from a drone control system for 15 minutes at 1.5 kHz is already more than 1 million samples.
This creates some interesting technical challenges. We implemented a custom visualisation engine that efficiently displays only the data that fits the screen. In the same way, we also support applying functions such as low-pass filters, integrals, derivatives, etc.
Having a visual approach to analysing data is in our opinion still highly underrated. Common engineering tools such as Matlab or python+matplotlib scripts require you to reduce the number of samples yourself. And you end up with a plot that is not interactive: zooming, panning highlighting, adding a different signal are all cumbersome or impossible. Marple treats interactivity as a first class citizen.
We recently launched a beta version and we're currently looking for test users to try it out. If you sometimes need to visualise some data from a .csv file, python script, matlab script, simulation, ... you should give it a spin!
Cheers! Nero
- O_H_E 6y agoHomepage and pitch looking awesome!
- blazespin 6y agoSome questions: - Is there druid integration? Is this a replacement for druid? - How does schema inference work? - Can I do SQL queries? - How is this better than superset?
- NeroVanbierv 6y agoThere is no integration for any db setup at the moment, but this is one of the next things we will tackle for sure! Druid was not on our radar, seems like it is used a lot in automotive/aerospace. Never tested superset, I'll give it a try. But it looks to be more like a dashboarding tool. Our goal is to provide an investigative tool that allows the user to detect problems and in a very interactive way change the visualisation.
- blazespin 6y agoI downloaded and looked at it. Very cool. Superset has the broad alchemy integration, which is pretty nice. Integrating into a larger enterprise data dictionary would be nice. Eg, amazon glue This is really a big data visualization tool. There's a whole gigantic rich market there to capture. You seem to be looking at it from the perspective of csv files, which is a fresh take, I guess. It's also unfortunately a very competitive space being worked on by folks with insanely deep pockets and hyper smart engineers: https://www.newgenapps.com/blog/10-big-data-visualization-tools/ https://www.newgenapps.com/blog/10-big-data-visualization-to... Still, a lot of what's out there is ungainly bloat ware meant for business logic data. If you target specific engineering/science verticals with clear use cases, it would compete.
- MBaert 6y ago(other co-founder) Thanks a lot! Great to hear these positive reactions. You make some very valid points. We are indeed trying to focus on a certain use case, which we encountered our self in the past.
- farseer 6y agoThis looks great, will definitely try it out. May I ask what tech stack are you using?
- NeroVanbierv 6y agoPython + React in electron
- nitrogen 6y agoAudio data is typically sampled at 44.1kHz and up, so audio visualization tools also have to handle millions of samples for filtering and display. I'm curious, is there any overlap in the techniques you used vs. those that an audio tool would use?
- NeroVanbierv 6y agoA very good suggestion and something we need to look into. Thinking about it, the techniques will probably be similar.
- karambahh 6y agoCongrats for your tool, seems impressive. Yet another great project supported by imec!