14 ms·
Ask HN: What do you use for basic data analysis, visualization, and graphing?
I often find myself with some JSON data that I want to visualize. I usually end up converting to CSV, uploading to a Google Sheet, and manually creating charts. BUT this is really time consuming and I find Google Sheets charts pretty difficult and painful for quickly exploring different views of the original data.
So what do you use for this type of thing?
I know python has lots of good utils for data wrangling & graphing, but I'd prefer a solution which is: no-code, gives me a bunch of common graph views I can quickly choose between, and that "just works" 99% of the time.
Thanks!
- iamcreasy 4y agoYou can write Trino rest client for a JSON endpoint that will allow you to query the endpoint using SQL and the result table can be push to any number of application for visualization.
- ghiculescu 4y agoIf you can connect it to the data source, Metabase is exactly what you want. https://www.metabase.com/ https://www.metabase.com/
- djbusby 4y agoI love metabase. I'd also suggest to take a look at Apache Superset.
- epgui 4y agoPersonally I find Metabase lacks flexibility, but then again I think that’s just the predicament you’re stuck with in no-code/low-code.
- ReDeiPirati 4y agoWhat do you mean with lacks of flexibility? I've used MB for 5y+ and I've never found myself limited by the tool as long as I was able to connect the data source, that's IMHO the main friction with this tool
- epgui 4y agoThere is only so many things you can do with it is what I mean. You can’t make arbitrary graphs and you can only do very basic exploratory data analysis. It’s great for cookie-cutter jobs, and for writing custom SQL, but not much more.
- transitivebs 4y agoMetabase looks amazing. Thanks!!
- ReDeiPirati 4y agoThis! As long as you can connect the data source you can go quite forward with this tool. It's probably the one that have the quickest learning curve.
- n8henrie 4y agoConsider adding "no code" to the title somewhere to save a click for the hundreds of people that are planning to cheerfully suggest jupyter + pandas / matplotlib / Altair / seaborn / R / etc etc.
- transitivebs 4y agoGood call; I realized that after the fact and unfortunately can't edit the title anymore.
- hprotagonist 4y agovisidata, maybe?
- __mharrison__ 4y agoI use pandas. I'm pretty biased but I generally prefer to create things programmatically rather than drag and drop tooling. Especially if I need to do it in the future. (I just made a course covering visualization w/ Pandas, Seaborn, Excel, Tableau, and a few others. My takeaway is that unless your data is good, you will need some preprocessing. Also, making good visualizations and tweaking them is difficult with code and no-code tooling. You need to figure out how to do the 20% of things (if you are even able to) in both code/no-code tools.)
- gooseyman 4y agoWhat is the name of your new course? I’m struggling to determine if it’s effective pandas or one of the others.
- __mharrison__ 4y agoThis is a pending course that will come out through Coursera
- flat-pluto 4y agoI know you said wanted a no-code solution but in case you don't get a satisfactory answer try this out. Earlier today there was a Show HN post[1] which showed how to visualize a Pandas dataframe (can come from CSV, JSON whatever). I tried it for basic tasks and it is pretty good. It's minimal code (<5 lines) - just reading the json and calling pygwalker in a Google Colab environment[2] or something. Something like this: import pandas as pd import pygwalker as pyg df = pd.read_json('{filename}.json') gwalker = pyg.walk(df) Should be decent for most basic use-cases. [1] - https://news.ycombinator.com/item?id=34869244 https://news.ycombinator.com/item?id=34869244 [2] - https://colab.research.google.com/ https://colab.research.google.com/
- ellisv 4y agoI use R and ggplot2 for most plotting/visualization but I’d recommend something like Apache Superset if you want no-code (although setup is still required).
- wanderingmind 4y agoYou can use superset[0]. Its a Flask app that can connect to databases, read csv, json and create good plots [0] https://superset.apache.org/ https://superset.apache.org/
- transitivebs 4y agoLooks very promising. I think I'm looking for the AI-powered equivalent of this that's one level of abstraction higher. Apache projects are obviously super high quality, but I want to offload the cognitive load of thinking about the graph specifics to an ML algo that "just works" for the majority of use cases (and is tweakable after the fact).
- aeontech 4y agoDatasette seems like it might be a good fit? https://datasette.io/ https://datasette.io/
- kungfufrog 4y ago+1 for Datasette, love it!
- transitivebs 4y agoChecking it out now; thanks :)
- cldellow 4y agoOP said they "find Google Sheets charts pretty difficult and painful for quickly exploring different views of the original data" And that they want "a bunch of common graph views I can quickly choose between" That doesn't sound like Datasette to me, although I'd be happy to be wrong -- how would you recommend someone achieve this in Datasette?
- aeontech 4y agoWell, datasette has some simple exploratory viz built in, and is easy to extend if you want something more complicated. At least, I have been impressed with examples on the author's blog that come up here every so often. I agree it's not the same as something like superset, but it is still a useful tool that some people might benefit from if they don't already know of it.
- acomjean 4y agoRstudio is a pretty nice user interface to the R language. datasets can be browsed like spreadsheet tables. ggplot2 is a great graphing tool. Used in science a lot by non programmers. there is an online book too thats pretty decent: R for data science https://r4ds.had.co.nz/ https://r4ds.had.co.nz/
- didgetmaster 4y agoHere is a tool that will quickly load data from CSV, Json, or JsonLines formatted files using 'drag-and-drop' techniques. You can query it, analyze it, and display the information using a variety of charts. https://www.youtube.com/watch?v=EHwBspzBDbs https://www.youtube.com/watch?v=EHwBspzBDbs Available for free download at https://www.Didgets.com https://www.Didgets.com
- employee42 4y agoCan't believe someone hasn't suggested Grafana[0] yet. It sounds perfect for your needs (although there is some coding required to make the queries). [0] https://grafana.com/ https://grafana.com/
- neduma 4y agoAWS Quicksight.
- uptownfunk 4y agoWhy?
- fbonawiede 4y ago-1
- rvrst 4y agoMarple[0] is a pretty awesome tool for quick visualization and browsing through data. [0] https://www.marpledata.com/ https://www.marpledata.com/
- transitivebs 4y agoLooks very promising. They seem to imply it's only for time-series data, but I like their marketing & UX so far. So many of the projects people link to are probably awesome, but if you don't nail the UX / DX, people bounce really quickly. Thanks!
- mutant 4y agohttps://www.spyder-ide.org/ https://www.spyder-ide.org/ Not no code, but can do simple things using something like nodes in blender.
- kasperset 4y agoUsually R tidyverse with GGplot2 does it for me. You could create shiny app and explore with "No code".
- ies7 4y agoSince you're already using Google sheet, fastest nocode dashboard available should be Google Data Studio.
- transitivebs 4y agoAhhh; didn't know about this. I guess it's called Looker Studio now? Will give it a try. Thanks!
- naijaboiler 4y agoIt sucks
- geophph 4y agoI might suggest pandas + plotly express. Not no code, and dependent on your data structure, but if you can form it into a tidy data frame plotly express will let you easily customize into different chart types and styles from there
- Gatsky 4y agoWell, there is this chap on twitter who makes amazing charts to do with equities and macroeconomics (eg https://twitter.com/TimmerFidelity/status/1618651048629108736 https://twitter.com/TimmerFidelity/status/161865104862910873...). Turns out he just uses Excel. Maybe that's not the answer you are looking for.
- transitivebs 4y agoStill proves how far you can go when you master your tools. Great example && thanks.
- ComputerGuru 4y agoI used to do this with Matlab. Haven’t in a long time, but if you speak that lingua franca, it’s a great way to go. Every kind of chart, lots of flexibility, customizable, etc. but I think everyone has moved to Python or R now.
- drewcoo 4y agoThe no code/low code poster child is Excel. https://www.zdnet.com/article/office-excel-why-its-microsofts-not-so-secret-weapon-in-no-code-app-development/ https://www.zdnet.com/article/office-excel-why-its-microsoft... And there are many would-be Excels that do parts of what it does better. Even if those contenders don't have a flight simulator yet. https://excelunusual.com/a-first-flight-simulator-model-in-excel/ https://excelunusual.com/a-first-flight-simulator-model-in-e...
- shubhamjain 4y agoShameless plug: This is exactly the problem the I am trying to solve with my app - TextQuery [1]. Creating even a basic graph means dealing with multiple tools. I wanted to create a simple app where you can import all common types of data, run SQL over it, and visualize it quickly. [1]: https://textquery.app/ https://textquery.app/
- transitivebs 4y agoAwesome; glad I helped validate the pain point && always happy to try and help fellow indie hackers. btw adding a screenshot to the home page of the goal UX would help 1000x even if it's just a design mockup. For my use case, I'd want to drag & drop a JSON file. Thanks!
- shubhamjain 4y agoThank you! I would love to add screenshots as soon as I have something solid. Would it be okay to reach out to you for feedback on some of the things I have done?
- transitivebs 4y agoFor sure; feel free to DM me on twitter transitive_bs
- transitivebs 4y agoI'm considering https://github.com/Kanaries/Rath https://github.com/Kanaries/Rath, which seems to be an OSS version of Tableau. Has anyone used it for this type of thing?
- deleted 4y ago[deleted]
- deleted 4y ago[deleted]
- noddingham 4y agoPower BI Desktop is free and handles JSON files as a data source.
- appleaday1 4y agoDoes Excel still freeze when trying to open huge .csv files?
- b_mc2 4y agoIf I'm not trying to build a very specific graph or chart, and just exploring data I usually use either Rawgraphs or Sqliteviz. Rawgraphs is nice if you just want to swap visualizations out with smaller data as is, sqliteviz seems to handle much larger datasets and let's you use SQL if you want to change the resultset. Both seem to keep data local too and I know sqliteviz works offline, rawgraphs might too. https://www.rawgraphs.io/ https://www.rawgraphs.io/ https://sqliteviz.com/ https://sqliteviz.com/
- MilStdJunkie 4y agoNot sure if this is "no code" exactly, but I use these from inside of Asciidoc every day, and I haven't seen them mentioned yet particularly. Asciidoc directives inside of a graph block are processed before the graph, so you can get conditional graphs in the output, or use the include directive to fetch outside graphics. == Vega and Vega-Lite Site:: https://vega.github.io/vega/ https://vega.github.io/vega/ Sandbox:: https://vega.github.io/editor/#/examples/vega/airport-connections https://vega.github.io/editor/#/examples/vega/airport-connec... == PlantUML Sandbox:: https://plantuml-editor.kkeisuke.dev/ https://plantuml-editor.kkeisuke.dev/ Language Specs:: https://plantuml.com/sitemap-language-specification https://plantuml.com/sitemap-language-specification
- georgewsinger 4y agoWolfram Mathematica.
- fatBatman 4y ago[dead]
- PaniniHead 4y ago[dead]
- catsordogs 4y ago[dead]
- FartnRoses 4y ago[dead]
- RedMonkeyButt 4y ago[dead]
- FreeHugz 4y ago[dead]
- actuallythedog 4y ago[dead]
- LtDansLegs 4y ago[dead]
- WookiesrPpl2 4y ago[dead]
- CountSwagula 4y ago[dead]
- Coco_loco 4y ago[dead]
- Veranorooz 4y ago[dead]
- LaTatiana 4y ago[dead]
- DorkyDweeb 4y ago[dead]
- HilariousRed 4y ago[dead]
- MamaHuh 4y ago[dead]
- Jabbahutt 4y ago[dead]
- givemethrill 4y ago[dead]
- victoriano 4y agoGive a try to http://graphext.com http://graphext.com . It’s no-code tool that at the same time is as powerful as a Jupyter Notebook
- masteruvpuppetz 4y agoExcel and that's all
- musclehuman 4y ago[dead]
- smokeygun 4y ago[dead]
- lonerwoof 4y ago[dead]
- hulknsmash 4y ago[dead]
- fastflash 4y ago[dead]
- ruggedheart 4y ago[dead]
- jockxxtreme 4y ago[dead]
- tornadoxbattler 4y ago[dead]
- soulcreaper 4y ago[dead]
- viking2striking 4y ago[dead]
- ziggyxstardust 4y ago[dead]
- PreciousPenny 4y ago[dead]
- PatootieRu 4y ago[dead]
- SugarJeez 4y ago[dead]
- BlondieZ 4y ago[dead]
- Switcharoo 4y ago[dead]
- CheekyBum 4y ago[dead]
- SupDiana 4y ago[dead]
- GorgGorl 4y ago[dead]
- JollyJester 4y ago[dead]
- msadowski 4y agoIn the robotics world many people use PlotJuggler (https://plotjuggler.io/ https://plotjuggler.io/) that, among other things, sports csv files.