7 ms·

Altair – A declarative statistical visualization library for Python

122 points by dragonsh 6y ago

teruakohatu 6y ago
I am definitely going to give it a try but I wish statistical/scientific plotting libraries' documentation would include example comparisons with matplotlib and ggplot2. I usually just want to know how much easier/prettier will library X be to use compared to those two.
- phonebucket 6y ago
  > I usually just want to know how much easier/prettier will library X be to use compared to those two. Don't the examples in the README provide a good enough intro? If you are familiar with matplotlib and ggplot, you'd have a good idea how to reproduce those examples in those frameworks. If you are not familiar with them, then what good is the comparison?
  - ErikBjare 6y ago
    If you are not familiar with them, the comparison is useful to help you decide which one to choose?
boromi 6y ago
would it be possible to link this up with multiple user selectible legend that then update a table? What I'm thinking is a table with multipl entires, where the legend on the right of the plot serves specify characterstics in the table. E.g. gender, age group, and then these selections would plot them but also update the table below them?
- sterlinm 6y ago
  Yes it's theoretically possible. I created an example of linking a table to a scatter plot brush selection. That said, I have never been able to get altair/vega-lite to generate a nicely formatted table to my satisfaction. I mostly end up connecting a simpler altair chart without interactions to a dataframe and hook them together using something like ipywidgets, Panel, or streamlit. It would be really nice though to be able to get the table linked to native altair interactions like selection and brushing. https://altair-viz.github.io/gallery/scatter_linked_table.html https://altair-viz.github.io/gallery/scatter_linked_table.ht...
  - boromi 6y ago
    Thanks. Yeah that's not quite what I was hoping for, I was actually thinking something closer like the following: https://www.m43lenses.com/ https://www.m43lenses.com/
    - sterlinm 6y ago
      ipywidgets + altair could mimic that pretty easily I think since with that example you just want to filter with a bunch of checkmarks/radios/dropdowns on a sidebar and then display a chart and table based on those filters. The place where you start to run into problems is if you want to filter the table based on interactions with the chart. If you're going to use dropdowns and checkboxes to filter the dataframe and the chart then you have a lot of good options.
      - boromi 6y ago
        Thanks, I'll check out ipywidgets. So basically use ipwidgets to create the checkmarks/radio/dropdowns. Then hook the database up to altair. I'll play tommorow with altair and ipywidgets and see how I can cook this up. "filter the table based on interactions with the chart" For me all I'd need is a the corresponding datapoint selected to highlight the row.
- MisterBiggs 6y ago
  I've seen this done by making a fake legend out of a bar chart. As far as I know, there's no way to make an interactive legend in Altair. Personally I would look into plotly / dash for something with interactivity.
  - sterlinm 6y ago
    Altair does have interactive legends actually. But dash is great for more complicated interactions and layouts. Panel, streamlit, and voila are also all potentially useful. https://altair-viz.github.io/gallery/interactive_legend.html https://altair-viz.github.io/gallery/interactive_legend.html https://altair-viz.github.io/user_guide/interactions.html#selection-targets-fields-and-encodings https://altair-viz.github.io/user_guide/interactions.html#se...
    - MisterBiggs 6y ago
      I stand corrected, I may have to revisit Altair. Some of those other options look pretty compelling too I think it's definitely time for something to replace Matplotlib as the go-to for python plotting.
      - cycomanic 6y ago
        While I agree with you that matplotlib should be replaced , I see a problem in that almost all these new plotting libraries are focused on plotting statistical type data. While this is obviously a big thing at the moment, more traditional type graphs are often not well catered for by these libraries. For example I work in signal processing and would like good looking line and 3d graphs with easy layout of multiple plots... Matplotlib despite its shortcomings is still the best tool for this.
    - prepend 6y ago
      I think they added this in v4 within the last year. Altair is developing really quickly, and I like that. JVP has been really responsive and it’s amazing how quickly the project is adding features.
kfk 6y ago
Altair and Vega offer a great declarative way to build interactive charts with a grammar of graphics. As with other options in this area like Tableau they are not as good with tabular reports (tables). I think they are still greatly worth it.
phunge 6y ago
Altair is amazing. I've been using matplotlib going on 12 years now -- Altair didn't feel more productive at first (more typing), but the longer you work with it, the more you realize how the API is a cohesive system. This leads to a more iterative workflow and eventually to better visualizations.
cgufus 6y ago
I especially liked the example of the interactive cross-filter: https://altair-viz.github.io/gallery/interactive_layered_crossfilter.html https://altair-viz.github.io/gallery/interactive_layered_cro... However I didn't get around to learning the principles to use it regularly. And I fear if you have a certain chart in your head with some special stuff you end up tinkering around eventually get a lot of code.
f00_ 6y ago
Hope I get to use this in a project one day! Declarative systems always seem to feel good (SQL and React come to mind) Vega-lite is the underlying standard (A Grammar of Interactive Graphics ): https://vega.github.io/vega-lite/ https://vega.github.io/vega-lite/ I used altair in a hackathon interview and got the job: https://github.com/DustinAlandzes/drchrono-hackathon/blob/master/drchrono/views.py#L218 https://github.com/DustinAlandzes/drchrono-hackathon/blob/ma... sadly not hosted
wodenokoto 6y ago
With ggplot2 you can add any compatible ggplot object to your plot with a simple `+`. It looks like with altair you can only "add" things that are already a method on your altair object. How does 3rd party geoms and similar work?
vpj 6y ago
We started using custom charts with Altair instead of Tensorboard and it has been amazing. Thanks!
dragonsh 6y ago
We used altair to develop an analytics dashboard as part of our single page application (SPA). We developed a web component encapsulating vega-lite JS library and used that component to assemble the dashboard which is part of the application. Altair based backend can use custom renderer to generate target response for analytics API requests. [1] Most of the commercial and open source solutions including Tableau, Apache Superset, Metabase were very complicated to provide a seamless integrated dashboard with our Single Page Application using the same authenticaton and authorization layer. Most of these solutions recommend using iFrame. With altair we could directly generate the target vega-lite json for our web component and it work seamless. Also for some static reports we could generate output in other formats from altair directly. Altair being in Python (Apache Superset was a big contender), it was easy enough to integrate into our backend as one of the analytics services provider. Given vega-lite and vega grammar is standardized, we are exploring to build real-time dashboard analytics application for large multi-screen display in a control room kind of an environment. Before altair our backend was generating data directly consumed by chartjs web component. [1] https://altair-viz.github.io/user_guide/custom_renderers.html https://altair-viz.github.io/user_guide/custom_renderers.htm...
- Sherl 6y ago
  Would you recommend this to integrate with FastAPI or dash/plotly for similar application?
  - dragonsh 6y ago
    We have tried dash/plotly and moved to altair. Reason is we can generate vega-lite specification and send it to web-component based on API Request (we did it with flask and bottle). In general with FastAPI you can integrate altair to generate your vega-lite json as a response to an API request taking care of authentication and authorization in FastAPI (either with JWT token or other schemes like oauth2).
h8hawk 6y ago
Python's ploting problem is not imperative vs declarative. The main ugliness is basically "* * kwargs" every where. Every time it force you look at document to just find name of parameter you are looking for. Another common problem is Configs pass as string rather than enum.
- uryga 6y ago
  are you arguing against keyword arguments in general, or against def foo(a, b, **kwargs): """ Refer to `bar` for the full list of allowed kwargs. """ ... i don't mind the former, but the latter always feels annoying. iirc matplotlib severely suffers from this
  - h8hawk 6y ago
    Latter. Named arguments (eg foo(a=1) ) are very helpful
  - ImaCake 6y ago
    Yeah, it is often a mystery just what options I have available to use in matplotlib, and it can be tricky to find which one is the one I actually want!
sandGorgon 6y ago
FYI - Altair is available on Google Colab notebooks without any hacks or modification. https://stackoverflow.com/a/56081568/112050 https://stackoverflow.com/a/56081568/112050
- s1t5 6y ago
  Yes, makes sense. Jake VanderPlas (who is the author of the post that you linked to) is the main developer of altair and currently works at Google on Google Colab. He also has a good introductory book on Python for data science and his conference talks have a very nice style to them - the guy is just a great teacher.
dwiel 6y ago
I gave altair a try but I found the data format requirements a pain that got in the way of the nice plotting API. For example, I wanted to plot n lines, stored in a (timestamps, n) shaped matrix. First I had to convert this into a format: (index, line_name, value) where index is the timestamps index in the original matrix, line_name is a unique name given to each line/column, and finally the value. There is a pandas method that helps with this conversion, but it just added one extra confusing step to what I was hoping to be a quick and intuitive plotting tool. Their write up on the data format is here: https://altair-viz.github.io/user_guide/data.html#long-form-vs-wide-form-data https://altair-viz.github.io/user_guide/data.html#long-form-...
- activatedgeek 6y ago
  Wouldn't any plotting library suffer from this challenge anyways? One would first make a relevant data transform and then send it to whatever plotting library. I suspect anything further would limit the flexibility of the plotting library. To make sure I have minimal pain with data transforms, I first store/transform data exactly like I would in a real transactional database. Beyond that it just becomes a matter a joins and filters/projections.
tkinz27 6y ago
Data scientists at my previous company switched to https://github.com/has2k1/plotnine https://github.com/has2k1/plotnine when we made a big push to python. Bit closer api to ggplot than Altair.
kpgiskpg 6y ago
I've always hated matplotlib, even though it gets the job done. The graphs are ugly by default, and the API would be unusable if it weren't for StackOverflow. Maybe I just need to sit down and learn it really well. Anyway, this seems cool.
- grenoire 6y ago
  While writing my thesis I found matplotlib to be quite beautiful with adjustments only on the text (use LaTeX rendering to fit in with the thesis doc itself) and colour schemes; that is literally three lines of code at most. It's not ugly by default either, it produces very crisp graphics easily.
  - kpgiskpg 6y ago
    Beauty is in the eye of the beholder, I guess. I wouldn't put matplotlib graphs in a paper without tweaking the style, and it gets frustrating when you have to do this for every single plotting script you write. And the defaults certainly aren't colourblind-friendly.
    - fock 6y ago
      eh, you know, you can put your styles in a rc-file? and yeah, you have to load your defaults every single script (though you have to do that with every tool?!)
- nl 6y ago
  Isn't it amazing how truly bad matplotlib is? And it gets worse because it gets new APIs with almost identical names to the previous ones, without a proper guide for when to chose which API. And yes it's just so ugly by default.
- dlkf 6y ago
  > even though it gets the job done How is this an addendum, rather than the main point? I will always take a flexible library that allows me to "get the job done" over a declarative framework that will do something similar to—but not exactly—what I need.
cjf4 6y ago
This is easily my favorite Python visualization tool. The declarative nature is intuitive, and the way it integrates with vegalite provides a lot of flexibility. The docs are also great. If you are missing ggplot2 in Python, I’d say look here first.
prepend 6y ago
I’ve been trying to find a “tableau to d3” product that just spits out html+css+JavaScript that can run anywhere. Altair isn’t quite that, but it’s the closest I’ve seen. I wish python had ggplot2 with its html widgets, but this will do. I’ve been really impressed with the browser compatibility in that I’ve yet to find a bug despite lots of weird mobile users. That and the team adds functionality quickly so almost as soon as I’m annoyed at not ability to add captions, it’s made available.
nicolaskruchten 6y ago
Altair and Vega-Lite are awesome! I'll shamelessly plug Plotly Express (https://plotly.express/ https://plotly.express/) here as something that works in a similar way, i.e. generates JSON figure descriptions rendered in Javascript, with an even more minimal API, that now accepts both long and wide data :)

122 points by dragonsh 6y ago

I am definitely going to give it a try but I wish statistical/scientific plotting libraries' documentation would include example comparisons with matplotlib and ggplot2. I usually just want to know how much easier/prettier will library X be to use compared to those two.

phonebucket 6y ago
> I usually just want to know how much easier/prettier will library X be to use compared to those two. Don't the examples in the README provide a good enough intro? If you are familiar with matplotlib and ggplot, you'd have a good idea how to reproduce those examples in those frameworks. If you are not familiar with them, then what good is the comparison?
- ErikBjare 6y ago
  If you are not familiar with them, the comparison is useful to help you decide which one to choose?

boromi 6y ago

would it be possible to link this up with multiple user selectible legend that then update a table? What I'm thinking is a table with multipl entires, where the legend on the right of the plot serves specify characterstics in the table. E.g. gender, age group, and then these selections would plot them but also update the table below them?

sterlinm 6y ago
Yes it's theoretically possible. I created an example of linking a table to a scatter plot brush selection. That said, I have never been able to get altair/vega-lite to generate a nicely formatted table to my satisfaction. I mostly end up connecting a simpler altair chart without interactions to a dataframe and hook them together using something like ipywidgets, Panel, or streamlit. It would be really nice though to be able to get the table linked to native altair interactions like selection and brushing. https://altair-viz.github.io/gallery/scatter_linked_table.html https://altair-viz.github.io/gallery/scatter_linked_table.ht...
- boromi 6y ago
  Thanks. Yeah that's not quite what I was hoping for, I was actually thinking something closer like the following: https://www.m43lenses.com/ https://www.m43lenses.com/
  - sterlinm 6y ago
    ipywidgets + altair could mimic that pretty easily I think since with that example you just want to filter with a bunch of checkmarks/radios/dropdowns on a sidebar and then display a chart and table based on those filters. The place where you start to run into problems is if you want to filter the table based on interactions with the chart. If you're going to use dropdowns and checkboxes to filter the dataframe and the chart then you have a lot of good options.
    - boromi 6y ago
      Thanks, I'll check out ipywidgets. So basically use ipwidgets to create the checkmarks/radio/dropdowns. Then hook the database up to altair. I'll play tommorow with altair and ipywidgets and see how I can cook this up. "filter the table based on interactions with the chart" For me all I'd need is a the corresponding datapoint selected to highlight the row.
MisterBiggs 6y ago
I've seen this done by making a fake legend out of a bar chart. As far as I know, there's no way to make an interactive legend in Altair. Personally I would look into plotly / dash for something with interactivity.
- sterlinm 6y ago
  Altair does have interactive legends actually. But dash is great for more complicated interactions and layouts. Panel, streamlit, and voila are also all potentially useful. https://altair-viz.github.io/gallery/interactive_legend.html https://altair-viz.github.io/gallery/interactive_legend.html https://altair-viz.github.io/user_guide/interactions.html#selection-targets-fields-and-encodings https://altair-viz.github.io/user_guide/interactions.html#se...
  - MisterBiggs 6y ago
    I stand corrected, I may have to revisit Altair. Some of those other options look pretty compelling too I think it's definitely time for something to replace Matplotlib as the go-to for python plotting.
    - cycomanic 6y ago
      While I agree with you that matplotlib should be replaced , I see a problem in that almost all these new plotting libraries are focused on plotting statistical type data. While this is obviously a big thing at the moment, more traditional type graphs are often not well catered for by these libraries. For example I work in signal processing and would like good looking line and 3d graphs with easy layout of multiple plots... Matplotlib despite its shortcomings is still the best tool for this.
  - prepend 6y ago
    I think they added this in v4 within the last year. Altair is developing really quickly, and I like that. JVP has been really responsive and it’s amazing how quickly the project is adding features.

kfk 6y ago

Altair and Vega offer a great declarative way to build interactive charts with a grammar of graphics. As with other options in this area like Tableau they are not as good with tabular reports (tables). I think they are still greatly worth it.

phunge 6y ago

Altair is amazing. I've been using matplotlib going on 12 years now -- Altair didn't feel more productive at first (more typing), but the longer you work with it, the more you realize how the API is a cohesive system. This leads to a more iterative workflow and eventually to better visualizations.

cgufus 6y ago

I especially liked the example of the interactive cross-filter: https://altair-viz.github.io/gallery/interactive_layered_crossfilter.html https://altair-viz.github.io/gallery/interactive_layered_cro... However I didn't get around to learning the principles to use it regularly. And I fear if you have a certain chart in your head with some special stuff you end up tinkering around eventually get a lot of code.

f00_ 6y ago

Hope I get to use this in a project one day! Declarative systems always seem to feel good (SQL and React come to mind) Vega-lite is the underlying standard (A Grammar of Interactive Graphics ): https://vega.github.io/vega-lite/ https://vega.github.io/vega-lite/ I used altair in a hackathon interview and got the job: https://github.com/DustinAlandzes/drchrono-hackathon/blob/master/drchrono/views.py#L218 https://github.com/DustinAlandzes/drchrono-hackathon/blob/ma... sadly not hosted

wodenokoto 6y ago

With ggplot2 you can add any compatible ggplot object to your plot with a simple `+`. It looks like with altair you can only "add" things that are already a method on your altair object. How does 3rd party geoms and similar work?

vpj 6y ago

We started using custom charts with Altair instead of Tensorboard and it has been amazing. Thanks!

dragonsh 6y ago

We used altair to develop an analytics dashboard as part of our single page application (SPA). We developed a web component encapsulating vega-lite JS library and used that component to assemble the dashboard which is part of the application. Altair based backend can use custom renderer to generate target response for analytics API requests. [1] Most of the commercial and open source solutions including Tableau, Apache Superset, Metabase were very complicated to provide a seamless integrated dashboard with our Single Page Application using the same authenticaton and authorization layer. Most of these solutions recommend using iFrame. With altair we could directly generate the target vega-lite json for our web component and it work seamless. Also for some static reports we could generate output in other formats from altair directly. Altair being in Python (Apache Superset was a big contender), it was easy enough to integrate into our backend as one of the analytics services provider. Given vega-lite and vega grammar is standardized, we are exploring to build real-time dashboard analytics application for large multi-screen display in a control room kind of an environment. Before altair our backend was generating data directly consumed by chartjs web component. [1] https://altair-viz.github.io/user_guide/custom_renderers.html https://altair-viz.github.io/user_guide/custom_renderers.htm...

Sherl 6y ago
Would you recommend this to integrate with FastAPI or dash/plotly for similar application?
- dragonsh 6y ago
  We have tried dash/plotly and moved to altair. Reason is we can generate vega-lite specification and send it to web-component based on API Request (we did it with flask and bottle). In general with FastAPI you can integrate altair to generate your vega-lite json as a response to an API request taking care of authentication and authorization in FastAPI (either with JWT token or other schemes like oauth2).

h8hawk 6y ago

Python's ploting problem is not imperative vs declarative. The main ugliness is basically "* * kwargs" every where. Every time it force you look at document to just find name of parameter you are looking for. Another common problem is Configs pass as string rather than enum.

uryga 6y ago
are you arguing against keyword arguments in general, or against def foo(a, b, **kwargs): """ Refer to `bar` for the full list of allowed kwargs. """ ... i don't mind the former, but the latter always feels annoying. iirc matplotlib severely suffers from this
- h8hawk 6y ago
  Latter. Named arguments (eg foo(a=1) ) are very helpful
- ImaCake 6y ago
  Yeah, it is often a mystery just what options I have available to use in matplotlib, and it can be tricky to find which one is the one I actually want!

sandGorgon 6y ago

FYI - Altair is available on Google Colab notebooks without any hacks or modification. https://stackoverflow.com/a/56081568/112050 https://stackoverflow.com/a/56081568/112050

s1t5 6y ago
Yes, makes sense. Jake VanderPlas (who is the author of the post that you linked to) is the main developer of altair and currently works at Google on Google Colab. He also has a good introductory book on Python for data science and his conference talks have a very nice style to them - the guy is just a great teacher.

dwiel 6y ago

I gave altair a try but I found the data format requirements a pain that got in the way of the nice plotting API. For example, I wanted to plot n lines, stored in a (timestamps, n) shaped matrix. First I had to convert this into a format: (index, line_name, value) where index is the timestamps index in the original matrix, line_name is a unique name given to each line/column, and finally the value. There is a pandas method that helps with this conversion, but it just added one extra confusing step to what I was hoping to be a quick and intuitive plotting tool. Their write up on the data format is here: https://altair-viz.github.io/user_guide/data.html#long-form-vs-wide-form-data https://altair-viz.github.io/user_guide/data.html#long-form-...

activatedgeek 6y ago
Wouldn't any plotting library suffer from this challenge anyways? One would first make a relevant data transform and then send it to whatever plotting library. I suspect anything further would limit the flexibility of the plotting library. To make sure I have minimal pain with data transforms, I first store/transform data exactly like I would in a real transactional database. Beyond that it just becomes a matter a joins and filters/projections.

tkinz27 6y ago

Data scientists at my previous company switched to https://github.com/has2k1/plotnine https://github.com/has2k1/plotnine when we made a big push to python. Bit closer api to ggplot than Altair.

kpgiskpg 6y ago

I've always hated matplotlib, even though it gets the job done. The graphs are ugly by default, and the API would be unusable if it weren't for StackOverflow. Maybe I just need to sit down and learn it really well. Anyway, this seems cool.

grenoire 6y ago
While writing my thesis I found matplotlib to be quite beautiful with adjustments only on the text (use LaTeX rendering to fit in with the thesis doc itself) and colour schemes; that is literally three lines of code at most. It's not ugly by default either, it produces very crisp graphics easily.
- kpgiskpg 6y ago
  Beauty is in the eye of the beholder, I guess. I wouldn't put matplotlib graphs in a paper without tweaking the style, and it gets frustrating when you have to do this for every single plotting script you write. And the defaults certainly aren't colourblind-friendly.
  - fock 6y ago
    eh, you know, you can put your styles in a rc-file? and yeah, you have to load your defaults every single script (though you have to do that with every tool?!)
nl 6y ago
Isn't it amazing how truly bad matplotlib is? And it gets worse because it gets new APIs with almost identical names to the previous ones, without a proper guide for when to chose which API. And yes it's just so ugly by default.
dlkf 6y ago
> even though it gets the job done How is this an addendum, rather than the main point? I will always take a flexible library that allows me to "get the job done" over a declarative framework that will do something similar to—but not exactly—what I need.

cjf4 6y ago

This is easily my favorite Python visualization tool. The declarative nature is intuitive, and the way it integrates with vegalite provides a lot of flexibility. The docs are also great. If you are missing ggplot2 in Python, I’d say look here first.

prepend 6y ago

I’ve been trying to find a “tableau to d3” product that just spits out html+css+JavaScript that can run anywhere. Altair isn’t quite that, but it’s the closest I’ve seen. I wish python had ggplot2 with its html widgets, but this will do. I’ve been really impressed with the browser compatibility in that I’ve yet to find a bug despite lots of weird mobile users. That and the team adds functionality quickly so almost as soon as I’m annoyed at not ability to add captions, it’s made available.

nicolaskruchten 6y ago

Altair and Vega-Lite are awesome! I'll shamelessly plug Plotly Express (https://plotly.express/ https://plotly.express/) here as something that works in a similar way, i.e. generates JSON figure descriptions rendered in Javascript, with an even more minimal API, that now accepts both long and wide data :)