4 ms·
I’ve been moving over to use polars more often for my data work. It’s much faster than pandas at things like imputing millions of lines. It’s also a little mo
by Vaslo 3y ago
I’ve been moving over to use polars more often for my data work. It’s much faster than pandas at things like imputing millions of lines. It’s also a little more intuitive and you don’t waste time pissing around with indexes everytime you transform a dataframe.
Polars biggest downfall is that pandas/matplotlib are so ubiquitous in data science and polars just plays so differently than pandas including using hvplot as its default plotting package, etc. It really is trying to do much of its ecosystem exactly how it wants to maximize productivity, speed, etc. This may slow down the adoption of it, but hopefully it will push others in the better direction.
- mirashii 3y ago> Polars biggest downfall is that pandas/matplotlib are so ubiquitous in data science and polars just plays so differently than pandas including using hvplot as its default plotting package, etc. huh? Polars doesn't have a default plotting package, it's always something you add. matplotlib supports polars out of the box through the dataframe exchange protocol, which is ubiquitous enough due to the proliferation of other dataframe libraries (dask, vaex, modin/ray) that you really get about every other tool in the ecosystem with polars for free.
- nojito 3y agoPolars can now leverage hvplot directly. https://docs.pola.rs/user-guide/misc/visualization/ https://docs.pola.rs/user-guide/misc/visualization/
- mmmmpancakes 3y agoSuggest the following pattern: 1. load and process / aggregate in polars to get the smaller dataset that goes into your plot. 2. df.to_pandas() 3. apply your favourite vis library that works with pandas. There's no use case i can think of where building a data viz interface more specific to polars than this is beneficial or necessary.
- __mharrison__ 3y agoPandas is the best interface for putting with matplotlib (better than matplotlib itself). What issues are you running into with the Python ecosystem? I ask because I'm in the middle of writing Effective Polars, and my experience is that many things like Xgboost, matplotlib, etc work fine with Polars. (Sadly/oddly/ironically some libraries now have issues with Pandas 2 pyarrow types but work with Polars.)