4 ms·
My go-to these days is Polars. You get good performance since it uses arrow in the back. Coupled that with built-in lazy evaluation and it's API design it's pre
by rdedev 4y ago
My go-to these days is Polars. You get good performance since it uses arrow in the back. Coupled that with built-in lazy evaluation and it's API design it's pretty good for me. There are some caveats you need to be aware though. It doesn't always work as a drop in replacement for pandas
- bsg75 4y agoAre you referring to https://www.pola.rs https://www.pola.rs ?
- rdedev 4y agoYup. My bad. Looks like autocorrect screwed me
- akdor1154 4y agoYup, Polars is awesome for both its performance and its stingy but very well designed API.
- silveraxe93 4y agoI tried Polars, but feel like it's not ready for production yet. It's fast! The API is nice. But the documentation is not great. While using pandas I can just open the docs and find all functions and examples of how to use, etc. Polars felt really bare. It's something I'd like to use in personal projects. But other data scientists would not accept using polars as it is today.
- ritchie46 4y agoAuthor of polars here. What would you say the docs is lacking? Quite curious how we should fill the gap. I understand the gap is large due to 12 years of being the standard for python. There is ton of materials for pandas. We hope to have such a clear API that once the expression language clicks, it is less needed to have the docs open constantly as it should feel natural.
- p6steve 4y agoHi @ritchie46 - I have just written [raku Dan](https://github.com/p6steve/raku-Dan https://github.com/p6steve/raku-Dan) as a way to scratch the "data analytics" itch in a new way -- my next step is to write Dan::Polars as a polars binding via (eg.) raku NativeCall. Can you point me to a good recipe for success? ~p6steve@furnival.net
- silveraxe93 4y agoOh hey! I should know better than to take a potshot at software in hackernews... I used it a month or two ago, so I don't remember specifics, but. The docs weren't unclear, they were bare compared to pandas tough. Once I found an example of how to do something I managed to do it. But a couple of times I opened a page and there was WIP message. There's definitely a bit of unfairness in the comparison, as pandas as you say has been the standard for python for years. But that means I already know all the syntax and how the API works, so even just a method name or required params will get me a long way. When I was fumbling around with polars I would have liked more examples of how to use each method/function. I mean, once the language clicks I wouldn't need it anymore. But at the start I really need that hand-holding. I'd have to reread other pages to remember simple syntax.
- silveraxe93 4y agoThanks for creating it btw! I didn't mean to sound so negative. I used on an analysis that was taking long and it went way quicker.