simicd

7 ms·

1.
Pre-Release of Polars 2.0(pola.rs)
8 points by simicd 27d ago|0 comments
2.
Polars v2.0 Release Candidate(github.com)
1 points by simicd 27d ago|0 comments
3.
by simicd 7mo ago
At 4.8TB one could add a header section with the full code, instructions how to compile it etc. That would certainly help to reproduce it, assuming civilizations in 10k years still can decypher todays language.
4.
by simicd 1y ago
It's correct that the number of reinsurers is smaller than that of primary insurers. But the risk born by reinsurers is less correlated, not more. Any given primary insurer has risk clusters (domestic market, line of business, etc.). I
5.
by simicd 2y ago
Since it is a fork of VS Code you can install any VS Code extension in Cursor (although manually): https://www.cursor.com/how-to-install-extension
6.
Separating Storage and Compute in DuckDB(motherduck.com)
3 points by simicd 2y ago|0 comments
7.
Annotated Logger: A Python package to aid in adding metadata to logs(github.blog)
3 points by simicd 2y ago|1 comments
8.
by simicd 2y ago
From what I understood the article refers to the point that DuckDB doesn't provide its own dataframe API, meaning a way to express SQL queries in Python classes/functions. The link you shared shows how DuckDB can run SQL queries o
9.
by simicd 2y ago
I suspect so, OpenAI is subject to the EU AI Act [0]. Last time they released the Advanced Voice Mode it also took some time before it became available in the EU. Not sure why UK and Switzerland are delayed as well, they are not in the Euro
10.
by simicd 2y ago
Hmm enough capacity for the rest of the world but not EU: https://help.openai.com/en/articles/10250692-sora-supported-...
11.
by simicd 2y ago
And in the UK and Switzerland unfortunately https://help.openai.com/en/articles/10250692-sora-supported-...
12.
by simicd 2y ago
I'm using both Spark and polars, to me the appeal of polars is additionally it is also much faster and easier to set up. Spark is great if you have large datasets since you can easily scale as you said. But if the dataset is small-ish
13.
Delta Kernel – Building Delta Lake connectors, made simple (2024)(delta.io)
2 points by simicd 2y ago|0 comments
14.
Apache DataFusion 40.0.0 Released(datafusion.apache.org)
4 points by simicd 2y ago|0 comments
15.
Apache DataFusion Comet 0.1.0 Release (Apache Spark Accelerator)(datafusion.apache.org)
1 points by simicd 2y ago|0 comments
16.
by simicd 2y ago
Yes only found the announcement [1] that the Polars team and NVIDIA engineers are working on a GPU engine, but other than that no concrete examples. Github issues also don't provide any hints on the status, only one open item [2] where
17.
Announcing Polars 1.0 (Blog Post)(pola.rs)
34 points by simicd 2y ago|7 comments
18.
by simicd 2y ago
To add to that, an additional benefit would be you can compile and release it as Python package (Py03/maturin) or compile to WASM so it runs in the browser (with javascript bindings). This makes the code portable while benefiting from
19.
by simicd 2y ago
In short: Compatible with existing Spark jobs but executing them much faster. Benchmarks in the README file and docs [1] show improvements up to 3x while not even all operations are implemented yet (i.e. if an operation is not available in
20.
by simicd 2y ago
Yeah totally agree. I think it's great there is an organization that works on establishing standards but paywalling them definitely adds lots of frictions. In an ideal world the org would be fully financed by its members/governmen
21.
by simicd 2y ago
Currently there is very little information available online on GQL, the SIGMOID paper 'Graph Pattern Matching in GQL and SQL/PGQ' linked in the article is a great intro to the topic [1]. The authoritative source is the ISO sp
22.
by simicd 2y ago
Agree names are too close, searching GQL on Google returns results related to GraphQL as well. GraphQL is older, it was introduced in 2015 [1] while the work on the ISO GQL standard officially started in 2019 [2]. [1] https://en.
23.
by simicd 3y ago
Agree, substrait is a really cool project! Related: if you like substrait you might want to check out datafusion too. The project is a query execution engine built on top of Apache Arrow (incl. SQL parser, query planner & optimizer, exe
24.
by simicd 3y ago
Have you by any chance used Pyright? If not, I can highly recommend it. The VS Code extension makes writing Python almost as if it's a statically typed language (+ there is a CLI if you want to check types in CI). The docs are claiming