3 ms·
Pandas is probably in Debian and it can read parquet files. Polars is fairly new and under active development. It's a python library, I install those in $HOME/.
by petre 2y ago
Pandas is probably in Debian and it can read parquet files. Polars is fairly new and under active development. It's a python library, I install those in $HOME/.local, as opposed to system wide. One can also install it in a venv. With pip you can also uninstall packages and keep things fairly tidy.
- jjgreen 2y agoPandas is in Debian but it cannot read parquet files itself, it uses 3rd party "engines" for that purpose and those are not available in Debian Python 3.10.12 (main, Nov 20 2023, 15:14:05) [GCC 11.4.0] on linux Type "help", "copyright", "credits" or "license" for more information. >>> import pandas >>> pandas.read_parquet('sample3.parquet') Traceback (most recent call last): File "<stdin>", line 1, in <module> File "/usr/lib/python3/dist-packages/pandas/io/parquet.py", line 493, in read_parquet impl = get_engine(engine) File "/usr/lib/python3/dist-packages/pandas/io/parquet.py", line 53, in get_engine raise ImportError( ImportError: Unable to find a usable engine; tried using: 'pyarrow', 'fastparquet'. A suitable version of pyarrow or fastparquet is required for parquet support.
- petre 2y agoThen the options you are left with are either polars via pip or a third party parquet-tools Debian package. https://github.com/hangxie/parquet-tools/blob/main/USAGE.md#prebuilt-packages https://github.com/hangxie/parquet-tools/blob/main/USAGE.md#...
- jjtheblunt 2y agopolars via Rust (cargo) also