3 ms·

I hate that this feature isn't stable yet. I actually ended up writing my own just to gurantee a stable interface. The notion to put name derivation on operati

I hate that this feature isn't stable yet. I actually ended up writing my own just to gurantee a stable interface. The notion to put name derivation on operations is probably more trouble than it's worth. Random new ops will never support it, leading to never predictable results. Still this is all better than pandas. <Shudder> pandas.

tgb 6y ago
Pandas does give indexes and columns named entries, so this is less of an issue there, and everything has only 2 dimensions. In numpy it's a real problem. xarray is a library trying to fix that, though I haven't tried it yet. [1] [1] http://xarray.pydata.org/en/stable/ http://xarray.pydata.org/en/stable/
- lambdatronics 6y ago
  I use xarray ever day. It's great for my workflows, which involve multidimensional datasets (typically scalar or vector fields evaluated or measured on 1D,2D,or 3D grids, sometimes including both Cartesian and polar or more exotic coordinates). I can read in an HDF5 file from a simulation & instantly make plots that automatically have meaningful axis labels. It saves me a ton of boilerplate. There are some gotchas with the HDF5 reader trying to infer dimension relationships that aren't specified in files. Sometimes merging datasets can wrong: if a 'join' is supposed to take place along a dimension whose values are floats, the result will be empty even if there is machine-epsilon offset between the two versions of the same dimension. Or,you can get an 'outer product' by accident and crash the interpreter by trying to allocate too much memory.
rmrfstar 6y ago
> I actually ended up writing my own just to gurantee a stable interface. Yeah, I do the same. Just write a thin wrapper and hook torch in the __init__.py. But ragging on pandas isn't cool. Pandas is probably the most important factor driving python's popularity over the past decade.
- alpineidyll3 6y ago
  Why is Python's popularity a good thing in itself? If all the people making plots in pandas just used R, the world would be very much the same. Pandas promotes bad software practices in my experience with it's horrible bloated interface. It has cost me a lot of time-- for no benefit whatsoever. I am actually pretty sure it was released to slow the pace of competing quantitative hedge funds.

tgb 6y ago

Pandas does give indexes and columns named entries, so this is less of an issue there, and everything has only 2 dimensions. In numpy it's a real problem. xarray is a library trying to fix that, though I haven't tried it yet. [1] [1] http://xarray.pydata.org/en/stable/ http://xarray.pydata.org/en/stable/

lambdatronics 6y ago
I use xarray ever day. It's great for my workflows, which involve multidimensional datasets (typically scalar or vector fields evaluated or measured on 1D,2D,or 3D grids, sometimes including both Cartesian and polar or more exotic coordinates). I can read in an HDF5 file from a simulation & instantly make plots that automatically have meaningful axis labels. It saves me a ton of boilerplate. There are some gotchas with the HDF5 reader trying to infer dimension relationships that aren't specified in files. Sometimes merging datasets can wrong: if a 'join' is supposed to take place along a dimension whose values are floats, the result will be empty even if there is machine-epsilon offset between the two versions of the same dimension. Or,you can get an 'outer product' by accident and crash the interpreter by trying to allocate too much memory.

rmrfstar 6y ago

> I actually ended up writing my own just to gurantee a stable interface. Yeah, I do the same. Just write a thin wrapper and hook torch in the __init__.py. But ragging on pandas isn't cool. Pandas is probably the most important factor driving python's popularity over the past decade.

alpineidyll3 6y ago
Why is Python's popularity a good thing in itself? If all the people making plots in pandas just used R, the world would be very much the same. Pandas promotes bad software practices in my experience with it's horrible bloated interface. It has cost me a lot of time-- for no benefit whatsoever. I am actually pretty sure it was released to slow the pace of competing quantitative hedge funds.