4 ms·

Would really love to see first class support for Javascript/Typescript for data visualization purposes. The columnar format would naturally lend itself to an En

Would really love to see first class support for Javascript/Typescript for data visualization purposes. The columnar format would naturally lend itself to an Entity-Component style architecture with TypedArrays.

nevi-me 6y ago
Have you seen https://github.com/finos/perspective https://github.com/finos/perspective? Though they removed the JS library a few months ago in favour of a WASM build of the C++ library.
- juntan 6y ago
  The JS library hasn't been removed - it's the main UI and API over the WASM library that allows for Perspective to be used in the browser: https://perspective.finos.org/ https://perspective.finos.org/
  - infinite8s 6y ago
    I think the GP meant the Typescript arrow library.
BadInformatics 6y ago
https://arrow.apache.org/docs/js/ https://arrow.apache.org/docs/js/ has existed for a while and uses typed arrays under the hood. It's a bit of a chunky dependency, but if you're at the point where that level of throughput is required bundle size is probably not a big deal.
- liminal 6y ago
  I was mostly looking at this: https://arrow.apache.org/docs/status.html https://arrow.apache.org/docs/status.html
  - BadInformatics 6y ago
    Not sure I follow, that page indicates that JS support is pretty good for all but the more obscure features (e.g. decimals) and doesn't mention data visualization at all? Anyhow, I've successfully used https://github.com/vega/vega-loader-arrow https://github.com/vega/vega-loader-arrow for in-browser plots before, and Observable has a fair few notebooks showing how to use the JS API (e.g. https://observablehq.com/@theneuralbit/introduction-to-apache-arrow https://observablehq.com/@theneuralbit/introduction-to-apach...)
infinite8s 6y ago
There is a Typescript arrow library that can operate off the IPC format. As an example use case, take a look at the arquero data processing library from the University of Washington (from the same group that created D3). https://github.com/uwdata/arquero https://github.com/uwdata/arquero

nevi-me 6y ago

Have you seen https://github.com/finos/perspective https://github.com/finos/perspective? Though they removed the JS library a few months ago in favour of a WASM build of the C++ library.

juntan 6y ago
The JS library hasn't been removed - it's the main UI and API over the WASM library that allows for Perspective to be used in the browser: https://perspective.finos.org/ https://perspective.finos.org/
- infinite8s 6y ago
  I think the GP meant the Typescript arrow library.

BadInformatics 6y ago

https://arrow.apache.org/docs/js/ https://arrow.apache.org/docs/js/ has existed for a while and uses typed arrays under the hood. It's a bit of a chunky dependency, but if you're at the point where that level of throughput is required bundle size is probably not a big deal.

liminal 6y ago
I was mostly looking at this: https://arrow.apache.org/docs/status.html https://arrow.apache.org/docs/status.html
- BadInformatics 6y ago
  Not sure I follow, that page indicates that JS support is pretty good for all but the more obscure features (e.g. decimals) and doesn't mention data visualization at all? Anyhow, I've successfully used https://github.com/vega/vega-loader-arrow https://github.com/vega/vega-loader-arrow for in-browser plots before, and Observable has a fair few notebooks showing how to use the JS API (e.g. https://observablehq.com/@theneuralbit/introduction-to-apache-arrow https://observablehq.com/@theneuralbit/introduction-to-apach...)

infinite8s 6y ago

There is a Typescript arrow library that can operate off the IPC format. As an example use case, take a look at the arquero data processing library from the University of Washington (from the same group that created D3). https://github.com/uwdata/arquero https://github.com/uwdata/arquero