3 ms·

i keep wondering - whether the combination of ES6/Typescript + immutable.js + lodash + d3 + asm.js makes for the true next generation of R like analytics tools

i keep wondering - whether the combination of ES6/Typescript + immutable.js + lodash + d3 + asm.js makes for the true next generation of R like analytics tools. The way that Periscope.io works is probably indicative of the direction of a JS based analytics/prototyping framework. I suppose the first step needs to be a Jupyter notebook in ES6.

shmageggy 11y ago
For me, the first step would need to be a good tabular data library, like R's data.frames or Python's Pandas. Doing any kind of subsetting/selecting/slicing/joining on nested objects is a nightmare.
- Joeri 11y ago
  You should check out crossfilter: http://square.github.io/crossfilter/ http://square.github.io/crossfilter/ You import your records, define dimensions, and can then slice and dice your datasets to your liking. Very impressive is dc.js, which adds some magic on top of crossfilter and d3 to build interactive charts. https://dc-js.github.io/dc.js/ https://dc-js.github.io/dc.js/
  - sandGorgon 11y ago
    this is brilliant! thanks for this. Incidentally, it seems my entire tech stack is running on Square these days. Retrofit, Picasso, okhttp, dagger, some rxjava libs.... and now crossfilter.
Mikeb85 11y ago
> the true next generation of R like analytics tools. Dunno, but right now, today, you can use Plotly (which itself uses D3.js) with R, Shiny and RStudio. It's pretty awesome :)
- deleted 11y ago
  [deleted]
gedy 11y ago
As much as I admire D3, it using the DOM as its data model has made it difficult to work with (for me at least). I've actually had a much better experience using SVG and RactiveJS. It's animation/tweening of property changes is very handy for designing visualizations. http://examples.ractivejs.org http://examples.ractivejs.org
- cpfohl 11y ago
  I was coming in to mention Ractive actually. Designed by the team at the Guardian for easy data vis by non programmers. I've found that teammates who look at it pick it up in about 30 minutes. All your have to do in a course is teach the HTML and CSS and Ractive pretty much makes the interaction easy
sandGorgon 11y ago
there is also Machine-Learning-In-The-Browser which attempts to link Emscripten+llvm+lapack in the browser https://github.com/software-engineering-amsterdam/MLitB https://github.com/software-engineering-amsterdam/MLitB https://github.com/software-engineering-amsterdam/MLitB/issues/1 https://github.com/software-engineering-amsterdam/MLitB/issu...
rodionos 11y ago
We took a different approach on how to engage end-users by designing our own DSL with a compact pre-processor (template engine) for basic control structures: http://apps.axibase.com/chartlab/14cf1974/3/ http://apps.axibase.com/chartlab/14cf1974/3/ - Basic example http://apps.axibase.com/chartlab/2111a2b7/2/ http://apps.axibase.com/chartlab/2111a2b7/2/ - Inheritance and Iterator http://apps.axibase.com/chartlab/e8635882/10/ http://apps.axibase.com/chartlab/e8635882/10/ - Time series Transformations http://apps.axibase.com/chartlab/2ef08f32/1/ http://apps.axibase.com/chartlab/2ef08f32/1/ - Composite html/js/d3.js is prominent but not exposed. Users still have to learn some basic syntax but we really wanted to give them an alternative to UI controls (select drop-down, click) and GUI editors which I find restrictive and limiting.
- tomcam 11y ago
  I hope this catches on. Just the right level of abstraction. Easy to learn, yet feature rich.

shmageggy 11y ago

For me, the first step would need to be a good tabular data library, like R's data.frames or Python's Pandas. Doing any kind of subsetting/selecting/slicing/joining on nested objects is a nightmare.

Joeri 11y ago
You should check out crossfilter: http://square.github.io/crossfilter/ http://square.github.io/crossfilter/ You import your records, define dimensions, and can then slice and dice your datasets to your liking. Very impressive is dc.js, which adds some magic on top of crossfilter and d3 to build interactive charts. https://dc-js.github.io/dc.js/ https://dc-js.github.io/dc.js/
- sandGorgon 11y ago
  this is brilliant! thanks for this. Incidentally, it seems my entire tech stack is running on Square these days. Retrofit, Picasso, okhttp, dagger, some rxjava libs.... and now crossfilter.

Mikeb85 11y ago

> the true next generation of R like analytics tools. Dunno, but right now, today, you can use Plotly (which itself uses D3.js) with R, Shiny and RStudio. It's pretty awesome :)

deleted 11y ago
[deleted]

gedy 11y ago

As much as I admire D3, it using the DOM as its data model has made it difficult to work with (for me at least). I've actually had a much better experience using SVG and RactiveJS. It's animation/tweening of property changes is very handy for designing visualizations. http://examples.ractivejs.org http://examples.ractivejs.org

cpfohl 11y ago
I was coming in to mention Ractive actually. Designed by the team at the Guardian for easy data vis by non programmers. I've found that teammates who look at it pick it up in about 30 minutes. All your have to do in a course is teach the HTML and CSS and Ractive pretty much makes the interaction easy

sandGorgon 11y ago

there is also Machine-Learning-In-The-Browser which attempts to link Emscripten+llvm+lapack in the browser https://github.com/software-engineering-amsterdam/MLitB https://github.com/software-engineering-amsterdam/MLitB https://github.com/software-engineering-amsterdam/MLitB/issues/1 https://github.com/software-engineering-amsterdam/MLitB/issu...

rodionos 11y ago

We took a different approach on how to engage end-users by designing our own DSL with a compact pre-processor (template engine) for basic control structures: http://apps.axibase.com/chartlab/14cf1974/3/ http://apps.axibase.com/chartlab/14cf1974/3/ - Basic example http://apps.axibase.com/chartlab/2111a2b7/2/ http://apps.axibase.com/chartlab/2111a2b7/2/ - Inheritance and Iterator http://apps.axibase.com/chartlab/e8635882/10/ http://apps.axibase.com/chartlab/e8635882/10/ - Time series Transformations http://apps.axibase.com/chartlab/2ef08f32/1/ http://apps.axibase.com/chartlab/2ef08f32/1/ - Composite html/js/d3.js is prominent but not exposed. Users still have to learn some basic syntax but we really wanted to give them an alternative to UI controls (select drop-down, click) and GUI editors which I find restrictive and limiting.

tomcam 11y ago
I hope this catches on. Just the right level of abstraction. Easy to learn, yet feature rich.