4 ms·
I’m working in biotech. I think creating “curated” materialized views with dbt + datawarehouse or duck db + using webgl with d3 will be best long term solution
by cactusfrog 2y ago
I’m working in biotech. I think creating “curated” materialized views with dbt + datawarehouse or duck db + using webgl with d3 will be best long term solution https://blog.scottlogic.com/2020/05/01/rendering-one-million-points-with-d3.html https://blog.scottlogic.com/2020/05/01/rendering-one-million... .
Matplotlib works well for static plots. Altair and others freeze at around 4000 data points, which is crazy. Streamlit + matplotlib is impossible to maintain but is quick to get up and running.
- mjoin 2y agoExactly. This is the exact stack I envision to be the future in that space. The work of Scott Logic is awesome (and the company looks really nice as well! People and values)
- plaidfuji 2y agoI completely agree with the entire stack. I’ve basically been learning d3 for this exact reason - the primitives are so intuitive and I can tell I’ll be able to make what I want. And yeah streamlit is so close to being useful but just not quite there. But isn’t plotly built on d3?