4 ms·
I was really impressed that it seems to be doing everything locally in the browser, but I see once you start trying to do more complex visualizations it POSTs t
by Hakkin 4y ago
I was really impressed that it seems to be doing everything locally in the browser, but I see once you start trying to do more complex visualizations it POSTs the dataset to the cloud. Still neat.
- loa_observer 4y agoI tested 1 million rows * 12 columns. It works fine with pure client's web-workers and indexedDB. For larger datasets(like CSV file > 150MB), especially for the "mega automation" feature, It turns to be slow and sometimes lead crash in browsers. For now, I have some temporally solutions, setting a sample size is the easiest. Another way is put some heavy computation tasks to scaleable OLAP services, like a clickhouse clusters. I will continue to research more ways to make the client handle as much data as possible and fast enough so more people can deploy it by their own with few costs.