5 ms·

Billion Cell Spreadsheets with Rust

8 points by qianli_cs 2y ago

gz09 2y ago
Thanks for posting this. Let me add some background for this demo we built to showcase incremental computation with Feldera (SQL compiled to do incremental evaluation). https://github.com/feldera/feldera https://github.com/feldera/feldera The gist of it is that if you update a cell, we incrementally update the spreadsheet which means we will only emit a minimal amount of changes for the cells affected by your update. The nice thing about it is that this is something that Feldera does automatically (and it would do that for any SQL that you end up writing, so it doesn't have to be a spreadsheet, but a spreadsheet is a nice example that everyone understands and knows about). There is a more detailed explanation in this video https://www.youtube.com/watch?v=ROa4duVqoOs https://www.youtube.com/watch?v=ROa4duVqoOs if you're interested what's going on under the hood -- or if you prefer reading about it we have an article series that goes over all the parts of the demo 1. Feldera SQL (gets compiled to Rust) https://docs.feldera.com/use_cases/real_time_apps/part1 https://docs.feldera.com/use_cases/real_time_apps/part1 2. API server (Rust/Axum hosted on fly.io) https://docs.feldera.com/use_cases/real_time_apps/part2 https://docs.feldera.com/use_cases/real_time_apps/part2 3. egui web Client (Rust compiled to WebAssembly) https://docs.feldera.com/use_cases/real_time_apps/part3 https://docs.feldera.com/use_cases/real_time_apps/part3
ryzhyk 2y ago
The backend for this app is literally 300 lines of SQL + Rust -- very cool.
- gz09 2y ago
  the code for it can be found here in case anyone is looking for it https://github.com/feldera/techdemo-spreadsheet https://github.com/feldera/techdemo-spreadsheet
deleted 2y ago
[deleted]
adidog 2y ago
[dead]
lsuresh 2y ago
Nice to see this here! There's been an interesting discussion on r/rust too: https://www.reddit.com/r/rust/comments/1i2ttwj/billion_cell_spreadsheets_with_rust/ https://www.reddit.com/r/rust/comments/1i2ttwj/billion_cell_...

8 points by qianli_cs 2y ago

gz09 2y ago

Thanks for posting this. Let me add some background for this demo we built to showcase incremental computation with Feldera (SQL compiled to do incremental evaluation). https://github.com/feldera/feldera https://github.com/feldera/feldera The gist of it is that if you update a cell, we incrementally update the spreadsheet which means we will only emit a minimal amount of changes for the cells affected by your update. The nice thing about it is that this is something that Feldera does automatically (and it would do that for any SQL that you end up writing, so it doesn't have to be a spreadsheet, but a spreadsheet is a nice example that everyone understands and knows about). There is a more detailed explanation in this video https://www.youtube.com/watch?v=ROa4duVqoOs https://www.youtube.com/watch?v=ROa4duVqoOs if you're interested what's going on under the hood -- or if you prefer reading about it we have an article series that goes over all the parts of the demo 1. Feldera SQL (gets compiled to Rust) https://docs.feldera.com/use_cases/real_time_apps/part1 https://docs.feldera.com/use_cases/real_time_apps/part1 2. API server (Rust/Axum hosted on fly.io) https://docs.feldera.com/use_cases/real_time_apps/part2 https://docs.feldera.com/use_cases/real_time_apps/part2 3. egui web Client (Rust compiled to WebAssembly) https://docs.feldera.com/use_cases/real_time_apps/part3 https://docs.feldera.com/use_cases/real_time_apps/part3

ryzhyk 2y ago

The backend for this app is literally 300 lines of SQL + Rust -- very cool.

gz09 2y ago
the code for it can be found here in case anyone is looking for it https://github.com/feldera/techdemo-spreadsheet https://github.com/feldera/techdemo-spreadsheet

deleted 2y ago

[deleted]

adidog 2y ago

[dead]

lsuresh 2y ago

Nice to see this here! There's been an interesting discussion on r/rust too: https://www.reddit.com/r/rust/comments/1i2ttwj/billion_cell_spreadsheets_with_rust/ https://www.reddit.com/r/rust/comments/1i2ttwj/billion_cell_...