3 ms·

When joining tables from 2 different data sources, is the join performed by loading two tables in full into memory ? If yes - any plans on improving this, so th

When joining tables from 2 different data sources, is the join performed by loading two tables in full into memory ? If yes - any plans on improving this, so that it does not OOM or kill the remote database ? If no - how do you handle this case ?

cube2222 7y ago
No, currently we support only lookup joins. We're planning to add table/hash-joins based on table-size heuristics.
- riku_iki 7y ago
  How do you look up csv records?..
  - cube2222 7y ago
    Hey, sorry for the late response, currently totally inefficient - scan whole file each time. We plan on adding an in memory or on disk index for such cases.