3 ms·
IIUC: The query written by users of arcticdb is in a dataframe-like python-ish language. The query engine first go through the inmemory parquet rows to get a s
by bigcat12345678 4y ago
IIUC:
The query written by users of arcticdb is in a dataframe-like python-ish language.
The query engine first go through the inmemory parquet rows to get a subset that contains the relevant data. These relevant data is returned as arrow frames.
Then the query planer produces a query plan and the engine execute the query plan on the previously returned arrow frames.
Does the query engine produce the query plan before selecting the arrow frames, and uses the plan for the selecting process as well?
- brancz 4y agoAs it stands, right now the query planner doesn’t look at any of the data (yet) when putting together the plan, but this will inevitably happen.