4 ms·
One alternative way I’ve been testing recently: load the entire csv file into a single row column in Postgres, and the use a view to parse it into lines and val
by ako 3y ago
One alternative way I’ve been testing recently: load the entire csv file into a single row column in Postgres, and the use a view to parse it into lines and values. Then cache the result with a materialized view. 16mb, 500k rows (formula 1 laptimes) takes only a few seconds to load and map to materialized view records.
- daza 3y agoWhat do you mean by "row column in Postgres"? It's confusing. Could you please clarify that?
- Linosaurus 3y agoSounds like the initial table has just one row and one column, containing the entire 16mb csv string.
- ako 3y agoCorrect, at least one row for every time you load a csv file.