5 ms·
If it took 40 minutes to insert a 60K line CSV with native postgres using bulk inserts there is something seriously wrong with the code.
by icedchai 6mo ago
If it took 40 minutes to insert a 60K line CSV with native postgres using bulk inserts there is something seriously wrong with the code.
- raw_anon_1111 6mo agoIsn’t that what I just said?
- icedchai 6mo agoNo? You made it sound like the only way it could go that fast is because you used a proprietary AWS extension. The fact is the original code had to be grossly inefficient, probably doing something like individual inserts outside of a transaction, to even be that slow.
- raw_anon_1111 6mo agoWell it wasn’t going to be that fast outside of S3 and please don’t give the tired cliche boogeyman of “cloud lockin” like using that one extension is going to make a difference