3 ms·
As a former DBA and closet python super fan I found this post to follow all the things I would have done. Kudos to the op. Loading to a temp non-logged table i
by gigatexal 7y ago
As a former DBA and closet python super fan I found this post to follow all the things I would have done. Kudos to the op.
Loading to a temp non-logged table is the right way to go and using built in bulk loading options is smart, too. The type annotations looked really good and kudos for using modern python here (although for the examples I’m not sure they were needed, but being that they could have been used in a larger context that this article was just a microcosm if I could be wrong). Very good article. I’ve bookmarked the blog to consume other such articles.
- mbogda 7y agoWhat about translating data on the fly to the one big copy statement ?
- gigatexal 7y agoI could see that working. Just depends on your use case and what you want to accomplish. The approach the author takes has the advantage that when data is in the load table it can then be used to load into a real table via some transform in batches and be done in the background.