3 ms·
I actually managed to load all CSVs into a postgres database. I have one database now with 5 tables that contain all the information. Now the tricky part is doi
by SnowingXIV 9y ago
I actually managed to load all CSVs into a postgres database. I have one database now with 5 tables that contain all the information. Now the tricky part is doing the restructure, stripping out unneeded columns, some if statements to choose the correct column to use, connecting the relationships, and redoing the IDs and making that as painless as possible (hopefully a query I can repeat) since I'll likely have a new fresh batch of data coming in a month.
All together the CSVs totaled 750MBs.
- tixocloud 9y agoGotcha. Sure, I can help you out. Send me an email and we can connect.