2 ms·
I'm on a project at the moment where google spreadsheets is the starting point for all content that goes into our database. Steps go something like this: 1. S
by sheraz 11y ago
I'm on a project at the moment where google spreadsheets is the starting point for all content that goes into our database.
Steps go something like this:
1. Scrape data from various places into CSV
2. Import CSV to google sheets
3. Manual clean / Visually inspection by human. They backfill any missing information
4. User scripts for google sheets (like geocoding addresses)
5. Point python script at sheet URL an import data to Postgres
6. Done
This workflow works extremely well because we outsource some of the data cleaning/backfilling on Upwork. These days everyone understands spreadsheets, so there is very little training involved.