3 ms·

Using openpyxl to extract data from exist excel workbooks and other documents would seem like a good place to start. I suspect many companies use excel workboo

Using openpyxl to extract data from exist excel workbooks and other documents would seem like a good place to start. I suspect many companies use excel workbooks as "forms" with lots of data at the same cell in multiple workbooks.

westurner 6y ago
> I suspect many companies use excel workbooks as "forms" with lots of data at the same cell in multiple workbooks. Downstream data quality costs can be minimized with data normalized schema and data collection process controls like forms-based data validation. There are established UI/UX design patterns for data validation of user-supplied data: accessible [web] forms with tab-ordered input fields and specific per-input feedback with accessible HTML5 and ARIA. IIUC, Firefox now supports PDF forms, too? Why would we move from a spreadsheet to an actual database? Data integrity: Referential integrity (making sure that record keys actually point to something when creating, updating, or deleting), Columnar datatypes (float, decimal, USD, complex fraction), Access controls (auth(z): authentication and authorization), Auditing (what was the value before and after that) and Disaster Recovery, Organizationally-unified schema development and corresponding validation. Repeatability / Reproducibility: can you replay the steps needed to build the whole sheet? What parameters were entered and how to we script that par so that we can easily assess the relations between the terms of the argument presented?