4 ms·
You'd be shocked and amazed how poorly designed and managed many gov. databases are. Many of these databases follow this pattern: 1) Some worker is fed up with
by TrackerFF 3y ago
You'd be shocked and amazed how poorly designed and managed many gov. databases are. Many of these databases follow this pattern:
1) Some worker is fed up with having to sift through hundreds of excel spreadsheets in order to find the information need, and the nightmare of keeping such spreadsheets updated
2) Said worker deploys a small database - just for their own use. After some time the DB gets more users, who make their own views and what not. The database and tables within may or may not follow some rules. Heck, maybe the worker that created it was learning as they went on.
3) Said worker quits or gets a new job, and the database is essentially unmanaged. Some other worker might not now about that DB, and you go back to step 1)
Now multiply a database like that with 100, and span it over 20 year. You get this unimaginable spaghetti monster of multiple DBs, some written in one dialect, some in others. Some are completely unnormalized, others a high degree of normalization.
And to build a report, you may need to access tables from numerous such databases. Even seasoned analysts dread starting on the reports, because they'll spend a good day just to find the right dbs, tables, and all the errors.
So of course when the directors hear about this new fangled AI magic that just spits out the results when you ask it it plain English, they immediately order a use/benefit analysis on it.
Ok, so that may be a bit harsh - but that's the reality of many agencies. Dogshit DB management, and being 20 year behind the digitalization revolution.
But yes, a problem would of course be: How do you know that the data the LLM returns is true? Is it conjuring up fake data? Does it process/calculate data as you want it to?
- vharuck 3y agoThis summarizes the actual hard parts of my job as a government statistician. But I'm hoping LLM-generated code (R in my case) can let me stay "in the flow" when exploring. I can spot-check generated code pretty quickly, but finding data, reading their docs, then finding packages to do what I want takes time. I'll often forget why I asked the question in the first place. For example, "How many children lived within 50 miles downstream of X in 2015 and were diagnosed with Y?" I can imagine how the finished code would look, but writing it myself means brushing up on the diagnosis records, two or three GIS datasets, and a GIS package. If we had a nice database or warehouse, this wouldn't be terrible. I don't fear for my job. The coffee would be generated by including snippets of previous analyses in prompts, and guess who wrote those snippets? My role will become less coding, and more reaching out to policymakers and nonprofits to help them answer questions. I'll tell them what data we do have, what's reliable, and what kind of statistics can answer their questions. At least, that's my dream.