9 ms·
U.S. Census director resigns amid turmoil over funding of 2020 count
- deleted 10y ago[deleted]
- swanson 10y agoOdds that Facebook ends up doing a privatized 2020 census?
- kirykl 10y agoMaking all US Citizens legally obligated to have Facebook account
- FfejL 10y ago0. An opt-in Census is useless.
- tdicola 10y agoBy 2020 President Zuckerberg will mandate all citizens have Facebook accounts.
- paulddraper 10y agoPrompting the few remaining Google+ loyalists to flee to the mountains, Red Dawn style.
- Rapzid 10y agoI bet they could get it done for us for half of the estimated 1bn cost of the "new electronic system" alone.
- irrational 10y agoUgh, so far I've been able to avoid the Facebook bandwagon (and according to me teenagers there will never be a reason to use Facebook - apparently Snapchat is the new Facebook). That would suck if I had to get an account just to participate in the census.
- iloveluce 10y agoA bit unrelated but the US Census should really work with the US Postal Service when performing the census. It would save the Census bureau some money and would provide the Postal Service with an additional source of funding.
- wavefunction 10y agoI'm sure both departments might like that but unfortunately they're currently in the grip of ideologues who would like to defund both departments and shut them down permanently.
- yellowbkpk 10y agoUS Census can't really work with anyone when it comes to their data. They take their responsibilities under Title 13 [0] (which prohibits them from sharing information they collect) very seriously. They're trying various options to share some limited data (like address data) [1], but haven't gotten very far. They've done some work on "Community TIGER" [2], which aims to give validation information back to local governments for geographic data, but not the improvements that Census generates as part of the decennial census. The US Postal Service has no motive to share with the Census Bureau. For one thing, the USPS makes all of its money selling limited access to its address list to advertisers. Additionally, the USPS's address list (or delivery points) doesn't necessarily correspond with people and where they live. PS: I'm interested in this sort of thing because I help run OpenAddresses [3], a community-built list of authoritative address data sources from around the world. There's a lot of data out there! [0] https://www.law.cornell.edu/uscode/text/13/9 https://www.law.cornell.edu/uscode/text/13/9 [1] https://fcw.com/articles/2011/09/14/census-bureau-title-13.aspx https://fcw.com/articles/2011/09/14/census-bureau-title-13.a... [2] https://www2.census.gov/geo/pdfs/gssi/Community_TIGER.pdf https://www2.census.gov/geo/pdfs/gssi/Community_TIGER.pdf [3] https://openaddresses.io/ https://openaddresses.io/
- knz 10y agoI used to be GIS Coordinator for a medium size municipality. The Census Bureau sent out DVD's of address points for the 2010 count for cities to validate. There was some collaboration between cities, USPS, and Census on it but as you likely know address standards are a mess in the US. Many states have efforts to standardize but it's often difficult because addressing is left to the municipality and often falls to a non GIS person (city planner, building inspector etc) who has little concept of normalization or why it's a bad idea to create addresses that are difficult for a computer to understand. Openaddresses.io is an awesome project, as a GIS professional thank you! This type of data can be immensely useful!
- John23832 10y agoTroubled funding for the census leads to easier gerrymandering. Today had been full of surprises.
- andrewl 10y agoThat was my immediate thought as well.
- Spooky23 10y agoThat's the Trump MO. They drop something big like the FBI director that they have in the bullpen to overshadow another turd like this. Underfunding the census directly hurts the democrats, as urban areas always need more human outreach than the burbs, whose residents dutifully fill out their surveys. It's not just gerrymandering, its outright warfare. Census numbers drive things like sales tax distribution, school aid, and local government aid too. The strategy here is to starve out democratic strongholds.
- zanny 10y agoThere have been confessions dating back to the Nixon administration of war like tactics to directly harm the democratic base (and plenty more before him). It is not new, they can just be more blatant the more drawn the partisan lines are into independent isolated silos. After all, what are republicans distraught by this behavior going to do? Side with the enemy, whose ideals their culture have defined as not just wrong but evil? Or in the inverse, is a liberal dissatisfied with the democrats behavior going to side with those whom the left deem imbeciles and tyrants? We saw in this last election what voter disdain in the major parties causes. A bunch of third party votes, some minor protests that the media systemically silenced or condemned, that still pale next to the structural rigidity of first past the post and a firmly established ideological divide meant to keep the poor fighting amongst themselves.
- refurb 10y agoas urban areas always need more human outreach than the burbs I would disagree as others have pointed out. It's the rural folks who couldn't care less that need to be tracked down. A single person could easily canvass an entire neighborhood in a large city. And I think the comment about dropping the big news at a convenient time is something every politician does. How many times have you seen announcements by the gov't go out on a Friday afternoon? Avoid media attention!!
- xname2 10y agoShould the new electronic system really cost that much? Do they work with the SV, or will they just give the project to a terrible contractor like the health insurance exchange market?
- coldcode 10y agoMaybe they could just eliminate the census entirely and just have Congress pick whatever numbers they want. That would save a lot of money. \s
- gavinpc 10y agoI know you're joking, but for those who may not be familiar, the Census is mandated explicitly by the Constitution. So that would require a constitutional amendment.
- Rapzid 10y ago1bn is a bit much for a CRUD app... I'm exaggerating of course, but I believe not as much as they are on the costs..
- jtmcmc 10y agowhat? the census requires massive amounts of people to do all sorts of stuff including large numbers of people to actually conduct the census.
- ethbro 10y ago$10k for the app, $250m for the IBM hardware, $350m for the IBM support contract, and $399,990,000 set aside for legal defense when the government decides what they spec'd wasn't what they needed and sues the contractor.
- vtange 10y agoThis is something to keep an eye on, given the fact that Congressional district borders will be drawn using 2020 data.
- harryh 10y agoSeats in the house of representatives are allocated based on census data. District borders can be drawn based on whatever data state governments want.
- eric_b 10y ago650 million dollars to tally some simple demographic information? I understand there is always more to the story - but this doesn't pass the smell test. Additionally, what does the Census Bureau need 1.5 billion for on a non-census year? I don't mean that rhetorically - 1.5 billion a year pays 15,000 people an annual salary of 100k. Where is that money going?
- nscalf 10y agoAWS bills
- skybrian 10y ago"Most recently, Census 2010 employed 635,000." https://www.census.gov/history/www/faqs/agency_history_faqs/how_many_census_takers_are_needed_to_conduct_the_census.html https://www.census.gov/history/www/faqs/agency_history_faqs/...
- magila 10y agoThat's during the census itself, which is still three years away. The funding in question is just to develop the infrastructure to record the data.
- ethbro 10y agoPer the article, spending typically jumps in the years leading up to a decennial count. And it is pretty important, as I'm assuming it gets fed in as base data to a lot of models (and our representative democracy).
- ACow_Adonis 10y agoEver done a census? Several hundred million dollars would equate to a few dollars a head in the US, which my gut feel says is not bad value (and may even be an unrealistic underestimate) That doesn't mean there aren't cheaper ways to generate specific figures/estimates than a census, but an important point is that those aren't censuses. Tabulation of the data is not the most expensive part, although even that is far more complicated than most realise. The data is literally not there to tally: you have to collect it. Now keep in mind you have to target and include, in no particular order: People with no homes People with no internet People with no smartphones Old people Young people People with lots of money People with no money Newborns The dead Non-English speakers The illiterate Etc. You need interviewers, transport, pre-testing and callibration, actual implementation, post-testing and calibration. This is all without even considering finding the people with the right skills to design, implement and coordinate this, and without accounting for any software or capital costs. Additionally, censuses ramp up and ramp down, you can't just put aside funding for the census year: systems of that size cannot be hired and deployed in that amount of time. It's a bigger operation with more bodies than many military exercises, and I'm guessing actually they do it N times cheaper. I'm assuming that the US census is much like ours: in the pre/post years you're planning the next roll out, analyzing the things that went wrong last year, experimenting with improvements, all with a possible backup-back out case in case those experiments go wrong and a hard deadline that cannot be missed.
- pfarnsworth 10y agoHonestly, why is it so expensive? If you created a startup with $50 Million, and gave them 4 years to implement this system, I'm sure it would be done much more efficiently. Then you "buy" the startup for $200 Million at the end of it, and all the employees get a nice payout.
- alecdibble 10y agoIt's equally likely that the startup would spend the $50 million with nothing to show for it.
- ceejayoz 10y agoI'm really struggling with Poe's Law with this comment.
- s73ver 10y agoWhat's more likely is that the founders and investors would take the payout, and the workers would get nothing. And I extremely doubt the ability of a startup to do any kind of worthwhile count of people outside of major metropolitan areas.
- ceejayoz 10y ago"We counted the Bay Area and NYC, that's enough, right?"
- kbd 10y ago> And it comes less than a week after a prickly hearing at which Thompson told lawmakers that cost estimates for a new electronic data collection system had ballooned by nearly 50 percent. I'd love to know the details of that project overrun.
- maxlybbert 10y agoHonestly, so would I. I took a project management class in college, and many of the examples were NASA projects because they were sexy. Sadly, I don't remember any case studies referring to project overruns. And, seriously, if you're looking at NASA projects, you shouldn't have trouble finding examples that went over budget or didn't make the deadline. There are good lessons to learn from less-successful cases.
- mattmcknight 10y agoThe latest PMR is online. https://census.gov/programs-surveys/decennial-census/2020-census/planning-management/program-briefings/2017-04-21-pmr.html https://census.gov/programs-surveys/decennial-census/2020-ce...
- froindt 10y agoI'm curious what caused the cost of the new electronic system to increase so much. I understand there could be a lot to it on the back end to ensure privacy and anonymity of the data collected, but it doesn't seem like it should be a huge deal technically. We're talking about ~325 million people and collecting demographic info and address info [1]. The IRS has far far more variables to collect info on, however they have fewer people. 325 million people is nothing compared to scaled companies like Facebook, Amazon, or Google (far more data points per person, far more people). Any speculation on cause or other considerations I'm missing? Did a quick search on Google News and didn't find anything. All the companies I listed have huge teams, but I am still not seeing how the cost has exploded. https://www.census.gov/history/pdf/2010questionnaire.pdf https://www.census.gov/history/pdf/2010questionnaire.pdf
- drc500free 10y agoPointing to the highest performing companies that have been selected by the market is not really a fair comparison for a government agency. It's more relevant to look at what a median tech company would end up doing, if they had to launch at scale without organic growth but had unlimited funding.
- jonnathanson 10y agoTotally fair, but to play devil's advocate for a split second, let's not forget that the Census Dept has to make people aware of itself and get people to give their info willingly and within timelines, given no real incentive to do so. Facebook, Amazon, and Google are collecting info that is willingly passed their way. We are probably talking about buying data entry and management bloatware from a big mediocre enterprise contractor and then integrating the monstrosity.
- drc500free 10y agoTotally agree... Private sector just isn't going to serve people with a negative ROI and stay in business. Facebook's costs would skyrocket if they had to chase down the last 10-20% of the population necessary for comprehensive coverage. These are all structural issues with solving the problem, before we even get to a procurement process that picks a mediocre LPTA contractor instead of Google.
- pdog 10y agoWhy hire nearly a million temporary census takers[1] every ten years? Even private companies have databases with far more detailed and more frequent demographic and psychographic information on every person in the United States. [1]: https://www.census.gov/history/www/faqs/agency_history_faqs/how_many_census_takers_are_needed_to_conduct_the_census.html https://www.census.gov/history/www/faqs/agency_history_faqs/...
- GavinMcG 10y agoWell we need some independent way to regularly reapportion representatives, if we're going to stick with a system of geographically-based representation.
- GavinMcG 10y agoAlso, if you're suggesting that we don't need to literally go door-to-door counting people, you're not alone. Many people argue that statistics will give us a better measure than one that has the flaws of in-person data collection. The problem is that the U.S. Constitution says the following: > which shall be determined by adding to the whole Number of free Persons, including those bound to Service for a Term of Years, and excluding Indians not taxed, three fifths of all other Persons. The actual Enumeration shall be made within three Years after the first Meeting of the Congress of the United States, and within every subsequent Term of ten Years, in such Manner as they shall by Law direct. The key word is Enumeration. That arguably means counting, one-by-one, rather than making a statistical estimation.
- deleted 10y ago[deleted]
- maxlybbert 10y agoIt's not entirely "the same old way." There have been some improvements since 1790.
- throwaway5752 10y agoIt's ridiculous this is the top trending submission when the president fired the FBI director that was investigating his ties to Russia. If political stories are fair game, this is important but a rounding error next to Comey. @dang, the HN ranking system is so trivially hackable via downvotes and flags by a motivated minority.
- paulddraper 10y ago(1) It's been known since forever that Trump and the FBI director didn't see eye to eye, and the former employs the latter. Still significant, just not surprising. (2) This story is tech related and way more on topic for HN then pure politics (https://news.ycombinator.com/newswelcome.html https://news.ycombinator.com/newswelcome.html). I'm sure Reddit is having kittens, if politics is your thing.
- bdrool 10y ago> It's been known for a long time that Trump and the FBI director didn't see eye to eye, and the former employs the latter. Still significant, just not surprising. The president firing the FBI director is huge news. The story is currently at the top of every single message board and news outlet except this one.
- fphhotchips 10y agoPrecisely why it doesn't need to be here. https://news.ycombinator.com/newsguidelines.html https://news.ycombinator.com/newsguidelines.html > Off-Topic: Most stories about politics, or crime, or sports, unless they're evidence of some interesting new phenomenon. Videos of pratfalls or disasters, or cute animal pictures. If they'd cover it on TV news, it's probably off-topic. (emphasis mine) Fact is that submission this is the sort of thing that could be interesting to the HN community and will probably get lost in the mainstream with news of Comey going. Comey going is huge news - there are other places to discuss it.
- yeukhon 10y ago
- DannyBee 10y agoIt's funny how easy people think this is. Yes it's "just a data collection app". You're talking about an org that, if your address is in the middle of a swamp, they will send someone by boat to find you. They take collection and processing very seriously. If you gave a startup 200 million or whatever, you'd have a pretty accurate census of internet connected people in the top 20 cities in the US. Oh, and a declaration of victory from the startup, plus 300 billion in market cap in the hope that they may actually be able to count everyone someday! Somehow, i doubt you'd come up with something that can collect data well, know where to be focusing field representatives, etc with 600k+ field representatives in a reasonable and efficient manner. Has anyone here tried to organize people,targets, and data in say a company twice the size of all of IBM? How did that go? :) (the census is honestly relatively cheap. it costs about 50 bucks per person, total. Obviously, counting rural, etc areas is the majority of the cost) The 2020 Census is going to be weird, too. Disadvantaged minorities, etc are statistically less likely to be counted[1], and especially given the climate in the US, counting immigrants is going to be especially hard. [1] Which is why in the US, they democrats often try to pass rules around using statistical methods, and the republicans claim it requires actual enumeration
- magila 10y agoThe difficulties you mention are entirely related to the operational costs of carrying out the census. I see no justification for the data collection system itself to cost over $900 million.
- DannyBee 10y agoErr, no. You understand this isn't a dumb mobile app someone types something into with a simple server backend right? It's the system that manages and handles the operational data collection and statistical analysis for the census. It's not a CRUD app bob types something into at the end of the day. It manages the whole effort.
- NeutronBoy 10y agoAnd the cost likely includes wages/costs of people for things like training users on the system, setting up and running a help desk for census staff to call when they're completing the census, costs for managing and running procurement for the different components, etc.
- perseusprime11 10y agoCan we use Machine learning to predict 2020 count? Do we really need to manually count?
- jtedward 10y agoThe above comment is an excellent example of political gaslighting, there is ample, undeniable evidence of some sort of GOP collision with Russia. No sane person looking at the evidence could come to any other conclusion, but by confidently stating the exact opposite of the truth the above commenter seeks to sow doubt in the mind of a potentially disinterested or confused audience. This is a an increasingly common tactic on these boards.
- jessaustin 10y ago"Gaslighting" is certainly going both ways, but it's important to me that one side is horrifyingly eager for war with Russia and the other... isn't. I don't care what "the truth" is; I just don't want the current generation of humans to be the last. And for what? Politics? Truly, it's the mind-killer.
- dang 10y agoPlease don't post like this to HN. It falls into the category of insinuating astroturfing/shillage by other users, which (unless you have evidence) is a breach of civility that is not allowed on HN. Someone holding an opposing opinion isn't evidence. The "you must be a shill/troll/spy because of what you say" argument is common, toxic, and false. People need to abstain from it in this corner of the internet. We detached this subthread from https://news.ycombinator.com/item?id=14305376 https://news.ycombinator.com/item?id=14305376 and marked it off-topic.
- jssmith 10y agoMy guess is that the contract under scrutiny to the RFP COMM-16-BC-2020. Here are the services to be provided: - Research and Data Analytics - Strategic Planning, Program Development, and Integration - Communications Support for Decennial Census Operations and Other Programs - Field Recruitment Advertising and Communications - Traditional Advertising and Media Buying - Digital Advertising and Other Communications Technologies - Social Media - Public Relations - Communications Planning and Materials for the Partnership Program - Statistics in Schools Program - Website Development and Digital Engagement - Rapid Response Activities - Project and Financial Management - Stakeholders Relations - Communications Support for the 2020 Census Data Dissemination The scope here is pretty large and it includes advertising, etc., so one can see how it might cost hundreds of millions. It isn't just about setting up a database and running a web site. Full document is here: ftp://ftp.census.gov/about/business-opportunities/2020-comm-final-rfp-1-21-16.pdf
- magila 10y agoThat sounds like it covers just about everything you would reasonably expect to be part of the preparations for the census. Which raises the question, what's the other $2 billion of the bureau's budget over the next two years being spent on?
- secabeen 10y agoContinuing to run the other ongoing projects that the census does, like the American Community Survey.
- 3131s 10y agoThe should do the census and register Americans to vote in the same process.