5 ms·
Why Isn't Taxpayer-Funded U.S. Broadband Mapping Data Owned by the Public?
- quantumensert 3y ago[dead]
- johnea 3y ago[flagged]
- bigallen 3y agoWhy are you roping Elon into it? Doesn’t SpaceX and other satellite broadband kind of make this map irrelevant?
- mschuster91 3y ago> Doesn’t SpaceX and other satellite broadband kind of make this map irrelevant? (Not the person you replied to) No, it doesn't. Fundamentally, no matter how many satellites SpaceX shoots up, it's still a geographically shared medium with significantly more latency and lower bandwidth than DSL or direct fiber. It's a stopgap for extremely rural areas that even in a thousand years couldn't recoup the investment of laying fiber, RVs, EMS, the military, ships, planes... but that's it. It can't ever beat a good 1 GBit/s fiber, much less the 10 Gbit/s you can get in some particularly well developed places.
- HotGarbage 3y agoWhen I checked last year the per-address geodata (sans addresses, sadly. Those are only available by license from CostQuest) was available via the map API. Only in small amounts (high zoom levels) however, and rate-limited. If someone wanted to perform a public service at the risk of pissing off the powers that be (see Aaron Swartz) it could be scraped.
- mike_d 3y agoBecause transparency and privacy are in direct conflict, and everyone has a "well ackshually" on where you should fall on that spectrum. If you require ISPs to hand over customer and connection performance data to the government you have government spying. If you have a third party estimate the data and sell it to the government, you have a proprietary dataset with no insight into its accuracy. If you let ISPs self report aggregate data they lie to make themselves look better while also convincing their competitors to build out in unprofitable markets. If you give nerds bulk access to data they will figure out a way to abuse it and pitch a YC startup to figure out when you are watching porn and better target ads. Everyone loses in this game. The real solution is you shouldn't care about broadband mapping. Change government broadband incentives to a post-paid reimbursement for delivering fiber to previously unserved homes. Make net neutrality a constitutional amendment. Make FCC spectrum auctions based on who will bid to provide the most free service to underserved users.
- eli 3y agoIt’s a map of where they offer service. There is no substantive privacy concern.
- yjftsjthsd-h 3y ago> If you require ISPs to hand over customer and connection performance data to the government you have government spying. What customer information? "We have a customer at this address and the min/avg/max download speed their connection has had this year was X/Y/Z" doesn't strike me as particularly sensitive information, nor PII.
- hn_acker 3y ago> "We have a customer at this address and the min/avg/max download speed their connection has had this year was X/Y/Z" Not even that. The data could be "With no more than a 1-hour router installation on premise, we (ISP Alpha) would be capable of serving this address at 500 Mbps download speed with 99% uptime, 800 Mbps down with 95% uptime, and 1 GB Mbps with 80% uptime." Ditto for upload speed. That's not customer information. Whether anyone at "this address" actually uses ISP Alpha internet right now doesn't matter until the customer disputes the advertised speed.
- m3kw9 3y agoTax payer also fund NSA, FBI and CIA
- atemerev 3y agoExactly, I don't know why you are being downvoted. There is data that has better to be secret, even though it is funded by public money. No controversy in that.
- actionfromafar 3y agoBut it's not secret, just a bit expensive?
- mannyv 3y agoWhile they raise god points, the data itself is probably less accurate than the dataset owned by Ookla/speedtest. The addresses and map really are pretty irrelevant. You can get all that data from open street maps. The real nice to have is service location and speed, which can be retrieved from Ookla and probably google or the data brokers. Some data providers can map IPs down to addresses, and they probably have a good idea of how fast the actual connection is as well. Why are we paying some lame company too much money to do this? That's really the question that should be asked.
- tptacek 3y agoWhy is this complicated? Public bodies fund all kinds of things under terms that don't create public domain IP rights to the work product data. When the federal government buys a copy of Time Magazine, it can't just publish it. What's public depends on the terms of the deal. I don't know whether the deal FCC and NTIA cut here is good --- is 93MM a lot for the data that got generated? But that's the question you'd have to answer before reaching a conclusion on whether the underlying data, which has value outside this project, should reasonably have been priced into it, or whether the USG got a price break for letting Costquest keep it.
- Dylan16807 3y agoIf the government funded a custom edition of Time, I would sure expect it to be public domain.
- tptacek 3y agoBy way of example: the whole DARPA SBIR program is premised on the government funding R&D that will not be made public.
- yellowbkpk 3y agoIt boils down to the fact that the United States does not have (public domain) knowledge of every address in the country. The USPS knows about deliverable addresses but won't give that information to the federal government because then it'd be public domain and they would lose several of their primary data moats (Zipcodes, addresses, delivery routes, for example). The Census has very complete knowledge of every address, but won't give it up because it's illegal (see Title 13 of the US Code). There is an ongoing attempt by the DOT to collect a National Address Database (https://www.transportation.gov/gis/national-address-database https://www.transportation.gov/gis/national-address-database) by collecting information from the address assigning authorities (usually county governments), but it's incomplete and unlikely to ever be complete because of holdout/underfunded local governments. There are several address datasets that are private (Google has a fairly complete one, FedEx/UPS probably have the most complete, TomTom, CostQuest, etc.). I started https://openaddresses.io/ https://openaddresses.io/ to try and collect them (NAD is based off this idea) into an open-licensed dataset. The broadband companies have records that say "this address is connected to this network, which could theoretically have this service level", but (a) they won't/can't tell you where they think the address is and (b) won't spend the time to match their address string format with the government's address because both are private data. Finally, without the address -> location data, even if we could get broadband providers to tell us what service is available at each address, we couldn't put that service level on a map because we don't know where the address is. ---- The Markup published some work in 2022 where they used OpenAddresses to use ISP's own tools to gather per-address service offerings and put them on a map. This is what the FCC's broadband map should be doing, but can't for the above (and political) reasons: https://themarkup.org/show-your-work/2022/10/19/how-we-uncovered-disparities-in-internet-deals#data-collection https://themarkup.org/show-your-work/2022/10/19/how-we-uncov...
- EMIRELADERO 3y ago> The USPS knows about deliverable addresses but won't give that information to the federal government because then it'd be public domain and they would lose several of their primary data moats Why does the USPS need a moat? It's not a private, profit-seeking enterprise
- c6400sc 3y agoI don't have such a conspiratorial take on this. Based on my previous experience in GovTech, I think this is what happened: The project team specs out a procurement. The procurement team gets bids and handles the bureaucracy of awarding the contract. After reviewing bids, the project team selects or shortlists finalists. A special part of the procurement team then handles negotiations. The negotiators usually know little to nothing about the project other than costs. In order to get a lower price, they will negotiate away things that the project team considers important but aren't spelled out in the requirements. Some of those things that gets easily negotiated away are rights for designs and data, even when gov't pays for their development. Negotiators are just looking for the lowest price for this particular project at this time. After all, there may or may not be extra costs in the future; they can claim wins on lower definite costs right now. Bidders know this game, and are ready and waiting to charge extra bucks for change orders down the line. I was a lead on a multi-million dollar open-first project for gov't. I was shocked how easily someone I'd never met gave away the rights to reproduce mounting brackets. And it was no surprise that we were locked into buying extra parts that could have been fabbed elsewhere for cheaper.
- whitej125 3y agoI'm confused. The articles talks about the data not being available for download and cites another article[0] which talks about it being available only for a fee. However if you go to the maps you see the data available for download and no fee[1]. What am I missing? [0] https://potsandpansbyccg.com/2024/02/14/shouldnt-broadband-mapping-data-belong-to-the-public/ https://potsandpansbyccg.com/2024/02/14/shouldnt-broadband-m... [1] https://broadbandmap.fcc.gov/data-download/nationwide-data?version=jun2023 https://broadbandmap.fcc.gov/data-download/nationwide-data?v...
- HotGarbage 3y agoThe address database and address-level ISP coverage is not freely available.
- fhk 3y agoI've done abit in this space... you can get the data at res 8 h3 hexagon. Sharing pre launch idea for comment, https://fiber2.me https://fiber2.me Open for questions / feedback
- TimeBearingDown 3y agoWhat’s the privacy policy?
- fhk 3y agoIt’s just a static site and stateless backend. That’s my biggest struggle atm, both for technical and non technical folks. Would putting the code on GitHub help here ? Still can’t verify what’s deployed on the backend…
- entitydc 3y agoCool project! Looking at starting a group of people to lobby my small city to invest in muni fiber. Would love to see what you have if it ends up on GitHub. Quick typo fix on the main page: neigbors is missing an “h” (neighbors).
- connon 3y agoOpen Directory of broadband performance by location https://broadband.money/broadband-audits https://broadband.money/broadband-audits