We're actually working on solving some of these problems at my non-profit, http://freelawproject.org http://freelawproject.org: - We've built https://www.court

We're actually working on solving some of these problems at my non-profit, http://freelawproject.org http://freelawproject.org: - We've built https://www.courtlistener.com https://www.courtlistener.com to provide a powerful search system with millions of opinions and scrapers for lots of jurisdictions. - We have the RECAP project that ingests content from PACER: https://www.recapthelaw.org https://www.recapthelaw.org - We'll start collecting an archive of oral arguments soon (just got funding for that, if all goes smoothly). Everything we do is open source and open access, so hopefully if we fail, people will take our code and content and keep it alive. You're right that it's a big challenge, but I think we're making some headway.