richardbarosky

10 ms·

61.
by richardbarosky 5y ago
Right, more cases primarily. The performance has been optimized so the searches, search result pages, and individual pages load significantly faster. Most searches load in under 200ms and most pages including SRPs load in less than 20 ms. S
62.
by richardbarosky 5y ago
hmmm, middle initial checks out. though it's possible it's another steve.
63.
by richardbarosky 5y ago
There are I think about 5 million opinions from that project, yes. I wouldn't say it's blackops, feel free contact me on reddit.
64.
by richardbarosky 5y ago
I think broadly the same tradeoffs exist for any search sysetm, like Google or PACER for example.
65.
by richardbarosky 5y ago
Valid criticisms, thanks for pointing them out as areas of improvement. Good question about the % of total cases though I think there are some estimates on that. My guess would maybe be 100M+ cases per year.
66.
by richardbarosky 5y ago
The search uses elasticsearch 7 for full text search. It's been extremely fast and worked very well. You're right court data is scattered across many different systems and needs to be aggregated, which is a difficult process.
67.
Show HN: Full text search on 630M US court cases(judyrecords.com)
698 points by richardbarosky 5y ago|269 comments
68.
by richardbarosky 5y ago
Nice. While I haven't used Dolt, I've definitely enjoyed reading the blog, sepecially the MySQL compatability stuff and some of the other fun ones (like the alcohol dispenser project). Good luck guys!
69.
by richardbarosky 5y ago
They wrote a blog about database versioning solutions a little while back, which distinguishes schema vs. data versioning tools. I can't say for sure how comprehensive it is, but presumbly it touches on the more well known solutions.
70.
All Digitized Texas Appeals Court Cases Since 1900(kaggle.com)
2 points by richardbarosky 5y ago|0 comments
71.
by richardbarosky 6y ago
Is the case available on the court portal? You can email me richardbarosky@gmail.com if its been removed since it was retrieved.
72.
by richardbarosky 6y ago
The race data in court case records is very often used for crime statistics. It's probably the most analyzed data point after what the incident was about.
73.
by richardbarosky 6y ago
Many similar databases and people finder sites are behind a paywall. There are a lot of positives to being able to use public records data available to make more informed decisions, whether it's to let your kid stay at someone's h
74.
by richardbarosky 6y ago
Feel free to join in if you're interested in gender dyanmics stuff
75.
by richardbarosky 6y ago
Good point, that would definitely be an improvement. Thank you.
76.
by richardbarosky 6y ago
Interesting, I'll check it out. Thanks for the link.
77.
by richardbarosky 6y ago
Thanks, as far as I know it's the largest database of court cases on the Internet. If there's enough traffic I'll support the site with ads. Don't have any other specific plans currently.
78.
by richardbarosky 6y ago
Thanks. All the data is collected from various government databases.
79.
by richardbarosky 6y ago
From what I understand, he had some kind of academic library access for PACER and used that to bypass what others would be changed for. There are lawsuits against PACER charging fees for what's public information generated by taxpayer
80.
by richardbarosky 6y ago
Do you think the data should be removed from the government portals? Those are interesting points. What do you think is the right balance to strike? I can see why it might be surprising to find some results when searching. The same data has
81.
by richardbarosky 6y ago
Interesting point. If you know the state where someone lives, you can look up the same info on the government website. Additionally, many many other databases have same public data but they ask for a payment to search.
82.
by richardbarosky 6y ago
Not sure. Maybe if someone doesn't like the Google search results, they make a complaint, and Google has to do what they want. There are many other public records databases that have similar data, including the federdal judiciary and m
83.
by richardbarosky 6y ago
The general idea has various problems. For example, would newspapers or accounts of things/people, in various media, of objectively public information be required to be retroactively removed from any mention? Does it make sense to forc
84.
by richardbarosky 6y ago
Thank you
85.
by richardbarosky 6y ago
I've mentioned other legal databases on the info page. It's public information. judyrecords is the largest free database of court cases, but there are many other free/not free ones as well.
86.
by richardbarosky 6y ago
I've noted CourtListener on the info page: https://www.judyrecords.com/info "PACER notwithstanding, CourtListener is the most powerful case law research tool available online — and in many ways is much more powerf
87.
by richardbarosky 6y ago
15KB is maybe the average case size, including HTTP request data. That's 1024 * 15 * 439,000,000 = 6.7TB roughly. The cases are all compressed, so I'm not using 6.7TB non-compressed for cases. But there are other request and non-r
88.
by richardbarosky 6y ago
Sure, I'll post after the dust settles. Server getting smashed but still handling searches pretty dang well. Some sites crash from the page views, and here I have to handle everyone searching 400 million documents too.
89.
by richardbarosky 6y ago
I've downgraded from that. I talked about that in that post. It was most definitely a knee-jerk reation to getting slashdotted on a popular subreddit and not wanting that to happen again. However, still on some very good hardware and h
90.
by richardbarosky 6y ago
Good point. PACER, in fact, has been called out by major news publications for literally being a scam the way the change for access to public records. https://www.politico.com/magazine/story/2019/03/20&#x

More ›