Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
ubutler
searching PlanetScale…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
13 ms
·
121.
▲
by
ubutler
3y ago
Let us not forget colonel and (in UK English) lieutenant (relevant: https://www.theguardian.com/notesandqueries/query/0,5753,-19... ).
122.
▲
The .ai TLD is itself a website
(ai.)
3 points
by
ubutler
3y ago
|
2 comments
123.
▲
Reddit bug inserting slurs into urls
(theverge.com)
2 points
by
ubutler
3y ago
|
0 comments
124.
▲
by
ubutler
3y ago
To be fair, they did write things down. It’s more a matter of explaining why GPT was behaving the way it was (ie, because it was regurgitating its training data). Also, I’d personally respect a blog post just as a much as a peer reviewed
125.
▲
Google Drive misplaces months' worth of customer data
(theregister.com)
507 points
by
ubutler
3y ago
|
274 comments
126.
▲
by
ubutler
3y ago
See my response to /u/nextworddev ( https://news.ycombinator.com/item?id=38399702 ). In short, GPT-4 outperforms my LLM simply because my model is quite small (its smallest version of GPT2). At the moment, I'm
127.
▲
by
ubutler
3y ago
> 1) What’s the main use case for this? Originally, I intended to produce an LLM that could be used for answering questions related to Australian law, potentially via retrieval augmented generation. The LLM I ended up building, however,
128.
▲
by
ubutler
3y ago
Hey HN, Last month, I had the honour of seeing my article on how I built the largest open database of Australian law ( https://umarbutler.com/how-i-built-the-largest-open-database... ) reach the front page. Due in large part
129.
▲
Show HN: I built the first open LLM for Australian law
(umarbutler.com)
40 points
by
ubutler
3y ago
|
9 comments
130.
▲
by
ubutler
3y ago
https://web.archive.org/web/20231123121535/https://blog.abct...
131.
▲
by
ubutler
3y ago
For Americans, this is comparable to Verizon going down. Optus is our second largest telco, with 10 million customers including many hospitals, trains, enterprises, etc… I myself am currently unable to make calls and use mobile internet.
132.
▲
by
ubutler
3y ago
The majority of the source data was already licensed under CC BY 4.0. Additionally, the Corpus, as a work constituting a curated and post-processed collation of other works, is also licensed under CC BY 4.0.
133.
▲
by
ubutler
3y ago
> A particular case I have is where there is a draft bill put out for industry/community consultation. Quickly diffing the releases is the goal but for now usually relies on one (preferably two) subject matter experts to read the wh
134.
▲
by
ubutler
3y ago
Correct. They are a member of WorldLII which was founded by AustLII: http://www.worldlii.org/
135.
▲
by
ubutler
3y ago
It actually looks quite clean. Certainly a lot better than some of our legal databases. I guess the only suggestion I'd have is that it seems like you can have an account with the website but there's login or register button on th
136.
▲
by
ubutler
3y ago
Unfortunately, I haven't been able to train a model on my database just yet (although I have seen great results using it as a RAG data source for GPT-4). I'll keep ollama in mind once I have something to share.
137.
▲
by
ubutler
3y ago
> Just one note - the link in your Github readme to https://umarbutler.com/open-australian-legal-corpus doesn't seem to go anywhere. Thanks for the heads up! I've fixed that now. > For someone interested in
138.
▲
by
ubutler
3y ago
Weird. Thanks for the heads up. I'm using SiteGround to host it which is shared hosting so perhaps that's why? I'll have to investigate.
139.
▲
by
ubutler
3y ago
So AustLII and Jade are what I was referring to when I say "While there were certainly a few free-to-access legal databases, none were truly open ...". They are free but not open in the sense of being licensed under an open sour
140.
▲
by
ubutler
3y ago
Absolutely. Luckily, the websites I scrape don’t change very often (ie, every 5-10 years based on Wayback Machine), and also a couple of them all use the same underlying legislation management system and APIs. Ultimately, however, I’m hopin
141.
▲
by
ubutler
3y ago
There is! It’s called the [Pile of Law]( https://huggingface.co/datasets/pile-of-law/pile-of-law ), and it’s actually what inspired this project. The only caveat is that it doesn’t appear to be regularly updated, an
142.
▲
by
ubutler
3y ago
> Fantastic work here! I was griping to my team just last night how painful developing a chunking strategy for Australian Legislation is that while there's (generally) layout consistency within a piece of legislation, that's no
143.
▲
by
ubutler
3y ago
Thanks for the suggestions! Distributing the Corpus widely will be my next focus.
144.
▲
by
ubutler
3y ago
As I point out in the introduction, there are a few free-to-access legal databases available in Australia, but none are truly open in the sense of being free from copyright restrictions. Neither AustLII nor Jade are licensed under an open
145.
▲
by
ubutler
3y ago
Github might be difficult as they impose constraints on the size of repositories and the Corpus is around 5GB. The Internet Archive is a good idea, however, I’ll have a look into that. I’ve also been thinking about sticking it on Kaggle as
146.
▲
Show HN: how I built the largest open database of Australian law
(umarbutler.com)
172 points
by
ubutler
3y ago
|
61 comments
147.
▲
by
ubutler
3y ago
Hey HN, Over the past year, I’ve been working on building the Open Australian Legal Corpus, the largest open database of Australian law. I started this project when I realised there were no open databases of Australian law I could use to tr
148.
▲
by
ubutler
3y ago
Does this support iOS WebKit? All I see is Tux sitting on a globe.
149.
▲
Prompt structure matters: examples first, instructions later
(umarbutler.com)
1 points
by
ubutler
3y ago
|
0 comments