Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
jabo
searching PlanetScale…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
24 ms
·
211.
▲
by
jabo
6y ago
Though I don’t have a need for this currently, a Segment for payment processing sounds interesting. Wish you had linked to your product in this post.
212.
▲
by
jabo
6y ago
“Getting AWS’ed”, that should go in the dictionary! In companies I’ve worked at in the past, during every round of fund raising, as part of the due diligence, lawyers would ask for the licenses of all software packages we use. And when AGPL
213.
▲
by
jabo
6y ago
Unfortunately it seems to scare people in all those categories. People typically start using it for free and over time, some of them become contributors and/or paying customers. So if a license scares the people who start using it for
214.
▲
by
jabo
6y ago
I’m working on an open source search alternative to Algolia, called Typesense [1], with a hosted SaaS option [2]. So our business model is very similar to Plausible. re: OSS licensing, we use GPL and have been very hesitant about using some
215.
▲
by
jabo
6y ago
The challenge is that there are several ways of doing this depending on your larger architecture. So the definition of "just work" depends on the context of your particular architecture. For eg: you could hook into your ORM and se
216.
▲
by
jabo
6y ago
The Typesense search backend supports this, I just haven't added a UI element for it.
217.
▲
by
jabo
6y ago
That’s a good point about reading directions, especially in a list that’s ranked. Thank you for the feedback.
218.
▲
by
jabo
6y ago
Also, forgot to mention this earlier: Please do contribute to OpenLibrary in any way you can. Here are some ways how: https://news.ycombinator.com/item?id=25408744
219.
▲
by
jabo
6y ago
Thanks @mekarpeles!
220.
▲
by
jabo
6y ago
I iterated through the "editions" dataset to build the index, which contains one record for each book (edition), which is why you see one result for each edition. There's another dataset called "works" which has one
221.
▲
by
jabo
6y ago
Not intended behavior. I have it on my list to fix: https://news.ycombinator.com/item?id=25415446
222.
▲
by
jabo
6y ago
Yeah, I was trying to work with the data I had: https://news.ycombinator.com/item?id=25418661
223.
▲
by
jabo
6y ago
Ah yes! Good point about using replaceState. I’ll update it.
224.
▲
by
jabo
6y ago
Like another comment pointed out, record sizes can be wildly different depending on the data you index. So it’s hard to quantify it in terms of number of records. That said, I’m planning to add some examples and pre-configured configs to th
225.
▲
by
jabo
6y ago
Yup, exact matching using quotes is on the horizon. Should be available in a few weeks.
226.
▲
by
jabo
6y ago
Thank you!
227.
▲
by
jabo
6y ago
Thank you! The indexed size is 14.3GB.
228.
▲
by
jabo
6y ago
I’m currently ranking by text match score and publish date and some of the records had publish dates that were hard to parse by Date.parse(), so I just set those to 1970: https://github.com/typesense/showcase-books-sear
229.
▲
by
jabo
6y ago
I’m using a stop word list on the client side at the moment: https://github.com/typesense/showcase-books-search/blob/01f2... Working on support for exact matches using quotes, which will also help here.
230.
▲
by
jabo
6y ago
Looks like I’m filtering out stop words a little too aggressively which is affecting the results in this case, I’ll take a closer look it in a few hours.
231.
▲
by
jabo
6y ago
Thank you! I thought it would take may be 4-5 hours to build it, but it ended up taking about 12 hours!
232.
▲
by
jabo
6y ago
Interesting observation about the small Internet Archive icon. I just pushed out an update to link the title to the OpenLibrary page.
233.
▲
by
jabo
6y ago
I excluded stop words on the client-side for just this site here: https://github.com/typesense/showcase-books-search/blob/01f2... Typesense does support searching by phrases on the server-side.
234.
▲
by
jabo
6y ago
Strange, I didn't notice it from Los Angeles. Just added a little debounce in any case. Hopefully that helps.
235.
▲
by
jabo
6y ago
I see, let me check if this is a field that's available in the dataset...
236.
▲
by
jabo
6y ago
Thank you! The OpenLibrary dataset has ~28M records, takes up 6.8GB on disk and 14.3GB in RAM when indexed in Typesense. Each node has 4vCPUs. Took me ~3 hours to index these 28M records. Could have probably been done in ~1.5hrs - most of t
237.
▲
by
jabo
6y ago
Alright! Just pushed the instant search app with the Open Library database live: https://news.ycombinator.com/item?id=25414389
238.
▲
by
jabo
6y ago
Quick context: I built this from the Open Library (Internet Archive) books dataset ( https://openlibrary.org/ ), as a follow up to this comment on the GoodReads post earlier today: https://news.ycombinator.com/
239.
▲
Show HN: Instantly search 28M books from OpenLibrary
(books-search.typesense.org)
424 points
by
jabo
6y ago
|
80 comments
240.
▲
by
jabo
6y ago
Thank you! Working on it as we speak.
More ›