andres

19 ms·

181.
by andres 15y ago
I think points is null because that item is < 5 days old. The API should only return points for items > 5 days old.
182.
HNSearch Feature Requests
20 points by andres 15y ago|28 comments
183.
by andres 15y ago
Seems cool but I don't think the UI is working in Chrome/Firefox. The graph shows up below the results.
184.
by andres 15y ago
We definitely want to add autocomplete to ThriftDB.
185.
by andres 15y ago
You rock. I'll make a note on the contest page.
186.
by andres 15y ago
I don't think so. Once we have the data it'll be easy to upload it. I'm emailing with the SearchYC creator so I'll ask him about arc forum data.
187.
by andres 15y ago
Has someone written a crawler for the forum? If so, I can help with the ThriftDB setup.
188.
by andres 15y ago
It's really big.
189.
by andres 15y ago
The `q` argument is used to perform a full-text search across all fields. One benefit to using `q` is that you can rank results based on field matches (using the `weights` argument). The `filter` arguments are used to cut the data before pe
190.
by andres 15y ago
Exactly! Would love to get more feedback if you have a chance to try out ThriftDB ( http://www.thriftdb.com ). We have a lot of experience scaling faceted search with solr. 15M docs might not sound like a lot if you're doing full-text searc
191.
by andres 15y ago
For now, don't worry about rate limits.
192.
by andres 15y ago
Solr can be run without a schema quite easily, or use the very common trope of the dynamicField typed schema (string_, text_, int_ or whatever) We're using solr dynamic fields in our current implementation of ThriftDB. ThriftDB adds a lay
193.
by andres 15y ago
Would you mind emailing me with your ideas? andres@octopart.com
194.
by andres 15y ago
Awesome! It would be great to start a discussion about ranking algorithms in the HNSearch developer forum ( http://groups.google.com/group/hnsearch ). We'd like to implement some ThriftDB features to tweak ranking algorithms automatically b
195.
by andres 15y ago
ThriftDB uses Solr internally so I don't want to give the impression that we've built new full-text indexing technology. Our goal with ThriftDB was to solve the search infrastructure problem. We wanted to give developers access to fast, sca
196.
by andres 15y ago
A search engine has many moving parts and we found that the existing technology worked but with great pain. Lucene/Solr is great for search but it's useless without a fast datastore. Additionally, you can't expose it to the open internet so
197.
by andres 15y ago
We wrote a crawler to download data from HN, parse it into JSON, and upload it to ThriftDB. The webapp at hnsearch.com sends requests directly to ThriftDB. There's a ~15min lag between HN and HNSearch.
198.
by andres 15y ago
It's on the todo list.
199.
by andres 15y ago
HNSearch is an Octopart/ThriftDB project to test out our search technology and give back to the HN community. Google has access to the link structure of the internet so it's great for macro searches. However, if you want to do a site-specif
200.
by andres 15y ago
Good point. The UI is designed for someone coming directly to hnsearch.com. I'll see if I can tweak it for people coming from HN.
201.
by andres 15y ago
HNSearch consists of a simple javascript webapp hosted at hnsearch.com which sends ajax requests directly to ThriftDB. ThriftDB returns items in the search response which makes it ideal for this type of architecture. For a more detailed exp
202.
by andres 15y ago
You can add HNSearch as a custom search engine in Firefox as well. Just visit hnsearch.com, click on the favicon in the browser's search box and select "Add HNSearch". For the Chrom custom search engine it would be better to use the non-jav
203.
by andres 15y ago
Nice catch! Fixed.
204.
by andres 15y ago
That could be a good app for the HNSearch API contest: http://www.hnsearch.com/contest
205.
by andres 15y ago
The API docs are a work in progress. Please let me know which parts need work.
206.
by andres 15y ago
The `_id` attribute for each item is its submission id plus a signature. ThriftDB references objects by their unique `_id` attributes. The `id` attribute on the other hand is an item's submission id. It's not indexed though so you can't do
207.
by andres 15y ago
Definitely! I'm actually trying to get in touch with the SearchYC folks. Recently they put up a link to HNSearch which was very nice of them.
208.
by andres 15y ago
We just changed the contest date from June 15th to June 20th to give people more time to work on apps.
209.
HNSearch API Contest(hnsearch.com)
115 points by andres 15y ago|31 comments
210.
by andres 15y ago
We're using the HN hotness algorithm with some points boosts to surface older items. For a full explanation of the ranking algorithm check out the API docs: http://www.hnsearch.com/api

More ›