jwngr

16 ms·

31.
by jwngr 5y ago
Shortwave cofounder here. We totally get that. Gmail is just the start for us. We plan to support more providers in the future and even become our own provider long-term. Read more about our company mission on our blog [1]. [1] https:&#x2F
32.
by jwngr 5y ago
Creator here. It's exciting to see this back on the front page of HN! My poor little f1-micro instance is not holding up well against the traffic though I won't be able to migrate it to a bigger server today, but if you bookmark
33.
Implementing Firebase Auth Session Durations(medium.com)
2 points by jwngr 8y ago|0 comments
34.
Demystifying Firebase Auth Tokens(medium.com)
3 points by jwngr 8y ago|0 comments
35.
Demystifying Firebase Auth Tokens(medium.com)
3 points by jwngr 8y ago|0 comments
36.
by jwngr 9y ago
Hey everybody, my "Show HN: Six Degrees of Wikipedia" [1] from two weeks ago was really popular with this crowd and I enjoyed all the comments and discussion that resulted. Now that the site has handled half a million search resul
37.
Insights on Hitler and More from the First 500,000 Searches(sixdegreesofwikipedia.com)
2 points by jwngr 9y ago|1 comments
38.
by jwngr 9y ago
Hey everybody, my "Show HN: Six Degrees of Wikipedia" [1] from two weeks ago was really popular with this crowd and I enjoyed all the comments and discussion that resulted. Now that the site has handled half a million search resul
39.
Insights on Hitler and More from the First 500,000 Searches(sixdegreesofwikipedia.com)
3 points by jwngr 9y ago|1 comments
40.
by jwngr 9y ago
Possibly... follow this GitHub issue[1] if you want to be notified about it. [1] https://github.com/jwngr/sdow/issues/11
41.
by jwngr 9y ago
I'd prefer you not send any additional load to my server (this is just a side project I'm paying out of pocket for), but you are welcome to download the data yourself. There are instructions in the project README[1] to download th
42.
by jwngr 9y ago
The full fact list is on GitHub[1]. The fact list was a lot more interesting and important when searches took longer to run. One of the bad things about improving the performance so much was the fact that the facts don't have as long t
43.
by jwngr 9y ago
It was down for a little while due to the traffic but it's back up and running again.
44.
by jwngr 9y ago
The autocomplete suggestions hit the live Wikipedia API[1]. The actual search algorithm is on a dump of Wikipedia[2], which I plan to update monthly. [1] https://github.com/jwngr/sdow/blob/f39398d112fecf7b993c
45.
by jwngr 9y ago
The resulting SQLite database file is currently 8.3 GB, most of which is taken up by the `links` table. The big performance wins are having a handful of indexes (see the .sql files[1] for the database's schema) and preprocessing a lot
46.
by jwngr 9y ago
So the reason is that "Theodore Roosevelt" links to "Freddy Fazbear" (ctrl+f for "Articles related to Theodore Roosevelt" and then click it and then click "Teddy Bears") which redirects to "Frida
47.
by jwngr 9y ago
Check out an earlier comment I made[1] which has some information about this. It also includes links to the relevant code, which is all open source. [1] https://news.ycombinator.com/item?id=16469260
48.
by jwngr 9y ago
The sheer scale of Wikipedia (5 millions pages, half a trillion links) made it difficult to make the searches fast. Simply downloading the Wikipedia database dumps and parsing them into my own database took over a day on my first successful
49.
by jwngr 9y ago
Thanks, glad you enjoyed it! > I was expecting the site to tell me how to start at page X and get to page Y with the min number of clicks. Yup, this is exactly what the site does, and a bi-directional BFS is an efficient way to do it. Th
50.
by jwngr 9y ago
Ooh cool idea! That certainly would improve the information density issue. I honestly never considered that at all and have no idea how I'd do it in d3, but I may try to hack it out. Thanks!
51.
by jwngr 9y ago
Thank you! The graph is built using vanilla d3, no library on top of it. The code for it lives all in one file, ResultsGraph.js [1]. I pieced together the code from a handful of other attempts online. I am still not 100% pleased with the pe
52.
by jwngr 9y ago
I do a bi-directional BFS, but the search from the target node traverses incoming links as opposed to outgoing links. That's why I have to store both in the `links` table[1]. [1] https://github.com/jwngr/sdow/
53.
by jwngr 9y ago
The graph is most definitely directed. One small example is Facebook -> Narcissism (1 path of 1 degree)[1] compared to Narcissism -> Facebook (8 paths of 2 degrees)[2]. [1] https://www.sixdegreesofwikipedia.com/?source
54.
by jwngr 9y ago
The bi-directional nature of the search does not change the end result. It is simply a performance improvement.
55.
by jwngr 9y ago
Very cool! Your UI is great. I like all the animations and the graph is super smooth. All my code is open source[1] and it is decently documented. I'm happy to answer any questions you have and you're more than welcome to use any
56.
by jwngr 9y ago
I just added the query string stuff in the URL this morning and didn't even think about this issue. Just made the change as you suggested[1]. Thanks! [1] https://github.com/jwngr/sdow/commit/b9164b4455661
57.
by jwngr 9y ago
This has been fixed[1] and should behave in a more intuitive way now. Thanks for the suggestion! [1] https://github.com/jwngr/sdow/commit/6e42e06488a592784e5d3d2...
58.
by jwngr 9y ago
I'm not sure caching would help a ton given how I structure the data and do my searches in batches of pages, not for individual pages. I already do some "caching" by precomputing all incoming and outgoing links for each page
59.
by jwngr 9y ago
Thanks a lot for sharing! BTW, I just fixed the confusing interaction with the text input placeholders[1]. [1] https://github.com/jwngr/sdow/commit/6e42e06488a592784e5d3d2...
60.
by jwngr 9y ago
Just implemented this with a quick hot fix[1]. Hopefully I didn't break anything else in my hurry to get out. [1] https://github.com/jwngr/sdow/commit/6e42e06488a592784e5d3d2...

More ›