Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
phgn
searching PlanetScale…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
9 ms
·
61.
▲
by
phgn
3y ago
Good luck, and thank you! I personally really enjoy writing and updating my /now and /ideas pages [0], it's quite clarifying to list the things you really care about :) [0] https://lindylearn.io/now
62.
▲
by
phgn
3y ago
That's fine, good that we index all three page types. I'm wishing you all the best in San Jose! :)
63.
▲
by
phgn
3y ago
Yep but there is a fallback to metascraper [0] which does check the HTML tags. However the fallback didn't work in case GPT returns a 1970 date -- I just fixed this! [1] I think you can now remove the date from your post content and it
64.
▲
by
phgn
3y ago
Good points about changing the intro text, thank you. But from all the HN comments I gather that /about and /now are actually core to the experience too and it shouldn't only be about /ideas... I had the same idea of sho
65.
▲
by
phgn
3y ago
Thank you! Reach out to them and make the idea a reality :)
66.
▲
by
phgn
3y ago
True, I removed it there without Louis noticing :) Why do you want to filter posts by type?
67.
▲
by
phgn
3y ago
YES! Submit your website on the site and enter an email address in case this ever gets implemented :)
68.
▲
by
phgn
3y ago
That's very interesting... What would you like to see "updates" about?
69.
▲
by
phgn
3y ago
2markdown is actually very interesting. You could expand into handling request proxies + JS rendering for people as well then it would be the easiest way to index web pages. We should definitely chat. I built unclutter.it before and the con
70.
▲
by
phgn
3y ago
We actually had an argument about this and I wanted to remove the filters entirely (since I didn't see a use case for filtering), Louis wanted to keep them. The compromise is the filter button :) I agree that showing all recent posts t
71.
▲
by
phgn
3y ago
This is so cool! I love the upvote function :) Could you put it at /ideas on your website so it appears on aboutideasnow.com?
72.
▲
by
phgn
3y ago
Mhh why do you want to go through all posts? My thought was that searching would be more useful than a huge list.
73.
▲
by
phgn
3y ago
And to clarify, we made up the /ideas thing. But IMO it makes so much sense since /about and /now are about the past & present. Because where else do you write about the future?
74.
▲
by
phgn
3y ago
Good point. We're using https://crawlee.dev , I think there's a way to handle more status codes as errors... Right now it only excludes pages based on the text content: https://github.com/lindylearn/
75.
▲
by
phgn
3y ago
Great idea, I will try this. Thank you!!
76.
▲
by
phgn
3y ago
Yes seems like a good number of people randomly decided to add /ideas to their website. /now is more of a standard, see nownownow.com There are some good results for your third idea, maybe you can talk to those people :) https:&#
77.
▲
by
phgn
3y ago
Yes :( Do you have an idea of how to remove company websites in an automated way? I didn't want to manually review all 7k indexed websites. This is the GPT prompt I used for filtering domains to add, but it gives false positives: Y
78.
▲
by
phgn
3y ago
Ahh, I believe we're not trusting the current date at the moment because of spam potential: https://github.com/lindylearn/aboutideasnow/blob/main/apps/a... Which seems bad if you update your si
79.
▲
by
phgn
3y ago
No, there are just some static rules to exclude missing pages and /ideas pages which don't actually talk about ideas: https://github.com/lindylearn/aboutideasnow/blob/main/apps/a... And ye
80.
▲
by
phgn
3y ago
That's the idea! And especially if more people start writing /ideas pages I think the search will become better and the results more actionable. Also, if you find something to improve, people open a GitHub issue: https:/
81.
▲
by
phgn
3y ago
The vast majority of indexed websites don't have a date unfortunately :( What's your website so I can take a look at the parsing?
82.
▲
by
phgn
3y ago
Very nice idea, I just implemented this! Feel free to create some GitHub issues at https://aboutideasnow.com/ideas to grow the list :)
83.
▲
by
phgn
3y ago
Sorry for this! I believe it's fixed now. In which timezone do you live by the way?
84.
▲
by
phgn
3y ago
I tried using https://www.npmjs.com/package/metascraper before which I believe does check this meta tag. But a few websites set their updated date to the current date which was annoying, maybe to rank better in Google?
85.
▲
by
phgn
3y ago
Yep at least the /ideas pages that turn up on the page load are sorted by recency. You can also see the most recent /now pages by clicking the filter icon next to the search bar and selecting /now. And we re-scrape all indexe
86.
▲
by
phgn
3y ago
GPT-3.5: https://github.com/lindylearn/aboutideasnow/blob/main/apps/a... But in this case the date seems very close to the unix timestamp 0 which we use when there's no date found. Maybe it
87.
▲
by
phgn
3y ago
Error querying the database: FATAL: Max client connections reached It's weird since the SvelteKit load() server function should be cached. I added a fallback just now, sorry again!
88.
▲
by
phgn
3y ago
Uh oh, the search overloaded the basic typesense.org cloud instance :( I'm upgrading it now!
89.
▲
by
phgn
3y ago
Fixed now, sorry! It was actually a bad deploy.
90.
▲
by
phgn
3y ago
For me it's actually that I have too many ideas and none of them are great. What makes ideas great I think is having the right people to try things out with -- hence this tool. So there are a lot of uses for this :)
More ›