5 ms·

I added my site and received the following response: > josephriddle.com/ideas without update time I looked into the source code to determine how it's finding

I added my site and received the following response: > josephriddle.com/ideas without update time I looked into the source code to determine how it's finding the update time. Come to find out, it's using ChatGPT! [0] It appears to only be looking at the article contents for the date, not at any page metadata. [0] https://github.com/lindylearn/aboutideasnow/blob/main/apps/api/src/common/meta.ts#L41 https://github.com/lindylearn/aboutideasnow/blob/main/apps/a...

phgn 3y ago
Yep but there is a fallback to metascraper [0] which does check the HTML tags. However the fallback didn't work in case GPT returns a 1970 date -- I just fixed this! [1] I think you can now remove the date from your post content and it should still work. If you submit your website again it should do a re-scrape if you changed the content text. Thanks for catching this :) [0] https://metascraper.js.org/#/ https://metascraper.js.org/#/ [1] https://github.com/lindylearn/aboutideasnow/commit/8b0ea5b468a320a9ff47da368ed484e1ecaaa137 https://github.com/lindylearn/aboutideasnow/commit/8b0ea5b46...
- nicbou 3y ago
  Does it also look at JSON+LD?
- plumeria 3y ago
  It would be nice if it also supported the If-Modified-Since and If-Unmodified-Since precondition headers.
  - phgn 3y ago
    Good idea, I just created https://github.com/lindylearn/aboutideasnow/issues/7 https://github.com/lindylearn/aboutideasnow/issues/7 for this!
jseliger 3y ago
I tried to add https://jakeseliger.com https://jakeseliger.com, and I got an error saying that there is no "about" page. But if you look at https://jakeseliger.com/about https://jakeseliger.com/about, there is in fact one!
- phgn 3y ago
  Oh, looks like the missing page detection went rogue in this case. It found the word "error" in your page and decided to use / instead of /about :) I just fixed this, sorry!
  - jseliger 3y ago
    Thank you! I think the idea is very cool.

phgn 3y ago

Yep but there is a fallback to metascraper [0] which does check the HTML tags. However the fallback didn't work in case GPT returns a 1970 date -- I just fixed this! [1] I think you can now remove the date from your post content and it should still work. If you submit your website again it should do a re-scrape if you changed the content text. Thanks for catching this :) [0] https://metascraper.js.org/#/ https://metascraper.js.org/#/ [1] https://github.com/lindylearn/aboutideasnow/commit/8b0ea5b468a320a9ff47da368ed484e1ecaaa137 https://github.com/lindylearn/aboutideasnow/commit/8b0ea5b46...

nicbou 3y ago
Does it also look at JSON+LD?
plumeria 3y ago
It would be nice if it also supported the If-Modified-Since and If-Unmodified-Since precondition headers.
- phgn 3y ago
  Good idea, I just created https://github.com/lindylearn/aboutideasnow/issues/7 https://github.com/lindylearn/aboutideasnow/issues/7 for this!

jseliger 3y ago

I tried to add https://jakeseliger.com https://jakeseliger.com, and I got an error saying that there is no "about" page. But if you look at https://jakeseliger.com/about https://jakeseliger.com/about, there is in fact one!

phgn 3y ago
Oh, looks like the missing page detection went rogue in this case. It found the word "error" in your page and decided to use / instead of /about :) I just fixed this, sorry!
- jseliger 3y ago
  Thank you! I think the idea is very cool.