Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
welanes
searching PlanetScale…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
9 ms
·
31.
▲
by
welanes
7y ago
Cheers Joel. I have most of your blog posts on Puppeteer bookmarked - super helpful and well written. For sure, once the app is a notch more tried and tested I'll get in touch. Appreciate it.
32.
▲
by
welanes
7y ago
Hey, right now you can select a Pagination element that the app will use to load the next page / new data. If the site's publicly accessible and you're able to share, send the details to mike @ simplescraper.io and I'll
33.
▲
by
welanes
7y ago
Right now it's free and will be until it's stable. Starting price will be about $25 for 4000 scraping credits, 200k API calls and data storage. This will likely change as I have more stats and feedback on usage and expenses. But t
34.
▲
by
welanes
7y ago
Came here to post exactly this. Music For Nine Post Cards is also a real gem: https://www.youtube.com/watch?v=zyY7NU4cbtY . Much respect to the uploaders giving these albums a digital rebirth.
35.
▲
by
welanes
7y ago
Yes, working on it now.
36.
▲
by
welanes
7y ago
Yes - you're able to save data behind a login using the point and click functionality as it extracts whatever data is loaded in your browser ("local scraping"). And no - if you choose to also create a cloud recipe that runs o
37.
▲
by
welanes
7y ago
Hi, it's both. There's 'local' scraping where the results of what you selected is ready to download as soon as you click results - no signup or server needed. And then anything's that saved as a recipe runs in the c
38.
▲
by
welanes
7y ago
Hey, yes the guide still needs work. Here's what you gotta do: - Click the pagination icon and then click the pagination element (usually 'Next' or an arrow). The icon will turn green - Click 'view results' and then
39.
▲
by
welanes
7y ago
Sure, in fact I'll do it this weekend.
40.
▲
by
welanes
7y ago
Thanks! Yeah the checkmark confirmation just feels effortless. Haven't got it perfected yet, but soon. Really appreciate the insights. You're right that much depends on mapping the solution to a particular problem. Are you selling
41.
▲
by
welanes
7y ago
Good catch, uberswe. Was an older video and I flubbed the selection process - here it is working correctly: https://www.kapwing.com/videos/5dbc3e33ee4d0f00136d01e6
42.
▲
by
welanes
7y ago
Yeah, that's offered although it's currently free. No particular tricks to avoid detection. It's Puppeteer under the hood with a few customizations which works well on the majority of sites tested so far. Given the cat-and-mo
43.
▲
by
welanes
7y ago
Hey HN, I posted this in a comment thread the other day and (to my surprise) it got a positive reception so added a few more updates and decided to post it proper. The idea is to be able to choose a website, select the data you want, and ma
44.
▲
Show HN: Turn any website into an API (for those who miss Kimono)
(simplescraper.io)
332 points
by
welanes
7y ago
|
74 comments
45.
▲
by
welanes
7y ago
Works for me: https://www.kapwing.com/videos/5db9feb530c3d00013d47ded
46.
▲
by
welanes
7y ago
Sure. I'm thinking a certain amount of cloud scraping / API request credits in the free tier and any number above that falls into a paid tier.
47.
▲
by
welanes
7y ago
I must have looked at that homepage over 1000 times and still didn't catch that! Thank you, fixed it.
48.
▲
by
welanes
7y ago
Thanks. I will for sure - although unless I'm doing something silly, don't see your email when I click through.
49.
▲
by
welanes
7y ago
Not exactly passive, but side hustle that I hope becomes main hustle: https://simplescraper.io Tryna fill the gap that Kimono left. Aim to post as a Show HN once I polish it a little more.
50.
▲
by
welanes
7y ago
> There’s clearly a point in the life of any company where you should move from the list you made in a spreadsheet to the richer tools you can make in coolproductivityapp.io Now there's a snazzy domain name (that, alas, was alre
51.
▲
by
welanes
8y ago
- Lanes ( https://lanes.io )
52.
▲
by
welanes
8y ago
.
53.
▲
by
welanes
8y ago
Aesthetics mainly. Circles feel neater.
54.
▲
by
welanes
8y ago
To help 'gamify' getting things done, I recently added the ability to set the timer in Lanes ( https://lanes.io ) to sync with any Youtube video. So instead of tidying for 10 minutes, for example, you can tidy for the l
55.
▲
by
welanes
8y ago
Haha, I'll have to A/B test this one :)
56.
▲
by
welanes
8y ago
Thanks, I'll get on that.
57.
▲
by
welanes
8y ago
This is really nice. So much so that I yoinked one of your demos and used it on my landing page: https://lanes.io . Thanks. Beautiful website btw - clearly took a lot of effort.
58.
▲
by
welanes
8y ago
From my experience Firebase are different. They're now a part of Google but support has been excellent anytime I needed it - both before and after they were acquired.
59.
▲
by
welanes
8y ago
Try Lanes - https://lanes.io . It combines tasks, bookmarks and video annotations and uses the Mercury API under the hood. Disclaimer: I made this. We've nailed down tasks and now we're focusing on making the read-later
60.
▲
by
welanes
8y ago
Lanes ( https://lanes.io ) has highlights - although articles are secondary to tasks, for now. Diigo does highlights too, and Feedly. Agree that highlights are a brilliant feature - the next natural step after saving an article is
More ›