Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
pranade
searching PlanetScale…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
9 ms
·
61.
▲
Correlate Bitcoin prices with anything
(kimonolabs.com)
71 points
by
pranade
13y ago
|
30 comments
62.
▲
by
pranade
13y ago
Assuming you mean that it only supports GET requests against the existing data. it's amazing though that something as simple as querying a table of olympics data wasn't possible without this (without a whole bunch of manual work).
63.
▲
by
pranade
13y ago
Yeah, it seems the facts are the most important part. I mean the data should be openly available, right? and that lowering the barrier to use by programmers and data scientists should improve the quality of how people interact with and expe
64.
▲
by
pranade
13y ago
fair enough. we removed the rings to improve the chances of keeping the data live
65.
▲
by
pranade
13y ago
Totally agree... we thought the same thing, which is why we built this :)
66.
▲
by
pranade
13y ago
Yes, you're right. We think it's important that this data is openly available
67.
▲
A Sochi Olympics API
(kimonolabs.com)
61 points
by
pranade
13y ago
|
28 comments
68.
▲
by
pranade
13y ago
That's the plan.. thanks!
69.
▲
by
pranade
13y ago
Thanks for the feedback. Just curious, did you see this after you moved/ resized the window or did this happen right away?
70.
▲
by
pranade
13y ago
Awesome, thanks for the recommendation!
71.
▲
by
pranade
13y ago
Thanks a ton for the feedback... that's super helpful. We'll make some tweaks to this page now.
72.
▲
by
pranade
13y ago
Yes, absolutely... we'll be providing more control for webmasters before we exit beta.
73.
▲
by
pranade
13y ago
No. You can extract any content you want from the page (incl. text, images, links) just not meta elements or invisible ones (e.g. <title> or anything else that usually shows up in <head> for that matter)
74.
▲
by
pranade
13y ago
Ah, yeah that's not a bad idea. Still keep the responsibility on the user, but do our best to keep them honest :)
75.
▲
by
pranade
13y ago
It's unfortunately not possible right now, but we know people want it, so we're working on it. Probably have to tuck it into our advanced mode feature as it's not something we'll ever be able to solve with the point and
76.
▲
by
pranade
13y ago
Although we do put the onus on the users to pay attention to robots.txt we realize the reality is that some amount of them won't necessarily respect it. That's one of the primary reasons behind the way we designed our crawler the
77.
▲
by
pranade
13y ago
Thanks, great suggestions! We're working on a more powerful API editor that will let you do just that.
78.
▲
by
pranade
13y ago
Awesome, glad you like it!
79.
▲
by
pranade
13y ago
Thanks for the suggestion. You're right, videos aren't the best way to comprehensively describe how to use this. We're working to put together some deeper documentation (and improving the API editor) so you'll have more
80.
▲
New pagination and crawling features
(kimonify.kimonolabs.com)
53 points
by
pranade
13y ago
|
31 comments
81.
▲
by
pranade
13y ago
Love your idea. Would love to follow up on this with you
82.
▲
by
pranade
13y ago
Feedback from webmasters is really helpful for us. We want to make sure we're making data available via API responsibly, so would love to hear your suggestions/ thoughts as we define a scalable solution.
83.
▲
by
pranade
13y ago
Thanks for the suggestion... we're working hard to get auth up and running!
84.
▲
by
pranade
13y ago
Thanks for the suggestion, we're adding to our list
85.
▲
by
pranade
13y ago
Thanks. We support regex matching now. Try dragging to select text, if there's a relevant regex pattern and kimono will find it (there's an example inthe blog post). You can preview (and soon, you'll be able to edit) the CSS
86.
▲
by
pranade
13y ago
Kimono can handle many pages with malformed/ old HTML. Of course, it's still beta and there are still pages that break it, so we're improving it as we go with the help of early adopters like everyone on this thread. Of course
87.
▲
by
pranade
13y ago
Yes, thanks for noting. This is a bug and we're working to get these characters supported as soon as we can
88.
▲
by
pranade
13y ago
It would be great to automate this eventually. For now, we're trying to make it really easy to set up and rebuild the scraper. If it goes down, you'll see it in the status on your user dashboard. We're also implementing alert
89.
▲
by
pranade
13y ago
We're working on auth... it's the most requested feature at the moment. And we're still beta at the moent, so all usage is free
90.
▲
by
pranade
13y ago
Thanks, for the suggestion. We're rolling out advanced mode soon, which will allow you to edit the CSS selectors and RegEx operating on the page's HTML to define the selected data elements
More ›