Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
pranade
searching PlanetScale…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
13 ms
·
91.
▲
by
pranade
13y ago
Yes, thanks for spotting. We'd discovered that Chinese, Japanese and Korean failed but didn't know about these characters. Thanks!
92.
▲
by
pranade
13y ago
Thanks for letting us know. We've tested on some versions of Firefox, but not v26 on Mavericks. We'll look into this
93.
▲
by
pranade
13y ago
It's a great question. What we're really trying to do is make data accessible programmatically and at scale. We want to connect data providers and data consumers with APIs in a way that's mutually beneficial vs. being a tool
94.
▲
by
pranade
13y ago
Not yet, but it's our #1 feature request, so we're working on it now. For now, you can make multiple APIs (one for each URL). If the URL takes query parameters though, you can re-use the same API and programmatically cycle through
95.
▲
by
pranade
13y ago
Thanks a ton for the feedback. Getting data from multiple similarly structured URLs programmatically is something we're working on now. We love hearing about the use cases you want to use this for so we can make sure we build out the r
96.
▲
by
pranade
13y ago
So sorry for missing this earlier. See our response in comments below: "At the moment, we rely on users to be responsible. We spell it out in the terms and FAQ. We've been in private beta, keeping usage very limited until today. W
97.
▲
by
pranade
13y ago
Yes, you're right... we can't handle angular quite yet. We're working on this.
98.
▲
by
pranade
13y ago
At the moment, we rely on users to be responsible. We spell it out in the terms and FAQ. We've been in private beta, keeping usage very limited until today. We fully understand the seriousness of the issue as we scale. We're commi
99.
▲
by
pranade
13y ago
Thanks for flagging. We'll get on this to figure out what's going on when running on ubuntu
100.
▲
by
pranade
13y ago
Kimono can handle several pages with malformed and old/bad HTML. We're still in beta though, so we're handling more edge cases as we encounter them. Should work on HN main page.
101.
▲
by
pranade
13y ago
Yes, we're excited about the possibilities of an end-to-end use case as well... in fact we were surprised when we found a lot of interest in front-end output layers on top of the APIs than just the APIs themselves. Would be curious to
102.
▲
by
pranade
13y ago
There's definitely things that a custom-built scraper can do more efficiently than kimono, but our focus right now making scraping accessible across a broad enough range of web sites.
103.
▲
by
pranade
13y ago
Thanks for the feedback. We're working on a feature that will allow you to edit APIs you've created and also edit the selectors and regex (right now, in advanced mode, you can see them, but cannot edit). We're looking into yo
104.
▲
by
pranade
13y ago
Thanks for the suggestions on tool tips... We can also expand the tutorials section to make this more clear.
105.
▲
by
pranade
13y ago
It's pretty homegrown right now, we did the intro video ourselves on our laptops
106.
▲
by
pranade
13y ago
Thanks for the suggestions!
107.
▲
by
pranade
13y ago
Thanks for the suggestion... adding to the list :)
108.
▲
by
pranade
13y ago
We don't support that quite yet. It's our #1 feature request though, and we're working to get it ready soon
109.
▲
by
pranade
13y ago
No, we don't have POST support quite yet. We're working on a solution.
110.
▲
by
pranade
13y ago
Love your suggestion. We're committed to making kimono better and we're working on it all the time. We want to make sure it's a responsible scraper, so want to work together with webmasters in cases where there might be block
111.
▲
by
pranade
13y ago
Yes, it's one of the most popular feature requests. We don't support auth yet, but it's on our shortlist and we hope to have it ready soon.
112.
▲
by
pranade
13y ago
Yes, it's a great point. We're working on updating the query param passthrough to handle params within the URL structure.
113.
▲
by
pranade
13y ago
Yes, we're in beta right now, while we're still working out the bugs. For beta, it's free for 30 APIs.
114.
▲
by
pranade
13y ago
Thanks for letting us know. Just tried and am getting the same error. The page is loading content dynamically from another source... We'll look into this and see if we can get it working on this page
115.
▲
by
pranade
13y ago
Thanks - we're not using flash, so it must be something else. Will follow up over email
116.
▲
by
pranade
13y ago
Great add. It's on our shortlist - a popular request!
117.
▲
by
pranade
13y ago
Yes, in concept quite similar. We wanted to make something that you can use from within your browser as part of your natural workflow, without installing any other software.We also really wanted to figure out the right data association inte
118.
▲
by
pranade
13y ago
Thanks a ton for sharing... the association algorithms have been where we've been spending a good chunk of time. Will read through this
119.
▲
by
pranade
13y ago
Yeah, we've been working on this for a while too... took a while to polish it a bit before we could put it out there. Will check out exfiltrate.org - looks cool!
120.
▲
by
pranade
13y ago
It's probably our #1 feature request at the moment. We're working on it and hope to have it ready for you to try soon
More ›