Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
geoscripting
searching PlanetScale…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
10 ms
·
31.
▲
A rails debugging trick you may not know
(ssscripting.wordpress.com)
1 points
by
geoscripting
17y ago
|
0 comments
32.
▲
How to submit a form programmatically. Pics included.
(ssscripting.wordpress.com)
1 points
by
geoscripting
18y ago
|
0 comments
33.
▲
Non web programmer's way to highlight code on your blog
(ssscripting.wordpress.com)
1 points
by
geoscripting
18y ago
|
0 comments
34.
▲
by
geoscripting
18y ago
You could give HtmlUnit a try.
35.
▲
by
geoscripting
18y ago
It is recommended that you use the API that google provides for searching, but I fail to see why telnetting would be illegal. After all, both firefox and telnet use sockets to do their job.
36.
▲
by
geoscripting
18y ago
Yes, I have worked with mechanize before. I was using mechanize even when there only was the perl version. I added a comment to the article explaining my choice.
37.
▲
by
geoscripting
18y ago
The example wasn't written in Java for performance gain. It so happened that I had NetBeans open , and it was easier for me to write it in Java at the moment :).
38.
▲
by
geoscripting
18y ago
There's also mechanize for python. It can be found here : http://wwwsearch.sourceforge.net/mechanize/ . It handles cookies by default, and is a pretty good tool.
39.
▲
by
geoscripting
18y ago
What did you thought this will be about? :)
40.
▲
by
geoscripting
18y ago
More and more websites are adding Turing tests after relatively short intervals of time. I consider that to be a good thing, and there are some good ways to stop/identify spiders. You can check out this site: http://stackoverflow.com/quest
41.
▲
by
geoscripting
18y ago
Twill is an option indeed, but this way you don't miss out on the javascript. You can take advantage of all of your browser's features.
42.
▲
by
geoscripting
18y ago
I think you misread the article.
43.
▲
by
geoscripting
18y ago
That's how it all starts :)
44.
▲
by
geoscripting
18y ago
True, you can use wget as well, but this way you have more control over your code.
45.
▲
How to scrape data from sites you can't log into
(ssscripting.wordpress.com)
37 points
by
geoscripting
18y ago
|
37 comments
46.
▲
Don't be afraid to try other frameworks
(ssscripting.wordpress.com)
2 points
by
geoscripting
18y ago
|
0 comments
47.
▲
Web scraping techniques
(ssscripting.wordpress.com)
3 points
by
geoscripting
18y ago
|
0 comments
48.
▲
How to write a spider
(ssscripting.wordpress.com)
3 points
by
geoscripting
18y ago
|
0 comments