2 ms·

I cannot go into technical details because that is a solution I worked out for Nuuton. Though it is possible by using a helper bot. The crawler does not do the

I cannot go into technical details because that is a solution I worked out for Nuuton. Though it is possible by using a helper bot. The crawler does not do the job itself, but gets the data passed to it by another bot. I don't want to sound dickish, but I can't really give you much technical details. Sorry.

rartichoke 14y ago
Sounds like it's not solved. Don't you think Google would be happily crawling javascript sites without the developer having to do anything special? I don't know what Nuuton is but from the looks of the home page it seems to be some random no name search engine that isn't even released. I wouldn't really call that solved, considering most end users are using Google, Bing or Yahoo.