I completely agree with you that in some (many) cases it's useful. But your checkout example proves my point; you wouldn't want a bot crawling through there.

I completely agree with you that in some (many) cases it's useful. But your checkout example proves my point; you wouldn't want a bot crawling through there. Bots should be crawling content-rich pages (blogs, articles, marketing pages), and IMO those should rarely be handled by fat clients.