I'm not sure I entirely agree - Facebook is mostly login-walled anyway and they developed React to suit the needs of a data intensive SPA. Why not just use a ro

I'm not sure I entirely agree - Facebook is mostly login-walled anyway and they developed React to suit the needs of a data intensive SPA. Why not just use a robots.txt to stop crawlers from indexing?