Today we require a set of credentials along with the login URL. We take the security very seriously and we made sure that these values travel and are stored enc

Today we require a set of credentials along with the login URL. We take the security very seriously and we made sure that these values travel and are stored encrypted; also, once the crawl is complete we redact the username and password provided. While this solution works for most sites out of the box, we also added flexibility to this procedure: we support custom CSS selectors, two-step forms (i.e. enter username, hit next, then enter password and hit `sign in`) and forms inside modals that have to be revealed. From our own tests and from our users so far we feel we cover most regular login scenarios. However, there are more cases that we want to cover in the future. For example two-factor authentication scenarios. One alternative that we've discussed for our next iteration is providing a browser plugin so you can "grab" the session data and send it to us so we can reuse it. That way there are no credentials being shared and we'd also get the benefit of getting more complex login systems to work :) This has been one of the most difficult features that look easy on paper but then get more complicated as you work on them, so feedback and ideas are more than welcomed!