Hi. I am crawling news sites. I want to apply form based authentication to news sites because some sites required authentication for news.Can anyone tell me that how I will know whether a site required form based authentication or not. I want to do this in crawling to find out that this site required authentication.
Thanks in advance.