Form based authentication

Hi all,

Hi. I am crawling news sites. I want to apply form based authentication to news sites because some sites required authentication for news.Can anyone tell me that how I will know whether a site required form based authentication or not. I want to do this in crawling to find out that this site required authentication.

Thanks in advance.

The best way, since you will have to subscribe to the sites anyway, is to test each site you want to monitor and add them to a list. For those that require a subscription, create an account and put the account information in the list, along with the GET/POST information needed to sign in.