Form based authentication

[Mrs. Deswal]

Hi all,

Hi. I am crawling news sites. I want to apply form based authentication to news sites because some sites required authentication for news.Can anyone tell me that how I will know whether a site required form based authentication or not. I want to do this in crawling to find out that this site required authentication.

Thanks in advance.

[Steve11235]

The best way, since you will have to subscribe to the sites anyway, is to test each site you want to monitor and add them to a list. For those that require a subscription, create an account and put the account information in the list, along with the GET/POST information needed to sign in.