Results 1 to 2 of 2
  1. #1
    amitvit014 is offline Member
    Join Date
    Nov 2011
    Rep Power

    Default [B]How to use Sitemap for WebCrawling[/B]

    How to use Sitemap(its available in robots.txt) for WebCrawling using any OpenSource. Please help me in this regard


  2. #2
    pbrockway2 is offline Moderator
    Join Date
    Feb 2009
    New Zealand
    Rep Power

    Default Re: [B]How to use Sitemap for WebCrawling[/B]

    Double post. Reply in the original thread:

    @OP: please don't post a question twice. Also consider giving some context about the site and the framework being used (if any) so people can see where the Java language fits in.

Similar Threads

  1. How to use Sitemap for WebCrawling
    By amitvit014 in forum Advanced Java
    Replies: 2
    Last Post: 11-15-2011, 10:20 PM
  2. Webcrawling
    By devasia1000 in forum Networking
    Replies: 0
    Last Post: 02-12-2011, 12:25 PM
  3. webcrawling and harvesting
    By locke19 in forum New To Java
    Replies: 2
    Last Post: 04-14-2010, 02:53 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts