Results 1 to 2 of 2
  1. #1
    amitvit014 is offline Member
    Join Date
    Nov 2011
    Posts
    4
    Rep Power
    0

    Default [B]How to use Sitemap for WebCrawling[/B]

    How to use Sitemap(its available in robots.txt) for WebCrawling using any OpenSource. Please help me in this regard

    Thanks.

  2. #2
    pbrockway2 is offline Moderator
    Join Date
    Feb 2009
    Location
    New Zealand
    Posts
    4,574
    Rep Power
    12

    Default Re: [B]How to use Sitemap for WebCrawling[/B]

    Double post. Reply in the original thread: How to use Sitemap for WebCrawling

    @OP: please don't post a question twice. Also consider giving some context about the site and the framework being used (if any) so people can see where the Java language fits in.

Similar Threads

  1. How to use Sitemap for WebCrawling
    By amitvit014 in forum Advanced Java
    Replies: 2
    Last Post: 11-15-2011, 10:20 PM
  2. Webcrawling www.stock-forecasting.com
    By devasia1000 in forum Networking
    Replies: 0
    Last Post: 02-12-2011, 12:25 PM
  3. webcrawling and harvesting
    By locke19 in forum New To Java
    Replies: 2
    Last Post: 04-14-2010, 03:53 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •