Question

When Nutch fetches a sitemap, it does not go ahead fetch all the links in the tag in the sitemap.

What configuration option do I set to make nutch crawl and fetch all the links mentioned in the sitemap.

No correct solution

OTHER TIPS

You can see the nutch issue.

There is a working for nutch sitemap parser here

Licensed under: CC-BY-SA with attribution
Not affiliated with StackOverflow
scroll top