How to parse and fetch XML sitemap nutch

StackOverflow https://stackoverflow.com/questions/21740273

Frage

When Nutch fetches a sitemap, it does not go ahead fetch all the links in the tag in the sitemap.

What configuration option do I set to make nutch crawl and fetch all the links mentioned in the sitemap.

Keine korrekte Lösung

Andere Tipps

You can see the nutch issue.

There is a working for nutch sitemap parser here

Lizenziert unter: CC-BY-SA mit Zuschreibung
Nicht verbunden mit StackOverflow
scroll top