How to crawl news websites (content only)? [closed]

Question

Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.

---

Questions asking us to recommend or find a tool, library or favorite off-site resource are off-topic for Stack Overflow as they tend to attract opinionated answers and spam. Instead, describe the problem and what has been done so far to solve it.

Closed 8 years ago.

Improve this question

I want to crawl Indian news websites and their archives (eg. thehindu.com, indianexpress.com and timesofindia.com).

I have heard of boilerplate library in Java used to extract content. But is there any library in python to do this and how t do this?

If this is a repeat question, please help me to point out.

Answer 1

Scrapy is a popular scraping framework for Python