How to crawl news websites (content only)? [closed]

https://stackoverflow.com/questions/21940080

python
web-crawler
web
hierarchical-clustering

14-10-2022
|

Question

Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.

Questions asking us to recommend or find a tool, library or favorite off-site resource are off-topic for Stack Overflow as they tend to attract opinionated answers and spam. Instead, describe the problem and what has been done so far to solve it.

Closed 8 years ago.

Improve this question

I want to crawl Indian news websites and their archives (eg. thehindu.com, indianexpress.com and timesofindia.com).

I have heard of boilerplate library in Java used to extract content. But is there any library in python to do this and how t do this?

If this is a repeat question, please help me to point out.

Solution

Scrapy is a popular scraping framework for Python

Licensed under: CC-BY-SA with attribution

Not affiliated with StackOverflow