Scanning to finds active working webservers (nmap?)

Question

I need an nmap command or other utility that finds open sites so I can do a survey on them. The problem is that when I use nmap it finds IPs of sites that are not working:

nmap -iR 200 -p 80 > scan.txt

I'd like it to show in the result sites like Google; Amazon; or whatever, they just need to be actual sites with some content on them.

Thx in advance!

Answer 1

I am not sure I got your question but if you have a list of those sites stored in a file you can use the following command:

nmap -iL yourfile -v -oX nmap.xml

This command will store the result on an XML file that should help you gathering the information you need.

However if you do not have a list and you just want to find "working" sites well.... in that case I don't know how you can do that with Nmap. Nmap scans a target. Host (site?) discovery works when you scan a LAN or VPN network but since sites are supposed to be on the Internet your question does not make so much sense. However I repeat, I am not quite sure I understand your question.

EDIT: Ok maybe now I got what you mean, if the problem is Nmap giving you false results you may try to improve the scan with some more aggressive parameter such as -A and -v. Please notice that scan random computers over the Internet (expecially if you do an aggressive scan) may not be exactly legal. Well honestly I don't really know about that but I suggest yout to gather more information before scanning.