How does Yahoo/Google find unknown domains?

Stephane Bortzmeyer bortzmeyer at
Tue Nov 9 03:21:25 UTC 2010

On Mon, Nov 08, 2010 at 02:02:52AM +0100,
 Michelle Konzack <linux4michelle at> wrote 
 a message of 94 lines which said:

> If I read the conditions of Networksolutions and Co, spidering of
> WHOIS records is prohibited also the commercial use of the data.

The list of domains in .COM (and other ICANN TLDs) can be obtained

> Now I see Googlebot, Yahoo and <> quering my DNS Servers for
> exactly those domains.

Hurricane Electric uses these zone files for very interesting and
useful statistics:

More information about the bind-users mailing list