<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<html>
<head>
<meta content="text/html; charset=ISO-8859-1"
http-equiv="Content-Type">
</head>
<body bgcolor="#ffffcc" text="#000000">
Did you consider robots.txt? Well behaved spiders should respect
that, although it does not prevent anything.<br>
<br>
I would expect google and yahoo to respect it, I have no clue about
he.net.<br>
<br>
On 08/11/10 2:02, Michelle Konzack wrote:
<blockquote cite="mid:20101108010252.GD5441@michelle1" type="cite">
<pre wrap="">Hello experts and *,
I have (since several years) collected some domain names which do not
exist (since years) and registered it in the last 4 month for the
internal use of my Internet Service.
Now I see Googlebot, Yahoo and <he.net> quering my DNS Servers for
exactly those domains.
If I read the conditions of Networksolutions and Co, spidering of WHOIS
records is prohibited also the commercial use of the data.
Does someone have an experience with his crap?
Unfortunately I can not deny access to the 180 servers and Google, Yahoo
and He is bombing my network with to much useless requests. I have
written a mail to Google not to attack my network of VOIP and IPTV
servers, but they continue...
The webservers have only an SHTTP administrativ VHost, but not <exp.com>
or <<a class="moz-txt-link-abbreviated" href="http://www.exp.com">www.exp.com</a>> but the webserver get any requests from <*.exp.com>
because it is an administrative VServer and the error logfile is per day
VERY long.
An htaccess does not work, because I have more then 800 VHosts on each
server.
Thanks, Greetings and nice Day/Evening
Michelle Konzack
</pre>
<pre wrap="">
<fieldset class="mimeAttachmentHeader"></fieldset>
_______________________________________________
bind-users mailing list
<a class="moz-txt-link-abbreviated" href="mailto:bind-users@lists.isc.org">bind-users@lists.isc.org</a>
<a class="moz-txt-link-freetext" href="https://lists.isc.org/mailman/listinfo/bind-users">https://lists.isc.org/mailman/listinfo/bind-users</a></pre>
</blockquote>
<br>
<pre class="moz-signature" cols="72">--
Best regards
Sten Carlsen
No improvements come from shouting:
"MALE BOVINE MANURE!!!"
</pre>
</body>
</html>