Recursive bind becomes unresponsive with high load

[Michael Brunnbauer]

Hello Tony,

On Thu, Mar 31, 2016 at 05:08:43PM +0100, Tony Finch wrote:
> Michael Brunnbauer <brunni at netestate.de> wrote:
> >
> > I am using bind on a server that does massive crawling with a multithreaded
> > Java app. This server occasionally has to do lookups for hosts in our local
> > zone netestate.de - for which it is not authoritative - and those lookups tend
> > to fail when the load is high (e.g. >1000 recursing clients). This suggests
> > some kind of congestion.
> 
> Have you tried adjusting the clients-per-query and max-clients-per-query
> options?

I just tried 

        clients-per-query 250;
        max-clients-per-query 1000;

and it did not help. I noticed a drop in the number of recursing clients and
the number of queries/s when a lookup failed for the local zone but named
logged no special messages in the syslog.

Is is possible that is this connected to rndc stats? I will stop doing
rndc stats for a while to test (it currently runs every minute).

BTW: I also excluded packet loss as cause of the problem.

Regards,

Michael Brunnbauer

-- 
++  Michael Brunnbauer
++  netEstate GmbH
++  Geisenhausener Straße 11a
++  81379 München
++  Tel +49 89 32 19 77 80
++  Fax +49 89 32 19 77 89 
++  E-Mail brunni at netestate.de
++  http://www.netestate.de/
++
++  Sitz: München, HRB Nr.142452 (Handelsregister B München)
++  USt-IdNr. DE221033342
++  Geschäftsführer: Michael Brunnbauer, Franz Brunnbauer
++  Prokurist: Dipl. Kfm. (Univ.) Markus Hendel
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 198 bytes
Desc: not available
URL: <https://lists.isc.org/pipermail/bind-users/attachments/20160331/49763632/attachment.bin>