BIND 10 #519: msgq socket recv hang

[BIND 10 Development]

#519: msgq socket recv hang
-------------------------------------+-------------------------------------
                   Reporter:  jreed  |                 Owner:  jreed
                       Type:         |                Status:  reviewing
  defect                             |             Milestone:
                   Priority:  major  |  Sprint-20110816
                  Component:         |            Resolution:
  Unclassified                       |             Sensitive:  0
                   Keywords:         |           Sub-Project:  DNS
            Defect Severity:  N/A    |  Estimated Difficulty:  5.0
Feature Depending on Ticket:         |           Total Hours:  0
        Add Hours to Ticket:  0      |
                  Internal?:  0      |
-------------------------------------+-------------------------------------

Comment (by jreed):

 b10-stats continually failed:

 {{{

 2011-08-08 08:12:03.186 INFO  [b10-boss.boss] BIND10_RESURRECTED_PROCESS
 resurrected b10-stats (PID 1230)
 Traceback (most recent call last):
   File "/home/reed/opt/bind10/lib/python3.1/site-
 packages/isc/cc/session.py", line 203, in _receive_full_buffer
     self._receive_len_data()
   File "/home/reed/opt/bind10/lib/python3.1/site-
 packages/isc/cc/session.py", line 163, in _receive_len_data
     new_data = self._receive_bytes(self._recv_len_size)
   File "/home/reed/opt/bind10/lib/python3.1/site-
 packages/isc/cc/session.py", line 149, in _receive_bytes
     data = self._socket.recv(size)
 socket.timeout: timed out

 During handling of the above exception, another exception occurred:

 Traceback (most recent call last):
   File "/home/reed/opt/bind10/libexec/bind10-devel/b10-stats", line 420,
 in <module>
     main()
   File "/home/reed/opt/bind10/libexec/bind10-devel/b10-stats", line 407,
 in main
     subject.start()
   File "/home/reed/opt/bind10/libexec/bind10-devel/b10-stats", line 163,
 in start
     self.notify('start')
   File "/home/reed/opt/bind10/libexec/bind10-devel/b10-stats", line 133,
 in notify
     listener.update(event)
   File "/home/reed/opt/bind10/libexec/bind10-devel/b10-stats", line 147,
 in update
     return callback()
   File "/home/reed/opt/bind10/libexec/bind10-devel/b10-stats", line 97, in
 __call__
     return self.callback(*args, **kwargs)
   File "/home/reed/opt/bind10/libexec/bind10-devel/b10-stats", line 230,
 in start
     self.session.group_recvmsg(False, seq)
   File "/home/reed/opt/bind10/lib/python3.1/site-
 packages/isc/cc/session.py", line 266, in group_recvmsg
     env, msg  = self.recvmsg(nonblock, seq)
   File "/home/reed/opt/bind10/lib/python3.1/site-
 packages/isc/cc/session.py", line 133, in recvmsg
     return self.recvmsg(nonblock, seq)
   File "/home/reed/opt/bind10/lib/python3.1/site-
 packages/isc/cc/session.py", line 121, in recvmsg
     data = self._receive_full_buffer(nonblock)
   File "/home/reed/opt/bind10/lib/python3.1/site-
 packages/isc/cc/session.py", line 218, in _receive_full_buffer
     raise SessionTimeout("recv() on cc session timed out")
 isc.cc.session.SessionTimeout: recv() on cc session timed out
 2011-08-08 08:12:07.426 WARN  [b10-boss.boss]
 BIND10_PROCESS_ENDED_WITH_EXIT_STATUS process b10-stats (PID 1230)
 terminated, exit status = 256
 2011-08-08 08:12:12.868 INFO  [b10-boss.boss] BIND10_RESURRECTING_PROCESS
 resurrecting dead b10-stats process...
 2011-08-08 08:12:12.879 INFO  [b10-boss.boss] BIND10_RESURRECTED_PROCESS
 resurrected b10-stats (PID 10565)
 Traceback (most recent call last):
   File "/home/reed/opt/bind10/lib/python3.1/site-
 packages/isc/cc/session.py", line 203, in _receive_full_buffer
     self._receive_len_data()
   File "/home/reed/opt/bind10/lib/python3.1/site-
 packages/isc/cc/session.py", line 163, in _receive_len_data
     new_data = self._receive_bytes(self._recv_len_size)
   File "/home/reed/opt/bind10/lib/python3.1/site-
 packages/isc/cc/session.py", line 149, in _receive_bytes
     data = self._socket.recv(size)
 socket.timeout: timed out

 During handling of the above exception, another exception occurred:

 Traceback (most recent call last):
   File "/home/reed/opt/bind10/libexec/bind10-devel/b10-stats", line 420,
 in <module>
     main()
   File "/home/reed/opt/bind10/libexec/bind10-devel/b10-stats", line 407,
 in main
     subject.start()
   File "/home/reed/opt/bind10/libexec/bind10-devel/b10-stats", line 163,
 in start

 ...
 }}}

 I reverted just the bin/stats change and that appeared to go away.

-- 
Ticket URL: <http://bind10.isc.org/ticket/519#comment:9>
BIND 10 Development <http://bind10.isc.org>
BIND 10 Development