BIND 10 #2568: bindctl systest is broken

[BIND 10 Development]

#2568: bindctl systest is broken
-------------------------------------+-------------------------------------
            Reporter:  jinmei        |                        Owner:
                Type:  defect        |                       Status:  new
            Priority:  medium        |                    Milestone:  New
           Component:  Unclassified  |  Tasks
            Keywords:                |                   Resolution:
           Sensitive:  0             |                 CVSS Scoring:
         Sub-Project:  DNS           |              Defect Severity:  N/A
Estimated Difficulty:  0             |  Feature Depending on Ticket:
         Total Hours:  0             |          Add Hours to Ticket:  0
                                     |                    Internal?:  0
-------------------------------------+-------------------------------------
Description changed by jinmei:

Old description:

> tests/system/bindctl is broken and fails.  There seem to be several
> issues:
>
> - statistics format seems to be old (there's no '<' or '>' in recent
>   versions, but the tests assume that)
> - the consistency assumption seems to be incorrect (there's a
>   reference to an open ticket (#1941), which is probably the reason)
> - there's a timing issue on when b10-auth is ready to answer queries.
>   it's now more tricky now the data source config happens
>   asynchronously in a separate thread.
>
> The last one could be worked around with some amount of sleeping
> (there are already some), but that's not really reliable, and sleeping
> isn't a good practice anyway (it will make the tests take
> unnecessarily longer).
>
> So I'm going to disable the test for now.  To fix this, I'd rather
> suggest migrating to a lettuce test.  It has a more sophisticated way
> to detect the readiness of servers.

New description:

 tests/system/bindctl is broken and fails.  There seem to be several
 issues:

 - there's a timing issue on when b10-auth is ready to answer queries.
   it's now more tricky now the data source config happens
   asynchronously in a separate thread.
 - the same thing sometimes happen with b10-stats, too (but that
   should be irrelevant to asynchronous zone loading of b10-auth, of
   course).

 These could be worked around with some amount of sleeping (there are
 already some), but that's not really reliable, and sleeping isn't a
 good practice anyway (it will make the tests take unnecessarily
 longer).

 So I'm going to disable the test for now.  To fix this, I'd rather
 suggest migrating to a lettuce test.  It has a more sophisticated way
 to detect the readiness of servers.

--

-- 
Ticket URL: <http://bind10.isc.org/ticket/2568#comment:3>
BIND 10 Development <http://bind10.isc.org>
BIND 10 Development