BIND 10 #1566: create a standard set of benchmarks

[BIND 10 Development]

#1566: create a standard set of benchmarks
-------------------------------------+-------------------------------------
                   Reporter:  jelte  |                 Owner:
                       Type:  task   |                Status:  new
                   Priority:  major  |             Milestone:
                  Component:         |  Sprint-20120207
  Unclassified                       |            Resolution:
                   Keywords:         |             Sensitive:  0
            Defect Severity:  N/A    |           Sub-Project:  DNS
Feature Depending on Ticket:         |  Estimated Difficulty:  0
        Add Hours to Ticket:  0      |           Total Hours:  0
                  Internal?:  0      |
-------------------------------------+-------------------------------------
Description changed by jelte:

Old description:

> For publishing and profiling

New description:

 In order to be able to actually measure performance improvements over
 time, we need a standardized set of benchmarks; so that we don't just say
 'X qps' (as one metric), but have a number of different scenarios, e.g.
 'Authoritative server for X zones (with X delegations and Y records),
 tracing a file with...' etc., and a fixed system to run them on. We
 already have a number of arbitrarily picked benchmarks, but nothing
 'official'. The plan is to run these on a dedicated benchmarking machine.

 The task for this ticket is to write a document that defines these
 benchmarks, so that they can then be implemented in followup tasks.

 There are some short notes about this in the F2F notes:

 http://bind10.isc.org/wiki/January2012MeetingMinutes#DNSBenchmarking
 and a short section before that anchor as well.

--

-- 
Ticket URL: <http://bind10.isc.org/ticket/1566#comment:1>
BIND 10 Development <http://bind10.isc.org>
BIND 10 Development