[bind10-dev] performance improvements and regressions

[Jeremy C. Reed]

This is a comparison from the 1.0.0-beta-release from Dec. 20 to master 
of today.

builtin-none-cpus4.nxdomain 88155.38 - 92263.39 qps 5% improvement
builtin-none-cpus4.soa 81261.60 - 87220.94 qps 7% improvement
builtin-none-cpus4.success 71176.89 - 79706.34 qps 12% improvement
builtin-none-.nxdomain 38136.66 - 40463.16 qps 6% improvement
builtin-none-.soa 36837.97 - 40820.82 qps 11% improvement
builtin-none-.success 35951.09 - 40229.78 qps 12% improvement
largehost-memory-cpus4.nxdomain 70387.96 - 89088.83 qps 27% improvement
largehost-memory-cpus4.soa 71433.80 - 72886.80 qps 2% improvement
largehost-memory-cpus4.success 73708.94 - 75274.09 qps 2% improvement
largehost-memory-.nxdomain 42804.25 - 53659.80 qps 25% improvement
largehost-memory-.soa 26376.11 - 32485.80 qps 23% improvement
largehost-memory-.success 27667.92 - 33884.98 qps 22% improvement
largehost-sqlite3-cpus4.nxdomain 12858.37 - 12736.98 qps 1% regression
largehost-sqlite3-cpus4.soa 10160.44 - 8972.82 qps 12% regression
largehost-sqlite3-cpus4.success 10246.93 - 9825.32 qps 4% regression
largehost-sqlite3-.nxdomain 3559.84 - 3506.93 qps 1% regression
largehost-sqlite3-.soa 2608.95 - 2367.28 qps 9% regression
largehost-sqlite3-.success 2794.61 - 2405.43 qps 14% regression
largetld-memory-.nxdomain 32150.84 - 40897.38 qps 27% improvement
largetld-memory-.soa 27652.68 - 32598.60 qps 18% improvement
largetld-memory-.success 25987.50 - 31887.14 qps 23% improvement
root-memory-cpus4.nxdomain 74305.37 - 90556.08 qps 22% improvement
root-memory-cpus4.soa 49238.45 - 50314.25 qps 2% improvement
root-memory-cpus4.success 48450.98 - 52668.91 qps 9% improvement
root-memory-.nxdomain 34194.28 - 41734.23 qps 22% improvement
root-memory-.soa 13527.61 - 14607.05 qps 8% improvement
root-memory-.success 14643.62 - 15364.43 qps 5% improvement
smallzone-memory-cpus4.nxdomain 77364.67 - 87602.89 qps 13% improvement
smallzone-memory-cpus4.soa 62550.34 - 87972.09 qps 41% improvement
smallzone-memory-cpus4.success 79272.69 - 81581.16 qps 3% improvement
smallzone-memory-.nxdomain 35007.06 - 41081.92 qps 17% improvement
smallzone-memory-.soa 30051.98 - 34798.48 qps 16% improvement
smallzone-memory-.success 32250.48 - 36181.17 qps 12% improvement
smallzone-sqlite3-.nxdomain 1420.72 - 1296.54 qps 9% regression
smallzone-sqlite3-.soa 1424.70 - 1271.29 qps 11% regression
smallzone-sqlite3-.success 1399.58 - 1339.89 qps 4% regression

Some very good improvements. But sqlite3 had all regressions.

Some descriptions of the scenarios are at
http://bind10.isc.org/wiki/DnsBenchmarks

(Note I updated the box from CentOS 5.3 to 6.3 and various package 
updates, but I re-ran the runs for the old version too.)