[bind10-dev] auth server benchmarks and resource usage

[Michal 'vorner' Vaner]

Hello

On Tue, Nov 23, 2010 at 09:38:19AM -0200, Shane Kerr wrote:
> On Fri, 2010-11-19 at 12:58 +0100, Elmar K. Bins wrote:
> > I suggest also adding a bigger TLD with a couple of 10 million records,
> > so you *really* get a feel for what your memory does. ".de" would be
> > a good example with like 50 million records, but unfortunately we do
> > not hand our zone over to anyone AFAIK...
> 
> I think this is probably a good idea, although loading such a zone into
> an SQL database can take days, so setup for the test may be a bit
> trickier. :)

I run a small test, just out of curiosity. I created a table in mysql that
looked similar as the "records" table in sql backend. I was able to put
50 000 000 records into it in 40 minutes.

I know I didn't include any relations with rest of the tables, I didn't parse it
(I just put some data there) and so on, but I think days is little bit
overestimated anyway.

So I think it can be loaded in some SQL database (but I doubt about SQLite's
ability to handle the 23GB database) in few hours. And we do not need to load it
every time we run the test, right? We could keep it.

The script is attached, I did some parallel filling both to see it handles
transactions and to keep the disk busy most of the time.

With regards

-- 
How many Lisp programmers does it take to change a light bulb?
(((H)mmm,) (I'm ((not) sure, better))) (find (out))...

Michal 'vorner' Vaner
-------------- next part --------------
A non-text attachment was scrubbed...
Name: x.pl
Type: text/x-perl
Size: 1107 bytes
Desc: not available
URL: <https://lists.isc.org/pipermail/bind10-dev/attachments/20101123/105cd63f/attachment.bin>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 198 bytes
Desc: not available
URL: <https://lists.isc.org/pipermail/bind10-dev/attachments/20101123/105cd63f/attachment-0001.bin>