makehistory takes a long time on latest CVS

[Dan Merillat]

"Forrest J. Cavalier III" writes:
> 
> > 11 hours for 2.8 million articles (3.3 million overvie)
> 
> That's 70 articles per second.

it's 83 overviews/sec, or 12ms. 

> How fast would be "fast enough" for you?

Heh.  Well, I havn't grown my spool and rebuilding used to take < 10 hours, so
there's been some change.   Still, for a once-off I don't mind, but the reason
I rebuilt and upgraded was I was having overview errors after only a few weeks
of service.  (Articles came in but never showed up for readers)  So I'm
concerned if I'm going to have to down the system for a half day frequently.

I'm hoping that was just a fluke.

BTW, speaking of spool size, how many gig do cidera/skycache people get
AFTER running filtering on it?   I doubt I'd need to store 120+ gig/day
post-filter, but 75-90 is fairly reasonable.

--Dan