expire running dead slow

[Bill Davidsen]

Russ Allbery wrote:
> Bill Davidsen <davidsen at tmr.com> writes:
> 
> 
>>I have a machine, 1 of 6, running INN 2.4.1 on an Intel platform. CNFS
>>storage, about 8TB, dual 2.8GHz HT Xeons, 2.5GB memory. Redhat
>>Enterprise AS3.0.
> 
> 
>>This is one of our small regional servers. For some reason, expire on
>>this machine takes forever to do expire every few days, anywhere from
>>35-50 hours. At other times it runs only 1-2 hours. We have about 22M
>>articles in history, INN is built largefile enabled, obviously.
> 
> 
> Whenever expire has suddenly become extremely slow to me, I've always
> ended tracking it down to thrashing swap.  I don't know why you'd have
> that problem on this system and not on others, though.
> 
Thanks for the thought, there seems to be a breakpoint around 20M 
articles, if that's a clue. Some recent times:
   Lines processed	time (hr)
    22163402		50
    19499316		2.4
    21375003		37
    19516415		0.4

I didn't see anything in the code that appeared likely to have a 
behavior issue there. It's way over 24 bits, so it's unlikely to be a 
field overflow.

On a mailed suggestion I changed articlemmap to 'false' without any 
improvement. I had that left over on one of my other machines when there 
was a kernel issue with mmap and forking.

Other ideas desperately embraced.

-- 
    -bill davidsen (davidsen at tmr.com)
"The secret to procrastination is to put things off until the
  last possible moment - but no longer"  -me