Wow... expire still too slow

[Pauline Middelink]

On Fri, 02 Feb 2001 around 00:48:18 -0800, Russ Allbery wrote:
> Pauline Middelink <middelink at polyware.nl> writes:
> 
> > As the subject says, just got the expire report from Monday (on Friday)
> > Needless to say this machine is rapidly overflowing, since the expire
> > can't cope with the incoming article flow (non-binary ~2GB/day)
> 
> > Double needless to say that i'm very interested in the new history API!
> 
> Um, from the below, it looks like you're running tradspool, since you're
> running expirerm.  Is that right?  If so, the problem doesn't have
> anything to do with history and everything to do with the fact that
> tradspool is incredibly slow to expire in 2.3.1.  It's much faster in
> CURRENT; I'm working on backporting those changes now.

Yes, tradspool.
It would be great to have this server running properly again,
as it is now, it needs to much attention from my ample time.

The reason I see tradspool is so slow, is because of the
split between the actual removing of articles by expireover
and the updating of the history by expire.
I assumed (when talking about the history API) that when this
comes into effect, expireover will expire those articles
in the history too, thereby making the bin/expire run
effectivly useless.

> Also, given the amount of time expire is taking to run, my guess is that
> your server is swapping itself to death and doesn't have enough memory.

It does not have much memory, but if it was swapping that much,
vmstat would show it, right? It doesn't. Sometimes 8 blocks in,
4 blocks out etc. Only the bi/bo give large numbers. But I presume
that is the metadata from opening each and every file.

> I'm running a pure tradspool server with a quarter again as many articles
> as yours and it expires in three hours.  Not ideal, but certainly much,
> much faster than what you're seeing.

:( Howmuch RAM does your machine have?

    Met vriendelijke groet,
        Pauline Middelink
-- 
GPG Key fingerprint = 2D5B 87A7 DDA6 0378 5DEA  BD3B 9A50 B416 E2D0 C3C2
For more details look at my website http://www.polyware.nl/~middelink