Wow... expire still too slow

[Pauline Middelink]

As the subject says, just got the expire report from Monday (on Friday)
Needless to say this machine is rapidly overflowing, since the
expire can't cope with the incoming article flow (non-binary ~2GB/day)

Double needless to say that i'm very interested in the new history API!

-------
Expire messages:
expireover start Mon Jan 29 09:09:18 CET 2001: ( -z/var/log/news/expire.rm -Z/var/log/news/expire.lowmark)
    Article lines processed  3206081
    Articles dropped          970054
    Overview index dropped   1071567
expireover end Mon Jan 29 10:59:22 CET 2001
lowmarkrenumber begin Mon Jan 29 10:59:22 CET 2001: (/var/log/news/expire.lowmark)
lowmarkrenumber end Mon Jan 29 11:00:58 CET 2001
        expirerm start Mon Jan 29 11:03:10 CET 2001
        expirerm end Mon Jan 29 19:31:37 CET 2001
expire begin Mon Jan 29 19:32:11 CET 2001: (-v1)
    Duplicate message-id "[712362D480983438B27927435F497459]" in history
    Duplicate message-id "[70604F10FC20887B3B792210B80B0818]" in history
    Duplicate message-id "[2B244802B1AA0CA49A24B487303DF886]" in history
    Duplicate message-id "[1D504B4F1C8394D6894335F887FE7295]" in history
    Duplicate message-id "[ED2FF53BA451CB25BEA11DDC5715FA72]" in history
    Duplicate message-id "[FC9B0F089339236D467DBAE2B2FC4D03]" in history
    Duplicate message-id "[4C197C693DEE5DEAF8FB44B3450885BB]" in history
    Duplicate message-id "[E5D612C16C391783DE7B70FA3ECB1418]" in history
    Duplicate message-id "[2AC1F5CF58A7AA106E3B97E26E0410C6]" in history
    Duplicate message-id "[62C19F1BAAFEB3F9760744D2B0929F38]" in history
    Duplicate message-id "[278F5BB8E344834A5A982BA33F9F1A72]" in history
    Duplicate message-id "[47F94396B172304124DFDDA3A2AD4E2D]" in history
    Duplicate message-id "[7D5D3B8A07BA0E594DD4200E70EFB307]" in history
    Duplicate message-id "[25ABE487A269D88C3C9882393C0EC476]" in history
    Duplicate message-id "[EC2122E2D7F6A3C46C880F3A28A89425]" in history
    Duplicate message-id "[95536B2BEADF38FF6FF381EAAD7B891F]" in history
    Duplicate message-id "[49A7A85258AE4748E4D48B7AE4C4948C]" in history
    Duplicate message-id "[00FA8BA3F9FF59542986B1C1B4698E33]" in history
    Duplicate message-id "[BF9B32A2289D3889387D0B29836189ED]" in history
    Duplicate message-id "[6BE7AABB95EE3A1D5E121C149EC0E111]" in history
    Duplicate message-id "[DF9E808B56D111391D9E78E280047C26]" in history
    Duplicate message-id "[2DD288A1A217AF3666D68D0C88D8A83A]" in history
    Duplicate message-id "[7C36C059FA97A3164BE2F39477F46C9C]" in history
    Duplicate message-id "[8F7EF1DA001E633E7354D387A94BBAAE]" in history
    Duplicate message-id "[B0E1E8D11C2AB1B0EC1D7EFB4C85A322]" in history
    Duplicate message-id "[7A26E264BE942697DA3800B4B7AF9BA6]" in history
    Duplicate message-id "[25E77C73EA1239F38E54B5A816E8E307]" in history
    Duplicate message-id "[D3C86935B38970525DF048CC60BB45BB]" in history
    Article lines processed  4262102
    Articles retained        3255600
    Entries expired          1006502
    Old entries dropped      1215214
    Old entries retained      483297
expire end Fri Feb  2 03:27:04 CET 2001
        all done Fri Feb  2 03:27:04 CET 2001
---------

According to an strace I had running for a while, its all the
hammering on the hd (expire tries to open each and every article
to prove to itself it still exists) what is killing this server

Oh, inn 2.2 never had this problem, it hummed nicely along...

    Met vriendelijke groet,
        Pauline Middelink
-- 
GPG Key fingerprint = 2D5B 87A7 DDA6 0378 5DEA  BD3B 9A50 B416 E2D0 C3C2
For more details look at my website http://www.polyware.nl/~middelink