expiration policy and CNFS problems.

DomoComm bvba domocomm at pandora.be
Mon Apr 10 10:34:27 UTC 2000


Dear all,

 I am relatively new to Inn and am struggling with the expiration
 policy under CNFS. The expiration of most articles is too fast and
 does not line up with what is configured in the expire.ctl file.

 When I run an cnfsstat -a, I got only a reasonable output for the
 first buffers. The rest of the buffers come back with "Missing...
 messages". (See below.)

 The first BUFF1/2 show that the oldest articles are not older than
 3 ... /4 ... days while this is not what we specify in the expire.ctl
 (see below.)

 We run news.daily with following cron command :

 30 23 * * * /opt/Inn/bin/news.daily delayrm expireover flags='-N -v1 -c -k -s'

 This comes back with :

Renumbering active file.
Expire messages:
expire begin Sun Apr  9 23:32:28 MET DST 2000: (-N -v1 -c -k -s -z/var/news/log/expire.rm -u/var/news/log/expire.index.rm)
    Removed approximately 0k
    Article lines processed  1601107
    Articles retained        1375028
    Entries expired           226079
    Articles dropped          111028
    Overview index dropped    278957
    Old entries dropped       251003
    Old entries retained     2453177
expire end Sun Apr  9 23:36:34 MET DST 2000
        all done Sun Apr  9 23:36:34 MET DST 2000
        expireindex start Sun Apr  9 23:37:05 MET DST 2000
        expireindex end Mon Apr 10 00:02:20 MET DST 2000
        expirerm start Mon Apr 10 00:02:20 MET DST 2000
        expirerm end Mon Apr 10 00:02:23 MET DST 2000 

  
Can someone :

- tell me what is happening with the cnfsstat -a output ?
- do I have to clean the CNFS buffers ? (What would be the best method
?)
- give me any suggestion how to implement the expiry policy as
described in the expire.ctl file below ?

Many thanks !

Geert
-- 
Best regards,
 DomoComm                          mailto:domocomm at pandora.be

 ===================================================================
 
 cnfsstat -a output
 ==================

Class MBUFF1  for groups matching "alt.*"
 Buffer BUFF1, len: 1953.12 Mbytes, used: 937.59 Mbytes (48.0%)  32 cycles
  Newest: 2000-04-10  0:02:11,    0 days,  0:07:52 ago
  Oldest: 2000-04-06  0:47:33,    3 days, 23:22:30 ago
 Buffer BUFF2, len: 1953.12 Mbytes, used: 887.29 Mbytes (45.4%)  32 cycles
  Newest: 2000-04-10  0:02:11,    0 days,  0:07:52 ago
  Oldest: 2000-04-05 23:46:06,    4 days,  0:23:57 ago

Class MBUFF2  for groups matching "rec.*"
  (Missing <20000226133824.15848.00001845 at ng-cd1.aol.com>)
  (Missing <38b81e4e_2 at news1.prserv.net>)
  (Missing <D4Vt4.2430$OV.392881 at typhoon.austin.rr.com>)
  (Missing <38b81aed.674375 at news.totacc.com>)
  (Missing <20000226133859.01649.00000364 at ng-ba1.aol.com>)
  (Missing <95Vt4.19585$tk7.1271300 at bgtnsc05-news.ops.worldnet.att.net>)
  (Missing <f5Vt4.8214$74.231381 at nnrp3.clara.net>)
  (Missing <20000226133914.15848.00001846 at ng-cd1.aol.com>)
  (Missing <l5Vt4.2431$OV.392938 at typhoon.austin.rr.com>)
  (Missing <38B7ACFD.5059A61D at pop.mindspring.com>)
  (Missing <20000226133930.01269.00000407 at ng-dd1.aol.com>)
 Buffer BUFF3, len: 1953.12 Mbytes, used: 1777.33 Mbytes (91.0%)   2 cycles
  Newest: 2000-04-10  0:02:12,    0 days,  0:07:52 ago
  Oldest: beats me, who knows how long ago
  (Missing <20000226170940.02057.00002198 at ng-de1.aol.com>)
  (Missing <38B84E5C.4A792EBB at erols.com>)
  (Missing <20000226170957.24186.00002256 at ng-ck1.aol.com>)
  (Missing <20000226170959.01209.00000751 at ng-fw1.aol.com>)
  (Missing <899i4f$2mg$1 at nnrp1.deja.com>)
  (Missing <899i74$2mm$1 at nnrp1.deja.com>)
  (Missing <899i61$2mj$1 at nnrp1.deja.com>)
  (Missing <899il5$2q2$1 at nnrp1.deja.com>)
  (Missing <862ee7$2df$0 at 216.39.149.189>)
  (Missing <38b8504b.33354174 at news.msmisp.com>)
  (Missing <899ijj$2ps$1 at nnrp1.deja.com>)
 Buffer BUFF4, len: 1953.12 Mbytes, used: 1828.16 Mbytes (93.6%)   2 cycles
  Newest: 2000-04-10  0:01:48,    0 days,  0:08:16 ago
  Oldest: beats me, who knows how long ago

Class MBUFF3  for groups matching "borland.*,comp.*,gnu.*,linux.*,microsoft.*,redhat.*"
  (Missing <87t3bk$3u6$2 at scream.auckland.ac.nz>)
  (Missing <OJuC5e2c$GA.212 at cppssbbsa05>)
  (Missing <OzMSxe2c$GA.212 at cppssbbsa05>)
  (Missing <BhaiOHElKCiyl=qgXYxexrcvK2hk at 4ax.com>)
  (Missing <87t4iv$cqt$1 at bob.news.rcn.net>)
  (Missing <tinman-0902001953580001 at mac-ara-port1.cs.unc.edu>)
  (Missing <OkLLAg2c$GA.166 at cppssbbsa02.microsoft.com>)
  (Missing <#cB29a2c$GA.175 at cppssbbsa02.microsoft.com>)
  (Missing <38a2118c.4243885 at news-server.nycap.rr.com>)
  (Missing <38a215e3.0 at katana.legend.co.uk>)
  (Missing <38A215C6.35F8F01 at tiac.net>)
 Buffer BUFF5, len: 1953.12 Mbytes, used: 1517.34 Mbytes (77.7%)   1 cycles
  Newest: 2000-04-10  0:01:47,    0 days,  0:08:18 ago
  Oldest: beats me, who knows how long ago
  (Missing <hQEo4.274$R6.4598 at news030.image.dk>)
  (Missing <38a31987 at netnews.web.de>)
  (Missing <sQEo4.23490$XT4.254038 at newscontent-01.sprint.ca>)
  (Missing <38A33574.1D1D52B3 at xs4all.nl>)
  (Missing <87v2mh$2132$1 at bnews.gigabell.net>)
  (Missing <38A30741.6B685D81 at 0800-einwahl.de>)
  (Missing <87v5eu$hdb$1 at news.hccnet.nl>)
  (Missing <38A31A35.28D8 at pointecom.net>)
  (Missing <MPG.130d29efa3ef117c989686 at news.freeserve.net>)
  (Missing <38A2A9D4.F9A at yahoo.com>)
  (Missing <oREo4.850$xA.3527 at news.iol.ie>)
 Buffer BUFF6, len: 1953.12 Mbytes, used: 1554.23 Mbytes (79.6%)   1 cycles
  Newest: 2000-04-10  0:01:48,    0 days,  0:08:17 ago
  Oldest: beats me, who knows how long ago

Class MBUFF4  for groups matching "sci.*"
  (Missing <3863257F.1205 at pop.removethistomailme.net>)
  (Missing <FmH84.11$Nj3.488 at dfiatx1-snr1.gtei.net>)
  (Missing <946029638.17606.1.nnrp-08.9e9809e7 at news.demon.co.uk>)
  (Missing <JzH84.228$O15.7113 at m2newsread.uni2.es>)
  (Missing <19991224050840.01139.00000390 at ng-ft1.aol.com>)
  (Missing <19991224051207.24948.00000315 at ng-fq1.aol.com>)
  (Missing <zld84.99$GF1.6669 at newsread1.prod.itd.earthlink.net>)
  (Missing <83s1n2$rot$1 at fir.prod.itd.earthlink.net>)
  (Missing <9uk26s8o4o5q0v4n1h9m3n9nmjrsgml8b6 at 4ax.com>)
  (Missing <83vf7r$6se$1 at fe1.cs.interbusiness.it>)
  (Missing <Hmd84.105$GF1.7375 at newsread1.prod.itd.earthlink.net>)
 Buffer BUFF7, len: 1953.12 Mbytes, used: 482.83 Mbytes (24.7%)   0 cycles
  Newest: 2000-04-09 23:58:29,    0 days,  0:11:37 ago
  Oldest: beats me, who knows how long ago
  (Missing <38634479.9D6FAC8C at gemsoft.co.uk>)
  (Missing <946029637.17606.0.nnrp-08.9e9809e7 at news.demon.co.uk>)
  (Missing <83vf12$gtd$1 at quokka.wn.com.au>)
  (Missing <KzH84.229$O15.7113 at m2newsread.uni2.es>)
  (Missing <hah66s80oi0pgikeh9odbra9oglj1dvlh6 at 4ax.com>)
  (Missing <p3d84.54$GF1.4348 at newsread1.prod.itd.earthlink.net>)
  (Missing <83vgv0$pvt$1 at lure.pipex.net>)
  (Missing <38618F00.F2ACB434 at earthlink.net>)
  (Missing <83rfak$900$1 at fir.prod.itd.earthlink.net>)
  (Missing <Ysc84.7$GF1.923 at newsread1.prod.itd.earthlink.net>)
  (Missing <Xod84.108$GF1.7714 at newsread1.prod.itd.earthlink.net>)
 Buffer BUFF8, len: 1953.12 Mbytes, used: 484.71 Mbytes (24.8%)   0 cycles
  Newest: 2000-04-09 23:58:29,    0 days,  0:11:37 ago
  Oldest: beats me, who knows how long ago

Class MBUFF5  for groups matching "talk.*,soc.*,humanities.*"
  (Missing <MPG.12cdc2ad11fa836b989690 at news.pacific.net.sg>)
  (Missing <83vg6f$bib$1 at barcode.tesco.net>)
  (Missing <83vg4i$734$2 at newsg4.svr.pol.co.uk>)
  (Missing <83vg4j$734$4 at newsg4.svr.pol.co.uk>)
  (Missing <3863445D.CD0845A9 at chechenya.org>)
  (Missing <83vfgt$uum$1 at nnrp1.deja.com>)
  (Missing <83vfjp$uv4$1 at nnrp1.deja.com>)
  (Missing <83vg7o$a9tl$1 at fu-berlin.de>)
  (Missing <83vg88$97e$1 at bl-1.rootsweb.com>)
  (Missing <83vgan$97i$1 at bl-1.rootsweb.com>)
  (Missing <004aa0e3.b248e062 at usw-ex0101-008.remarq.com>)
 Buffer BUFF9, len: 1953.12 Mbytes, used: 1788.35 Mbytes (91.6%)   0 cycles
  Newest: 2000-04-09 23:59:21,    0 days,  0:10:45 ago
  Oldest: beats me, who knows how long ago
  (Missing <83vft2$ihp$1 at newton3.pacific.net.sg>)
  (Missing <83vg4h$734$1 at newsg4.svr.pol.co.uk>)
  (Missing <83vg4i$734$3 at newsg4.svr.pol.co.uk>)
  (Missing <83vg4k$734$5 at newsg4.svr.pol.co.uk>)
  (Missing <3863442C.74537A2A at pandora.be>)
  (Missing <83vfjg$uv3$1 at nnrp1.deja.com>)
  (Missing <83vfqi$v7r$1 at nnrp1.deja.com>)
  (Missing <VsH84.309$AE1.5597 at paloalto-snr1.gtei.net>)
  (Missing <uoemTWfT$GA.310 at cpmsnbbsa03>)
  (Missing <83vgb2$97j$1 at bl-1.rootsweb.com>)
  (Missing <386344C3.1786C260 at tomatoweb.com>)
 Buffer BUFF10, len: 1953.12 Mbytes, used: 1786.53 Mbytes (91.5%)   0 cycles
  Newest: 2000-04-09 23:59:21,    0 days,  0:10:46 ago
  Oldest: beats me, who knows how long ago

Class MBUFF6  for groups matching "de.*,es.*,fr.*,it.*,nl.*,uk.*"
  (Missing <YFKv4.58155$qv.584535 at news.infostrada.it>)
  (Missing <38BF777C.198A52DC at nigeons.net>)
  (Missing <89ns5n$nva$1 at news.wolfsburg.de>)
  (Missing <fHKv4.165$6I7.1006749 at nnrp2.proxad.net>)
  (Missing <slrn8butli.lf.lutz at taranis.iks-jena.de>)
  (Missing <89nt0n$r37$1 at wanadoo.fr>)
  (Missing <89nt0g$mtt$1 at fb1.euro.net>)
  (Missing <38BF790A.14D1 at wanadoo.fr>)
  (Missing <7GKv4.58161$qv.583666 at news.infostrada.it>)
  (Missing <86noiv$4qf$1 at nclient3-gui.server.dtn.ntl.com>)
  (Missing <9dtubsga7p5a4ogv5drhv8u4m71klai6eo at 4ax.com>)
 Buffer BUFF11, len: 1953.12 Mbytes, used: 1646.10 Mbytes (84.3%)   2 cycles
  Newest: 2000-04-10  0:02:09,    0 days,  0:07:58 ago
  Oldest: beats me, who knows how long ago
  (Missing <10o84dt$b5u$1 at fe2.cs.interbusiness.it>)
  (Missing <38BF11DA.8D822A84 at lycosmail.com>)
  (Missing <86nbpl$q28$2 at pegasus.tiscalinet.it>)
  (Missing <38BF1CB2.33FEFB39 at lycosmail.com>)
  (Missing <9sFv4.57861$qv.580906 at news.infostrada.it>)
  (Missing <t8cu8so7sq9sumdi15kvmn6c90s7002brf at 4ax.com>)
  (Missing <d0Fv4.57846$qv.580505 at news.infostrada.it>)
  (Missing <89n7kr$ipn$1 at nnrp1.deja.com>)
  (Missing <38BF1B0A.51FCF21D at compuserve.com>)
  (Missing <89n6i3$8pg$1 at news.mclink.it>)
  (Missing <38BF1FE6.368FD93C at mail.aitec.it>)
 Buffer BUFF12, len: 1953.12 Mbytes, used: 1625.77 Mbytes (83.2%)   2 cycles
  Newest: 2000-04-10  0:02:09,    0 days,  0:07:59 ago
  Oldest: beats me, who knows how long ago

Class MBUFF7  for groups matching "*"
  (Missing <snowshoe-2412990057500001 at 89-pm2.hom.alaska.net>)
  (Missing <83vfig$uuu$1 at nnrp1.deja.com>)
  (Missing <386343ba.93347008 at nntp.ix.netcom.com>)
  (Missing <83vg0r$82g$1 at news03.btx.dtag.de>)
  (Missing <19991224050127.01031.00000704 at ng-ci1.aol.com>)
  (Missing <Er2fvJBnA0Y4EArE at genesys.demon.co.uk>)
  (Missing <19991224050224.01031.00000705 at ng-ci1.aol.com>)
  (Missing <lindane-6CF97A.09504924121999 at news.brunel.ac.uk>)
  (Missing <83vgeq$9jn$2 at vnetnews.value.net>)
  (Missing <kAH84.64$S3.5096 at newsfeed.avtel.net>)
  (Missing <3863544f.1 at news2.cluster1.telinco.net>)
 Buffer BUFF13, len: 1953.12 Mbytes, used: 1436.47 Mbytes (73.5%)   0 cycles
  Newest: 2000-04-10  0:02:11,    0 days,  0:07:57 ago
  Oldest: beats me, who knows how long ago
  (Missing <83vg03$krq$1 at front3m.grolier.fr>)
  (Missing <QuH84.16$Nj3.438 at dfiatx1-snr1.gtei.net>)
  (Missing <38634453_1 at news2.vip.uk.com>)
  (Missing <zvH84.63$S3.5112 at newsfeed.avtel.net>)
  (Missing <19991224040049.25099 at dsrs.nntp.sol.net>)
  (Missing <r07li4vep3.fsf at mitel.com>)
  (Missing <MwH84.17$Nj3.452 at dfiatx1-snr1.gtei.net>)
  (Missing <19991224050316.01031.00000706 at ng-ci1.aol.com>)
  (Missing <83vg0c$eju$1 at seagoon.newcastle.edu.au>)
  (Missing <3863458A.3E4F065D at Magnolia-Net.Com>)
  (Missing <3863544f.5 at news2.cluster1.telinco.net>)
 Buffer BUFF14, len: 1953.12 Mbytes, used: 1430.60 Mbytes (73.2%)   0 cycles
  Newest: 2000-04-10  0:02:11,    0 days,  0:07:58 ago
  Oldest: beats me, who knows how long ago


===================================================================


expire.ctl contents :
=====================
##  ( Depending on what you use for the innd -c flag and how paranoid you
##  are about old news, you might want to make this 28, 30, etc.)
##  This remember value will affect the size of the history database, as the
##  message IDs of even expired articles are kept in the history for this long.
/remember/:14


## ---------------------------------
##  Default rule for all newsgroups:
##  means, as we put further below rules for ALL unmoderated and moderated
##  ones, the only groups left here which should expire emediately, are the
##  removed groups. So the line below expires all articles in deleted groups
##  emediately (see FAQ section 7.6 for reference).
*:A:0:0:1


## ----------------------------------------------------------------
##  Keep unmoderated ones for 1-7 days, but no longer than 10 days:
##
*:U:1:7:10

## -----------------------------------------------------------------
##  Keep moderated ones for 1-12 days, but no longer than 16 days:
##
*:M:1:12:16


## --------------------------------------------------
##  Some particular groups stay long or even forever:
##

# Keep FAQ's for a month, so they're always available:
#
*.answers:M:1:32:60
news.announce.*:M:1:32:90

# these may stay forever:
#
#uunet*:A:never:never:never


## ---------------------------------------
## Some special settings for other groups:
##

# .announce groups tend to be low-traffic, high lifetime:
#
*.announce:M:1:32:90

# weather forecasts (who want's to know the weather had been yesterday?):
#
*.weather:A:1:3:5

# test posts stay just for one or two days:
#
*.test:A:1:1:2
junk*:A:1:1:1

# job offers are causing enourmous disk usage, so we limit them:
#
misc.jobs*:A:1:5:7

# control.cancel grows very steadily as giving reference to any canceled
# spam posting, so just keep them for max 3 days:
#
control.cancel:A:1:2:3


## -----------------------------------------
## Local groups should stay for a long time:
##
local.*:A:1:35:never





More information about the inn-workers mailing list