INN 2.4.3 and news.daily errors with buffindexed overview storage

Mike Brudenell pmb1 at york.ac.uk
Tue Oct 17 13:48:17 UTC 2006


Greetings -

I've just migrated our Usenet News service to a new computer.  We're  
running INN 2.4.3 and I've taken the opportunity to move to using the  
buffindexed storage system for overview data.

On the old setup, which used unified overview, I ran news.daily from  
cron using this command:

     /usr/local/pkg/inn-2.1/bin/news.daily expireover lowmark flags='- 
v1 -c -e -N'

On the new setup I currently use simply:

     /usr/local/news/bin/news.daily expireover lowmark

However the output that gets e-mailed to me includes reams of scary- 
looking warnings, such as:

Expire messages:
expireover start Tue Oct 17 00:00:54 BST 2006: (-z/usr/local/news/log/ 
expire.rm -Z/usr/local/news/log/expire.lowmark)
Can't unlink @03016362303200000000001E5FA900000001@: read only  
storage api
Can't unlink @03016362303200000000001E754800000001@: read only  
storage api
Can't unlink @03016362303200000000001E87EB00000001@: read only  
storage api
Can't unlink @03016362303200000000001EE68900000001@: read only  
storage api
Can't unlink @03016362303200000000001F2D3C00000001@: read only  
storage api
Can't unlink @03016362303200000000001F638000000001@: read only  
storage api
Can't unlink @03016362303200000000001F8D5900000001@: read only  
storage api
Can't unlink @03016362303200000000001F8D5C00000001@: read only  
storage api
Can't unlink @03016362303200000000001F9CA900000001@: read only  
storage api
     ... hundreds more lines like this ...

Am I doing something wrong/forgotten something?

======================================================================

I'm using groupbaseexpiry "true" in inn.conf; here's the relevant  
extract:

inn.conf (extract)
------------------
# Article Storage

cnfscheckfudgesize:     0
enableoverview:         true
groupbaseexpiry:        true
mergetogroups:          false
overcachesize:          15
#ovgrouppat:
storeonxref:            true
useoverchan:            false
wireformat:             false
xrefslave:              false
nfswriter:              false

======================================================================

storage.conf
------------
method cnfs {
         newsgroups: york,york.*
         class:      0
         options:    YORK
}

method cnfs {
         newsgroups: *
         class:      1
         options:    DEFAULT
}

======================================================================

cycbuff.conf
------------
cycbuff:cb00:/usr/local/news/spool/cycbuffs/cb00:1048576
cycbuff:cb01:/usr/local/news/spool/cycbuffs/cb01:1048576
cycbuff:cb02:/usr/local/news/spool/cycbuffs/cb02:1048576
cycbuff:cb03:/usr/local/news/spool/cycbuffs/cb03:1048576
cycbuff:cb04:/usr/local/news/spool/cycbuffs/cb04:1048576
cycbuff:cb05:/usr/local/news/spool/cycbuffs/cb05:1048576
cycbuff:cb06:/usr/local/news/spool/cycbuffs/cb06:1048576
cycbuff:cb07:/usr/local/news/spool/cycbuffs/cb07:1048576
cycbuff:cb08:/usr/local/news/spool/cycbuffs/cb08:1048576
cycbuff:cb09:/usr/local/news/spool/cycbuffs/cb09:1048576
cycbuff:cb10:/usr/local/news/spool/cycbuffs/cb10:1048576
metacycbuff:YORK:cb00:SEQUENTIAL
metacycbuff:DEFAULT:cb01,cb02,cb03,cb04,cb05,cb06,cb07,cb08,cb09,cb10:SE 
QUENTIAL

======================================================================

buffindexed.conf
----------------
1:/usr/local/news/spool/overview/OV1:1048576
2:/usr/local/news/spool/overview/OV2:1048576
3:/usr/local/news/spool/overview/OV3:1048576


% ls -l /usr/local/news/spool/overview/
total 6294576
-rw-rw----   1 news     news     1073741824 Oct 17 14:43 OV1
-rw-rw----   1 news     news     1073741824 Oct 17 14:43 OV2
-rw-rw----   1 news     news     1073741824 Oct 17 14:43 OV3

% inndf -o
25% overview space used

======================================================================

expire.ctl
----------
/remember/:10
*:A:1:32:90
york:A:1:32:90
york.*:A:1:32:90
york.test:A:0.1:0.1:0.1

======================================================================

Output from contrib/showtoken.in for some of the tokens
-------------------------------------------------------
echo @03016362303200000000001E5FA900000001@ | perl contrib/showtoken.in
@03016362303200000000001E5FA900000001@ type=cnfs class=1 buffer=cb02  
offset=3cbf5200 cycnum=1

echo @03016362303200000000001E754800000001@ | perl contrib/showtoken.in
@03016362303200000000001E754800000001@ type=cnfs class=1 buffer=cb02  
offset=3cea9000 cycnum=1

echo @03016362303200000000001E87EB00000001@ | perl contrib/showtoken.in
@03016362303200000000001E87EB00000001@ type=cnfs class=1 buffer=cb02  
offset=3d0fd600 cycnum=1

echo @03016362303200000000001EE68900000001@ | perl contrib/showtoken.in
@03016362303200000000001EE68900000001@ type=cnfs class=1 buffer=cb02  
offset=3dcd1200 cycnum=1

echo @03016362303200000000001F2D3C00000001@ | perl contrib/showtoken.in
@03016362303200000000001F2D3C00000001@ type=cnfs class=1 buffer=cb02  
offset=3e5a7800 cycnum=1


Out of curiosity I ran all the tokens from all the 3439 warnings in  
today's news.daily e-mail through showtoken.in.  Interestingly only  
articles in cycbuffs cb01, cb02 and cb03 appeared in the output.   
Does this imply the other cycbuffs aren't being used?  Or that there  
is a problem with cb01 to cb03?  An "ls -l" seems to suggest the  
former (is this normal in the early days of a new news server  
installation?):

% ls -l /usr/local/news/spool/cycbuffs/
total 23080112
-rw-rw----   1 news     news     1073741824 Oct 16 15:29 cb00
-rw-rw----   1 news     news     1073741824 Oct  9 23:30 cb01
-rw-rw----   1 news     news     1073741824 Oct 13 21:31 cb02
-rw-rw----   1 news     news     1073741824 Oct 17 14:41 cb03
-rw-rw----   1 news     news     1073741824 Oct  5 11:43 cb04
-rw-rw----   1 news     news     1073741824 Oct  5 11:44 cb05
-rw-rw----   1 news     news     1073741824 Oct  5 11:46 cb06
-rw-rw----   1 news     news     1073741824 Oct  5 11:48 cb07
-rw-rw----   1 news     news     1073741824 Oct  5 11:49 cb08
-rw-rw----   1 news     news     1073741824 Oct  5 11:50 cb09
-rw-rw----   1 news     news     1073741824 Oct  5 11:55 cb10

======================================================================


With many thanks,
Mike Brudenell

-- 
The Computing Service, University of York, Heslington, York Yo10 5DD, UK
Tel:+44-1904-433811  FAX:+44-1904-433740

* Unsolicited commercial e-mail is NOT welcome at this e-mail address. *




More information about the inn-workers mailing list