Tradindexed cache entries

Julien ÉLIE julien at trigofacile.com
Sat Mar 13 00:13:19 UTC 2010


Hi Russ,

>> This error is logged by tdx_cache_insert when it does not find
>> the oldest entry.
>> I do not know why the entry suddenly became unavailable :-/
>
> It means that innd thought the cache was empty.  But I'm not sure how it
> ended up in that situation.

I've just had the same problem.

Mar 12 11:06:58 news innd: tradindexed: unable to find oldest cache entry
Mar 12 11:07:18 news innd: tradindexed: unable to find oldest cache entry
Mar 12 11:07:32 news innd: tradindexed: unable to find oldest cache entry
[...]
Mar 12 13:21:43 news innd: tradindexed: unable to find oldest cache entry
Mar 12 13:21:44 news innd: tradindexed: unable to find oldest cache entry
Mar 12 13:21:44 news innd: tradindexed: cannot open 
/home/news/spool/overview/f/s/p/fr.sci.philo.DAT: Trop de fichiers ouverts
Mar 12 13:21:44 news innd: SERVER cant store overview for 
@03034652320000000000002DD4D500000002@
Mar 12 13:22:14 news innd: tradindexed: cannot open 
/home/news/spool/overview/n/l/f/news.lists.filters.DAT: Trop de fichiers ouverts
Mar 12 13:22:14 news innd: SERVER cant store overview for 
@02014B9A31F63F3B00000000000000000000@
Mar 12 13:22:22 news innd: tradindexed: cannot open 
/home/news/spool/overview/f/s/r/fr.soc.religion.DAT: Trop de fichiers ouverts
Mar 12 13:22:22 news innd: SERVER cant store overview for 
@03034652320000000000002DD4DA00000002@
[...]


> Running lsof on innd to see what files it has open when this happens would
> be interesting.  It would at least confirm if it's overview entries that
> are being leaked.

# lsof -c innd | more
COMMAND   PID USER   FD   TYPE     DEVICE       SIZE     NODE NAME
innd    20401 news  cwd    DIR        3,2       4096  8568853 
/home/news/spool/articles
innd    20401 news  rtd    DIR        3,1       4096        2 /
innd    20401 news  txt    REG        3,2    1299951  8569007 /home/news/bin/innd
innd    20401 news  mem    REG        0,0                   0 [heap] (stat: No such 
file or directory)
innd    20401 news  mem    REG        3,1       9436   114790 
/usr/lib/gconv/ISO8859-1.so
innd    20401 news  mem    REG        3,1      21568   110490 
/usr/lib/gconv/gconv-modules.cache
innd    20401 news  mem    REG        3,1     120881   160097 
/usr/share/locale/fr/LC_MESSAGES/libc.mo
innd    20401 news  mem    REG        3,1      30392   113755 
/usr/lib/perl/5.8.8/auto/Data/Dumper/Dumper.so
innd    20401 news  mem    REG        3,1      13120   113701 
/usr/lib/perl/5.8.8/auto/Digest/MD5/MD5.so
innd    20401 news  mem    REG        3,1    1677680   110677 
/usr/lib/locale/locale-archive
innd    20401 news  mem    REG        3,2 1610612736  8601612 
/home/news/spool/cycbuffs/autrecnfs
innd    20401 news  mem    REG        3,2 1610612736  9503425 
/home/news/spool/cycbuffs/frcnfs4
innd    20401 news  mem    REG        3,2 1610612736  9503411 
/home/news/spool/cycbuffs/frcnfs3
innd    20401 news  mem    REG        3,2 1610612736  8601613 
/home/news/spool/cycbuffs/frcnfs2
innd    20401 news  mem    REG        3,2 1610612736  8601611 
/home/news/spool/cycbuffs/frcnfs
innd    20401 news  mem    REG        3,2      29665  8569509 /home/news/db/active
innd    20401 news  mem    REG        3,1      67364   346427 
/lib/tls/i686/cmov/libresolv-2.3.6.so
innd    20401 news  mem    REG        3,1      17840   346411 
/lib/tls/i686/cmov/libnss_dns-2.3.6.so
innd    20401 news  mem    REG        3,1      20968   110736 
/usr/lib/python2.4/lib-dynload/strop.so
innd    20401 news  mem    REG        3,2     131080  8569115 
/home/news/spool/overview/group.index
innd    20401 news  mem    REG        3,1      38372   346443 
/lib/tls/i686/cmov/libnss_files-2.3.6.so
innd    20401 news  mem    REG        3,1      34320   346433 
/lib/tls/i686/cmov/libnss_nis-2.3.6.so
innd    20401 news  mem    REG        3,1      76548   346431 
/lib/tls/i686/cmov/libnsl-2.3.6.so
innd    20401 news  mem    REG        3,1      30428   346413 
/lib/tls/i686/cmov/libnss_compat-2.3.6.so
innd    20401 news  mem    REG        3,1    1241392   346417 
/lib/tls/i686/cmov/libc-2.3.6.so
innd    20401 news  mem    REG        3,1       9656   346429 
/lib/tls/i686/cmov/libutil-2.3.6.so
innd    20401 news  mem    REG        3,1    1084876    97047 
/usr/lib/libpython2.4.so.1.0
innd    20401 news  mem    REG        3,1      21868   346421 
/lib/tls/i686/cmov/libcrypt-2.3.6.so
innd    20401 news  mem    REG        3,1      89370   346442 
/lib/tls/i686/cmov/libpthread-2.3.6.so
innd    20401 news  mem    REG        3,1     145136   346415 
/lib/tls/i686/cmov/libm-2.3.6.so
innd    20401 news  mem    REG        3,1       9592   236448 
/lib/tls/i686/cmov/libdl-2.3.6.so
innd    20401 news  mem    REG        3,1    1153844    94984 
/usr/lib/libperl.so.5.8.8
innd    20401 news  mem    REG        3,1      88164   237091 /lib/ld-2.3.6.so
innd    20401 news    0u   CHR        1,3                 397 /dev/null
innd    20401 news    1w   REG        3,1     456618   236748 /var/log/news/news
innd    20401 news    2w   REG        3,1      31649   236770 /var/log/news/errlog
innd    20401 news    3u  unix 0xccc70500            18435077 socket
innd    20401 news    4r   CHR        1,3                 397 /dev/null
innd    20401 news    5r   CHR        1,3                 397 /dev/null
innd    20401 news    6r   CHR        1,3                 397 /dev/null
innd    20401 news    7r   CHR        1,3                 397 /dev/null
innd    20401 news    8u   REG        3,2     131080  8569115 
/home/news/spool/overview/group.index
innd    20401 news   10w   REG        3,2          0  2982045 
/home/news/spool/outgoing/news.litech.org
innd    20401 news   12u  unix 0xccc70700            18435083 /var/run/news/control
innd    20401 news   13u  unix 0xccc70300            18435085 socket
innd    20401 news   14u  unix 0xccc70100            18435086 /var/run/news/nntpin
innd    20401 news   15u  IPv4   18435088                 TCP *:nntp (LISTEN)
innd    20401 news   16r  FIFO        0,5            18435089 pipe
innd    20401 news   17u  IPv6   18435113                 TCP *:nntp (LISTEN)
innd    20401 news   18r  FIFO        0,5            18435114 pipe
innd    20401 news   19u   REG        3,2      29665  8569509 /home/news/db/active
innd    20401 news   20uW  REG        3,2    5032368  5439569 
/home/news/spool/articles/timecaf-02/9a/4b33.CF.20401 (deleted)
innd    20401 news   21u   REG        3,2    2147292  9505294 
/home/news/spool/overview/f/l/l/f/fr.lettres.langue.francaise.IDX
innd    20401 news   22u  unix 0xcce08900            18441950 socket
innd    20401 news   23u   REG        3,2 1610612736  8601611 
/home/news/spool/cycbuffs/frcnfs
innd    20401 news   24u  unix 0xcce08500            18441954 socket
innd    20401 news   25u   REG        3,2    3539268  9505578 
/home/news/spool/overview/f/r/s/f/fr.rec.sport.football.IDX
innd    20401 news   27u   REG        3,2 1610612736  8601613 
/home/news/spool/cycbuffs/frcnfs2
innd    20401 news   28u   REG        3,2 1610612736  9503411 
/home/news/spool/cycbuffs/frcnfs3
innd    20401 news   29u   REG        3,2 1610612736  9503425 
/home/news/spool/cycbuffs/frcnfs4
innd    20401 news   30u   REG        3,2 1610612736  8601612 
/home/news/spool/cycbuffs/autrecnfs
innd    20401 news   36u   REG        3,2     242100 15466503 
/home/news/spool/overview/n/l/f/news.lists.filters.IDX
innd    20401 news   38u   REG        3,2   30239064  9505754 
/home/news/spool/overview/f/s/p/fr.soc.politique.IDX
innd    20401 news   40u   REG        3,2     468900  9505340 
/home/news/spool/overview/f/m/f/b/fr.misc.finance.banque.IDX
innd    20401 news   41u   REG        3,2   25034399  9505295 
/home/news/spool/overview/f/l/l/f/fr.lettres.langue.francaise.DAT
innd    20401 news   42u  unix 0xc3eb0b80            24472008 socket
innd    20401 news   43u   REG        3,2    1882368  9505348 
/home/news/spool/overview/f/m/s/r/fr.misc.securite.routiere.IDX
innd    20401 news   44u   REG        3,2   30921944  9505349 
/home/news/spool/overview/f/m/s/r/fr.misc.securite.routiere.DAT
innd    20401 news   45u   REG        3,2      18108 15269990 
/home/news/spool/overview/c/c/control.cancel.IDX
innd    20401 news   46u   REG        3,2     167500 15269991 
/home/news/spool/overview/c/c/control.cancel.DAT
innd    20401 news   47u   REG        3,2     242100 15466503 
/home/news/spool/overview/n/l/f/news.lists.filters.IDX
innd    20401 news   48u   REG        3,2    3107273 15466504 
/home/news/spool/overview/n/l/f/news.lists.filters.DAT
innd    20401 news   49u   REG        3,2     242100 15466503 
/home/news/spool/overview/n/l/f/news.lists.filters.IDX
innd    20401 news   50u  unix 0xcce08d00            18441958 socket
innd    20401 news   51u   REG        3,2    3107273 15466504 
/home/news/spool/overview/n/l/f/news.lists.filters.DAT
innd    20401 news   52u   REG        3,2    1659096  9505037 
/home/news/spool/overview/f/b/m/fr.bio.medecine.IDX
innd    20401 news   53u   REG        3,2   18289754  9505038 
/home/news/spool/overview/f/b/m/fr.bio.medecine.DAT
innd    20401 news   54u   REG        3,2      10908  9504571 
/home/news/spool/overview/m/p/f/i/microsoft.public.fr.ie.IDX
innd    20401 news   55u   REG        3,2     171972  9505103 
/home/news/spool/overview/f/c/l/c/fr.comp.lang.c.IDX
innd    20401 news   56u   REG        3,2    2302277  9505107 
/home/news/spool/overview/f/c/l/c/fr.comp.lang.c.DAT
innd    20401 news   57u   REG        3,2      81585  9504572 
/home/news/spool/overview/m/p/f/i/microsoft.public.fr.ie.DAT
innd    20401 news   58u   REG        3,2     785340  9505174 
/home/news/spool/overview/f/c/o/m/fr.comp.os.ms-windows.IDX
innd    20401 news   59u   REG        3,2    6331541  9505175 
/home/news/spool/overview/f/c/o/m/fr.comp.os.ms-windows.DAT
innd    20401 news   60u   REG        3,2     250884  9505415 
/home/news/spool/overview/f/r/a/m/r/fr.rec.arts.musique.rock.IDX
innd    20401 news   61u   REG        3,2    3064847  9505416 
/home/news/spool/overview/f/r/a/m/r/fr.rec.arts.musique.rock.DAT
innd    20401 news   62u   REG        3,2    2147292  9505294 
/home/news/spool/overview/f/l/l/f/fr.lettres.langue.francaise.IDX
innd    20401 news   63u   REG        3,2   25034399  9505295 
/home/news/spool/overview/f/l/l/f/fr.lettres.langue.francaise.DAT
innd    20401 news   64u   REG        3,2     216072  9504225 
/home/news/spool/overview/f/p/n/france.pays-de-la-loire.nantes.IDX
innd    20401 news   65u   REG        3,2    2232739  9504227 
/home/news/spool/overview/f/p/n/france.pays-de-la-loire.nantes.DAT
innd    20401 news   66u   REG        3,2    2489220  9505461 
/home/news/spool/overview/f/r/b/fr.rec.bricolage.IDX
innd    20401 news   67u   REG        3,2   27911319  9505462 
/home/news/spool/overview/f/r/b/fr.rec.bricolage.DAT
innd    20401 news   68u   REG        3,2    2147292  9505294 
/home/news/spool/overview/f/l/l/f/fr.lettres.langue.francaise.IDX
innd    20401 news   69u   REG        3,2   25034399  9505295 
/home/news/spool/overview/f/l/l/f/fr.lettres.langue.francaise.DAT
innd    20401 news   70u   REG        3,2    1273932  9505725 
/home/news/spool/overview/f/s/e/fr.soc.environnement.IDX
innd    20401 news   71u   REG        3,2   14936094  9505727 
/home/news/spool/overview/f/s/e/fr.soc.environnement.DAT
innd    20401 news   72u   REG        3,2   30239064  9505754 
/home/news/spool/overview/f/s/p/fr.soc.politique.IDX
innd    20401 news   73u   REG        3,2  282495821  9505755 
/home/news/spool/overview/f/s/p/fr.soc.politique.DAT
innd    20401 news   74u   REG        3,2    3539268  9505578 
/home/news/spool/overview/f/r/s/f/fr.rec.sport.football.IDX
innd    20401 news   75u   REG        3,2   42646174  9505579 
/home/news/spool/overview/f/r/s/f/fr.rec.sport.football.DAT
innd    20401 news   76u   REG        3,2      72108  9505255 
/home/news/spool/overview/f/c/u/l/fr.comp.usenet.lecteurs-de-news.IDX
innd    20401 news   77u   REG        3,2     959573  9505256 
/home/news/spool/overview/f/c/u/l/fr.comp.usenet.lecteurs-de-news.DAT
innd    20401 news   78u   REG        3,2    2147292  9505294 
/home/news/spool/overview/f/l/l/f/fr.lettres.langue.francaise.IDX
innd    20401 news   79u   REG        3,2   25034399  9505295 
/home/news/spool/overview/f/l/l/f/fr.lettres.langue.francaise.DAT
innd    20401 news   80u   REG        3,2   30239064  9505754 
/home/news/spool/overview/f/s/p/fr.soc.politique.IDX
innd    20401 news   81u   REG        3,2  282495821  9505755 
/home/news/spool/overview/f/s/p/fr.soc.politique.DAT
innd    20401 news   82u   REG        3,2    3746628  9505686 
/home/news/spool/overview/f/s/p/fr.sci.philo.IDX
innd    20401 news   83u   REG        3,2   49826760  9505687 
/home/news/spool/overview/f/s/p/fr.sci.philo.DAT
innd    20401 news   84u   REG        3,2    3246588  9505758 
/home/news/spool/overview/f/s/r/fr.soc.religion.IDX
innd    20401 news   85u   REG        3,2   45825383  9505766 
/home/news/spool/overview/f/s/r/fr.soc.religion.DAT
innd    20401 news   86u   REG        3,2     417348  9503047 
/home/news/spool/overview/f/b/t/fido.belg.trains.IDX
innd    20401 news   87u   REG        3,2    5569873  9503049 
/home/news/spool/overview/f/b/t/fido.belg.trains.DAT
innd    20401 news   88u   REG        3,2      38484  9504809 
/home/news/spool/overview/m/p/f/s/microsoft.public.fr.securite.IDX
innd    20401 news   89u   REG        3,2     503493  9504810 
/home/news/spool/overview/m/p/f/s/microsoft.public.fr.securite.DAT
innd    20401 news   90u   REG        3,2   30239064  9505754 
/home/news/spool/overview/f/s/p/fr.soc.politique.IDX
innd    20401 news   91u   REG        3,2  282495821  9505755 
/home/news/spool/overview/f/s/p/fr.soc.politique.DAT
innd    20401 news   92u   REG        3,2     133848  9505855 
/home/news/spool/overview/f/m/m/fr.misc.militaire.IDX
innd    20401 news   93u   REG        3,2    1981591  9505857 
/home/news/spool/overview/f/m/m/fr.misc.militaire.DAT
innd    20401 news   94u   REG        3,2    1588212  9505447 
/home/news/spool/overview/f/r/a/fr.rec.aviation.IDX
innd    20401 news   95u   REG        3,2   13884800  9505448 
/home/news/spool/overview/f/r/a/fr.rec.aviation.DAT
innd    20401 news   96u   REG        3,2     638640  9505744 
/home/news/spool/overview/f/s/h/fr.soc.histoire.IDX
innd    20401 news   97u   REG        3,2    6142115  9505745 
/home/news/spool/overview/f/s/h/fr.soc.histoire.DAT
innd    20401 news   98u   REG        3,2    6959448  9503139 
/home/news/spool/overview/s/c/b/soc.culture.belgium.IDX
innd    20401 news   99u   REG        3,2   89516657  9503159 
/home/news/spool/overview/s/c/b/soc.culture.belgium.DAT
[...]


Hmm...  I see that I have several times the same file...

innd    20401 news  163u   REG        3,2   30239064  9505754 
/home/news/spool/overview/f/s/p/fr.soc.politique.IDX
innd    20401 news  164u   REG        3,2  282495821  9505755 
/home/news/spool/overview/f/s/p/fr.soc.politique.DAT
innd    20401 news  165u   REG        3,2   30239064  9505754 
/home/news/spool/overview/f/s/p/fr.soc.politique.IDX
innd    20401 news  166u   REG        3,2  282495821  9505755 
/home/news/spool/overview/f/s/p/fr.soc.politique.DAT
innd    20401 news  167u   REG        3,2    2257344  9505482 
/home/news/spool/overview/f/r/j/fr.rec.jardinage.IDX
innd    20401 news  168u   REG        3,2   36136275  9505483 
/home/news/spool/overview/f/r/j/fr.rec.jardinage.DAT
innd    20401 news  187u   REG        3,2   30239064  9505754 
/home/news/spool/overview/f/s/p/fr.soc.politique.IDX
innd    20401 news  188u   REG        3,2  282495821  9505755 
/home/news/spool/overview/f/s/p/fr.soc.politique.DAT
innd    20401 news  189u   REG        3,2  282495821  9505755 
/home/news/spool/overview/f/s/p/fr.soc.politique.DAT
innd    20401 news  191u   REG        3,2   30239064  9505754 
/home/news/spool/overview/f/s/p/fr.soc.politique.IDX




# lsof -c innd | grep overview | wc -l
982

overcachesize:          384


Is there something else to check?

That's strange.
Maybe a bug I introduced with:
    http://inn.eyrie.org/trac/changeset/8947/trunk/storage/tradindexed/tradindexed.c
though I do not see why.

Is someone else experiencing the same problem with the release candidate of INN 
2.5.2?

-- 
Julien ÉLIE

« -- Et on appelle comment ce genre de logis ?
  -- HLM... Habitations Latines Mélangées... » (Astérix) 




More information about the inn-workers mailing list