References/XOVER bug?

[Jeffrey M. Vinocur]

Since upgrading to CURRENT, some articles weren't threading properly.  It
looks like References wasn't included in overview for some reason.  
Here's an example:

    200 news.litech.org InterNetNews NNRP server INN 2.5.0 (20040608 CVS 
    prerelease) ready (posting ok).

    GROUP news.software.nntp
    211 385 16980 22479 news.software.nntp

    HEAD 22468
    221 22468 <87fz9bvt9e.fsf at windlord.stanford.edu> head
    [...other headers here...]
    Message-ID: <87fz9bvt9e.fsf at windlord.stanford.edu>
    References: <40afa061$0$26354$9b4e6d93 at newsread4.arcor-online.net> <c8o8jl$h42$1 at puck.litech.org>
     <ng3sc.965$FC3.272 at newssvr16.news.prodigy.com>
     <87y8nh2ytx.fsf at windlord.stanford.edu>
     <Xns94FEBCA6CB1D1idispcom at 216.65.98.77>
    [...more headers here...]
    .

    XOVER
    224 22468 fields follow
    22468   Re: nntp 503 server timeout     Russ Allbery <rra at stanford.edu> Fri, 04 Jun 2004 15:43:41 -0700 <87fz9bvt9e.fsf at windlord.stanford.edu>          1705   16       Xref: news.litech.org news.software.nntp:22468
    .


Also:

    ~news # grep 22468 spool/overview/n/s/n/news.software.nntp.DAT
    22468   Re: nntp 503 server timeout     Russ Allbery <rra at stanford.edu> Fri, 04 Jun 2004 15:43:41 -0700 <87fz9bvt9e.fsf at windlord.stanford.edu>          1705   16       Xref: news.litech.org news.software.nntp:22468

    ~news # bin/tdx-util -R spool/articles/news/software/nntp -n news.software.nntp

    ~news # grep 22468 spool/overview/n/s/n/news.software.nntp.DAT
    22468   Re: nntp 503 server timeout     Russ Allbery <rra at stanford.edu> Fri, 04 Jun 2004 15:43:41 -0700 <87fz9bvt9e.fsf at windlord.stanford.edu>  <40afa061$0$26354$9b4e6d93 at newsread4.arcor-online.net> <c8o8jl$h42$1 at puck.litech.org> <ng3sc.965$FC3.272 at newssvr16.news.prodigy.com> <87y8nh2ytx.fsf at windlord.stanford.edu> <Xns94FEBCA6CB1D1idispcom at 216.65.98.77>     1745    16      Xref: news.litech.org news.software.nntp:22468


Interestingly, the parts of overview that were created by makehistory the
old spool (we just recovered from a crash) are fine, as are entries
rebuilt with tdx-util; it's only the new articles that have arrived to
innd itself that are strange.  Also, it's not all of the new articles,
cursory inspection relates it to References headers that wrap onto
multiple lines.

I think there were a couple header-parsing changes recently that might be 
relevant?


-- 
Jeffrey M. Vinocur 
jeff at litech.org