Duplicate message-id in history text

[Tommy van Leeuwen]

Zenon Panoussis wrote:

>Persistent problem since a month ago when I messed up everything:
>
>Rebuilding history, I get a zillion errors on makedbz in the style of
>   Duplicate message-id "[1E1452C63E118829D12541DD6A337C9F]" in history text
>and, no matter what I do, I can't get rid of them.
>
>  
>
Probably your expire process was broken somewhere and one part of the 
newly generated history is appended to an older one. Don't know how or 
why this happens but we've seen it occasionally.

>If I just sent the history file through sort|uniq, would I solve
>the problem or create a new mess?
>  
>
Depending on your sort and uniq parameters :)

This is what we use to wipe out dups:

  cat history.new | sort -T ~/spool/tmp | uniq -w33 > history.newer
  ~/bin/makedbz -s 15000000 -f history.newer

>Should I assume that the articles are also physically stored twice in
>the spool? If so, how do I get rid of the duplicates?
>  
>
Most probably not.

Regards,
Tommy
News-Service.com