Million articles in a single directory

Maarten Thibaut mthibaut at
Fri Nov 14 00:37:34 UTC 2008


Excellent! What about migration methods from tradspool to timehash?  
Has anyone written something like that?


On Nov 14, 2008, at 1:28 AM, Russ Allbery wrote:

> Maarten Thibaut <mthibaut at> writes:
>> We have up to a million articles in some news groups. As they're all
>> stored in a single directory, our file system is grounding to a halt.
>> We would like to use some kind of mechanism whereby the different  
>> files
>> are stored in a tree structure, maybe like this:
>> First level: 256 dirs named dir.00 to dir.ff. Second level: each  
>> dir  has
>> 256 dirs each named dir.00 to dir.ff. Each of those contains the   
>> actual
>> news articles. You then use a hash function to generate the  name  
>> of the
>> file.
> Yup, it's called timehash.  :)  See storage.conf(5).
> -- 
> Russ Allbery (rra at             < 
> >
>    Please send questions to the list rather than mailing me directly.
>     <> explains why.

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <>

More information about the inn-workers mailing list