Million articles in a single directory

Maarten Thibaut mthibaut at cisco.com
Fri Nov 14 00:37:34 UTC 2008


Russ,

Excellent! What about migration methods from tradspool to timehash?  
Has anyone written something like that?

--
maarten


On Nov 14, 2008, at 1:28 AM, Russ Allbery wrote:

> Maarten Thibaut <mthibaut at cisco.com> writes:
>
>> We have up to a million articles in some news groups. As they're all
>> stored in a single directory, our file system is grounding to a halt.
>> We would like to use some kind of mechanism whereby the different  
>> files
>> are stored in a tree structure, maybe like this:
>>
>> First level: 256 dirs named dir.00 to dir.ff. Second level: each  
>> dir  has
>> 256 dirs each named dir.00 to dir.ff. Each of those contains the   
>> actual
>> news articles. You then use a hash function to generate the  name  
>> of the
>> file.
>
> Yup, it's called timehash.  :)  See storage.conf(5).
>
> -- 
> Russ Allbery (rra at stanford.edu)             <http://www.eyrie.org/~eagle/ 
> >
>
>    Please send questions to the list rather than mailing me directly.
>     <http://www.eyrie.org/~eagle/faqs/questions.html> explains why.

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.isc.org/pipermail/inn-workers/attachments/20081114/f2497b5a/attachment.html>


More information about the inn-workers mailing list