Million articles in a single directory
Maarten Thibaut
mthibaut at cisco.com
Fri Nov 14 00:37:34 UTC 2008
Russ,
Excellent! What about migration methods from tradspool to timehash?
Has anyone written something like that?
--
maarten
On Nov 14, 2008, at 1:28 AM, Russ Allbery wrote:
> Maarten Thibaut <mthibaut at cisco.com> writes:
>
>> We have up to a million articles in some news groups. As they're all
>> stored in a single directory, our file system is grounding to a halt.
>> We would like to use some kind of mechanism whereby the different
>> files
>> are stored in a tree structure, maybe like this:
>>
>> First level: 256 dirs named dir.00 to dir.ff. Second level: each
>> dir has
>> 256 dirs each named dir.00 to dir.ff. Each of those contains the
>> actual
>> news articles. You then use a hash function to generate the name
>> of the
>> file.
>
> Yup, it's called timehash. :) See storage.conf(5).
>
> --
> Russ Allbery (rra at stanford.edu) <http://www.eyrie.org/~eagle/
> >
>
> Please send questions to the list rather than mailing me directly.
> <http://www.eyrie.org/~eagle/faqs/questions.html> explains why.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.isc.org/pipermail/inn-workers/attachments/20081114/f2497b5a/attachment.html>
More information about the inn-workers
mailing list