WARNING: Problem with '-u' option and separate wordlists

[Greg Louis]

On 20030927 (Sat) at 0831:38 -0400, David Relson wrote:
> On Sat, 27 Sep 2003 14:01:09 +0200
> Matthias Andree <matthias.andree at gmx.de> wrote:

> > Is there any reason besides "compatibility" that lets us keep
> > "separate" word lists? If not, we'll just add huge banners to "make
> > install" and force the migration, dropping "separate word list"
> > support.
> 
> Basically correct.  It's there primarily for compatibility.  When the
> combined wordlist was introduced, there were a number of reasons people
> had for wanting to keep their separate wordlists.  I don't remember the
> details.

For reasons unknown to me, nobody who used separate wordlists had ever
run into the
oh....................................................................
I.....................................................................
am....................................................................
thrashing.............................................................
between...............................................................
my....................................................................
and...................................................................
the...................................................................
OS's..................................................................
idea of what's a decent db cache size vs..............................
filesystem write cache size...........................................
is.  But as soon as we started playing with single lists, it became
GawdAwfullySlow to run bogofilter with the default 256Kb Berkeley db
cache; one had to set it to less than a third, or more than the whole,
of the size of the db file one wanted to manipulate, or bf would run
like a snail in a honeypot.

Some would rather not hit that issue, but sooner or later even they
will have scars behind, so I vote we abandon multiple lists.
-- 
| G r e g  L o u i s         | gpg public key: 0x400B1AA86D9E3E64 |
|  http://www.bgl.nu/~glouis |   (on my website or any keyserver) |
|  http://wecanstopspam.org in signatures helps fight junk email. |

Header information for this message:
Subject: Re: WARNING:  Problem with '-u' option and separate wordlists
     To: bogofilter at aotto.com
   From: Greg Louis <glouis at dynamicro.on.ca>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 211 bytes
Desc: not available
URL: <http://www.bogofilter.org/pipermail/bogofilter/attachments/20030927/75155672/attachment.sig>