Excessive memory usage: bug?

Matthias Andree matthias.andree at gmx.de
Thu Mar 10 14:28:47 CET 2005


JUANVAQUEROPONC <JUANVAQUEROPONC at terra.es> writes:

> I did:
> bogofilter -s < spam.mbox
> (with a big spam.mbox file of 300MB)
>
> The memory usage is so huge that Linux kills the program or I need to
> kill it to continue using the machine.
>
> Why bogofilter uses so much memory?

It caches the whole token count to be registered in RAM so it can sort
the tokens to achieve acceptable performance. We tried without and it
was slow like a snail.

Do you have lots of random garbage (rather than regular words in
messages) in that mailbox? Note that attachments do not count,
bogofilter skips them.

> Is it a memory leak?

I don't think so.

> Is it a bug?

Unless further evidence is provided that some component inside
bogofilter runs away, no.

-- 
Matthias Andree
_______________________________________________
Bogofilter mailing list
Bogofilter at bogofilter.org
http://www.bogofilter.org/mailman/listinfo/bogofilter



More information about the Bogofilter mailing list