bogofilter-0.95.2 - new current release

[David Relson]

On Sat, 02 Jul 2005 11:43:52 +0200
Boris 'pi' Piwinger wrote:

> David Relson <relson at osagesoftware.com> wrote:
> 
> >	  - default configuration:
> >	    . bogofilter auto-detects whether database is using
> >	      unicode (utf-8) or not.
> >	    . bogofilter uses unicode when creating new databases.
> >	    . bogoutil preserves unicode/non-unicode stat during
> >	      dump/load.
> >	    . bogofilter, bogolexer, and bogoutil have "--unicode=yes/no"
> >	      options which permit user selectable modes for experimenting, 
> >	      testing, and wordlist conversion.
> 
> So when I build a new database I will never need those
> options. So is there any other use-case for the options than
> translating a database or not using unicode at all?
> 
> pi

That's basically right.  With bogolexer the unicode=yes/no options can
be used to see how the encoding changes the parsed tokens.  Otherwise
the options are only used during a transition, e.g. during initial
wordlist creation or when changing a wordlist from one encoding to
another.