replace-nonascii-characters stopped working?

[David Relson]

On Mon, 21 Mar 2005 18:27:37 -0600
Bill McClain wrote:

> On Mon, 21 Mar 2005 18:49:44 -0500
> David Relson <relson at osagesoftware.com> wrote:
> 
> > Attached is a tarball with test script, input file, and the two output
> > files.  Let me know what it does on your machine.
> 
> You example works ok here, but I've attached a message which doesn't
> work here. How about at your end?
> 
> -Bill

Hi Bill,

The file looks like all the accented european characters.  The relevant
line is:

   Content-Type: text/plain; charset=Windows-1251

Running the 0.92.8 and 0.94.1 versions of bogolexer give the same
results.  The design purpose of replace-nonascii-characters was to
limit the tokens generated by asian spam. Since windows-1251 is a
'normal' charset, what bogofilter's doing is appropriate.

Regards,

David


_______________________________________________
Bogofilter mailing list
Bogofilter at bogofilter.org
http://www.bogofilter.org/mailman/listinfo/bogofilter