eastern language support [was: Re: [bogofilter-announce] Version 0.7.5 Released]

[Graham Wilson]

On Mon, Oct 21, 2002 at 12:10:36PM +0200, Matthias Andree wrote:
> On Mon, 21 Oct 2002, Boris 'pi' Piwinger wrote:
> 
> > Adrian Otto <aotto at aotto.com> wrote:
> > 
> > >We are proud to announce release 0.7.5 of the bogofilter software.
> > 
> > >* Extended TOKEN patterns to improve support for european languages.
> > 
> > Can someone elaborate on that, please?
> 
> Rather than listing what runs of characters make up a token,
> bogofilter's lexer now knows about the stop characters (call them the
> token delimiters if you like) instead. Everything else /is/ a token.

are there plans to add stop characters from other charsets, and for that
matter, allow the lexer to recognize different charsets?

--
gram
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 481 bytes
Desc: not available
URL: <https://www.bogofilter.org/pipermail/bogofilter-dev/attachments/20021021/c9e8e3d2/attachment.sig>