radical lexer

[Boris 'pi' Piwinger]

David Relson <relson at osagesoftware.com> wrote:

>A quick comparison of bogofilter's lexer_v3.l and your radical lexer
>was interesting, particularly the following line:
>
>TOKENBORDER [^[:blank:][:cntrl:]<>;&%@|/\\{}^"*,[\]=()+?:#$._!'`~-]

Also we differ on BOGOLEX_TOKEN, where I don't allow =()+
which you do allow. I really don't know if this is
important. Can you explain why?

pi