tilde (was: [cvs] bogofilter/src lexer_v3.l,1.125,1.126)

[Boris 'pi' Piwinger]

David Relson wrote:

>> >> Exclude tilde from tokens.
>> 
>> Everywhere? Or just TOKENBACK?
> 
> I changed it in TOKENMID and TOKENBACK.  What did you want?

Looking at the history, tilde, apostrophe and backtick were
forgotten when expanding [:punct:] to allow exclamation
points in TOKENBACK:
http://cvs.sourceforge.net/viewcvs.py/bogofilter/bogofilter/src/lexer_v3.l?r1=1.23&r2=1.24

Tilde was allowed in TOKENMID already in revision 1.1. I
believe the reason are TOKENs like F~R~E~E. That makes
sense, but I don't have a strong opinion here.

I meant only TOKENBACK where it is a mistake, but we
certainly can think about TOKENMID.

pi