What is a word (lexertest)

[Boris 'pi' Piwinger]

Matthias Andree wrote:

>> >Even though I don't code here, I tested something;-)
>> >
>> >[3.14 at pi ~/local/bogolists]$ echo "»cmsg newgroup«"|lexertest
>> >get_token: 1 '»cmsg'
>> >get_token: 1 'newgroup«'
>> 
>> I'm guessing that you wanted the two special characters removed???
> 
> I'll object. « and » have valid national characters in other ISO
> character sets,

Yes, that's why we cannot do it before Unicode uniformization.

> and these characters clearly will not show in valid cmsg
> checkgroups.

Rigth, the example comes from a discussion about valid subjects and
was quoted to prevent cmsg.

> Leaving them in as-is is fine with me. Frenchies, scream now ;-)

For German just use them the other way round>;->

pi