ALPHA [was: lexer change]

[Boris 'pi' Piwinger]

David Relson <relson at osagesoftware.com> wrote:

>A1 is needed for the places where a single letter needs to be identified
>for use in a token and a2 is needed for a single letter followed by a
>letter a digit.  An example is a token split by an html comment, i.e.
>"T<!xxx>ha<!xx>t".
>
>I have corrected the problems and updated CVS.

I haven't seen it, but could we use [[:alpha:]][[:alnum:]]?
for a combined version of those? If so then why not write it
into TOKEN_12 directly. I think it increases readability if
things which occur only once are not hidden in another
definition: TOKEN_12 ({TOKEN}|[[:alpha:]][[:alnum:]]?)

pi