lexer change

[Boris 'pi' Piwinger]

Me again ...

There are some things I don't understand in the lexer, maybe
they also can be simplified:

ALPHA is never used and is identical to A2.

A2 is defined as [[:alpha:]][[:alnum:]]+ which is AFAICS the
same as [[:alnum:]]+. Is that correct? Or does it mean: I
alpha character followed by at least one alnum character?

In either case: TOKEN_12 is the only place where A1 and A2
are used. Since anything of the form A1 is also of the form
A2, it would be sufficient to defined TOKEN_12 as
({TOKEN}|{A2}).

I don't understand what the use of TOKEN_12 is.

What is BOGO_LEX doing?

Can someone explain those things to me, please?

pi