[patch] small lexer changes

[David Relson]

At 05:27 PM 10/9/02, Matthias Andree wrote:
>-----BEGIN PGP SIGNED MESSAGE-----
>Hash: SHA1
>
>On Tue, 08 Oct 2002, Mark M. Hoffman wrote:
>
> > Regarding the size of lexer.c... change "%option full" to "%option ecs" on
> > line 305.  That reduces lexer.c from 47596 lines to 4894 lines for me.
> > The scanner isn't ready to take advantage of "%option full" anyway, yet.
> > If there are no objections, I'll commit that later today.
>
>I benchmarked this, I copied my linux-kernel mailing list mbox file, and
>ran lexertest <lexertest.data >/dev/null. I ran five tests and averaged
>the results. (Duron 700 with 320 MB RAM).

Matthias,

The thought occurs to me that lexertest uses printf() to output all the 
tokens.  For our purposes, a more interesting comparison might be to 
comment out the printf() calls.

David