[patch] modified lexer interface

[Gyepi SAM]

On Wed, Oct 02, 2002 at 10:01:24PM -0700, Mark M. Hoffman wrote:
> The point of this is to allow the lexer to pass meta-tokens like
> "subject:money" and "received:foo at bar.com".

Glad to see that. I was thinking about this...

> I haven't included any such tokenizing yet... I just want to check
> that you're all OK with this much first.

Fine with me.

-Gyepi