More strangeness in lexer?

[David Relson]

At 06:32 PM 8/10/03, michael at optusnet.com.au wrote:
>David Relson <relson at osagesoftware.com> writes:
> > Michael,
> >
> > 'Tis clear you've encountered a problem and I've yet to
> > understand/reproduce it.  Sigh :-(
> >
> > Question:  have you modifications to bogofilter that fix the problem?
>
>Not yet. :)
>(Well, I do, but they're bound up with the word-pair scoring and
>hinting work I've been doing).
>
>[..]
> > >In this case though, the MTA isn't at issue, nor is the original sender.
> > >The only place that "\n\n\From\ " is relevent is at the MDA. If your
> > >local MDA is getting mbox wrong, then you probably need to change
> > >MDA's :)
> >
> > Sounds like one approach would be a state flag that increments on
> > empty lines and clears on tokens...
>
>Actually, I think you can just change the '^From\ ' to be
>'\n\nFrom\ ' in the lexer. The lexer is always looking for the
>longest match anyway, so that's perfectly safe.... I think. :)

I tried to do that a while back, to no avail.  This evening it seems to 
work.  Possibly what I did was change "^From\ " to "\n\n^From ", or 
something comparably wrong.

As "\n\nFrom\ " will fail on the very first line of a message, or mbox, I 
need to be a bit more clever...