try to use bogolexer 0.15.7 on messages with attaches

[David Relson]

On Wed, 5 Nov 2003 15:32:51 +0400
Mike Lykov <combr at vesna.ru> wrote:

> Hi all.
> 
> Following David Relson advice, I take mailbox with non-spam messages,
> which bogofilter with old bases incorrect classify as spam.
> 
> first of all, explain to me value of tokens 
> bh bs hi bo bt bl.
> 
> As I can see: hi - header, bh - html, bs- stylesheet in html part, bt
> - base64 data (bo, bl - can't figure out).

They're debugging aids and indicate the lexer state.  The first leader
stands for header or body.  The second letter is defined in function
yy_get_state() in bogofilter/src/lexer_v3.l.