several bugs/glitches/typos/questions

[W M Brelsford]

David,

The patch fixes #1 (-n -m works and combines tokens).  However it
appears that the date assigned to combined tokens is the last date
encountered in the database rather than the most recent date.

And, "bogoutil -n -d file.db" still does not combine tokens.  I
assume this would take more involved code, and may not be worth
worrying about as long as it's documented.  Presumably one would run
bogoutil -n -m once per database, set "replace_nonascii_characters=Y"
in bogofilter.cf and be done with it.

On Fri Mar 07 2003 at 07:41 PM -0500, David Relson wrote:
> Bill,
> 
> Give the attached patch a try.  As it steps through the wordlist, it checks 
> for tokens with non-ascii characters.  When one is found, it is deleted and 
> a new one (with changed characters) is added.  If two tokens map to the 
> same token, their counts will be combined.  The patch also includes a 
> simple test in scripts tests/bogoutil/t.nonascii.replace
> 
> As always, I request that you let me know whether or not the patch fixes 
> _your_ problem.
> 
> Cheers,
> 
> David
> 
> At 06:01 PM 3/7/03, W M Brelsford wrote:
> 
> >A couple problems seem to remain in 0.11.1.2:
> >
> >On Thu Mar 06 2003 at 03:00 PM -0500, David Relson wrote:
> >> At 01:48 PM 3/6/03, W M Brelsford wrote:
> >>
> >> >A few things I've noticed lately (using 0.11.1.1):
> >> >
> >> >1. bogoutil -m doesn't work, e.g. "bogoutil -c3 -m file.db" does
> >> >        not change file.db.
> >
> >Works now with -c3, but "bogoutil -n -m file.db" still does nothing.
> >
> >> >2. bogoutil -n doesn't combine tokens, e.g. "bogoutil -n -d file.db"
> >> >        yields multiple identical lines like "c??067???? 1 20030222".
> >> >        (Would they be combined with "-m"?)
> >
> >Still doesn't combine tokens.

-- 
Bill Brelsford
k2di2 at att.net