multiple wordlists in 0.93.*

[David Relson]

-- 
David Relson                   Osage Software Systems, Inc.
relson at osagesoftware.com       Ann Arbor, MI 48103
www.osagesoftware.com          tel:  734.821.8800
On Mon, 15 Nov 2004 01:09:36 +0100
Matthias Andree wrote:

> Hi,
> 
> anyone got multiple wordlists working in 0.93.*?
> 
> $ ( echo ; echo "encore une ligne a tester" ) | 
> strace -feopen bogofilter -v \
>         --wordlist r,wordlist,/tmp/wl1/wordlist.db,2 \
>         --wordlist r,wordlist,/tmp/wl2/wordlist.db,1
> 
> yields:
> 
> open("/home/ma/.bogofilter/wordlist.db", O_RDONLY|O_LARGEFILE) = 5
> open("/home/ma/.bogofilter/wordlist.db", O_RDONLY|O_LARGEFILE) = 5
> open("/home/ma/.bogofilter/wordlist.db", O_RDONLY|O_LARGEFILE) = 6
> open("/home/ma/.bogofilter/wordlist.db", O_RDONLY|O_LARGEFILE) = 6
> X-Bogosity: Unsure, tests=bogofilter, spamicity=0.507000,
> version=0.93.1.cvs
> 
> which looks bogus. 0.92.8 was fine with the traditional store but not
> when BOGOFILTER_CONCURRENT_DATA_STORE was set in the environment.
> 
> Not sure yet how this can be fixed, this mail is just to let people
> know there's something wrong.

Matthias,

Yep.  Looks like the pathing is borked.  By the way strace isn't needed
-- use flags "-x d -vv" (see below).  'Tis odd that DB_ENV->open() has
the wrong directory and DB->close() has the right one.

I'll take a look, unless you'd rather do so....

David

[relson at osage src]$ bogofilter -x d -C -vv --wordlist
r,wordlist,/tmp/wl1/wordlist.db,1 --wordlist
r,wordlist,/tmp/wl2/wordlist.db,2 < msg.ligne.txt
open_lockfile: open(/home/relson/.bogofilter/lockfile-p) succeeded, fd
#3
db_env_create: 0x806f870
DB_ENV->set_cachesize(4)
DB_ENV->set_lk_max_locks(0x806f870, 16384)
DB_ENV->set_lk_max_objects(0x806f870, 16384)
DB_ENV->set_lk_detect(DB_LOCK_DEFAULT)
DB_ENV->open(home=/home/relson/.bogofilter)
db_version: Header version 4.2, library version 4.2
[pid 648] DB->open(db=0x8070130, file=wordlist.db, database=NIL, type=1,
flags=0x1000010=DB_RDONLY DB_AUTO_COMMIT , mode=0664) -> 0 Successful
return: 0
DB->get_byteswapped: false
DB->fd: 5
DB->stat success, pagesize: 4096
[pid 648] DB->open(db=0x8070800, file=wordlist.db, database=NIL, type=1,
flags=0x1000010=DB_RDONLY DB_AUTO_COMMIT , mode=0664) -> 0 Successful
return: 0
DB->get_byteswapped: false
DB->fd: 5
DB->stat success, pagesize: 4096
X-Bogosity: Ham, tests=bogofilter, spamicity=0.000080,
version=0.93.1.cvs
   int  cnt   prob  spamicity histogram
  0.00    1 0.000080 0.000080 #
  0.10    0 0.000000 0.000080 
  0.20    0 0.000000 0.000080 
  0.30    0 0.000000 0.000080 
  0.40    0 0.000000 0.000080 
  0.50    0 0.000000 0.000080 
  0.60    0 0.000000 0.000080 
  0.70    0 0.000000 0.000080 
  0.80    0 0.000000 0.000080 
  0.90    0 0.000000 0.000080 
DB->close(/tmp/wl1/wordlist.db, nosync)
DB->close(/tmp/wl2/wordlist.db, nosync)
DB_ENV->close(0x806f870): Successful return: 0
close_lockfile