Database corruption [ was: DB_PAGE_NOTFOUND ]

[Sergii Laskavyi]

[Sorry for late reply -- was checking if I can reproduce the problem]

> Sounds like you can make this happen every time.  Is that correct?

Yes.

> What operating system, distribution, version, and cpu are you using?

FreeBSD 4.9-STABLE Wed Jan  7 08:16:53 MSK 2004
Intel Pentium III (844.61-MHz 686-class CPU)

> What version of bogofilter?

0.15.13.1

> How are you building bogofilter?

cd /usr/ports/mail/bogofilter && sudo make install clean

Compiler flags are "-O -pipe", gcc 2.95.4.
Can try with 3.3.3 20040105 (prerelease).

> What version of BerkeleyDB?

db4-4.0.14_1,1 from ports/databases/db4

> How big is the wordlist?

280703 records

> what does "ls -l" report for wordlist.db.new?

-rw-r-----  1 bogotest	bogotest  9617408 Jan  8 16:38 wordlist.db

Bogofilter is started by maildrop 1.6.3, which is started by Postfix 2.0.16,1:

Here is ~/.mailfilter:

	MAILDIR=$HOME/Mail

	xfilter "/usr/local/bin/bogofilter -u -e -p"
	if (/^X-Bogosity: Yes, tests=bogofilter/)
	{
	  to $MAILDIR/spam
	}

Postfix file size limit is default (48 Megabytes):

	mailbox_size_limit = 51200000

Probably database corrupts when free space in $HOME is less than 10M:

	Filesystem   Size   Used  Avail Capacity  Mounted on
	/dev/vnc0c    63M    51M    12M    80%    /home/bogotest

Yesterday I recompiled bogofilter with db4 and started it.

Some first messages were filtered and delivered
OK, but then I've got messages in maillog:

(db) db_get_dbvalue( 'from:Matt' ), err: -30988, DB_PAGE_NOTFOUND
(db) db_get_dbvalue( 'from:osagesoftware.com' ), err: -30988, DB_PAGE_NOTFOUND
(db) db_get_dbvalue( 'head:V6.00.2800.1165' ), err: -30988, DB_PAGE_NOTFOUND
(db) db_get_dbvalue( 'head:Windows-1251' ), err: -30988, DB_PAGE_NOTFOUND
(db) db_get_dbvalue( 'from:Mufqpol' ), err: -30988, DB_PAGE_NOTFOUND
(db) db_get_dbvalue( 'head:X-Mailer' ), err: -30988, DB_PAGE_NOTFOUND
(db) db_get_dbvalue( 'head:V6.00.2800.1165' ), err: -30988, DB_PAGE_NOTFOUND
(db) db_get_dbvalue( 'from:Maryellen' ), err: -30988, DB_PAGE_NOTFOUND
(db) db_get_dbvalue( 'from:osagesoftware.com' ), err: -30988, DB_PAGE_NOTFOUND
(db) db_get_dbvalue( 'from:ntlworld.com' ), err: -30988, DB_PAGE_NOTFOUND
(db) db_get_dbvalue( 'from:ntlworld.com' ), err: -30988, DB_PAGE_NOTFOUND
(db) db_get_dbvalue( 'from:osagesoftware.com' ), err: -30988, DB_PAGE_NOTFOUND
(db) db_get_dbvalue( 'from:osagesoftware.com' ), err: -30988, DB_PAGE_NOTFOUND
(db) db_get_dbvalue( 'head:X-Kaspersky-Antivirus' ), err: -30988, DB_PAGE_NOTFOUND
(db) db_get_dbvalue( 'from:markg' ), err: -30988, DB_PAGE_NOTFOUND
(db) db_get_dbvalue( 'from:mattg' ), err: -30988, DB_PAGE_NOTFOUND