bug using passthrough option on opensuse

[Matthias Andree]

Am 20.05.24 um 15:23 schrieb Manvendra Bhangui:
> I tried replies to your mail. But my mail is getting rejected with the
> following message
>
> Message rejected by filter rule match
>
> Maybe attachments are not allowed? I have now pasted the same here
>
> https://pastebin.com/WfvpvqKd
>
> I managed to find a partial fix thanks to the command you gave.
>
>   bogofilter -d /etc/bogofilter -p < /tmp/mail.txt -vvvvv -xabcdghilmrstuwyz
>
> This above command was most helpful in debugging the situation. On
> opensuse 15.6 there is this following conversion error from iso-8859-1
> to UTF-8 after which yyinput fails. This doesn't happen on tumbleweed
> or any of the other distributions (archlinux, debian 10, 11, 12,
> ubuntu (all versions from 16 onwards), all fedora, centos, rhel
> versions). My guess is that if this iconv issue is fixed then
> bogofilter will run properly. Maybe a test in configure.ac could warn
> there is an issue? But at least I have some clue. Let me try fixing
> this iconv error using google. If you know what I should do to fix
> this error or what further command I can run, let me know. But for the
> moment I have a temporary fix to make bogofilter run.

I need to understand where this is from.  UTF-8 is a superset of
ISO-8859-1, so a failing conversion might be a bug in the iconv library.

My current conjecture is that the glibc-locale-base package isn't
installed on your system, which might fix iso-8859-1 conversion.

However, iconv_open() error checking is incomplete and needs fixing.

I will NOT issue patches for 1.2.4 or older versions. I might do 1.2.6,
but it's up to the distros to fix that up.

>
> BEGIN INITIAL
> converting iso-8859-1 to UTF-8
> Conversion from 'iso-8859-1' to 'UTF-8' is not supported.
> ***  0 hi 21 To: test at example.com
> textblock.c:62  0x1c09b40 0x1c0ef60  21 *add* cur: 85, max: 85, tot: 85
> ### iconvert buffers: linebuff 2064, buff 8192
> tx: 0x1c0ef80, rd: 0, ln: 21, sz: 2064
> *** yyinput("", 8192) = 0
> ^@

I tried to provoke this, to no avail.

Can you get me the output of these commands please, and a relevant input
sample of e-mail?  I need to understand why this conversion runs, if it
is from your locale somehow, or from the input message file.

env|sort -f

locale

bogofilter -QQ # current configuration

bogofilter -QQ -C # default configuration

iconv -l


But something is REALLY hosed with the OpenSUSE package, and it must
have been broken since ages because the rpm's changelog ends in 2017.

1) bogofilter-db uses the way obsolete db 4.8, not 5.x, and it also
defaults the wordlist extension to .kct (KyotoCabinet). this is WRONG.
The BerkeleyDB/Sleepycat backend must use the .db extension.

2) It does not depend on the necessary glibc-locale-base package.

I can fix some error checking in bogofilter, but it will be OpenSUSE
maintainer's task to get the fix backported into the 1.2.4 package.  At
the very least, all bogofilter binary packages must depend on
glibc-locale-base so that glibc's iconv_open() actually finds the
conversion table.

>
> After which I can see yyinput failure. That gave me a clue and I used
> the following configure option to build bogofilter without unicode
>
> ./configure --prefix=/usr --disable-unicode

Please install glibc-locale-base, rebuild with --enable-unicode, and retry.

>
> bogofilter built using the above --disable-unicode works without any
> issue on leap 15.5 and leap 15.6.
>
> Output of git show command
> # git show
> commit d1f560775e71daeeea4237b814e3a0c5dfe4b9f7 (HEAD -> main,
> origin/main, origin/HEAD)

Yep, that was current when you built it, and there are no relevant fixes
yet, since.

> Merge: 343f55fa 3f4db3a6
> Author: Matthias Andree <matthias.andree at gmx.de>
> Date:   Fri Jul 28 06:08:03 2023 +0000
>
>      Merge branch 'pydsigner-main-patch-94248' into 'main'
>
>      Fix dead URLs in README
> _______________________________________________
> bogofilter mailing list
> bogofilter at bogofilter.org
> https://www.bogofilter.org/mailman/listinfo/bogofilter