November 2013 - dovecot

[Dovecot] Dovecot antispam unable to call dspam since dovecot upgrade to 2.X
by Guillaume Hilt 15 Nov '13

15 Nov '13

Hello, Running Gentoo AMD64 2013 with postfix, mysql, dovecot and dspam, i finally upgraded to dovecot 2.X. I'm running dovecot 2.2.6, dspam 3.10.2-r1 and dovecot-antispam-2.0_pre20130429. My DSPAM configuration hasn't changed between dovecot 1.X and 2.X. When i'm moving a mail to or from the Spam folder, Igot this error in my logs : Nov 14 10:33:25 srv1 dovecot: imap(ghilt(a)shadowprojects.org): Debug: dspam error:7751 prefix=imap(ghilt(a)shadowprojects.org): Nov 14 10:33:25 srv1 dovecot: imap(ghilt(a)shadowprojects.org): Debug: executing /usr/bin/dspam failed: 13 (uid=1001, gid=12) Nov 14 10:33:25 srv1 dovecot: imap: Error: Nov 14 10:33:25 srv1 dovecot: imap: Error: uid 1001 is user vmail (dovecot is running under vmail) gid 12 is group mail (vmail is a member, with mail,postfix,dspam,dovecot,apache) I enabled DSPAMdebug mode and when i move the mail, i don't see anything in the logs, meaning that dspam isn't called at all. Enabling debug in dovecot doesn't give me more informations. Here's my dovecot plugins settings : plugin { #setting_name = value # Selects the specific backend to be used for spam system training antispam_backend = dspam # Specifies whether to allow appending mails to the spam folder # from the unknown source. Optional, default = NO. antispam_allow_append_to_spam = NO # Specifies whether to skip the leading "From " line of the mail # piped to the backend processor. Optional, default = NO. antispam_skip_from_line = NO # semicolon-separated list of spam folders antispam_spam = Spam # semicolon-separated list of Trash folders (default unset i.e. none) antispam_trash = Trash # semicolon-separated list of unsure folders (default unset i.e. none) #antispam_unsure = # mail signature (used with any backend requiring a signature) antispam_signature = X-DSPAM-Signature # specifies what to do if the signature header is missing. Possible # values: "move" (move the mail silently without training), "error" # (display an error stating that the signature header is missing). # Optional, default = "error". antispam_signature_missing = error # specifies the path to the dspam client binary. # Optional, default = "/usr/bin/dspam". antispam_dspam_binary = /usr/bin/dspam # list of command line arguments to the dspam binary. Must include # one "%%s" in order to be replaced with the signature value. # Optional, default = "--source=error;--signature=%%s". antispam_dspam_args = --user;%u;--deliver=;--source=error;--signature=%%s # command line argument to specify that mail should be reclassified # as SPAM. Optional, default = "--class=spam". antispam_dspam_spam = --class=spam # command line argument to specify that mail should be reclassified # as not SPAM. Optional, default = "--class=innocent". antispam_dspam_notspam = --class=innocent # specifies the mail header name to derive the classification result. # Optional, default = NONE. antispam_dspam_result_header = X-DSPAM-Result # specifies the list of classification results to avoid retraining # for. Optional, default = NONE. #antispam_dspam_result_blacklist = Virus;Blocklisted;Blacklisted } USE flags : [I] mail-filter/dovecot-antispam Available versions: (~)2.0_pre20120226 (~)2.0_pre20130429 Installed versions: 2.0_pre20130429(12:26:34 04/11/2013) Homepage: http://wiki2.dovecot.org/Plugins/Antispam/ Description: A dovecot antispam plugin supporting multiple backends [I] net-mail/dovecot Available versions: 2.0.19 2.1.9 2.1.16 (~)2.1.17 2.2.5 (~)2.2.6 {bzip2 caps cydir doc imapc ipv6 kerberos ldap lucene +maildir managesieve mbox mdbox mysql pam pop3c postgres sdbox selinux sieve solr sqlite (+)ssl static-libs suid tcpd vpopmail zlib} Installed versions: 2.2.6(12:26:15 04/11/2013)(bzip2 ipv6 maildir managesieve mysql pam sieve ssl tcpd zlib -caps -cydir -doc -imapc -kerberos -ldap -lucene -mbox -mdbox -pop3c -postgres -sdbox -selinux -solr -sqlite -static-libs -suid -vpopmail) Homepage: http://www.dovecot.org/ Description: An IMAP and POP3 server written with security primarily in mind [I] mail-filter/dspam Available versions: 3.10.2-r1 {clamav daemon debug +domain-scale +hash large-scale ldap mysql postgres small-scale sqlite static-libs syslog user-homedirs virtual-users} Installed versions: 3.10.2-r1(10:08:06 14/11/2013)(clamav daemon domain-scale mysql syslog virtual-users -debug -hash -large-scale -ldap -postgres -small-scale -sqlite -static-libs -user-homedirs) Homepage: http://dspam.sourceforge.net/ Description: A statistical-algorithmic hybrid anti-spam filter DSPAM binary is owned by dspam (chmod u+s) : -r-s--x--- 1 dspam dspam 96K 14 nov. 10:08 /usr/bin/dspam And all the necessary users are trusted by DSPAM : Trust root Trust dspam Trust apache Trust mail Trust mailnull Trust smmsp Trust daemon Trust vmail Trust dovecot Trust postfix Any idea ? Thanks, -- Guillaume Hilt

4 5

[Dovecot] Dovecot panic during replication
by IT geek 31 15 Nov '13

15 Nov '13

I'm seeing the following errors on my Dovecot box when trying to replicate: Nov 15 18:44:46 server1 dovecot: dsync-server(mark): Panic: file mbox-lock.c: line 799 (mbox_lock): assertion failed: (lock_type == F_RDLCK || mbox->mbox_lock_type != F_RDLCK) Nov 15 18:44:46 server1 dovecot: dsync-server(mark): Fatal: master: service(doveadm): child 21571 killed with signal 6 (core not dumped - set service doveadm { drop_priv_before_exec=yes }) And on the target I see: Nov 15 17:47:02 server2 dovecot: dsync-server(mark): Error: read( server1.mdb.eu.com) failed: EOF Does anyone know what is causing this? I help to solve this before I can put it live :-( Here's my dovecot -n from server1: # 2.2.7: /usr/pkg/etc/dovecot/dovecot.conf # OS: NetBSD 5.2 cobalt auth_mechanisms = plain login doveadm_password = secret doveadm_port = 12345 listen = 192.168.1.1 mail_location = mbox:~/mail:INBOX=/var/mail/%u mail_plugins = " notify replication" passdb { driver = passwd } plugin { mail_replica = tcp:server2.mdb.eu.com } protocols = imap service aggregator { fifo_listener replication-notify-fifo { mode = 0600 user = vmail } unix_listener replication-notify { mode = 0600 user = vmail } } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } user = root } service doveadm { inet_listener { port = 12345 } } service imap-login { inet_listener imap { port = 0 } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0600 } } ssl_cert = </etc/openssl/certs/mail.mdb.eu.com.crt ssl_key = </etc/openssl/private/mail.mdb.eu.com.key userdb { driver = passwd } protocol lda { postmaster_address = postmaster(a)example.com } Thanks.

1 0

[Dovecot] Sieve script problem (don't know if is it possible to do this)
by Yanko Hernández Álvarez 15 Nov '13

15 Nov '13

Hello: I'm loosing my mind trying to classify my outgoing messages with sieve-test (2.0.9, centos 6.4). It came to the point I think it's not even possible with a sieve script. I need to classify my outgoing messages in three folders: 1- To my department (@dept.example.com) 2- To my company (@example.com, @anyotherdept.example.com) (anyotherdept.example.com as in a way to say "any other domain that ends with 'example.com', but not 'dept.example.com'") 3- To the rest of the word (@any.other.domain) The problematic requirement is I need to make a copy in EVERY IMAP folder that applies. For instance: for an email such as ---- From: myuser(a)dept.example.com To: user(a)dept.example.com, user(a)example.com, user(a)other.domain ... ---- I need to make a copy to all folders: Dept (because of user(a)dept.example.com) Company (because of user(a)example.com) and Rest (because of user(a)other.domain) Rule for #1 is simple: ----- if address :matches :domain "To" "dept.example.com" { fileinto: "Dept"; } ----- Rule for #2, I don't know how to declare it: I don't know how to make a rule that matches "example.com" (or anyotherdept.example.com) and not "dept.example.com". if allof(address :matches :domain "To" "example.com", not address :matches :domain "To" "dept.example.com") { fileinto: "Company"; } ... doesn't work, because user(a)dept.example.com matches (address :matches :domain "To" "example.com"), but it doesn't matches (not address :matches :domain "To" "dept.example.com"). "user(a)example.com" matches both conditions, but sieve-test stops on the first email address with a "not matches" As for Rule #3: I don't know how to do it either, it should be the same as Rule #2, (with different parameters of course). A sieve script should be capable to do this, but it seems that I'm loosing something. Does any one knows how to do this? Kind regards Yanko PS: English is not my native language. Please forgive me any mistakes/misspellings/etc I made.

6 9

[Dovecot] Fwd: Sieve script problem (don't know if is it possible to do this)
by Yanko Hernández Álvarez 15 Nov '13

15 Nov '13

Ok, let simplify a little bit the problem: Forget about outgoing or incoming mail. Forget about IMAP or SMTP. You have a ton of emails in raw form (RFC-XXX, don’t remember the exact number right now) you want to classify… and you think: “Sieve is a language made to do exactly that kind of task… If only I could use the same mechanism dovecot-lda uses! Oh, wait… “sieve-test –e” does exactly that!!! I could use it!!!”… but so far… no success. Now, a little more context. I want to leave a copy (a historical record) of every email (work related) I received/sent. The processing/classification doesn’t have to be in real time, it can be on “down time/offline/later/scheduled”. Sent messages are hard, because of the several senders and the several copies on several folders. But I can work around it, with various tricks (bcc, different headers, etc.) and adjusting the processing sieve script. I can train myself –The interest is mine after all!-, and that’s OK. But I can’t train other people to suit my needs. And received messages are JUST AS HARD. Because I want to classify them using the same rules. I also want to keep context, to record all things work related, not only what I said, but also what was said by others, using the same rules (which by the way, are many more than the restricted example I posted). Besides, I want the PC do all the work for me, not the other way around. I think “Sieve must be capable of doing it! This is the kind of things sieve was designed for!” is a reasonable idea. But so far, no success… :-( Now, let me see all the replies in detail... (I really appreciate all the help I'm getting, thank you all very much) Yanko On 11/15/13, Stephan Bosch <stephan(a)rename-it.nl> wrote: > On 11/15/2013 8:41 AM, Steffen Kaiser wrote: >> Hi Stephan, about #3 how about the variable extension? I never used it so >> far, but it should work > > Congratulations! You fell into the same trap I did when I first saw this > problem. :) > > Consider this header: > > To: user(a)dept.example.com, user(a)example.com, user(a)other.domain > > >> > require "fileinto"; >> > require "relational"; >> >> require "variables"; >> >> set "done" "0"; >> >> > if address :is :domain "To" "dept.example.com" { >> > fileinto "Dept"; >> >> set "done" "1"; >> >> > } > > The variable "done" is set to "1", due to the first address. > >> > if allof ( >> > address :value "ne" :domain "To" "dept.example.com", >> > anyof ( >> > address :matches :domain "To" "*.example.com", >> > address :is :domain "To" "example.com")) { >> > fileinto "Company"; >> >> set "done" "1"; >> > } > > The variable "done" is set to "1", due to the second address. And now > that I think of it, it would also work on the combination of the first > and the third, making this rule still inadequate. > >> if string :is "${done}" "0" { >> fileinto "other"; >> } > > Since "done" is set to "1", the message is not filed into "other". But > that is wrong, due to the presence of the third address. > > See the core of the problem now? :) > > Regards, > > Stephan. > >

1 0

[Dovecot] Establing a GMail like workflow
by Florian Lindner 15 Nov '13

15 Nov '13

Hello! I'm about to migrate my mails from GMail back to my self hosted solution, using Dovecot imap server. I really liked gmail workflow: - (Almost) all mail goes to inbox. - Most mail is read and not important anymore, it is archived and moved to "all messages". - Inbox stays more or less clean, with only mails that are still of some interest. - Mail (except Spam) is never deleted, just archived. How can I achieve such a workflow using Dovecot and some MUA (Roundcube and probably KMail). - I can simply delete messages that I want to archive, Trash will never be purged. Problems: Some mail clients have settings like "Purge Trash at exit", so my mail is always in danger of being deleted accidently. Futhermore it does not really have the semantics of what I am actually doing. - Instead of deleting messages for archiving, move them to some Archiv folder. Since archiving is a very frequent action this involves much more cliks in the MUA than just deleting. Or some configuration change in the client. How would you do that? I'm also open to entirely different suggestions! What I want are basically these things: - Never delete legitimate mail - Use the Inbox as a workspace for mails that are still of some interest. This can also be quite old mail, time based archiving does not work. - Have some kind of mail archive. Thanks! Florian

1 0

[Dovecot] Dovecot login slow
by Marc Perkel 15 Nov '13

15 Nov '13

Can't figure out why the login is slow. I telnet to port 143 on localhost. I type: 0 login user password Takes about 10 seconds and it lets me in. I'm using MYSQL and it's a small indexed database on a fast server so it's not the mysql query that's slowing it down. At least I don't think it is. But - kind of stumped. Just wondering if there's something obvious I'm overlooking.

6 14

[Dovecot] Executing a wget? or clicking on a link in inbound email?
by Voytek 14 Nov '13

14 Nov '13

I use Dovecot, but all I know about Dovecot is that's it is an IMAP server, and, I know that it includes lots of other stuff that I see discussed on this list, but I know nothing about it. I have a situation that, maybe once a week, I get an html only email that contains 3 clickable links. I would like, on receipt of such email, auto click the first link (perhaps execute a wget to do so? or ?) Can something like this be done, which of the tools, what docs to look at? link is like so http://llll.domain.tld/irportal?id=a0000000006hWO4AAM0000000000KlOrcAAF1111… Dovecot 2.09 Centos (apologies for blank post I've just sent) -- Sent from Kaiten Mail. Please excuse my brevity.

1 0

[Dovecot] Autocreation of sieve filters
by Angel L. Mateo 14 Nov '13

14 Nov '13

Hello, Is there any way to create a predefined sieve filters during mailbox autocreation? What I want is that my user's mailboxes are automatically created (using mailbox option in namespaces) but I want them to have a predefined sieve script. Using a postlogin script could be an idea, but I'd prefer an automatic one, because postlogin only will filter after first user login -- Angel L. Mateo Martínez Sección de Telemática Área de Tecnologías de la Información y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868887590 Fax: 868888337

2 3

[Dovecot] trashed
by Nick Edwards 14 Nov '13

14 Nov '13

On 11/12/13, Reindl Harald <h.reindl(a)thelounge.net> wrote: > tell that Noel which is blocking my messages and so did > not read what i quoted from Benny's trolling but opens > his mouth > > tell that Noel which is abusing his power by set complete > IP-ranges on RBL lists he maintains because he does not > like one person using a mailserver on that range besides > many other people > Let us see Posfix list - BANNED Roundcube List - MODERATED Centos List - MODERATED (maybe banned) Fedora list - 1/ MODERATED - 2/ Had hissy fit temper tantrum with moderators a few days ago about his continual moderation and claimed was quitting fedora list. Likely has resubscribed to Fedora (if indeed even did quit), like on Postfix under a lists(a)rhsoft.net address or something similar and thats only the ones *I* know about. So, your in a blacklist as well? wouldnt have anything to do with your actions pretty much everywhere would it now, nooooooooooooooooooooooooooooo, of course not. Taking into account all of the above, I think its fair to say, its more than one person that doesn't like your foul mouthed antics, which was explained to you many times by fedora moderators, trying to get you to change, all you had to do, and they would remove moderation, but you refused, so you deserve it, no one else to blame but yourself YOU ARE NOT THE VICTIM >>> blocked using >>> bl.alt-backspace.org; This range is used by caustic Internet troll >>> Harald >>> Reindl h.reindl(a)thelounge.net / ACCESS DENIED - see >>> http://www.alt-backspace.org/usage.php#misc (in reply to RCPT TO >>> command) Awesome! Thanks for that, I have just enabled bl.alt-backspace.org on our company servers ciao

6 11

Re: [Dovecot] Dovecot login slow
by Joseph Tam 14 Nov '13

14 Nov '13

> ssl_ca = </usr/share/ssl/certs/rapidssl.crt > ssl_cert = </usr/share/ssl/certs/imapd.pem > ssl_key = </usr/share/ssl/certs/imapd.pem > > These lines look weird to me. Why do they have a < ? Red herring; this is standard. I think it means "feed this file into stdin". On 11/13/2013 12:41 PM, Marc Perkel wrote: >>> Takes about 10 seconds and it lets me in. I'm using MYSQL and it's a >>> small indexed database on a fast server so it's not the mysql query that's >>> slowing it down. At least I don't think it is. But - kind of stumped. Just >>> wondering if there's something obvious I'm overlooking. I think maybe turning up the verbosity on logging will help. If that doesn't, try process tracing the dovecot auth process. Joseph Tam <jtam.home(a)gmail.com>

1 0