- dovecot - dovecot.org

[Dovecot] lock files causing time outs with Thunderbird
by CJ Keist 30 Jul '09

30 Jul '09

I have dovecot 1.1.16 running on Solaris 10. We are seeing problem with lock files taking forever to be removed after opening a email folder like Trash with several thousand messages in them. We use mbox format. All users inbox's are local to the mail server, and all other users mail folders are stored on a separate file server mounted via NFS. I see no problems with the NFS mounts. cd'ing into the mount points, listing files and viewing files a perform with now visible delays. Is there something I can do in the config file to speed things up? Here is the config file: # 1.1.16: /userM/mail-services/dovecot/etc/dovecot.conf Warning: fd limit 256 is lower than what Dovecot can use under full load (more than 3072). Either grow the limit or change login_max_processes_count and max_mail_processes settings # OS: SunOS 5.10 sun4v base_dir: /userM/mail-services/dovecot/var/run/dovecot/ protocols: imap imaps pop3 pop3s ssl_cert_file: /userM/mail-services/dovecot/etc/ssl/dovecot.pem ssl_key_file: /userM/mail-services/dovecot/etc/ssl/privkey.pem ssl_parameters_regenerate: 0 ssl_cipher_list: MEDIUM:!LOW disable_plaintext_auth: no login_dir: /userM/mail-services/dovecot/var/run/dovecot/login login_executable(default): /userM/mail-services/dovecot/libexec/dovecot/imap-login login_executable(imap): /userM/mail-services/dovecot/libexec/dovecot/imap-login login_executable(pop3): /userM/mail-services/dovecot/libexec/dovecot/pop3-login login_greeting: Cyrus ready. login_max_processes_count: 1024 max_mail_processes: 1024 mail_location: mbox:~/:INBOX=/userM/mail/%u mail_debug: yes mmap_disable: yes mail_nfs_index: yes mbox_write_locks: fcntl dotlock mbox_dotlock_change_timeout: 60 mail_executable(default): /userM/mail-services/dovecot/libexec/dovecot/imap mail_executable(imap): /userM/mail-services/dovecot/libexec/dovecot/imap mail_executable(pop3): /userM/mail-services/dovecot/libexec/dovecot/pop3 mail_plugins(default): convert mail_plugins(imap): convert mail_plugins(pop3): mail_plugin_dir(default): /userM/mail-services/dovecot/lib/dovecot/imap mail_plugin_dir(imap): /userM/mail-services/dovecot/lib/dovecot/imap mail_plugin_dir(pop3): /userM/mail-services/dovecot/lib/dovecot/pop3 auth default: mechanisms: plain login verbose: yes debug: yes worker_max_count: 1024 worker_max_request_count: 2000 passdb: driver: pam passdb: driver: passwd args: blocking=yes userdb: driver: passwd args: blocking=yes socket: type: listen client: path: /var/lib/postfix/private/auth mode: 438 user: postfix group: postfix master: path: /userM/mail-services/dovecot/var/run/dovecot//auth-master mode: 384 plugin: convert_mail: Maildir:~/Maildir:INBOX=/userM/mail/%u -- C. J. Keist Email: cj.keist(a)colostate.edu UNIX/Network Manager Phone: 970-491-0630 Engineering Network Services Fax: 970-491-5569 College of Engineering, CSU Ft. Collins, CO 80523-1301 All I want is a chance to prove 'Money can't buy happiness'

2 7

[Dovecot] imap, locks, and dovecot
by Mauricio Tavares 30 Jul '09

30 Jul '09

Let's say I have two computers -- a desktop and a laptop -- setup to check email on my postfix/dovecot/mailscanner box by using imap. Now, both machines use thunderbird and have a filter in that mail client to move emails that have a certain to: address (an alias, like support(a)domain.com) to a mail directory. The desktop is setup to check for mail every minute while the laptop initially is told to do the same. So, I send an email to the said address. dovecot (1.1.7) puts it in the inbox. thunderbird in one of those machines sees it and moves it to the, say, support folder. Then, another copy of the same mail is created and placed in the same folder. I then begin increasing the time the laptop waits before checking mails. Up to 5 minutes I am still having the double email issue, but if I the laptop to wait 10 minutes I only have one copy of the said email. That makes me think both clients are seeing the same email and moving it at the same time. I do not know the imap commands being used but it sure seems that there is not some kind of locking system for the mail files (I use maildir) to make sure only one program is accessing the said email. Am I correct? Is there a way around that?

1 0

[Dovecot] Filtering with Public Namespaces and Sieve Plugin
by Thomas Leuxner 30 Jul '09

30 Jul '09

Hi, after upgrading to Dovecot 1.2x including the rewritten Sieve plugin replacing 'cmusieve', messages which have formerly been filed to a "Public/Mailing-List" maildir are no longer filtered correctly. The sieve script itself is included in the user's personal-script. The messages are dropped to the INBOX rather than the "Public Namespace Maildir". Log's don't give a hint (at least to me). The documentation says the personal script should automatically fetch the include, and compile it in the users home... Debug log excerpt: ----------------- >2009-07-30 10:44:09 deliver(xxxx): Info: Namespace: type=public, prefix=Public/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=no >2009-07-30 10:44:09 deliver(xxxx): Info: maildir: data=/var/vmail/public:CONTROL=~/maildir/public:INDEX=~/maildir/public >2009-07-30 10:44:09 deliver(xxxx): Info: maildir++: root=/var/vmail/public, index=/var/vmail/leuxner.net/tlx/maildir/public, control=/var/vmail/leuxner.net/tlx/maildir/public, inbox= >2009-07-30 10:44:09 deliver(xxxx): Info: sieve: using sieve path for user's script: /var/vmail/leuxner.net/tlx/.dovecot.sieve >2009-07-30 10:44:09 deliver(xxxx): Info: sieve: opening script /var/vmail/leuxner.net/tlx/.dovecot.sieve >2009-07-30 10:44:09 deliver(xxxx): Info: sieve: executing compiled script /var/vmail/leuxner.net/tlx/.dovecot.sieve >2009-07-30 10:44:09 deliver(xxxx): Info: Namespace : Using permissions from /var/vmail/leuxner.net/tlx/maildir: mode=0750 gid=-1 >2009-07-30 10:44:09 deliver(xxxx): Info: sieve: msgid=<20090730084326.GP1111(a)jeeves.jpl.local>: stored mail into mailbox 'INBOX' Personal ".dovecot.sieve" script: ------------------------------ require ["include","copy","fileinto","vacation"]; include :global "global.sieve"; -- snip --- Global script "global.sieve" excerpt: ------------------------------------ require ["copy","fileinto"]; #Newsletters / Mailinglists if allof (address :is ["To","CC"] "dovecot(a)dovecot.org", header :contains "List-Id" "dovecot.dovecot.org") { fileinto "Public/Mailing-Lists.Dovecot"; } elsif allof (address :is "To" "dovecot-news(a)dovecot.org", header :contains "List-Id" "dovecot-news.dovecot.org") { fileinto :copy "Public/Newsletters.Dovecot"; } Thanks Thomas $ dovecot -n # 1.2.1: /etc/dovecot/dovecot.conf # OS: Linux 2.6.26-2-amd64 x86_64 Debian 5.0.2 log_path: /var/log/dovecot.log info_log_path: /var/log/dovecot-info.log log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap listen: 188.138.0.199:143 ssl_cert_file: /etc/ssl/certs/spectre_leuxner_net_2009.crt ssl_key_file: /etc/ssl/private/spectre_leuxner_net_2009.key login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login mail_privileged_group: mail mail_location: maildir:~/maildir mail_debug: yes maildir_copy_preserve_filename: yes mail_plugins: acl quota imap_quota fts fts_squat namespace: type: private separator: / inbox: yes list: yes subscriptions: yes namespace: type: public separator: / prefix: Public/ location: maildir:/var/vmail/public:CONTROL=~/maildir/public:INDEX=~/maildir/public list: yes auth default: passdb: driver: passwd-file args: username_format=%u /var/vmail/%d/etc/passwd userdb: driver: passwd-file args: username_format=%u /var/vmail/%d/etc/passwd socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: vmail group: vmail plugin: acl: vfile:/var/vmail/%d/etc/acls:cache_secs=300 quota: maildir:User quota quota_rule: *:storage=1GB quota_rule2: Trash:storage=10%% fts: squat fts_squat: partial=4 full=10 sieve_global_dir: /var/vmail/%d/etc/sieve-scripts

2 2

Re: [Dovecot] AutoCreate per Domain
by Robert Schetterer 30 Jul '09

30 Jul '09

Darvin Denmian schrieb: > Thanks Robert, > > i will try this solution !!! maybe i can be done via a global sieve rule too ask the sieve gurus if that might work > > On Thu, Jul 30, 2009 at 11:44 AM, Robert > Schetterer<robert(a)schetterer.org> wrote: >> Darvin Denmian schrieb: >>> Any idea? >>> >>> On Thu, Jul 30, 2009 at 2:30 AM, Darvin Denmian<darvin.denmian(a)gmail.com> wrote: >>>> Hello, >>>> >>>> is there a way to configure plugin "autocreate" per domain? Like: >>>> >>>> For domain xwz.com i want to autocreate folders: Models and Clients >>>> For domain yxw.com i want to autocreate folders: Adm and Tech >>>> >>>> Thanks. >>>> >> i dont think this would be a good idea, cause there are so much >> layouts and setups thinkable >> so in fact it might be difficult to implement this >> for all thinkable cases in the plugin, in my maildrop setup >> i do some testing about folders exist, and if not create it, >> but deliver does not exec scripts right now i think >> >> but perhaps you can exec test folder scripts at login stage >> >> http://wiki.dovecot.org/PostLoginScripting >> >> that should do the job >> >> -- >> Best Regards >> >> MfG Robert Schetterer >> >> Germany/Munich/Bavaria >> -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria

1 0

[Dovecot] sieve redirect action
by Nikita Koshikov 30 Jul '09

30 Jul '09

Hello Stephan, First of all, thank you for dovecot-sieve implementation. I see that you are adding X-Sieve header to all outgoing e-mail in cmd-redirect.c /* Prepend sieve version header (should not affect signatures) */ rfc2822_header_field_write(f, "X-Sieve", SIEVE_IMPLEMENTATION); How do you look at adding one more header, for example X-Sieve-Forward-From: Now, when redirect action is in use - mail forwards using sendmail command line interface. The problem that there is no suitable way to know which user's script has generate redirect. Received: header may contain envelope receiver but this is valid if only 1 "rcpt to:" command was specified on SMTP session. This invokes problem when forwarding mail to non-local domains, breaking such things like SPF. I'd like to setup SRS for fixing this, but I don't know sender("sieve local user") mail. Adding one header with valid local user e-mail address will fix this. Google add 2 headers for this - X-Forwarded-To: and X-Forwarded-For: . What do you think about this ?

3 2

[Dovecot] Missing return-path on vacation messages
by Stephen Vaughan 30 Jul '09

30 Jul '09

Hi, I can see this has been discussed previously, was just wondering if it's been fixed in v1.1.x? -- Best Regards, Stephen

3 11

Re: [Dovecot] Some people asked me lately about how professional Dovecot is.
by Stewart Dean 30 Jul '09

30 Jul '09

I purely love that kind of crap. As if presentations meant anything, as if there aren't all kinds of scholarly work about theoretical perfect world algorithms and conceptual systems that will never be implemented and are as practical and effective as wings on a pig. Please. I'm reminded of the story about how, during the American Civil War, when the North had finally, after years of ignominious defeats, gotten a general would could fight and win a battle, General Grant. A fussy old lady approached President Lincoln and complained loudly that Grant was a drunk. Lincoln blinked at the woman, then said, "Ma'am, if you'll be so kind as to find out what kind of whiskey Grant drinks, I'll send a case of it to all the other generals." Dovecot Works. That's all anyone needs to know. Plus it has a towering wizard of a developer and an avid, engaged and endlessly helpful community. -- ==== Once upon a time, the Internet was a friendly, neighbors-helping-neighbors small town, and no one locked their doors. Now it's like an apartment in Bed-Stuy: you need three heavy duty pick-proof locks, one of those braces that goes from the lock to the floor, and bars on the windows.... ==== Stewart Dean, Unix System Admin, Bard College, New York 12504 sdean(a)bard.edu voice: 845-758-7475, fax: 845-758-7035

6 5

[Dovecot] STARTTLS problem
by Рачков Сергей 30 Jul '09

30 Jul '09

Hi I have a problem with STARTTLS, with imaps all ok. I have tried to connect to server with different clients (thunderbird, the bat, mulberry) and had same result. Thunderbird log for example: 0[284708]: 25c0e08:192.168.4.200:NA:SetupWithUrl: clearing IMAP_CONNECTION_IS_OPEN 1920[25c77c8]: ImapThreadMainLoop entering [this=25c0e08] 1920[25c77c8]: 25c0e08:192.168.4.200:NA:ProcessCurrentURL: entering 1920[25c77c8]: 25c0e08:192.168.4.200:NA:ProcessCurrentURL:imap://test%40my%2Elocal@192.168.4.200:143/select%3E/INBOX: = currentUrl 1920[25c77c8]: ReadNextLine [stream=25c8020 nb=210 needmore=0] 1920[25c77c8]: 25c0e08:192.168.4.200:NA:CreateNewLineFromSocket: * OK [CAPABILITY IMAP4rev1 SASL-IR SORT THREAD=REFERENCES MULTIAPPEND UNSELECT LITERAL+ IDLE CHILDREN NAMESPACE LOGIN-REFERRALS UIDPLUS LIST-EXTENDED I18NLEVEL=1 STARTTLS AUTH=PLAIN AUTH=LOGIN] Dovecot ready. 1920[25c77c8]: 25c0e08:192.168.4.200:NA:SendData: 1 capability 1920[25c77c8]: ReadNextLine [stream=25c8020 nb=190 needmore=0] 1920[25c77c8]: 25c0e08:192.168.4.200:NA:CreateNewLineFromSocket: * CAPABILITY IMAP4rev1 SASL-IR SORT THREAD=REFERENCES MULTIAPPEND UNSELECT LITERAL+ IDLE CHILDREN NAMESPACE LOGIN-REFERRALS UIDPLUS LIST-EXTENDED I18NLEVEL=1 STARTTLS AUTH=PLAIN AUTH=LOGIN 1920[25c77c8]: ReadNextLine [stream=25c8020 nb=28 needmore=0] 1920[25c77c8]: 25c0e08:192.168.4.200:NA:CreateNewLineFromSocket: 1 OK Capability completed. 1920[25c77c8]: 25c0e08:192.168.4.200:NA:SendData: 2 STARTTLS 1920[25c77c8]: ReadNextLine [stream=25c8020 nb=33 needmore=0] 1920[25c77c8]: 25c0e08:192.168.4.200:NA:CreateNewLineFromSocket: 2 OK Begin TLS negotiation now. 1920[25c77c8]: 25c0e08:192.168.4.200:NA:SendData: 3 capability my comment - at this place the process is waiting 1920[25c77c8]: ReadNextLine [stream=25c8020 nb=0 needmore=1] 1920[25c77c8]: 25c0e08:192.168.4.200:NA:CreateNewLineFromSocket: clearing IMAP_CONNECTION_IS_OPEN - rv = 804b0014 1920[25c77c8]: 25c0e08:192.168.4.200:NA:TellThreadToDie: close socket connection 1920[25c77c8]: 25c0e08:192.168.4.200:NA:CreateNewLineFromSocket: (null) 1920[25c77c8]: 25c0e08:192.168.4.200:NA:ProcessCurrentURL: aborting queued urls 1920[25c77c8]: ImapThreadMainLoop leaving [this=25c0e08] At same time dovecot log: Jul 29 18:33:08 freebsd dovecot: auth(default): new auth connection: pid=3339 Jul 29 18:33:34 freebsd dovecot: imap-login: Disconnected (no auth attempts): rip=192.168.4.100, lip=192.168.4.200, TLS handshaking: Disconnected What does it mean, i don't know, because if I try to connect with gnutls-cli it works perfectly. freebsd# dovecot -n # 1.1.16: /usr/local/etc/dovecot.conf # OS: FreeBSD 7.2-RELEASE i386 ufs syslog_facility: local0 protocols: imap imaps pop3 pop3s ssl_key_file: /etc/ssl/keys/dovecot.pem disable_plaintext_auth: no verbose_ssl: yes login_dir: /var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_greeting_capability(default): yes login_greeting_capability(imap): yes login_greeting_capability(pop3): no verbose_proctitle: yes first_valid_uid: 1000 first_valid_gid: 1000 mail_privileged_group: mail mail_uid: 4738 mail_gid: 4738 mail_location: maildir:/var/mail/vmail/%d/%n mail_debug: yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugins(default): acl mail_plugins(imap): acl mail_plugins(pop3): mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 imap_client_workarounds(default): delay-newmail netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(pop3): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh namespace: type: private separator: / inbox: yes list: yes subscriptions: yes namespace: type: public separator: / prefix: public/ location: maildir:/var/mail/vmail/%d/public:INDEX=/var/mail/vmail/%d/%n/public/index:CONTROL=/var/mail/vmail/%d/%n/public/control list: yes subscriptions: yes auth default: mechanisms: plain login username_format: %Lu verbose: yes debug: yes passdb: driver: passwd-file args: /usr/local/etc/passwd.dovecot userdb: driver: passwd-file args: /usr/local/etc/passwd.dovecot socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 plugin: acl: vfile any ideas ? Regards, Sergey

4 6

[Dovecot] problem with disable_plaintext_auth
by Olivier Nicole 30 Jul '09

30 Jul '09

Hi, I am using dovecot with postfix for authentication. Everything (TLS/SSL, authentication) is working fine, except that when I set: disable_plaintext_auth = yes I still can authenticate with plain text on a no TLS/SSL session: 20 mail2.cs.ait.ac.th ESMTP Postfix (2.6.2) EHLO [192.41.170.57] 250-mail2.cs.ait.ac.th 250-PIPELINING 250-SIZE 10240000 250-VRFY 250-ETRN 250-STARTTLS 250-AUTH PLAIN LOGIN 250-AUTH=PLAIN LOGIN 250-ENHANCEDSTATUSCODES 250-8BITMIME 250 DSN AUTH PLAIN XXXX 235 2.7.0 Authentication successful My dovecot configuration is: # 1.1.16: /usr/local/etc/dovecot.conf # OS: FreeBSD 7.2-RELEASE-p2 amd64 base_dir: /var/run/dovecot/ protocols: none ssl_listen: * ssl_ca_file: /usr/local/ssl/ca/ait-itserv.crt ssl_cert_file: /usr/local/ssl/crt/mail2.cs.ait.ac.th.crt ssl_key_file: /usr/local/ssl/key/mail2.cs.ait.ac.th.key ssl_cipher_list: ALL:!LOW:!SSLv2 login_dir: /var/run/dovecot/login login_executable: /usr/local/libexec/dovecot/imap-login login_chroot: no login_greeting_capability: yes verbose_proctitle: yes first_valid_uid: 1000 first_valid_gid: 1000 mail_privileged_group: mail mail_location: mbox:~/mail/:INBOX=/var/mail/%u imap_client_workarounds: delay-newmail netscape-eoh tb-extra-mailbox-sep auth default: mechanisms: plain login username_format: %Ln verbose: yes debug: yes passdb: driver: ldap args: /usr/local/etc/dovecot-ldap.conf passdb: driver: passwd args: blocking=yes socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 Any help is welcome. Best regards, Olivier

2 3

[Dovecot] sieve 0.1.8 raw backtrace
by jsechser＠gmx.ch 30 Jul '09

30 Jul '09

hi, I had two problems with deliver / sieve. First one is not reproducible anymore. Im using debian unstable (amd64), often dist-upgraded, with some experimental stuff too (wine i think). The first basically triggered a backtrace when confronted an email with spammassassins report headers prepended. (user_prefs: report_safe 0) However i dont have that backtrace anymore, sorry. The second poped up only later as i began to investigate more the first, a few days later. Now my entire sieve script seemed broken suddenly. After some time i narrowed it down to one offending line: >require ["fileinto","regex"]; > >if address :regex "to" ["m-a-test(a)test\\.ch","m-a-members(a)test\\.ch", \ >"m-a-region(a)test\\.ch","m-a-sig(a)test\\.ch"] { > fileinto "Test"; > stop; >} if i remove even one of the regex tests, then this script will not make deliver or sieve_test go panic. here the backtrace: 2009-07-29 18:15:37 deliver(xxx): Panic: pool_data_stack_realloc(): stack frame changed 2009-07-29 18:15:37 deliver(xxx): Error: Raw backtrace: /usr/lib/dovecot/deliver [0x496bc2] -> /usr/lib/dovecot/deliver(default_fatal_handler+0x34) [0x496cc4] -> /usr/lib/dovecot/deliver [0x496346] -> /usr/lib/dovecot/deliver [0x4a18fb] -> /usr/lib/dovecot/deliver [0x494185] -> /usr/lib/dovecot/deliver(buffer_write_zero+0xe5) [0x494a55] -> /usr/lib/dovecot/modules/lda/lib90_sieve_plugin.so [0x7f444ca98ff2] -> /usr/lib/dovecot/modules/lda/lib90_sieve_plugin.so(sieve_match_value+0xb0) [0x7f444ca8ea10] -> /usr/lib/dovecot/modules/lda/lib90_sieve_plugin.so(sieve_address_match+0xe3) [0x7f444ca8e5f3] -> /usr/lib/dovecot/modules/lda/lib90_sieve_plugin.so [0x7f444ca9291b] -> /usr/lib/dovecot/modules/lda/lib90_sieve_plugin.so(sieve_interpreter_continue+0x97) [0x7f444ca89307] -> /usr/lib/dovecot/modules/lda/lib90_sieve_plugin.so(sieve_interpreter_run+0x48) [0x7f444ca894f8] -> /usr/lib/dovecot/modules/lda/lib90_sieve_plugin.so [0x7f444ca96716] -> /usr/lib/dovecot/modules/lda/lib90_sieve_plugin.so(sieve_execute+0x3d) [0x7f444ca9698d] -> /usr/lib/dovecot/modules/lda/lib90_sieve_plugin.so [0x7f444ca7dc8a] -> /usr/lib/dovecot/deliver(main+0xf5e) [0x41d0fe] -> /lib/libc.so.6(__libc_start_main+0xe6) [0x7f444ceea5c6] -> /usr/lib/dovecot/deliver [0x41b029] I hope this helps cheers

2 2