- dovecot - dovecot.org

[Dovecot] dovecot 1.x: problem with quota
by Toni Mueller 17 Sep '12

17 Sep '12

Hi, I have now verified that there is a problem with quota (and sieve?). Summary: If the "maildirsize" file gets garbled (= every once in a while), mail is getting lost randomly. Details: I have a Debian box (6.0.5/amd64) with a Postfix server (2.7.1), which delivers email via Dovecot (1.2.15) to local disk (ext3). My email is filtered via a sieve script (wish I could have something better, eg. procmail). The account data is fetched from an SQL database, and I have a default quota set in dovecot.conf (200MB). My own mailbox has no quota (*:storage=0, mentioned in the database). A client sent an email to me, which is logged as being delivered like normal to my mailbox, but doesn't show up there. After poking around, I decided to simply delete the maildirsize file and have the client send that email again, and voila, it shows up in my mailbox. At the same time, however, other emails get delivered just fine, so the heinous thing is that you don't immediately notice that something fishy is going on - only when the client actually calls you (sort of defeats some uses of email)... The problem is worsened by the fact that you can't tell *which* emails get lost - you only end up with a random subset of "your" messages. The problem occurred now after running for a few months. FWIW, the problem with the garbled maildirsize file resulted in a different user's email getting bounced due to "mailbox full", when it wasn't. Questions: * Is this a known problem (Google was unhelpful/unwieldy)? * How can I prevent the problem, short of setting up a cron job to delete that file every week? * How can I log the delivery of messages in dovecot's log, not only the POP3/IMAP activity when people fetch their email? TIA! Kind regards, --Toni++

1 1

[Dovecot] Can`t get over 1024 processes
by Tomáš Randa 17 Sep '12

17 Sep '12

Hello, I have configuration question. Running FreeBSD 9.0 / AMD64 / Dovecot 2.1.8 version and cannot get over 1024 processes. I`ve increased process_limit in imap and pop3 and still have messages in syslog like: maxproc limit exceeded by uid 89, please see tuning(7) and login.conf(5). Did I forget to increase some other value? System values are higher - kern.maxprocperuid: 8192 and kern.maxproc: 12288 I`d like to have more secure configuration > one process to one connection. Thanks for help. Tomas My config: # OS: FreeBSD 9.0-STABLE amd64 auth_mechanisms = plain login digest-md5 cram-md5 default_client_limit = 6200 default_process_limit = 4096 disable_plaintext_auth = no first_valid_gid = 89 first_valid_uid = 89 info_log_path = /var/log/dovecot-info.log last_valid_gid = 89 last_valid_uid = 89 listen = * log_timestamp = "%Y-%m-%d %H:%M:%S " login_greeting = Mail Toaster (Dovecot) ready. mail_location = maildir:~/Maildir mail_privileged_group = mail maildir_broken_filename_sizes = yes passdb { driver = vpopmail } plugin { quota = maildir quota_rule = Trash:ignore } protocols = imap pop3 service auth { unix_listener auth-client { mode = 0660 } unix_listener auth-master { mode = 0600 } } service imap-login { process_limit = 1536 service_count = 1 } service imap { process_limit = 2048 } service pop3-login { service_count = 1 } service pop3 { process_limit = 2048 } shutdown_clients = no ssl_cert = </var/qmail/control/servercert.pem ssl_key = </var/qmail/control/servercert.pem userdb { args = blocking=yes driver = passwd } userdb { driver = vpopmail } verbose_proctitle = yes protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep mail_max_userip_connections = 1024 mail_plugins = quota imap_quota } protocol lda { mail_plugins = quota imap_quota sendmail_path = /var/qmail/bin/sendmail } -- Tomáš Randa, Blueboard.cz s.r.o. ---------------------------------- http://hosting.blueboard.cz GSM: +420 775 086 575 Jabber: tomas(a)blueboard.cz Tel: +420 245 008 678 -- Tomáš Randa, Blueboard.cz s.r.o. ---------------------------------- http://hosting.blueboard.cz GSM: +420 775 086 575 Jabber: tomas(a)blueboard.cz Tel: +420 245 008 678

3 9

[Dovecot] clucene build warnings?
by Charles Marcus 17 Sep '12

17 Sep '12

Hi all/Timo, Is clucene still the best/recommended method for enabling full text search? Although I haven't enabled FTS yet, I plan on doing sometime in the future, and was going to be using clucene, but before I do, I'd like to see if I need to worry about an issue I've been seeing ever since I first installed clucene (and still get every time it is upgraded)... I run gentoo linux on an amd64 server, and have always gotten this warning whenever it is updated (and also got it when I first installed it): QA Notice: Package triggers severe warnings which indicate that it may exhibit random runtime failures. /var/tmp/portage/dev-cpp/clucene-2.3.3.4-r4/work/clucene-core-2.3.3.4/src/core/CLucene/index/DocumentsWriter.cpp:129:33: warning: passing NULL to non-pointer argument 2 of ‘void* memset(void*, int, size_t)’ Please do not file a Gentoo bug and instead report the above QA issues directly to the upstream developers of this software. Homepage:http://clucene.sourceforge.net/ Has anyone else ever seen similar warnings when building clucene? Is the gentoo ebuild output correct that this is not a gentoo bug, but is in fact a problem with upstream? If so, is it harmless? Or should I try to get upstream to fix it? That said, being that ianap, I probably wouldn't be much help to them, so, Timo, any chance you can see if this is a problem that needs to be addressed with them? Thanks, -- Best regards, Charles

3 10

[Dovecot] Mailbox directory permissions (LDA, 0600 -> 0660, virtual users)
by Marcin Hłybin 17 Sep '12

17 Sep '12

Hello, I have a quite common dovecot configuration with virtual users support: 1. User configuration is stored in MySQL database. 2. Mailboxes are owned by vmail:vmail with permission 0600 or drwx------. Is it possible to change mailbox mode to 0660? Dovecot version is 2.1.7 Part of SQL configuration: user_query = \ SELECT \ CONCAT_WS('/', home, u.uid, d.domain_name, u.user_name) AS home, \ 500 AS uid, \ 500 AS gid \ FROM users u \ LEFT JOIN domains d ON u.domain_id = d.id \ WHERE \ u.user_name = '%n' AND \ d.domain_name = '%d' AND \ u.active = 1 Regards. -- M.

2 7

[Dovecot] doveadm backup - Fatal: All your namespaces have a location setting.
by Tobias Hachmer 17 Sep '12

17 Sep '12

Hello list, I am using dovecot v2.1.9 and have a problem with doveadm backup: # doveadm backup -u user(a)domain.com maildir:/backup/domain.com/user/Maildir doveadm(user(a)domain.com): Fatal: All your namespaces have a location setting. It should be empty (default mail_location) in the namespace to be converted. Here my namespace config: namespace { list = children location = maildir:/var/vmail/%%d/%%n/Maildir:INDEX=/var/vmail/%d/%n/shared/%%u prefix = Gemeinsame-Postfaecher/%%u/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = maildir:/var/vmail/%d/%n/Maildir:INDEX=/var/vmail/indexes/%u prefix = separator = / subscriptions = yes type = private } Have I got a problem with my namespace config? Regards, Tobias Hachmer

2 1

[Dovecot] RFC 6154: German umlauts in special_use folder names
by Daniel Parthey 17 Sep '12

17 Sep '12

Hi, the Drafts special folder is called "Entwürfe" in German locale. How should the special_use entry in the config file look like? Would you recommended to use the encoded folder name... mailbox "Entw&APw-rfe" { special_use = \Drafts } ...or rather the utf-8 Encoding in the dovecot config file? mailbox "Entwürfe" { special_use = \Drafts } Regards Daniel -- https://plus.google.com/103021802792276734820

3 4

[Dovecot] Strip backslash from usernames
by Dominic Malolepszy 17 Sep '12

17 Sep '12

Hi, Is there a way to strip a backslash if it exists at the start of username like \user(a)example.com within the Dovecot LDA? I am using Dovecot 2.1.9 with a LDAP backend, so I cannot do any sort of SQL trickery. Dominic.

2 2

[Dovecot] Edit an existing message or replacing it
by Mostafa Rokooie 16 Sep '12

16 Sep '12

Hi, I want to know is there any solution to edit an existing message in mailbox via IMAP? or replace it with a new message (store a new message with same UID)? Thank you very much, --Mostafa Rokooie

2 1

[Dovecot] Error: User doesn't have home dir set, disabling duplicate database
by Carsten Laun-De Lellis 16 Sep '12

16 Sep '12

Hi all I receive the following error in my mail.log. Does anybody know how to configure dovecot to get rid of this ? I have one server up and running with postfix, dovecot and a mysql backend. The error above happens on another server with postfix, dovecot and a ldap backend. Any hints ? Mit freundlichem Gruß Carsten Laun-De Lellis Dipl.-Ing. Elektrotechnik Certified Information Systems Auditor (CISA) Hauptstrasse 13 D-67705 Trippstadt Phone: +49 (6306) 992140 Mobile: +49 (151) 27530865 Fax: +49 (6306) 992142 email: <mailto:carsten.delellis@delellis.net> carsten.delellis(a)delellis.net

4 5

[Dovecot] POP3S PORT
by Robert JR 14 Sep '12

14 Sep '12

Hello I am using dovecot with POP3S and IMAPS ports, When client connect to POP3S port (995) , i can see in dovecot log file that the protocol is TLSv1 So how come the protocol is TLSv1 and not SSL ? Does the user connect t port 995 with SSL protocol then encrypt again inside the SSL session to make The TLSv1 protocol ? Or does the client use TLSv1 Protocol immediately when connect to port 995 without Using SSL protocol ? Please Help. Robert JR

3 2

[Dovecot] sieve_execute_bytecode failed with squirrelmail
by Gregory Charot (EVENIUM) 14 Sep '12

14 Sep '12

Hello all, I'm using dovecot on CentOS 5.8 (official CentOS package) and have lot of lock and "sieve_execute_bytecode error" in my dovecot.log. $ cat /etc/redhat-release CentOS release 5.8 (Final) $ dovecot --version 1.0.13 The sieve scripts are generated by squirrelmail mail and are mostly mail filters and vacations notices. $ yum info squirrelmail.noarch Installed Packages Name : squirrelmail Arch : noarch Version : 1.4.8 Release : 5.el5.centos.13 When I look at my dovecot.log I have a lot of sieve error : deliver(foo): Sep 11 15:08:04 Info: msgid=<1881992580.96697.1347363282479.JavaMail.jboss(a)gula1.xxx.com>: save failed to EvSUPPORT: Timeout while wait ing for lock deliver(foo): Sep 11 15:08:04 Info: sieve runtime error: Fileinto: Generic Error deliver(foo): Sep 11 15:08:04 Error: sieve_execute_bytecode(/home/foo/.dovecot.sievec) failed The server hosts around 50 mailboxes, some people does have sieve errors some doesn't. Is there any way to get more details about the runtime error ? How can I debug this issue ? Thanks a lot in advance, Greg My config below : #dovecot -n # 1.0.13: /etc/dovecot.conf log_path: /var/log/dovecot.log ssl_ca_file: /etc/pki/roch_crt/roch_evenium_com.ca-bundle ssl_cert_file: /etc/pki/roch_crt/roch_evenium_com.crt ssl_key_file: /etc/pki/roch_crt/private/roch-private.key ssl_cipher_list: ALL:!aNULL:!ADH:!eNULL:!LOW:!EXP:!SSLv2:RC4+RSA:+HIGH:+MEDIUM:+SSLv3 login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login login_process_per_connection: no login_process_size: 256 login_processes_count: 10 login_max_connections: 32 mail_privileged_group: mail dotlock_use_excl: yes fsync_disable: yes maildir_copy_with_hardlinks: yes mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/lib64/dovecot/imap mail_plugin_dir(imap): /usr/lib64/dovecot/imap mail_plugin_dir(pop3): /usr/lib64/dovecot/pop3 pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls,oe-ns-eoh auth default: passdb: driver: pam userdb: driver: passwd socket: type: listen client: path: /var/run/dovecot/auth-client mode: 438 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384

2 3

[Dovecot] Possible mbox corruption if mail is saved with wrong Content-Length header (2.1.6)
by Jost Krieger 14 Sep '12

14 Sep '12

One of our users likes to delete attachments from his mails. He is using roundcube and we installed a plugin for that. He reports that from time to time one of his mails gets corrupted (cut off in the middle). I could verify there is something wrong in the logs: imap(x1234567): Error: Cached message size larger than expected (6796 > 2844) imap(x1234567): Error: Corrupted index cache file /net/mbx3/disc2/home/85/x1234567/Index/.imap/Sent/dovecot.index.cache: Broken physical size for mail UID 5001 imap(x1234567): Error: read(/net/mbx3/disc2/home/85/x1234567/Mail/Sent) failed: Input/output error (FETCH for mailbox Sent UID 5001) imap(x1234567): Info: Disconnected: Internal error occurred. Refer to server log for more information. [2012-08-23 00:00:49] in=1124145 out=1324791 I had a look at the plugin and it works by duplicating the message and leaving out the attachment(s). The headers are also duplicated, including Content-Length. I've fixed that in the plugin, (don't know yet if it helps), but I think it shouldn't cause such breakage in dovecot. # doveconf -n # 2.1.6: /usr/local/dovecot/etc/dovecot/dovecot.conf # OS: Linux 2.6.9-103.ELsmp i686 Red Hat Enterprise Linux AS release 4 (Nahant Update 9) doveconf: Warning: Dovecot was last started using /usr/local/dovecot/etc/dovecot.conf, but this config is /usr/local/dovecot/etc/dovecot/dovecot.conf auth_master_user_separator = * disable_plaintext_auth = no doveadm_password = (hidden) lda_mailbox_autocreate = yes log_path = /dev/stderr log_timestamp = mail_location = mbox:~/Mail:INBOX=~/Mailbox:INDEX=~/Index mail_plugins = " quota zlib mail_log notify virtual" mdbox_rotate_size = 5 M namespace { hidden = no inbox = yes location = prefix = separator = / type = private } namespace { hidden = yes inbox = no list = children location = maildir:~/Maildir prefix = "#MD/" separator = / type = private } passdb { driver = pam } passdb { args = /usr/local/dovecot/etc/passwd.dovcot.master driver = passwd-file master = yes } plugin { acl = vfile mail_log_events = undelete mailbox_delete mailbox_rename mailbox_create mail_log_fields = uid box msgid size quota = fs:Disk quota } protocols = pop3 imap service auth { client_limit = 4300 user = root } service doveadm { inet_listener { port = 542 } } service imap-login { inet_listener imap { address = 134.147.64.42 port = 143 } service_count = 0 } service imap { drop_priv_before_exec = yes process_limit = 4096 vsz_limit = 1 G } service pop3-login { inet_listener pop3 { address = 134.147.64.42 port = 110 } service_count = 0 } service pop3 { drop_priv_before_exec = yes process_limit = 2048 vsz_limit = 512 M } ssl = no userdb { driver = passwd } protocol imap { mail_max_userip_connections = 50 mail_plugins = " quota zlib mail_log notify virtual imap_quota imap_zlib" } Thanks Jost Krieger -- | Helft Spam ausrotten! HTML in Mail ist unhöflich. | | Postmaster, JAPH, manchmal Wahrsager am RZ der RUB | | Wahre Worte sind nicht gefällig, gefällige Worte sind nicht wahr.| | Lao Tse, Tao Te King 81 |

2 4

[Dovecot] Couldn't drop privileges: User is missing UID (see mail_uid setting)
by Carsten Laun-De Lellis 14 Sep '12

14 Sep '12

Hi all I hope anyone could help me out with my problem regarding the user_id settings. I am running my mail servers just for fun and I am not a professional mail admin. After I am using postfix and dovecot for my mail servers with a mysql backend for the last 2 years I have tried to set up an installation with a ldap backend. I followed the how-to from the Postfix Book and now I have always the following error message: Couldn't drop privileges: User is missing UID (see mail_uid setting) This error message occurs whenever I try to connect via a mail client. System emails were delivered the way I expected. So I assume postfix is working fine. The ldap search I use for user authentication is as follows: uris = ldap://myserver.com dn = cn=admin, dc=mydomain, dc=com dnpass = secure tls = no base = ou=mailuser,dc=mydomain,dc=com ldap_version = 3 user_attrs = pfMailMessageStore=home user_filter = (&(objectClass=PFMailAccount)(pfMail=%u)) pass_attrs = pfClearPassword=password,pfMailMessageStore=userdb_home pass_filter = (&(objectClass=PFMailAccount)(pfMail=%u)) default_pass_scheme = PLAIN user_global_uid = 5000 user_global_gid = 5000 I am using dovecot 2.1.9, postfix 2.8.5 and openldap 2.4.23 I would appreciate any help or tipps. ~ Mit freundlichem Gruß Carsten Laun-De Lellis Dipl.-Ing. Elektrotechnik Certified Information Systems Auditor (CISA) Hauptstrasse 13 D-67705 Trippstadt Phone: +49 (6306) 992140 Mobile: +49 (151) 27530865 Fax: +49 (6306) 992142 email: <mailto:carsten.delellis@delellis.net> carsten.delellis(a)delellis.net

1 0

[Dovecot] best way to activate quota
by Angel L. Mateo 14 Sep '12

14 Sep '12

Hello, I'm planning to activate quota control in dovecot, with maildir quota backend. I have about 70k users in my system directed to 4 backend servers (with a director to ensure that a user is always directed to the same server). I have tried to activate it in one of my nodes. The problem is that load of it has increase a lot, as much as the system was unusable (maildir is in nfs storage, with indexes in local disks). What do you think is the best to activate it? I have think that I could use doveadm commands to calculate an initial quota (on low load periods) and then activate quota, hoping that although quota is not correct, it would be used. Should this work?

5 9

[Dovecot] antispam_plugin prevents IMAP login (error 3) [Dovecot 2.0.19]
by dof＠projektfabrik.com 13 Sep '12

13 Sep '12

Hi everybody, trying to get the Dovecot antispam_plugin to work and I must be doing something wrong, because as soon as it is enabled with a certain backend, imap logins do not work anymore (the session is immediately closed after a successful login). Interestingly, pipe and spool2dir are working (that is, the session won't be closed), dspam-exec and crm114-exec are not. If this happens, mail_debug output is as follows: imap-login: Login: user=<dof>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=10420, secured imap: Debug: Loading modules from directory: /usr/lib/dovecot/modules imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_autocreate_plugin.so imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_fts_plugin.so imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib21_fts_squat_plugin.so imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib90_antispam_plugin.so imap(dof): Debug: Effective uid=23244, gid=8, home=/var/spool/dovecot/userdata/dof imap(dof): Debug: Home dir not found: /var/spool/dovecot/userdata/dof master: Error: service(imap): child 10420 returned error 3 Without the plugin I get: imap-login: Login: user=<dof>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=10469, secured imap: Debug: Loading modules from directory: /usr/lib/dovecot/modules imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_autocreate_plugin.so imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_fts_plugin.so imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib21_fts_squat_plugin.so imap(dof): Debug: Effective uid=23244, gid=8, home=/var/spool/dovecot/userdata/dof imap(dof): Debug: Home dir not found: /var/spool/dovecot/userdata/dof imap(dof): Debug: fs: root=/var/spool/dovecot/mail/dof, index=, control=, inbox=/var/spool/dovecot/mail/dof/INBOX, alt= imap(dof): Debug: Namespace : Using permissions from /var/spool/dovecot/mail/dof: mode=0755 gid=-1 Hopefully this is just a configuration problem. I tried the plugin in the Ubuntu repository (I'm using LTS 12.04) and even checked out the source from git and compiled it myself, but to no avail. Thanks a lot in advance and best regards, Florian ------------------- dovecot -n output: auth_cache_size = 128 k auth_cache_ttl = 20 mins auth_failure_delay = 10 secs auth_mechanisms = plain login disable_plaintext_auth = no login_greeting = Projektfabrik IMAP ready. mail_gid = mail mail_home = /var/spool/dovecot/userdata/%u mail_location = maildir:/var/spool/dovecot/mail/%u:INBOX=/var/spool/dovecot/mail/%u/INBOX:LAYOUT=fs mail_uid = dovemail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } plugin { antispam_backend = dspam-exec antispam_dspam_binary = /usr/bin/dspam antispam_signature = X-DSPAM-Signature antispam_signature_missing = error antispam_spam = Spam antispam_trash = trash;Trash;Deleted Items; Deleted Messages autocreate = INBOX/Sent Mail autocreate2 = INBOX/Spam autocreate3 = INBOX/Trash autosubscribe = INBOX/Sent Mail autosubscribe2 = INBOX/Spam autosubscribe3 = INBOX/Trash fts = squat sieve = /var/spool/dovecot/sieve/%u/defaultbc sieve_before = /etc/dovecot/sieve/spam.sieve sieve_dir = /var/spool/dovecot/sieve/%u } protocols = imap pop3 sieve service auth { unix_listener /var/spool/postfix/private/dovecot-auth { group = postfix mode = 0600 user = postfix } unix_listener auth-userdb { mode = 0600 user = dovemail } user = dovenull } service imap-login { inet_listener imap { address = localhost port = 143 } inet_listener imaps { address = localhost XX.XXX.XX.XXX port = 993 } service_count = 1 user = dovenull } service managesieve-login { inet_listener sieve { address = localhost port = 2000 } service_count = 1 user = dovenull } service pop3-login { inet_listener pop3 { address = localhost port = 110 } inet_listener pop3s { address = XX.XXX.XX.XXX port = 995 } service_count = 1 user = dovenull } ssl_ca = </etc/ssl/dovecot/cacert.pem ssl_cert = </etc/ssl/dovecot/cert.pem ssl_key = </etc/ssl/dovecot/key.pem protocol imap { imap_client_workarounds = tb-extra-mailbox-sep mail_plugins = antispam autocreate fts fts_squat } protocol pop3 { pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_lock_session = yes } protocol lda { mail_fsync = optimized mail_plugins = sieve postmaster_address = postmaster(a)projektfabrik.com }

2 1

[Dovecot] cyrus2dovecot script converts mailboxes to bigger sizes
by Igor Zinovik 13 Sep '12

13 Sep '12

Hello, list. I'm asking question not directly connected with dovecot. I'm planning a migration from cyrus-imapd to dovecot and i'm using cyrus2dovecot script (by Freie Universität Berlin) to convert mailboxes of users, but i'm wondering why size of mailbox in Maildir++ is so much bigger than mailbox in cyrus format after conversion: linux-a9qw:~/ # du -sh /mnt/imap/z/user/zinovik /srv/vmail/petrsu.ru/z/zinovik/Maildir 238M /mnt/imap/z/user/zinovik 1.2G /srv/vmail/mydom.ru/z/zinovik/Maildir I was planning to implement quota for mailboxes about 1 gigabyte, but after conversion I would not be able to receive messages to my own box, because i'm overquota. I think the only way would be to set quota up to 15 GB since some of users have mailbox with 12GB after conversion, but I have no such disk capacity to allow more than 1500 users have 15GB quota. Would it be practical solution to compress all files after conversion and enable zlib support in dovecot?

1 1

[Dovecot] doveadm director map : User listing returned failure
by Ramón Frontera 13 Sep '12

13 Sep '12

Hello we are running Dovecot 2.1.9. We have 2 proxies with director and 4 mail servers. We have the user information in a LDAP. I try to do: # doveadm director map doveadm(root): Error: User listing returned failure doveadm(root): Error: user listing failed user mail server ip expire time <unknown> x.x.x.x 2012-09-12 10:52:17 <unknown> x.x.x.x 2012-09-12 10:55:53 in the dovecot log i have found: dovecot: auth: Error: Trying to iterate users, but userdbs don't support it What can I do to solve this problem? Thanks in advance. -- ------------------------------------------ Ramon Frontera Gallardo Universitat de les Illes Balears

2 1

[Dovecot] Dovecot 1.x POP3 to Dovecot 2.x POP3 mbox to Maildir best transfer program/method
by Tim E. 12 Sep '12

12 Sep '12

I have a box running Dovecot 1.x POP3 only server using mbox format. I want to port the mail over to a Centos 6.3 box running a Dovecot 2.x POP3 only server using Maildir format. The main thing I want to do is support XUID/read/unread status so the transfer is transparent for the end user. I have been able to achieve transfers from the mbox format to Maildir but loose the XUID/read/unread status so that the Thunderbird client always re-downloads all the mail as if it were new. Ive googled and I have tried the following: dsync : dovecot 1.x server is too old and doesnt support the command? mb2md.pl: transfers the mbox to maildir and creates file dovecot-uidlist but the Thunderbird client redownloads the files virtualmin copy-mailbox: transfers the mailbox to Maildir but doesnt reproduce the dovecot indexes. Any thoughts would be appreciated. I would like to produce a howto of the process when I am done.

2 6

[Dovecot] TIMO HELP! director ring wont stay connected
by Kelsey Cummings 12 Sep '12

12 Sep '12

I've had 2x director ring up and running with production load on 2.1.8 with around 10,000 active connections for two weeks and everything has been working great - until this morning. There isn't anything obvious in the logs beyond the fact that the director connections started bouncing. It was not resolved by reloads or restarts or an upgrade to 2.1.9 (only the directors.) I've dropped one of the servers out of the ring to prevent suffering but this is a less than ideal situation. Any idea what is going on? Load today is consistent with low weekend load since it is a major US holiday so this wouldn't appear to be a load related issue. auth_master_user_separator = * auth_username_format = %Ln auth_verbose = yes default_client_limit = 10000 director_mail_servers = 1.1.1.1 1.1.1.2 1.1.1.3 1.1.1.4 director_servers = a.director.foo b.director.foo disable_plaintext_auth = no doveadm_proxy_port = 1842 login_trusted_networks = 10.0.0.1 mbox_write_locks = fcntl passdb { args = /etc/dovecot/master-users driver = passwd-file master = yes pass = yes } passdb { args = proxy=y nopassword=y driver = static } service anvil { client_limit = 20103 } service auth { client_limit = 41704 } service director { fifo_listener login/proxy-notify { mode = 0666 } inet_listener { port = 9321 } unix_listener login/director { mode = 0666 } } service imap-login { executable = imap-login director process_limit = 20000 process_min_avail = 32 } service imap { process_limit = 20480 } service pop3-login { executable = pop3-login director process_limit = 20000 process_min_avail = 32 } ssl_ca = </etc/dovecot/ssl/gd_bundle.crt ssl_cert = </etc/dovecot/ssl/imap.sonic.net.crt ssl_key = </etc/dovecot/ssl/imap.sonic.net.key ssl_parameters_regenerate = 1 days syslog_facility = local0 protocol imap { ssl_ca = </etc/dovecot/ssl/gd_bundle.crt ssl_cert = </etc/dovecot/ssl/imap.sonic.net.crt ssl_key = </etc/dovecot/ssl/imap.sonic.net.key } protocol pop3 { ssl_ca = </etc/dovecot/ssl/pop.sonic.net.ca-bundle ssl_cert = </etc/dovecot/ssl/pop.sonic.net.crt ssl_key = </etc/dovecot/ssl/pop.sonic.net.key } >Sep 3 09:22:42 b.director. b dovecot: director: Error: Director 10.10.10.71:9321/right disconnected >Sep 3 09:22:45 a.director. a dovecot: director: Error: Director 10.10.10.37:9321/left disconnected >Sep 3 09:22:49 b.director. b dovecot: director: Error: Director 10.10.10.71:9321/left disconnected >Sep 3 09:22:53 b.director. b dovecot: director: Error: Director 10.10.10.71:9321/left disconnected >Sep 3 09:22:54 a.director. a dovecot: director: Error: Director 10.10.10.37:9321/left disconnected >Sep 3 09:22:59 b.director. b dovecot: director: Error: Director 10.10.10.71:9321/left disconnected >Sep 3 09:23:02 a.director. a dovecot: director: Error: Director 10.10.10.37:9321/right disconnected >Sep 3 09:23:02 a.director. a dovecot: director: Warning: director: Couldn't connect to right side, we must be the only director left >Sep 3 09:23:02 b.director. b dovecot: director: Error: Director 10.10.10.71:9321/right disconnected >Sep 3 09:23:02 b.director. b dovecot: director: Warning: director: Couldn't connect to right side, we must be the only director left >Sep 3 09:23:32 a.director. a dovecot: director: Error: director: User foo host lookup failed: Timeout - queued for 47 secs (Ring synced for 30 secs, weak user, user refreshed 47 secs ago) >Sep 3 09:23:32 a.director. a dovecot: director: Error: director: User bar host lookup failed: Timeout - queued for 38 secs (Ring synced for 30 secs, weak user, user refreshed 38 secs ago) >Sep 3 09:23:32 a.director. a dovecot: director: Error: director: User bla host lookup failed: Timeout - queued for 30 secs (Ring synced for 30 secs) >Sep 3 09:23:32 a.director. a dovecot: director: Error: director: User bla2 host lookup failed: Timeout - queued for 30 secs (Ring synced for 30 secs) >Sep 3 09:23:32 a.director. a dovecot: director: Error: Director 10.10.10.37:9321/right disconnected >Sep 3 09:23:32 a.director. a dovecot: director: Warning: director: Couldn't connect to right side, we must be the only director left >Sep 3 09:23:32 a.director. a dovecot: director: Warning: director: Couldn't connect to right side, we must be the only director left >Sep 3 09:23:32 b.director. b dovecot: director: Error: Director 10.10.10.71:9321/out disconnected before handshake finished >Sep 3 09:23:32 b.director. b dovecot: director: Warning: director: Couldn't connect to right side, we must be the only director left >Sep 3 09:24:02 b.director. b dovecot: director: Error: Director 10.10.10.71:9321/out disconnected before handshake finished >Sep 3 09:24:02 b.director. b dovecot: director: Warning: director: Couldn't connect to right side, we must be the only director left >Sep 3 09:24:05 a.director. a dovecot: director: Warning: Delaying new user requests until ring is synced >Sep 3 09:24:32 a.director. a dovecot: director: Warning: Ring is synced, continuing delayed requests >Sep 3 09:24:41 b.director. b dovecot: director: Error: Director 10.10.10.71:9321/right disconnected >Sep 3 09:24:41 b.director. b dovecot: director: Warning: director: Couldn't connect to right side, we must be the only director left >Sep 3 09:24:41 a.director. a dovecot: director: Error: Director 10.10.10.37:9321/right disconnected >Sep 3 09:24:41 a.director. a dovecot: director: Warning: director: Couldn't connect to right side, we must be the only director left >Sep 3 09:25:11 b.director. b dovecot: director: Error: User hash 2285697953 is being redirected to two hosts: 10.10.10.39 and 10.10.10.76 (old_ts=1346689481,handshaking,recv_ts=1346689467) >Sep 3 09:25:12 b.director. b dovecot: director: Error: User hash 623192092 is being redirected to two hosts: 10.10.10.76 and 10.10.10.39 (old_ts=1346689481,handshaking,recv_ts=1346689468) >Sep 3 09:25:12 b.director. b dovecot: director: Error: User hash 1683990717 is being redirected to two hosts: 10.10.10.43 and 10.10.10.76 (old_ts=1346689481,handshaking,recv_ts=1346689468) >Sep 3 09:25:12 a.director. a dovecot: director: Error: Director 10.10.10.37:9321/right disconnected >Sep 3 09:25:12 a.director. a dovecot: director: Warning: director: Couldn't connect to right side, we must be the only director lef -- Kelsey Cummings - kgc(a)corp.sonic.net sonic.net, inc. System Architect 2260 Apollo Way 707.522.1000 Santa Rosa, CA 95407

3 10

[Dovecot] Expire plugin with multiple mail servers
by Ramón Frontera 12 Sep '12

12 Sep '12

Hello we are running Dovecot 2.1.9 and I want to configure expire plugin. We have 2 proxies with director and 4 mail servers. I have configured expire plugin on a single mail server and it works Ok. I don't konw how to configure with 4 mail servers and 2 proxies. My first idea is create on each mailserver one sqlite database and configure the expire plugin on proxy, but I don't know if this is a good idea. I don't know if the database should be in one proxy, and I don't know which server has to do the "doveadm expunge" command Do you have any idea how is the best way to configure expire plugin on this scenario? Thanks in advance. -- Ramon Frontera Gallardo Universitat de les Illes Balears

3 3

[Dovecot] dovecot/log not running
by Mark Hinch 12 Sep '12

12 Sep '12

I'm running 2.1.7 as downloaded/installed by Debian (and then appropriately setup for my config, ...). It almost works. I can send/receive email from thunderbird, squirrelmail, ... However there are two anomalies: 1. dovecot/log is not running. After restarting dovecot (and waiting 30 seconds), I have this in the log files: Sep 6 17:42:16 hinch4 dovecot: master: Dovecot v2.1.7 starting up (core dumps disabled) Sep 6 17:42:56 hinch4 dovecot: master: Error: service(anvil): Initial status notification not received in 30 seconds, killing the process Sep 6 17:42:56 hinch4 dovecot: master: Error: service(log): Initial status notification not received in 30 seconds, killing the process Sep 6 17:42:56 hinch4 dovecot: master: Error: service(ssl-params): Initial status notification not received in 30 seconds, killing the process Sep 6 17:42:56 hinch4 dovecot: master: Error: service(log): child 31286 killed with signal 9 After 30 seconds, a "ps -ef | grep dovecot" yields: dovenull 1858 20223 0 18:56 ? 00:00:00 dovecot/imap-login root 1859 20223 0 18:56 ? 00:00:00 dovecot/auth -w mhinch 1860 20223 0 18:56 ? 00:00:00 dovecot/imap root 1862 14520 0 18:56 pts/3 00:00:00 grep dovecot root 20223 1 0 18:54 ? 00:00:00 /usr/sbin/dovecot -c /etc/dovecot/dovecot.conf dovenull 25144 20223 0 18:55 ? 00:00:00 dovecot/imap-login dovecot 25147 20223 0 18:55 ? 00:00:00 dovecot/anvil root 25148 20223 0 18:55 ? 00:00:00 dovecot/config dovecot 25161 20223 0 18:55 ? 00:00:00 dovecot/auth root 25174 20223 0 18:55 ? 00:00:00 dovecot/ssl-params mhinch 25208 20223 0 18:55 ? 00:00:00 dovecot/imap Seems like everything is there except dovecot/log. ssl-params and anvil came back (?!?). A "doveadm log find" dumps this in the log: Sep 6 18:52:24 hinch4 dovecot: doveadm: Debug: This is Dovecot's debug log (1346975543) Sep 6 18:52:24 hinch4 dovecot: doveadm: This is Dovecot's info log (1346975543) Sep 6 18:52:24 hinch4 dovecot: doveadm: Warning: This is Dovecot's warning log (1346975543) Sep 6 18:52:24 hinch4 dovecot: doveadm: Error: This is Dovecot's error log (1346975543) Sep 6 18:52:24 hinch4 dovecot: doveadm: Fatal: This is Dovecot's fatal log (1346975543) However, further debugging that I try to do (see next problem) does not result in ANY further input to the log files, even though I have all known logging turned on. So I *think* that logging is not actually running. If I can get that started, then I'll take a crack at the next problem myself ... 2. However, as long as I have your attention, my next problem is that it seems like dovecot/imap-login hangs(?). After a few hours, I have something like: # ps -ef | grep dovecot dovecot 530 31186 0 18:49 ? 00:00:00 dovecot/auth root 13277 31186 0 17:47 ? 00:00:00 dovecot/config dovenull 13664 31186 0 18:44 ? 00:00:00 dovecot/imap-login root 20207 14520 0 18:54 pts/3 00:00:00 grep dovecot dovenull 27599 31186 0 18:45 ? 00:00:00 dovecot/imap-login dovenull 27601 31186 0 18:45 ? 00:00:00 dovecot/imap-login dovenull 27603 31186 0 18:45 ? 00:00:00 dovecot/imap-login dovenull 27607 31186 0 18:45 ? 00:00:00 dovecot/imap-login root 31186 1 0 17:42 ? 00:00:00 /usr/sbin/dovecot -c /etc/dovecot/dovecot.conf dovecot 31289 31186 0 17:42 ? 00:00:00 dovecot/anvil with exactly 100 imap-login processes. I'm the only meaningful user on the machine (unless somebody is imap DoS-ing me), so this does not make much sense. Obviously thunderbird is polling the machine and each time is leaving around a imap-log process. As far as I can tell, thunderbird successfully logs in (i.e., I get mail) though I can't be sure whether these are successful logins or not (no logging!). What hangs imap-log processes for hours at a time? After a while of course, dovecot will not start any new imap-login processes so Thunderbird cannot get any more mail until I restart dovecot. Then everything is OK for another 12 hours or so. Ideas on either problem? -Mark

3 3

[Dovecot] Found bug on doing IMAP search with UTF8 chars
by Weinreich, Nico 12 Sep '12

12 Sep '12

Hi! I'm using Roundcube 0.9git as mail frontend and have installed Dovecot 2.1.7 on Debian Squeeze. When searching for mail via Roundcube and the keyword contains "special" chars (like german umlauts), then Dovecot seems to die when the folder does not contain a message which contains this keyword, i.e. folder contains message /w subject "Dies ist eine Nachricht" => search for "Nachricht" => Roundcube shows that messages folder contains message /w subject "Dies ist eine Nachricht" => search for "Nachricht123" => Roundcube shows error that no messages where found folder contains message /w subject "Auflösung der Frage" => search for "Lösung" => Roundcube shows that messages folder contains message /w subject "Auflösung der Frage" => search for "Lösung123" => Roundcube shows error saying: "Connection to storage server failed" Looking into /var/log/mail.log shows: Sep 5 11:43:32 mail dovecot: imap(abc(a)def.de): Panic: search key not utf8: L.sung123 dsr_sub_allocation Sep 5 11:43:32 mail dovecot: imap(abc(a)def.de): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x4478a) [0 x7f065ba8e78a] -> /usr/lib/dovecot/libdovecot.so.0(+0x447d6) [0x7f065ba8e7d6] -> /usr/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f065ba655ef ] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x9a3cb) [0x7f065bd6f3cb] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x9a8aa) [0x7f065bd6f8 aa] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x78641) [0x7f065bd4d641] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_search_args_fore ach+0x3c) [0x7f065bd4d7bc] -> /usr/lib/dovecot/libdovecot.so.0(message_parse_header+0x29) [0x7f065ba78eb9] -> /usr/lib/dovecot/libdovecot-st orage.so.0(+0x9a0cf) [0x7f065bd6f0cf] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x9b160) [0x7f065bd70160] -> /usr/lib/dovecot/libdovecot- storage.so.0(index_storage_search_next_nonblock+0x48) [0x7f065bd706e8] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_search_next_nonbl ock+0x27) [0x7f065bd51a07] -> dovecot/imap() [0x41668f] -> dovecot/imap(imap_search_start+0xd8) [0x416ad8] -> dovecot/imap(cmd_sort+0x1e6) [ 0x40e636] -> dovecot/imap(command_exec+0x3d) [0x41157d] -> dovecot/imap() [0x4104fe] -> dovecot/imap(client_handle_input+0x135) [0x410805] - > dovecot/imap(client_input+0x5f) [0x41112f] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7f065ba9a926] -> /usr/lib/dovecot/ libdovecot.so.0(io_loop_handler_run+0x9f) [0x7f065ba9b95f] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7f065ba9a8c8] -> /usr/li b/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f065ba87053] -> dovecot/imap(main+0x2a4) [0x419354] -> /lib/libc.so.6(__libc_start_ma in+0xfd) [0x7f065b706c8d] -> dovecot/imap() [0x408e79] Huh? This error only occurs when I search for a keyword, that contains probably non-ASCII-US chars (like umlauts, euro sign EUR ...) and no message was found in that folder. When there is any message which contains this keyword, then Roundcube is fine and there error above cannot be found in mail.log. Can anybody confirm this behaviour? Regards

3 10

[Dovecot] Resynchronization of indexes (or Warning: Maildir Scanning <dir> took <X> seconds)
by Angel L. Mateo 12 Sep '12

12 Sep '12

Hello, We have a dovecot servers farm with storage in NFS and indexes in local files. Under heavy load conditions we a log of messages in the form: Sep 3 12:35:49 myotis32 dovecot: imap(<imapuser>): Warning: Maildir: Scanning <maildir cur directory> took 62 seconds (9516 readdir()s, 0 rename()s to cur/, why=0x80) We have check that messages are directed with lmtp to the same server the user (scenario 3 at http://wiki2.dovecot.org/NFS with director in front of backend servers). So my question is why is dovecot using these readdirs operations? why it is scanning the whole cur directory of the user? I guess this is an index resynchronization, but I don't know could it be the cause. PS: I have attached my dovecot -n output

2 4

[Dovecot] dsync issue: "Server sent invalid input: Error parsing input: Unexpected ')'"
by Gábor Lénárt 12 Sep '12

12 Sep '12

Hi, I'm trying to use dsync (dovecot version 2.1.9) for IMAP only per-user migration from other IMAP servers to my shiny new one. One worked quite well, but there is a problem with an old IMAP server: dsync(migtest@office): Debug: imapc(imap-sunw-old.servers.intra:143): Looking up IP address dsync(migtest@office): Debug: imapc(imap-sunw-old.servers.intra:143): Connecting to 192.168.10.100:143 dsync(migtest@office): Error: imapc(imap-sunw-old.servers.intra:143): Server sent invalid input: Error parsing input: Unexpected ')' dsync(migtest@office): Debug: imapc(imap-sunw-old.servers.intra:143): Disconnected dsync(migtest@office): Error: imapc: Command failed: Disconnected from server dsync(migtest@office): Error: user migtest@office: Initialization failed: Initializing mail storage from mail_location setting failed: imapc: LIST failed: Internal error occurred. Refer to server log for more information. [2012-09-10 11:49:02] dsync(migtest@office): Fatal: User init failed What can cause this? "By hand" test with telnet'ing says: dovecot-test:~$ telnet imap-sunw-old.servers.intra 143 Trying 192.168.10.100... Connected to imap-sunw-old.servers.intra. Escape character is '^]'. * OK [CAPABILITY IMAP4 IMAP4rev1 ACL QUOTA LITERAL+ NAMESPACE UIDPLUS CHILDREN BINARY UNSELECT SORT LANGUAGE XSENDER X-NETSCAPE XSERVERINFO X-SUN-SORT X-SUN-IMAP X-ANNOTATEMORE X-UNAUTHENTICATE XUM1 AUTH=PLAIN] imap-sunw-old.servers.intra IMAP4 service (Sun Java(tm) System Messaging Server 6.3-5.02 (built Oct 12 2007; 32bit)) (this is one line of course) Is it possible that the problem about ')' is caused by this line? Or is it tottaly different issue? I just think this, because the the major difference between this and the working server on migration is to have ')' and '(' at the imap "greeting", the working server does not have those, and the error message is about something with ')'. The command was the following (no configuration in dovecot for this, only this command is given at shell level - currently mainly for testing if it works or not); doveadm -D -v -o imapc_features=rfc822.size \ -o imapc_host=192.168.10.100 \ -o imapc_user=migtest@office -o imapc_password=SECRET backup -R -f \ -u migtest@office imapc: This was OK with a dovecot v1 as the "source" (as I've written) but has the problem I've desribed with that "old" sun messaging server as the source. I've also used tcpdump then wireshark's "follow TCP stream" on it: the communication seems to be just that "greeting" line, then my (target) dovecot sends FIN. That "old" server works otherwise since years with various IMAP clients. The log of my server does not contain too much just the db lookups, which works nicely (the same for working and non-working source IMAP servers): Sep 10 11:49:02 dovecot-test dovecot: auth: Debug: prefetch(migtest@office): passdb didn't return userdb entries, trying the next userdb Sep 10 11:49:02 dovecot-test dovecot: auth: Debug: ldap(migtest@office): user search: base=cn=mail,dc=office,dc=intra scope=subtree filter=(&(objectClass=mailUser)(uid=migtest@office)) fields=uid Sep 10 11:49:02 dovecot-test dovecot: auth: Debug: ldap(migtest@office): result: uid=migtest@office Any help is welcome, - Gábor

2 2

[Dovecot] [PATCH] Generalize HMAC implementation
by Florian Zeitz 11 Sep '12

11 Sep '12

Hello everyone and Timo in particular, about a year ago I implemented a SHA-1 variant of the HMAC(-MD5) present in Dovecot. I had always disliked this a bit, because it replicates a lot of code. This patch generalizes the HMAC function to take a hash_method struct as parameter, and changes existing code which uses the "old" HMAC function to use this new one. I'm not really sure this is actually a good idea, but I still felt I should provide the code in case you would want to merge it upstream. Attached is the patch as a hg export based on the revision of dovecot-2.2 current at the time of writing. Regards, Florian Zeitz

2 2