- dovecot - dovecot.org

[Dovecot] FreeBSD, Dovecot and ZFS
by Jason Lock 13 Feb '13

13 Feb '13

Mail Issues - FreeBSD Hello, my apologies if this may be the wrong forum but hoping that maybe someone might be able to provide some insight. Have a very sporadic and strange issue with our mail servers running Dovecot on FreeBSD. There are three servers hosting Dovecot with FreeBSD as the underlying operating system. All three connect to a NAS server, again running FreeBSD and ZFS. When the specific issue occurs, clients connecting to check mail via POP3 or IMAP experience long delays and timeouts. To the point where POP3 Logins fail due to the timeouts. The issue is further compounded by clients increasing the number of attempts to check mail. Part of the frustration in attempting to diagnose the issue is not knowing the root cause or symptom that initates the issue. Wondering if anyone has experienced anything similar, or suggestions on ways to help identify the root cause

5 6

[Dovecot] dovecot-uidlist crashing and re retriving messages by pop3 clients
by Piotr Rotter 13 Feb '13

13 Feb '13

Hello, I have issue with dovecot (v. 2.1.13)configuration after implementation dovecot-lda (I used maildrop earlier). Now i have 9 servers with storage by NFS v3. My problem is frequently dovecot-uidlist crashing. 2013-02-13T13:34:02.447969+01:00 k1 dovecot: imap(user(a)domain.com): Error: Broken file /path_to_mailbox/dovecot-uidlist line 3170: Invalid data: 2013-02-13T13:34:34.527715+01:00 k1 dovecot: pop3(user(a)domain.com): Error: Broken file /path_to_mailbox/dovecot-uidlist line 367: Invalid data: It happens few time in minute for diferent users and has effect to re retriving messages by pop3 clients. This my NFS mount options: (rw,tcp,vers=3,actimeo=0) 10-mail.conf options: mmap_disable = yes dotlock_use_excl = yes mail_fsync=always mail_nfs_storage = yes mail_nfs_index = yes lock_method = dotlock I do not know what I did wrong and how solve this issue. Maybe NFS v4 or fcntl locks or migration to pop3_uidl_format = %g will by solution. Please some hint. Please any help for solve this issue and sorry my english.

2 1

[Dovecot] backing up maildir dovecot files
by David Mehler 13 Feb '13

13 Feb '13

Hello, I'm having to migrate servers. Both are dovecot2 systems. I'm wanting to copy over my mail store from one system to the other. I'd like to preserve dates/times of emails. These are maildir setups on both boxes, I'd like to be as transparent to the end user as possible. I currently have the first dovecot system offline and the second dovecot system is offline. Recommendations? Thanks. Dave.

5 9

[Dovecot] dsync 2.1.10 does not correctly handle renames of mailbox subtrees
by Karol Jurak 13 Feb '13

13 Feb '13

Hi, It seems that dsync 2.1.10 does not correctly handle renames of mailbox subtrees. The scenario is as follows. There are two servers, A and B, both running dovecot 2.1.10 and configured to use mdbox. Automatic replication between them is disabled, ie. replication plugin is not active and replicator service has process_min_avail = 0. I perform the following actions: 1. On A: doveadm mailbox create -u test_user a a/b a/b/c d 2. On A: doveadm sync -u test_user -d The result is as expected: on both A and B there are a/b/c and d mailboxes. Now I connect to A via IMAP and rename a/b to d/b. The result is as expected: on A there are a and d/b/c mailboxes. Next I execute on A 'doveadm sync -u mailstoragetest -d' and now the result is not as expected: there are a/b/c and d/b subtrees on both A and B and a/b is just a directory, ie. it does not contain dbox-Mails (the rest are proper mailboxes). dovecot.mailbox.logs have the following records appended to them: A: #2112: rename 33259783092361d18c60ba1c7cfe973c (2013-02-12 10:42:55) - this probably is the rename of a/b to d/b (recursive, ie. including children - in this case a/b/c => d/b/c) by the IMAP client #2136: rename ee2be6da91ae879476b152d7ca041f1b (1970-01-01 01:00:00) - rename of d/b/c to a/b/c by dsync (unexpected/incorrect) B: #1104: rename 33259783092361d18c60ba1c7cfe973c (1970-01-01 01:00:00) - rename of a/b to d/b (non recursive) by dsync What seems to be missing is the record in A's dovecot.mailbox.log describing the rename of a/b/c to d/b/c (or in general case the set of records describing the renames of all the children of a/b). Would appending such records allow dsync to make correct decisions as to which mailboxes and on which servers to rename? Thanks for any help. # 2.1.10: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.1 auth_master_user_separator = * auth_username_format = %Ln default_vsz_limit = 2 G dotlock_use_excl = no dsync_remote_cmd = ssh -l%{login} %{host} doveadm dsync-server -u%u -l5 log_path = /var/log/dovecot.log log_timestamp = "%Y-%m-%d %H:%M:%S " mail_access_groups = mail mail_location = mdbox:~/mdbox:ALT=/var/vmail/alt/%n mail_plugins = acl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / } passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } plugin { acl = vfile } protocols = imap lmtp pop3 service aggregator { fifo_listener replication-notify-fifo { mode = 0666 } unix_listener replication-notify { mode = 0666 } } service auth { executable = /usr/lib/dovecot/auth unix_listener auth-client { mode = 0660 } unix_listener auth-master { mode = 0600 } unix_listener auth-userdb { mode = 0666 } user = root } service dict { unix_listener dict { mode = 0666 } } service doveadm { process_min_avail = 1 service_count = 1024 } service imap-login { chroot = login executable = /usr/lib/dovecot/imap-login inet_listener imap { address = * port = 143 } service_count = 0 user = dovecot } service imap { executable = /usr/lib/dovecot/imap } service lmtp { inet_listener lmtp { port = 24 } process_limit = 48 } service pop3-login { chroot = login executable = /usr/lib/dovecot/pop3-login inet_listener pop3 { address = * port = 110 } service_count = 0 user = dovecot } service pop3 { executable = /usr/lib/dovecot/pop3 } ssl = no userdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } protocol imap { imap_client_workarounds = tb-extra-mailbox-sep mail_plugins = acl } protocol lmtp { mail_plugins = acl } protocol pop3 { pop3_uidl_format = %08Xu%08Xv } protocol lda { mail_plugins = acl } -- Karol Jurak

2 2

Re: [Dovecot] Imap process crash: assertion failed: (full_fs_access)
by Joseph Tam 13 Feb '13

13 Feb '13

Timo Sirainen <tss(a)iki.fi> writes: > > Any guess at what would cause this? > > > > Feb 7 21:20:53 server dovecot: imap(user): Panic: file > > mailbox-list-fs-iter.c: line 447 (fs_list_get_roots): assertion > > failed: (full_fs_access) > > LIST command that had invalid parameters that somehow got through the > first validity check. What namespace config do you have? I got more info from the user that had this problem. He reported that he was was setting up a new Email client (Nexus4 Android) and he sent me a screenshot of his setup. Everything look ordinary except perhaps the IMAP prefix set to "mail". My setup documents inform users to leave it blank, but sometimes they use "mail/", a holdover from the uw-imapd days. I provide some aliases for that, but I don't know what would happen if you leave off the trailing "/". My namespace settings as reported by dovecot -n: namespace { inbox = yes location = prefix = separator = / } (The following are aliases to keep backward compatibility) namespace { alias_for = hidden = yes list = no location = prefix = / separator = / } namespace { alias_for = hidden = yes list = no location = prefix = mail/ separator = / } namespace { alias_for = hidden = yes list = no location = prefix = ~/mail/ separator = / } namespace { alias_for = hidden = yes list = no location = prefix = ~%u/mail/ separator = / } I've asked the user to change his prefix, and he'll probably report back. Joseph Tam <jtam.home(a)gmail.com>

2 2

[Dovecot] Is there any way to mask or hide the INBOX label for Dovecot 1.2.x Shared Mailboxes?
by Jason Discount 13 Feb '13

13 Feb '13

Hello, I'm setting up a new Dovecot sever to replace an old Cyrus server, and need to keep things as consistent as possible. I have a couple local accounts, like junkmail and notjunkmail that users get shared access to, and can drop things in to train sa-update. However, when users share over junkmail's inbox, it's displayed in the hierarchy: • Other Users • junkmail • INBOX Is there any way to get junkmail's INBOX to just show up at Other Users/junkmail and not require that extra depth? • Other Users • junkmail I'm running Debian Squeeze and the standard dovecot package available therein: > # uname -a > Linux internet.digitalquay.com.au 2.6.32-5-xen-amd64 #1 SMP Sun Sep 23 13:49:30 UTC 2012 x86_64 GNU/Linux > #dovecot --version > 1.2.15 I'm running in a configuration where all mail is owned by the vmail user, due to the impression I'm under, that it's a better way if there is to be shared mailboxes. Relevant bits of dovecot -n: > mail_uid: vmail > mail_gid: vmail > mail_location: maildir:/var/spool/dovecot/user/%u > mail_plugins: acl imap_acl > namespace: > type: private > separator: / > inbox: yes > list: yes > subscriptions: yes > namespace: > type: shared > separator: / > prefix: Other Users/%%u/ > location: maildir:/var/spool/dovecot/user/%%u:INDEX="/var/spool/dovecot/user/%u/Other\ Users/%%u" > list: children > auth default: > passdb: > driver: ldap > args: /etc/dovecot/dovecot-ldap.conf > userdb: > driver: passwd > args: uid=vmail gid=vmail blocking=yes mail=maildir:/var/spool/dovecot/user/%u Am I barking up the wrong tree, or is this possible? Thanks, Jay

2 1

[Dovecot] Marking messages read / retaining date with Sieve
by Bret Martin 13 Feb '13

13 Feb '13

I'm trying to mark several hundred thousand messages as read as they are delivered via dovecot-lda(1). (I'm importing some mail from another format for migration purposes.) I've been able to do this with Sieve, but it has the side effect that the messages' received and saved dates are set to the current date, and Apple Mail (at least) uses one of these to display the message date. Without the Sieve filter in place, the dates are retained based on the From_ line as I would like. Does anyone know of any way I can either - retain the date when delivering using Sieve? - systematically mark a specific set of messages as read *after* delivery instead, perhaps with doveadm(1)? (even marking *everything* read would work in this particular case. I couldn't find any way to set flags with doveadm) Thanks, --Bret

2 5

[Dovecot] POLL: v2.2 to allow one mail over quota?
by Timo Sirainen 12 Feb '13

12 Feb '13

Currently if user is 1MB under quota and someone tries to deliver mail that is over 1MB, Dovecot rejects the mail. But smaller mails aren't rejected probably for days. So user might not even realize that they didn't receive one of the mails. Also having a user "almost over quota" is a rather strange state I think. So what do you think about v2.2 allowing delivery of one last mail even if it brings the user over quota? Except add a limit that if the message size is as much as the user's entire quota limit it wouldn't be added (or 50% or ..?). Also IMAP wouldn't allow this, since user would get an error anyway. I could make this also optional, but if nobody really wants to keep the old behavior there's really no point in adding the option.

20 27

[Dovecot] I can't sync with dsync and imapc
by Angel L. Mateo 12 Feb '13

12 Feb '13

Hello, I am deploying a new dovecot server to replace and old one, both of the with dovecot 2.1.9. Now I want to synchronize imap mailbox from the old to the new one. So, in my new server I run (whith a $ sudo dsync -v -D -o imapc_host="<oldserver>" -o imapc_password="<master password>" -o imapc_features=rfc822.size backup -R -f -u myuser(a)um.es imapc: doveadm(root): Debug: Loading modules from directory: /usr/lib/dovecot/modules doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/lib01_acl_plugin.so doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/lib02_lazy_expunge_plugin.so doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/lib10_quota_plugin.so doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/lib20_zlib_plugin.so doveadm(root): Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_acl_plugin.so doveadm(root): Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_deinit (this is usually intentional, so just ignore this message) doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_quota_plugin.so doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_zlib_plugin.so doveadm(root): Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_backend_rescan (this is usually intentional, so just ignore this message) doveadm(myuser(a)um.es): Debug: Added userdb setting: plugin/quota_rule=*:storage=10G doveadm(myuser(a)um.es): Debug: Effective uid=2012, gid=204, home=/home/buzones/b1/an/myuser doveadm(myuser(a)um.es): Debug: acl: No acl_shared_dict setting - shared mailbox listing is disabled doveadm(myuser(a)um.es): Debug: Quota root: name=User quota backend=dict args=:file:/home/buzones/b1/an/myuser/quota doveadm(myuser(a)um.es): Debug: Quota rule: root=User quota mailbox=* bytes=10737418240 messages=0 doveadm(myuser(a)um.es): Debug: Quota rule: root=User quota mailbox=Trash bytes=+1073741824 messages=0 doveadm(myuser(a)um.es): Debug: dict quota: user=myuser(a)um.es, uri=file:/home/buzones/b1/an/myuser/quota, noenforcing=0 doveadm(myuser(a)um.es): Debug: Namespace : type=private, prefix=, sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=mdbox:/home/buzones/b1/an/myuser/mdbox:INDEX=/home/indexes/i1/an/myuser:ALT=/home/alt/a1/an/myuser doveadm(myuser(a)um.es): Debug: fs: root=/home/buzones/b1/an/myuser/mdbox, index=/home/indexes/i1/an/myuser, control=, inbox=, alt=/home/alt/a1/an/myuser doveadm(myuser(a)um.es): Debug: Namespace : Using permissions from /home/buzones/b1/an/myuser/mdbox: mode=0700 gid=-1 doveadm(myuser(a)um.es): Debug: acl: initializing backend with data: vfile doveadm(myuser(a)um.es): Debug: acl: acl username = myuser(a)um.es doveadm(myuser(a)um.es): Debug: acl: owner = 1 doveadm(myuser(a)um.es): Debug: acl vfile: Global ACL directory: (none) doveadm(myuser(a)um.es): Debug: Namespace : type=private, prefix=BORRADOS., sep=., inbox=no, hidden=yes, list=no, subscriptions=yes location=mdbox:/home/buzones/b1/an/myuser/expunged doveadm(myuser(a)um.es): Debug: fs: root=/home/buzones/b1/an/myuser/expunged, index=, control=, inbox=, alt= doveadm(myuser(a)um.es): Debug: Namespace BORRADOS.: Using permissions from /home/buzones/b1/an/myuser/expunged: mode=0700 gid=-1 doveadm(myuser(a)um.es): Debug: acl: initializing backend with data: vfile doveadm(myuser(a)um.es): Debug: acl: acl username = myuser(a)um.es doveadm(myuser(a)um.es): Debug: acl: owner = 1 doveadm(myuser(a)um.es): Debug: acl vfile: Global ACL directory: (none) dsync(myuser(a)um.es): Debug: Effective uid=2012, gid=204, home=/home/buzones/b1/an/myuser dsync(myuser(a)um.es): Debug: acl: No acl_shared_dict setting - shared mailbox listing is disabled dsync(myuser(a)um.es): Debug: Quota root: name=User quota backend=dict args=:file:/home/buzones/b1/an/myuser/quota dsync(myuser(a)um.es): Debug: Quota rule: root=User quota mailbox=* bytes=10737418240 messages=0 dsync(myuser(a)um.es): Debug: Quota rule: root=User quota mailbox=Trash bytes=+1073741824 messages=0 dsync(myuser(a)um.es): Debug: dict quota: user=myuser(a)um.es, uri=file:/home/buzones/b1/an/myuser/quota, noenforcing=0 dsync(myuser(a)um.es): Debug: Namespace : type=private, prefix=, sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=imapc: dsync(myuser(a)um.es): Debug: imapc: root=, index=, control=, inbox=, alt= dsync(myuser(a)um.es): Debug: imapc(myotis30.um.es:143): Looking up IP address dsync(myuser(a)um.es): Debug: imapc(myotis30.um.es:143): Connecting to 155.54.211.169:143 dsync(myuser(a)um.es): Debug: imapc(myotis30.um.es:143): Server capabilities: IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN dsync(myuser(a)um.es): Debug: imapc(myotis30.um.es:143): Authenticating as master for user myuser(a)um.es dsync(myuser(a)um.es): Debug: imapc(myotis30.um.es:143): Server capabilities: IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE QUOTA ACL RIGHTS=texk dsync(myuser(a)um.es): Debug: imapc(myotis30.um.es:143): Authenticated successfully dsync(myuser(a)um.es): Debug: acl: initializing backend with data: vfile dsync(myuser(a)um.es): Debug: acl: acl username = myuser(a)um.es dsync(myuser(a)um.es): Debug: acl: owner = 1 dsync(myuser(a)um.es): Debug: acl vfile: Global ACL directory: (none) dsync(myuser(a)um.es): Debug: Namespace : type=private, prefix=BORRADOS., sep=., inbox=no, hidden=yes, list=no, subscriptions=yes location=mdbox:/home/buzones/b1/an/myuser/expunged dsync(myuser(a)um.es): Debug: fs: root=/home/buzones/b1/an/myuser/expunged, index=, control=, inbox=, alt= dsync(myuser(a)um.es): Debug: Namespace BORRADOS.: Using permissions from /home/buzones/b1/an/myuser/expunged: mode=0700 gid=-1 dsync(myuser(a)um.es): Debug: acl: initializing backend with data: vfile dsync(myuser(a)um.es): Debug: acl: acl username = myuser(a)um.es dsync(myuser(a)um.es): Debug: acl: owner = 1 dsync(myuser(a)um.es): Debug: acl vfile: Global ACL directory: (none) dsync(myuser(a)um.es): Debug: acl vfile: file /home/buzones/b1/an/myuser/mdbox/mailboxes/dovecot-acl not found dsync(myuser(a)um.es): Error: Failed to sync mailbox INBOX: Internal error occurred. Refer to server log for more information. [2013-02-12 13:52:29] dsync(myuser(a)um.es): Debug: acl vfile: file /home/buzones/b1/an/myuser/mdbox/mailboxes/INBOX/dbox-Mails/dovecot-acl not found dsync(myuser(a)um.es): Error: Can't delete mailbox INBOX: INBOX can't be deleted. dsync(myuser(a)um.es): Info: INBOX: only in dest (guid=edd76012063b1a5138270000a9061514) dsync(myuser(a)um.es): Error: Trying to open a non-listed mailbox with guid=edd76012063b1a5138270000a9061514 dsync(myuser(a)um.es): Error: msg iteration failed: Couldn't open mailbox edd76012063b1a5138270000a9061514 dsync(myuser(a)um.es): Error: Trying to open a non-listed mailbox with guid=edd76012063b1a5138270000a9061514 dsync(myuser(a)um.es): Debug: imapc(myotis30.um.es:143): Disconnected In the old server I get the error: Feb 12 13:52:29 myotis30 dovecot: imap(myuser(a)um.es): Error: Failed to autocreate mailbox INBOX: Permission denied Feb 12 13:52:29 myotis30 dovecot: imap(myuser(a)um.es): Debug: acl: Mailbox not in dovecot-acl-list: Archives Feb 12 13:52:29 myotis30 dovecot: imap(myuser(a)um.es): Debug: acl: Mailbox not in dovecot-acl-list: Archives.2012 Feb 12 13:52:29 myotis30 dovecot: imap(myuser(a)um.es): Debug: acl: Mailbox not in dovecot-acl-list: Sent Items So it seems dsync is trying to create a mailbox in the original server. What am I doing wrong? -- Angel L. Mateo Martínez Sección de Telemática Área de Tecnologías de la Información y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868889150 Fax: 868888337

1 0

[Dovecot] Migration to Gmail ...
by Frank Bonnet 12 Feb '13

12 Feb '13

Hello Anyone has migrated Dovecot IMAP only mailboxes server to GMAIL ? We use MBOX format. Any feedback welcome ... Thanks you

3 2