February 2013 - dovecot

[Dovecot] dsync 2.1.10 does not correctly handle renames of mailbox subtrees
by Karol Jurak 13 Feb '13

13 Feb '13

Hi, It seems that dsync 2.1.10 does not correctly handle renames of mailbox subtrees. The scenario is as follows. There are two servers, A and B, both running dovecot 2.1.10 and configured to use mdbox. Automatic replication between them is disabled, ie. replication plugin is not active and replicator service has process_min_avail = 0. I perform the following actions: 1. On A: doveadm mailbox create -u test_user a a/b a/b/c d 2. On A: doveadm sync -u test_user -d The result is as expected: on both A and B there are a/b/c and d mailboxes. Now I connect to A via IMAP and rename a/b to d/b. The result is as expected: on A there are a and d/b/c mailboxes. Next I execute on A 'doveadm sync -u mailstoragetest -d' and now the result is not as expected: there are a/b/c and d/b subtrees on both A and B and a/b is just a directory, ie. it does not contain dbox-Mails (the rest are proper mailboxes). dovecot.mailbox.logs have the following records appended to them: A: #2112: rename 33259783092361d18c60ba1c7cfe973c (2013-02-12 10:42:55) - this probably is the rename of a/b to d/b (recursive, ie. including children - in this case a/b/c => d/b/c) by the IMAP client #2136: rename ee2be6da91ae879476b152d7ca041f1b (1970-01-01 01:00:00) - rename of d/b/c to a/b/c by dsync (unexpected/incorrect) B: #1104: rename 33259783092361d18c60ba1c7cfe973c (1970-01-01 01:00:00) - rename of a/b to d/b (non recursive) by dsync What seems to be missing is the record in A's dovecot.mailbox.log describing the rename of a/b/c to d/b/c (or in general case the set of records describing the renames of all the children of a/b). Would appending such records allow dsync to make correct decisions as to which mailboxes and on which servers to rename? Thanks for any help. # 2.1.10: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.1 auth_master_user_separator = * auth_username_format = %Ln default_vsz_limit = 2 G dotlock_use_excl = no dsync_remote_cmd = ssh -l%{login} %{host} doveadm dsync-server -u%u -l5 log_path = /var/log/dovecot.log log_timestamp = "%Y-%m-%d %H:%M:%S " mail_access_groups = mail mail_location = mdbox:~/mdbox:ALT=/var/vmail/alt/%n mail_plugins = acl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / } passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } plugin { acl = vfile } protocols = imap lmtp pop3 service aggregator { fifo_listener replication-notify-fifo { mode = 0666 } unix_listener replication-notify { mode = 0666 } } service auth { executable = /usr/lib/dovecot/auth unix_listener auth-client { mode = 0660 } unix_listener auth-master { mode = 0600 } unix_listener auth-userdb { mode = 0666 } user = root } service dict { unix_listener dict { mode = 0666 } } service doveadm { process_min_avail = 1 service_count = 1024 } service imap-login { chroot = login executable = /usr/lib/dovecot/imap-login inet_listener imap { address = * port = 143 } service_count = 0 user = dovecot } service imap { executable = /usr/lib/dovecot/imap } service lmtp { inet_listener lmtp { port = 24 } process_limit = 48 } service pop3-login { chroot = login executable = /usr/lib/dovecot/pop3-login inet_listener pop3 { address = * port = 110 } service_count = 0 user = dovecot } service pop3 { executable = /usr/lib/dovecot/pop3 } ssl = no userdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } protocol imap { imap_client_workarounds = tb-extra-mailbox-sep mail_plugins = acl } protocol lmtp { mail_plugins = acl } protocol pop3 { pop3_uidl_format = %08Xu%08Xv } protocol lda { mail_plugins = acl } -- Karol Jurak

2 2

Re: [Dovecot] Imap process crash: assertion failed: (full_fs_access)
by Joseph Tam 13 Feb '13

13 Feb '13

Timo Sirainen <tss(a)iki.fi> writes: > > Any guess at what would cause this? > > > > Feb 7 21:20:53 server dovecot: imap(user): Panic: file > > mailbox-list-fs-iter.c: line 447 (fs_list_get_roots): assertion > > failed: (full_fs_access) > > LIST command that had invalid parameters that somehow got through the > first validity check. What namespace config do you have? I got more info from the user that had this problem. He reported that he was was setting up a new Email client (Nexus4 Android) and he sent me a screenshot of his setup. Everything look ordinary except perhaps the IMAP prefix set to "mail". My setup documents inform users to leave it blank, but sometimes they use "mail/", a holdover from the uw-imapd days. I provide some aliases for that, but I don't know what would happen if you leave off the trailing "/". My namespace settings as reported by dovecot -n: namespace { inbox = yes location = prefix = separator = / } (The following are aliases to keep backward compatibility) namespace { alias_for = hidden = yes list = no location = prefix = / separator = / } namespace { alias_for = hidden = yes list = no location = prefix = mail/ separator = / } namespace { alias_for = hidden = yes list = no location = prefix = ~/mail/ separator = / } namespace { alias_for = hidden = yes list = no location = prefix = ~%u/mail/ separator = / } I've asked the user to change his prefix, and he'll probably report back. Joseph Tam <jtam.home(a)gmail.com>

2 2

[Dovecot] Is there any way to mask or hide the INBOX label for Dovecot 1.2.x Shared Mailboxes?
by Jason Discount 13 Feb '13

13 Feb '13

Hello, I'm setting up a new Dovecot sever to replace an old Cyrus server, and need to keep things as consistent as possible. I have a couple local accounts, like junkmail and notjunkmail that users get shared access to, and can drop things in to train sa-update. However, when users share over junkmail's inbox, it's displayed in the hierarchy: • Other Users • junkmail • INBOX Is there any way to get junkmail's INBOX to just show up at Other Users/junkmail and not require that extra depth? • Other Users • junkmail I'm running Debian Squeeze and the standard dovecot package available therein: > # uname -a > Linux internet.digitalquay.com.au 2.6.32-5-xen-amd64 #1 SMP Sun Sep 23 13:49:30 UTC 2012 x86_64 GNU/Linux > #dovecot --version > 1.2.15 I'm running in a configuration where all mail is owned by the vmail user, due to the impression I'm under, that it's a better way if there is to be shared mailboxes. Relevant bits of dovecot -n: > mail_uid: vmail > mail_gid: vmail > mail_location: maildir:/var/spool/dovecot/user/%u > mail_plugins: acl imap_acl > namespace: > type: private > separator: / > inbox: yes > list: yes > subscriptions: yes > namespace: > type: shared > separator: / > prefix: Other Users/%%u/ > location: maildir:/var/spool/dovecot/user/%%u:INDEX="/var/spool/dovecot/user/%u/Other\ Users/%%u" > list: children > auth default: > passdb: > driver: ldap > args: /etc/dovecot/dovecot-ldap.conf > userdb: > driver: passwd > args: uid=vmail gid=vmail blocking=yes mail=maildir:/var/spool/dovecot/user/%u Am I barking up the wrong tree, or is this possible? Thanks, Jay

2 1

[Dovecot] Marking messages read / retaining date with Sieve
by Bret Martin 13 Feb '13

13 Feb '13

I'm trying to mark several hundred thousand messages as read as they are delivered via dovecot-lda(1). (I'm importing some mail from another format for migration purposes.) I've been able to do this with Sieve, but it has the side effect that the messages' received and saved dates are set to the current date, and Apple Mail (at least) uses one of these to display the message date. Without the Sieve filter in place, the dates are retained based on the From_ line as I would like. Does anyone know of any way I can either - retain the date when delivering using Sieve? - systematically mark a specific set of messages as read *after* delivery instead, perhaps with doveadm(1)? (even marking *everything* read would work in this particular case. I couldn't find any way to set flags with doveadm) Thanks, --Bret

2 5

[Dovecot] POLL: v2.2 to allow one mail over quota?
by Timo Sirainen 12 Feb '13

12 Feb '13

Currently if user is 1MB under quota and someone tries to deliver mail that is over 1MB, Dovecot rejects the mail. But smaller mails aren't rejected probably for days. So user might not even realize that they didn't receive one of the mails. Also having a user "almost over quota" is a rather strange state I think. So what do you think about v2.2 allowing delivery of one last mail even if it brings the user over quota? Except add a limit that if the message size is as much as the user's entire quota limit it wouldn't be added (or 50% or ..?). Also IMAP wouldn't allow this, since user would get an error anyway. I could make this also optional, but if nobody really wants to keep the old behavior there's really no point in adding the option.

20 27

[Dovecot] I can't sync with dsync and imapc
by Angel L. Mateo 12 Feb '13

12 Feb '13

Hello, I am deploying a new dovecot server to replace and old one, both of the with dovecot 2.1.9. Now I want to synchronize imap mailbox from the old to the new one. So, in my new server I run (whith a $ sudo dsync -v -D -o imapc_host="<oldserver>" -o imapc_password="<master password>" -o imapc_features=rfc822.size backup -R -f -u myuser(a)um.es imapc: doveadm(root): Debug: Loading modules from directory: /usr/lib/dovecot/modules doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/lib01_acl_plugin.so doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/lib02_lazy_expunge_plugin.so doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/lib10_quota_plugin.so doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/lib20_zlib_plugin.so doveadm(root): Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_acl_plugin.so doveadm(root): Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_deinit (this is usually intentional, so just ignore this message) doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_quota_plugin.so doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_zlib_plugin.so doveadm(root): Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_backend_rescan (this is usually intentional, so just ignore this message) doveadm(myuser(a)um.es): Debug: Added userdb setting: plugin/quota_rule=*:storage=10G doveadm(myuser(a)um.es): Debug: Effective uid=2012, gid=204, home=/home/buzones/b1/an/myuser doveadm(myuser(a)um.es): Debug: acl: No acl_shared_dict setting - shared mailbox listing is disabled doveadm(myuser(a)um.es): Debug: Quota root: name=User quota backend=dict args=:file:/home/buzones/b1/an/myuser/quota doveadm(myuser(a)um.es): Debug: Quota rule: root=User quota mailbox=* bytes=10737418240 messages=0 doveadm(myuser(a)um.es): Debug: Quota rule: root=User quota mailbox=Trash bytes=+1073741824 messages=0 doveadm(myuser(a)um.es): Debug: dict quota: user=myuser(a)um.es, uri=file:/home/buzones/b1/an/myuser/quota, noenforcing=0 doveadm(myuser(a)um.es): Debug: Namespace : type=private, prefix=, sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=mdbox:/home/buzones/b1/an/myuser/mdbox:INDEX=/home/indexes/i1/an/myuser:ALT=/home/alt/a1/an/myuser doveadm(myuser(a)um.es): Debug: fs: root=/home/buzones/b1/an/myuser/mdbox, index=/home/indexes/i1/an/myuser, control=, inbox=, alt=/home/alt/a1/an/myuser doveadm(myuser(a)um.es): Debug: Namespace : Using permissions from /home/buzones/b1/an/myuser/mdbox: mode=0700 gid=-1 doveadm(myuser(a)um.es): Debug: acl: initializing backend with data: vfile doveadm(myuser(a)um.es): Debug: acl: acl username = myuser(a)um.es doveadm(myuser(a)um.es): Debug: acl: owner = 1 doveadm(myuser(a)um.es): Debug: acl vfile: Global ACL directory: (none) doveadm(myuser(a)um.es): Debug: Namespace : type=private, prefix=BORRADOS., sep=., inbox=no, hidden=yes, list=no, subscriptions=yes location=mdbox:/home/buzones/b1/an/myuser/expunged doveadm(myuser(a)um.es): Debug: fs: root=/home/buzones/b1/an/myuser/expunged, index=, control=, inbox=, alt= doveadm(myuser(a)um.es): Debug: Namespace BORRADOS.: Using permissions from /home/buzones/b1/an/myuser/expunged: mode=0700 gid=-1 doveadm(myuser(a)um.es): Debug: acl: initializing backend with data: vfile doveadm(myuser(a)um.es): Debug: acl: acl username = myuser(a)um.es doveadm(myuser(a)um.es): Debug: acl: owner = 1 doveadm(myuser(a)um.es): Debug: acl vfile: Global ACL directory: (none) dsync(myuser(a)um.es): Debug: Effective uid=2012, gid=204, home=/home/buzones/b1/an/myuser dsync(myuser(a)um.es): Debug: acl: No acl_shared_dict setting - shared mailbox listing is disabled dsync(myuser(a)um.es): Debug: Quota root: name=User quota backend=dict args=:file:/home/buzones/b1/an/myuser/quota dsync(myuser(a)um.es): Debug: Quota rule: root=User quota mailbox=* bytes=10737418240 messages=0 dsync(myuser(a)um.es): Debug: Quota rule: root=User quota mailbox=Trash bytes=+1073741824 messages=0 dsync(myuser(a)um.es): Debug: dict quota: user=myuser(a)um.es, uri=file:/home/buzones/b1/an/myuser/quota, noenforcing=0 dsync(myuser(a)um.es): Debug: Namespace : type=private, prefix=, sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=imapc: dsync(myuser(a)um.es): Debug: imapc: root=, index=, control=, inbox=, alt= dsync(myuser(a)um.es): Debug: imapc(myotis30.um.es:143): Looking up IP address dsync(myuser(a)um.es): Debug: imapc(myotis30.um.es:143): Connecting to 155.54.211.169:143 dsync(myuser(a)um.es): Debug: imapc(myotis30.um.es:143): Server capabilities: IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN dsync(myuser(a)um.es): Debug: imapc(myotis30.um.es:143): Authenticating as master for user myuser(a)um.es dsync(myuser(a)um.es): Debug: imapc(myotis30.um.es:143): Server capabilities: IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE QUOTA ACL RIGHTS=texk dsync(myuser(a)um.es): Debug: imapc(myotis30.um.es:143): Authenticated successfully dsync(myuser(a)um.es): Debug: acl: initializing backend with data: vfile dsync(myuser(a)um.es): Debug: acl: acl username = myuser(a)um.es dsync(myuser(a)um.es): Debug: acl: owner = 1 dsync(myuser(a)um.es): Debug: acl vfile: Global ACL directory: (none) dsync(myuser(a)um.es): Debug: Namespace : type=private, prefix=BORRADOS., sep=., inbox=no, hidden=yes, list=no, subscriptions=yes location=mdbox:/home/buzones/b1/an/myuser/expunged dsync(myuser(a)um.es): Debug: fs: root=/home/buzones/b1/an/myuser/expunged, index=, control=, inbox=, alt= dsync(myuser(a)um.es): Debug: Namespace BORRADOS.: Using permissions from /home/buzones/b1/an/myuser/expunged: mode=0700 gid=-1 dsync(myuser(a)um.es): Debug: acl: initializing backend with data: vfile dsync(myuser(a)um.es): Debug: acl: acl username = myuser(a)um.es dsync(myuser(a)um.es): Debug: acl: owner = 1 dsync(myuser(a)um.es): Debug: acl vfile: Global ACL directory: (none) dsync(myuser(a)um.es): Debug: acl vfile: file /home/buzones/b1/an/myuser/mdbox/mailboxes/dovecot-acl not found dsync(myuser(a)um.es): Error: Failed to sync mailbox INBOX: Internal error occurred. Refer to server log for more information. [2013-02-12 13:52:29] dsync(myuser(a)um.es): Debug: acl vfile: file /home/buzones/b1/an/myuser/mdbox/mailboxes/INBOX/dbox-Mails/dovecot-acl not found dsync(myuser(a)um.es): Error: Can't delete mailbox INBOX: INBOX can't be deleted. dsync(myuser(a)um.es): Info: INBOX: only in dest (guid=edd76012063b1a5138270000a9061514) dsync(myuser(a)um.es): Error: Trying to open a non-listed mailbox with guid=edd76012063b1a5138270000a9061514 dsync(myuser(a)um.es): Error: msg iteration failed: Couldn't open mailbox edd76012063b1a5138270000a9061514 dsync(myuser(a)um.es): Error: Trying to open a non-listed mailbox with guid=edd76012063b1a5138270000a9061514 dsync(myuser(a)um.es): Debug: imapc(myotis30.um.es:143): Disconnected In the old server I get the error: Feb 12 13:52:29 myotis30 dovecot: imap(myuser(a)um.es): Error: Failed to autocreate mailbox INBOX: Permission denied Feb 12 13:52:29 myotis30 dovecot: imap(myuser(a)um.es): Debug: acl: Mailbox not in dovecot-acl-list: Archives Feb 12 13:52:29 myotis30 dovecot: imap(myuser(a)um.es): Debug: acl: Mailbox not in dovecot-acl-list: Archives.2012 Feb 12 13:52:29 myotis30 dovecot: imap(myuser(a)um.es): Debug: acl: Mailbox not in dovecot-acl-list: Sent Items So it seems dsync is trying to create a mailbox in the original server. What am I doing wrong? -- Angel L. Mateo Martínez Sección de Telemática Área de Tecnologías de la Información y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868889150 Fax: 868888337

1 0

[Dovecot] Migration to Gmail ...
by Frank Bonnet 11 Feb '13

11 Feb '13

Hello Anyone has migrated Dovecot IMAP only mailboxes server to GMAIL ? We use MBOX format. Any feedback welcome ... Thanks you

3 2

[Dovecot] dovecot 2.2: doveadm-server crash in latest hg
by Oli Schacher 11 Feb '13

11 Feb '13

Hi Timo With the current hg (ed5fa76f0dc7), I get a crash as soon as I append a single message to a dsync replicated mailbox. Setup is the same as in the thread "dsync replication errors" ( http://www.dovecot.org/list/dovecot/2013-January/070574.html ) Feb 11 15:01:19 doco1 dovecot: imap-login: Login: user=<user1>, method=PLAIN, rip=192.168.23.130, lip=192.168.23.61, mpid=1709, session=<roTpV3PV1wDAqBeC> Feb 11 15:01:32 doco1 dovecot: doveadm: Fatal: master: service(doveadm): child 1713 killed with signal 11 (core dumped) Feb 11 15:01:56 doco1 dovecot: doveadm: Fatal: master: service(doveadm): child 1715 killed with signal 11 (core dumped) bt full is attached. Thanks, Oli -- message transmitted on 100% recycled electrons

1 0

[Dovecot] Keyword Flags
by David Woodfall 11 Feb '13

11 Feb '13

I mostly use Mutt to read mail but today I fired up Thunderbird. I have a shell script that looks for new mail, which looks for files in cur/ and new/ ending with the server hostname or a comma. When I fired up TB it seems that all new mail has been given a flag of ,a which I gather means it matches a keyword. My questions are: How did this happen? Did TB do something strange to my mail when it fetched headers? If I change my search parameters to ',[a-z]' will this only catch new mail? Cheers -- When all you have is a Swiss Army Knife, every problem looks like email. -- Peter da Silva

3 3

[Dovecot] Disabling auth caching just from one passdb
by Angel L. Mateo 11 Feb '13

11 Feb '13

Hello, I'm using various password databases (one of them is a ldap database, which is the used for users connecting with email clients, and the other with pam, using a pam module integrated with our SSO that is used from our webmail). I would like to disable password caching in my pam database (because 'passwords' provided by our SSO are single use tokens, so caching them has no benefit), but not in the ldap. As far as I know, auth_cache_size is the option to enable caching in all databases. But, is there any option I could use to disable it in a specific password database? -- Angel L. Mateo Martínez Sección de Telemática Área de Tecnologías de la Información y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868889150 Fax: 868888337

2 1