March 2015 - dovecot - dovecot.org

IMAP ANNOTATE Extension RFC5257: priority on roadmap
by Florian Sager 27 Mar '15

27 Mar '15

Hi Timo, congrats to the merger with OX. Currently the implementation of RFC 5257, ANNOTATE-EXPERIMENT-1, has only low priority on http://wiki2.dovecot.org/Roadmap I want to explain a scenario that would benefit from annotation support to - maybe - increase the priority in your roadmap: I'm currently working on a project to publish bank customer related documents inside a banking webinterface (they call it 'postbox'). There are different requirements that would be satisfied very well by an IMAP server as data storage/provider for a long term email/document archive inside the bank. Annotations would be necessary to tag emails with customer numbers and document IDs to allow a delayed grouping of several emails by such identifiers (message IDs may not be available for references so annotations have to be used to compute references indirectly). Same for sorting and filtering by customer number or account number. I would highly appreciate if you at Dovecot could increase the priority of ANNOTATE in your roadmap. Best regards, Florian -- Agitos GmbH Emil-Geis-Straße 40 D-81379 München Telefon: +49-89-381 564 46-0 Telefax: +49-89-381 564 46-9 E-Mail: support(a)agitos.de Web: http://www.agitos.de Registergericht: Amtsgericht München, HRB 213590 Geschäftsführer: Dipl.-Inf. (Univ.) Florian Sager Ust-Identifikationsnummer: DE296114074

3 2

Re: Option to not add "Received" header ?
by G H 27 Mar '15

27 Mar '15

You could remove them with sieve in the latest version of pigeonhole. On Mar 24, 2015 7:33 AM, Florent B <florent(a)coppint.com> wrote: > > I know about RFC's, but that could be an option, not enabled by default.

2 1

Error "Next message unexpectedly lost from mbox file"
by BehrensM 26 Mar '15

26 Mar '15

Hi, i am the new one;) - and my first post is about a problem i ran into. I installed a mailserver on a RaspberryPi. It works mostly well, using dovecot 2.1.7. (exim4 4.8 (not in use, smtp direct to Provider), fetchmail 6.3.21, RasPi 3.12.28+, Roundcube (no version known) - the whole system went through an apg-get update/uppgrade this night to look if a known problem already been fixed. When getting bigger Attachments (not sure if it occurs by smaller too, but bigger attachments are normally "to open" and often fail) Not all of them, but much. Unpredictable when it occurs. These Attachments are shown with less size in the Mailclient (Thunderbird actual version). In Roundcube they are shown to small, too. But it looks as the mail IS "fullsized" on the lokal Mailserver: When i use Roundcube and try to open an x00kB .zip, Roundcube starts to get the whole xyMB (real size) .zip-file, even when disconnected from internet. Thunderbird behaves different, doesnt load the full file, so "ignore" is no option;) And yes, i always dont like that option:) Beside the lokal mailserver-account(s) there is/are pulled Mails via imap direct from the mailprovider, the "old" solution which shall be replaced by the new mailserver. imap direct from provider shows the mails/Attachments in corrects size an opening works. Only using the local mailserver fails. In the log-files i found (i quote a part in which - cronjob matching - one of these defect mails was pulled): In Syslog: Mar 26 09:40:01 raspberrypi /USR/SBIN/CRON[26696]: (info) CMD (/usr/bin/fetchmail -s --fetchsizelimit 0 --fetchlimit 0 --limit 0 --timeout 300) Mar 26 09:40:05 raspberrypi dovecot: imap(info): Error: Next message unexpectedly lost from mbox file /home/info/mail/.INBOX at 1066141935 (cached) Mar 26 09:40:05 raspberrypi dovecot: imap(info): Error: read(/home/info/mail/.INBOX) failed: Invalid argument (FETCH for mailbox INBOX UID 1247) Mar 26 09:40:05 raspberrypi dovecot: imap(info): Disconnected: Internal error occurred. Refer to server log for more information. [2015-03-26 09:40:05] in= 2693 out=172626 Mar 26 09:40:07 raspberrypi dovecot: imap(info): Panic: file mbox-sync.c: line 1286 (mbox_sync_handle_eof_updates): assertion failed: (trailer_size <= 2) Mar 26 09:40:07 raspberrypi dovecot: imap(info): Fatal: master: service(imap): child 26341 killed with signal 6 (core dumps disabled) Mar 26 09:40:51 raspberrypi dovecot: imap-login: Login: user=<info>, method=PLAIN, rip=192.168.100.27, lip=192.168.100.199, mpid=26723, TLS, session=<hbkg+ SwS3gDAqGQb> Mar 26 09:42:16 raspberrypi dovecot: imap(info): Connection closed in=752 out=21810 And in mail.err: Mar 26 09:40:05 raspberrypi dovecot: imap(info): Error: Next message unexpectedly lost from mbox file /home/info/mail/.INBOX at 1066141935 (cached) Mar 26 09:40:05 raspberrypi dovecot: imap(info): Error: read(/home/info/mail/.INBOX) failed: Invalid argument (FETCH for mailbox INBOX UID 1247) Mar 26 09:40:07 raspberrypi dovecot: imap(info): Panic: file mbox-sync.c: line 1286 (mbox_sync_handle_eof_updates): assertion failed: (trailer_size <= 2) Mar 26 09:40:07 raspberrypi dovecot: imap(info): Fatal: master: service(imap): child 26341 killed with signal 6 (core dumps disabled) (To tell the whole story: /home/$user/mail is link by NFS to a NAS. The limit 0 and timeout entries are just to test after running into the error and before i discovered that not fetchmail but dovecot looks to cause the problem) In the archive i only found an issue in 2010 with a CR/LF-problem, but it is a) a long time ago an b) i am not sure that my specific problem comes from the same direction. http://www.dovecot.org/list/dovecot/2010-November/054938.html Any suggestions how to solve that problem? Thanks.

1 0

Lazy_expunge issue...
by giorgio paolucci 26 Mar '15

26 Mar '15

Hello everybody, I have a question about lazy_expunge plugin. I set up Dovecot with lazy_expunge plugin on a Debian Wheezy machine; I setup also a global acl to keep .expunged namespace readonly for all users. Imap client is Horde Webmail Edition 5.2.3 When I try to delete folders containing subfolders, lazy_expunge copies into expunged private namespace only the upper level folder. The subfolder and all messages inside it are lost. Quota is also corrupted (subfolder messages are still accounted in the Message counter and disk quota) and a recalc is needed to fix. Problem can be reproduced this way: 1)Create with horde a folder "extern" 2)Create a subfolder "extern/subfolder" 3) copy some messages into extern and some into subfolder (in my test 5 messages each) 4) verify quota usage: root@gold:# doveadm quota get -u testimap2.csia(a)unipd.it Quota name Type Value Limit % User quota STORAGE 4 1126400 0 User quota MESSAGE 10 - 0 3)Delete extern with option to delete all subfolders. 4)verify that all folders and messages have been deleted 5)verify that only extern folder has been copied into .expunged namespace and verify that quota still reports the 5 messages that were in subfolder: root@gold:# doveadm quota get -u testimap2.csia(a)unipd.it Quota name Type Value Limit % User quota STORAGE 2 1126400 0 User quota MESSAGE 5 - 0 6) recalc quota and check again that quota has benne corrected: # doveadm quota recalc -u testimap2.csia(a)unipd.it root@gold:# doveadm quota get -u testimap2.csia(a)unipd.it Quota name Type Value Limit % User quota STORAGE 0 1126400 0 User quota MESSAGE 0 - 0 Is there anything I am missing? Thanks in advance. Best regards. Giorgio Paolucci ================================================ dovecot version 2.2.13 OS :Linux bronze 3.2.0-4-amd64 #1 SMP Debian 3.2.65-1+deb7u1 x86_64 GNU/Linux ================================================= root@bronze:/etc/dovecot/conf.d# more ../dovecot-acl _PostaCancellataPerErrore* owner lrik ================================================= root@bronze:/etc/dovecot/conf.d# dovecot -n # 2.2.13: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.8 auth_default_realm = unipd.it disable_plaintext_auth = no log_path = /var/log/dovecot/dovecot.log mail_debug = yes mail_fsync = always mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = quota listescape lazy_expunge acl mail_log notify mdbox_rotate_interval = 1 days mdbox_rotate_size = 10 M mmap_disable = yes namespace { hidden = no inbox = no list = yes location = maildir:/SYSTEM/USERS/mailbox/%d/%1n/%u/expunged mailbox .LEGGIMI { auto = subscribe } mailbox INBOX.Trash { auto = subscribe special_use = \Trash } prefix = _PostaCancellataPerErrore/ separator = / subscriptions = yes type = private } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / } passdb { args = /etc/dovecot/conf.d/dovecot-sql.conf.ext driver = sql } passdb { args = /etc/dovecot/conf.d/dovecot-sqlSSO.conf.ext driver = sql } plugin { acl = vfile:/etc/dovecot/dovecot-acl lazy_expunge = _PostaCancellataPerErrore/ lazy_expunge_only_last_instance = yes mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size pop3_migration_mailbox = INBOX quota = dict:User quota::file:/SYSTEM/USERS/homes/%d/%1u/%u/%u.quota quota_rule = *:storage=1100M quota_rule2 = Trash:storage=+100M quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } pop3c_host = 147.162.10.68 protocols = imap pop3 lmtp service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0600 user = vmail } } service imap-login { inet_listener imaps { ssl = no } process_min_avail = 20 service_count = 1 } service imap { executable = imap postlogin } service lmtp { executable = lmtp inet_listener lmtp { port = 2223 } process_min_avail = 15 } service pop3-login { inet_listener pop3s { ssl = no } } service postlogin { executable = script-login -d rawlog user = vmail } service quota-warning { executable = script /SYSTEM/DOVECOT/scripts/quota-warning.sh unix_listener quota-warning { user = vmail } user = vmail } ssl = no userdb { driver = prefetch } userdb { args = /etc/dovecot/conf.d/dovecot-sql.conf.ext driver = sql } userdb { driver = prefetch } userdb { args = /etc/dovecot/conf.d/dovecot-sqlSSO.conf.ext driver = sql } protocol lmtp { info_log_path = /tmp/dovecot-lmtp-info.log log_path = /tmp/dovecot-lmtp.log mail_plugins = quota listescape lazy_expunge acl mail_log notify } protocol imap { imap_max_line_length = 128 k mail_plugins = quota listescape lazy_expunge acl mail_log notify imap_quota acl imap_acl } protocol doveadm { mail_plugins = quota listescape lazy_expunge acl mail_log notify pop3_migration } protocol pop3 { pop3_no_flag_updates = yes pop3_uidl_format = %10v.%09u } =================================== root@gold:# doveadm user -u testimap2.csia(a)unipd.it userdb: testimap2.csia(a)unipd.it uid : 1003 gid : 1003 home : /SYSTEM/USERS/homes/unipd.it/t/testimap2.csia(a)unipd.it mail : sdbox:/NAS1/unipd.it/mailbox/t/testimap2.csia@unipd.it/sdbox:INDEX=/INDEX1/unipd.it/t/testimap2.csia@unipd.it:ALT=/ALTSTORAGE1/unipd.it/t/testimap2.csia@unipd.it ------------------------------- Here follows IMAP transaction in and out from rawlog IN: 2 ENABLE QRESYNC 3 NAMESPACE 4 LIST () "" (extern/*) 5 DELETE extern 6 UNSUBSCRIBE extern 7 DELETE extern/subfolder 8 UNSUBSCRIBE extern/subfolder 9 LOGOUT OUT: root@gold:/SYSTEM/USERS/homes/unipd.it/t/testimap2.csia@unipd.it/dovecot.rawlog# more 20150326-095943-1773.out 1 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=OR DEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARC H ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE BINARY MOVE QUOTA ACL RIGHTS=texk] Logged in * ENABLED QRESYNC 2 OK Enabled. * NAMESPACE (("" "/")("_PostaCancellataPerErrore/" "/")) NIL NIL 3 OK Namespace completed. * LIST () "/" extern/subfolder 4 OK List completed. 5 OK Delete completed. 6 OK Unsubscribe completed. 7 OK Delete completed. 8 OK Unsubscribe completed. * BYE Logging out 9 OK Logout completed. ================================== Here follows debug log from dovecot. Mar 26 09:59:43 imap-login: Info: Login: user=<testimap2.csia(a)unipd.it>, method=PLAIN, rip=147.162.10.141, lip=147.162.10.84, mpid=1771, session=<DXefPC0SWQCTogqN> Mar 26 09:59:43 script-login: Debug: Added userdb setting: mail_location=sdbox:/NAS1/unipd.it/mailbox/t/testimap2.csia@unipd.it/sdbox:INDEX=/INDEX1/unipd.it/t/testimap2.csia@unipd.it:ALT=/ALTSTORAGE1/unipd.it/t/testimap2.csia@unipd.it Mar 26 09:59:43 imap: Debug: Loading modules from directory: /usr/lib/dovecot/modules Mar 26 09:59:43 imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib01_acl_plugin.so Mar 26 09:59:43 imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib02_imap_acl_plugin.so Mar 26 09:59:43 imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib02_lazy_expunge_plugin.so Mar 26 09:59:43 imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib10_quota_plugin.so Mar 26 09:59:43 imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib11_imap_quota_plugin.so Mar 26 09:59:43 imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib15_notify_plugin.so Mar 26 09:59:43 imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_listescape_plugin.so Mar 26 09:59:43 imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_mail_log_plugin.so Mar 26 09:59:43 imap: Debug: Added userdb setting: mail_location=sdbox:/NAS1/unipd.it/mailbox/t/testimap2.csia@unipd.it/sdbox:INDEX=/INDEX1/unipd.it/t/testimap2.csia@unipd.it:ALT=/ALTSTORAGE1/unipd.it/t/testimap2.csia@unipd.it Mar 26 09:59:43 imap(testimap2.csia(a)unipd.it): Debug: Effective uid=1003, gid=1003, home=/SYSTEM/USERS/homes/unipd.it/t/testimap2.csia(a)unipd.it Mar 26 09:59:43 imap(testimap2.csia(a)unipd.it): Debug: acl: No acl_shared_dict setting - shared mailbox listing is disabled Mar 26 09:59:43 imap(testimap2.csia(a)unipd.it): Debug: Quota root: name=User quota backend=dict args=:file:/SYSTEM/USERS/homes/unipd.it/t/testimap2.csia@unipd.it/testimap2.csia@unipd.it.quota Mar 26 09:59:43 imap(testimap2.csia(a)unipd.it): Debug: Quota rule: root=User quota mailbox=* bytes=1153433600 messages=0 Mar 26 09:59:43 imap(testimap2.csia(a)unipd.it): Debug: Quota rule: root=User quota mailbox=Trash bytes=+104857600 messages=0 Mar 26 09:59:43 imap(testimap2.csia(a)unipd.it): Debug: Quota warning: bytes=1095761920 (95%) messages=0 reverse=no command=quota-warning 95 testimap2.csia(a)unipd.it Mar 26 09:59:43 imap(testimap2.csia(a)unipd.it): Debug: Quota warning: bytes=922746880 (80%) messages=0 reverse=no command=quota-warning 80 testimap2.csia(a)unipd.it Mar 26 09:59:43 imap(testimap2.csia(a)unipd.it): Debug: Quota grace: root=User quota bytes=115343360 (10%) Mar 26 09:59:43 imap(testimap2.csia(a)unipd.it): Debug: dict quota: user=testimap2.csia(a)unipd.it, uri=file:/SYSTEM/USERS/homes/unipd.it/t/testimap2.csia@unipd.it/testimap2.csia@unipd.it.quota, noenforcing=0 Mar 26 09:59:43 imap(testimap2.csia(a)unipd.it): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=sdbox:/NAS1/unipd.it/mailbox/t/testimap2.csia@unipd.it/sdbox:INDEX=/INDEX1/unipd.it/t/testimap2.csia@unipd.it:ALT=/ALTSTORAGE1/unipd.it/t/testimap2.csia@unipd.it Mar 26 09:59:43 imap(testimap2.csia(a)unipd.it): Debug: fs: root=/NAS1/unipd.it/mailbox/t/testimap2.csia(a)unipd.it/sdbox, index=/INDEX1/unipd.it/t/testimap2.csia(a)unipd.it, indexpvt=, control=, inbox=, alt=/ALTSTORAGE1/unipd.it/t/testimap2.csia(a)unipd.it Mar 26 09:59:43 imap(testimap2.csia(a)unipd.it): Debug: acl: initializing backend with data: vfile:/etc/dovecot/dovecot-acl Mar 26 09:59:43 imap(testimap2.csia(a)unipd.it): Debug: acl: acl username = testimap2.csia(a)unipd.it Mar 26 09:59:43 imap(testimap2.csia(a)unipd.it): Debug: acl: owner = 1 Mar 26 09:59:43 imap(testimap2.csia(a)unipd.it): Debug: acl vfile: Global ACL file: /etc/dovecot/dovecot-acl Mar 26 09:59:43 imap(testimap2.csia(a)unipd.it): Debug: Namespace : type=private, prefix=_PostaCancellataPerErrore/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=yes location=maildir:/SYSTEM/USERS/mailbox/unipd.it/t/testimap2.csia@unipd.it/expunged Mar 26 09:59:43 imap(testimap2.csia(a)unipd.it): Debug: maildir++: root=/SYSTEM/USERS/mailbox/unipd.it/t/testimap2.csia(a)unipd.it/expunged, index=, indexpvt=, control=, inbox=, alt= Mar 26 09:59:43 imap(testimap2.csia(a)unipd.it): Debug: acl: initializing backend with data: vfile:/etc/dovecot/dovecot-acl Mar 26 09:59:43 imap(testimap2.csia(a)unipd.it): Debug: acl: acl username = testimap2.csia(a)unipd.it Mar 26 09:59:43 imap(testimap2.csia(a)unipd.it): Debug: acl: owner = 1 Mar 26 09:59:43 imap(testimap2.csia(a)unipd.it): Debug: acl vfile: Global ACL file: /etc/dovecot/dovecot-acl Mar 26 09:59:43 imap(testimap2.csia(a)unipd.it): Debug: acl vfile: file /NAS1/unipd.it/mailbox/t/testimap2.csia(a)unipd.it/sdbox/mailboxes/dovecot-acl not found Mar 26 09:59:43 imap(testimap2.csia(a)unipd.it): Debug: acl vfile: file /NAS1/unipd.it/mailbox/t/testimap2.csia@unipd.it/sdbox/mailboxes/extern/subfolder/dbox-Mails/dovecot-acl not found Mar 26 09:59:43 imap(testimap2.csia(a)unipd.it): Debug: acl vfile: file /NAS1/unipd.it/mailbox/t/testimap2.csia(a)unipd.it/sdbox/mailboxes/extern/dbox-Mails/dovecot-acl not found Mar 26 09:59:43 imap(testimap2.csia(a)unipd.it): Debug: acl vfile: file /SYSTEM/USERS/mailbox/unipd.it/t/testimap2.csia(a)unipd.it/expunged/.extern/dovecot-acl not found Mar 26 09:59:43 imap(testimap2.csia(a)unipd.it): Debug: acl vfile: file /SYSTEM/USERS/mailbox/unipd.it/t/testimap2.csia(a)unipd.it/expunged/dovecot-acl not found Mar 26 09:59:43 imap(testimap2.csia(a)unipd.it): Debug: Namespace _PostaCancellataPerErrore/: /SYSTEM/USERS/mailbox/unipd.it/t/testimap2.csia(a)unipd.it/expunged/.extern doesn't exist yet, using default permissions Mar 26 09:59:43 imap(testimap2.csia(a)unipd.it): Debug: Namespace _PostaCancellataPerErrore/: Using permissions from /SYSTEM/USERS/mailbox/unipd.it/t/testimap2.csia(a)unipd.it/expunged: mode=0700 gid=default Mar 26 09:59:43 imap(testimap2.csia(a)unipd.it): Debug: acl vfile: file /SYSTEM/USERS/mailbox/unipd.it/t/testimap2.csia(a)unipd.it/expunged/dovecot-acl not found Mar 26 09:59:43 imap(testimap2.csia(a)unipd.it): Debug: acl vfile: file /SYSTEM/USERS/mailbox/unipd.it/t/testimap2.csia(a)unipd.it/expunged/.extern/dovecot-acl not found Mar 26 09:59:43 imap(testimap2.csia(a)unipd.it): Info: copy from extern: box=_PostaCancellataPerErrore/extern, uid=1, msgid=, size=523 Mar 26 09:59:43 imap(testimap2.csia(a)unipd.it): Info: copy from extern: box=_PostaCancellataPerErrore/extern, uid=2, msgid=, size=523 Mar 26 09:59:43 imap(testimap2.csia(a)unipd.it): Info: copy from extern: box=_PostaCancellataPerErrore/extern, uid=3, msgid=, size=523 Mar 26 09:59:43 imap(testimap2.csia(a)unipd.it): Info: copy from extern: box=_PostaCancellataPerErrore/extern, uid=4, msgid=, size=523 Mar 26 09:59:43 imap(testimap2.csia(a)unipd.it): Info: copy from extern: box=_PostaCancellataPerErrore/extern, uid=5, msgid=, size=524 Mar 26 09:59:43 imap(testimap2.csia(a)unipd.it): Info: expunge: box=extern, uid=1, msgid=, size=523 Mar 26 09:59:43 imap(testimap2.csia(a)unipd.it): Info: expunge: box=extern, uid=2, msgid=, size=523 Mar 26 09:59:43 imap(testimap2.csia(a)unipd.it): Info: expunge: box=extern, uid=3, msgid=, size=523 Mar 26 09:59:43 imap(testimap2.csia(a)unipd.it): Info: expunge: box=extern, uid=4, msgid=, size=523 Mar 26 09:59:43 imap(testimap2.csia(a)unipd.it): Info: expunge: box=extern, uid=5, msgid=, size=524 Mar 26 09:59:43 imap(testimap2.csia(a)unipd.it): Debug: Namespace : Using permissions from /NAS1/unipd.it/mailbox/t/testimap2.csia(a)unipd.it/sdbox: mode=0755 gid=default Mar 26 09:59:43 imap(testimap2.csia(a)unipd.it): Info: Mailbox deleted: extern Mar 26 09:59:44 imap(testimap2.csia(a)unipd.it): Info: Mailbox deleted: extern/subfolder Mar 26 09:59:44 imap(testimap2.csia(a)unipd.it): Info: Disconnected: Logged out in=162 out=704 Mar 26 09:59:44 imap-login: Info: Login: user=<testimap2.csia(a)unipd.it>, method=PLAIN, rip=147.162.10.141, lip=147.162.10.84, mpid=1778, session=<vUqqPC0SXACTogqN> Mar 26 09:59:44 script-login: Debug: Added userdb setting: mail_location=sdbox:/NAS1/unipd.it/mailbox/t/testimap2.csia@unipd.it/sdbox:INDEX=/INDEX1/unipd.it/t/testimap2.csia@unipd.it:ALT=/ALTSTORAGE1/unipd.it/t/testimap2.csia@unipd.it Mar 26 09:59:44 imap: Debug: Loading modules from directory: /usr/lib/dovecot/modules Mar 26 09:59:44 imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib01_acl_plugin.so Mar 26 09:59:44 imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib02_imap_acl_plugin.so Mar 26 09:59:44 imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib02_lazy_expunge_plugin.so Mar 26 09:59:44 imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib10_quota_plugin.so Mar 26 09:59:44 imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib11_imap_quota_plugin.so Mar 26 09:59:44 imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib15_notify_plugin.so Mar 26 09:59:44 imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_listescape_plugin.so Mar 26 09:59:44 imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_mail_log_plugin.so Mar 26 09:59:44 imap: Debug: Added userdb setting: mail_location=sdbox:/NAS1/unipd.it/mailbox/t/testimap2.csia@unipd.it/sdbox:INDEX=/INDEX1/unipd.it/t/testimap2.csia@unipd.it:ALT=/ALTSTORAGE1/unipd.it/t/testimap2.csia@unipd.it Mar 26 09:59:44 imap(testimap2.csia(a)unipd.it): Debug: Effective uid=1003, gid=1003, home=/SYSTEM/USERS/homes/unipd.it/t/testimap2.csia(a)unipd.it Mar 26 09:59:44 imap(testimap2.csia(a)unipd.it): Debug: acl: No acl_shared_dict setting - shared mailbox listing is disabled Mar 26 09:59:44 imap(testimap2.csia(a)unipd.it): Debug: Quota root: name=User quota backend=dict args=:file:/SYSTEM/USERS/homes/unipd.it/t/testimap2.csia@unipd.it/testimap2.csia@unipd.it.quota Mar 26 09:59:44 imap(testimap2.csia(a)unipd.it): Debug: Quota rule: root=User quota mailbox=* bytes=1153433600 messages=0 Mar 26 09:59:44 imap(testimap2.csia(a)unipd.it): Debug: Quota rule: root=User quota mailbox=Trash bytes=+104857600 messages=0 Mar 26 09:59:44 imap(testimap2.csia(a)unipd.it): Debug: Quota warning: bytes=1095761920 (95%) messages=0 reverse=no command=quota-warning 95 testimap2.csia(a)unipd.it Mar 26 09:59:44 imap(testimap2.csia(a)unipd.it): Debug: Quota warning: bytes=922746880 (80%) messages=0 reverse=no command=quota-warning 80 testimap2.csia(a)unipd.it Mar 26 09:59:44 imap(testimap2.csia(a)unipd.it): Debug: Quota grace: root=User quota bytes=115343360 (10%) Mar 26 09:59:44 imap(testimap2.csia(a)unipd.it): Debug: dict quota: user=testimap2.csia(a)unipd.it, uri=file:/SYSTEM/USERS/homes/unipd.it/t/testimap2.csia@unipd.it/testimap2.csia@unipd.it.quota, noenforcing=0 Mar 26 09:59:44 imap(testimap2.csia(a)unipd.it): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=sdbox:/NAS1/unipd.it/mailbox/t/testimap2.csia@unipd.it/sdbox:INDEX=/INDEX1/unipd.it/t/testimap2.csia@unipd.it:ALT=/ALTSTORAGE1/unipd.it/t/testimap2.csia@unipd.it Mar 26 09:59:44 imap(testimap2.csia(a)unipd.it): Debug: fs: root=/NAS1/unipd.it/mailbox/t/testimap2.csia(a)unipd.it/sdbox, index=/INDEX1/unipd.it/t/testimap2.csia(a)unipd.it, indexpvt=, control=, inbox=, alt=/ALTSTORAGE1/unipd.it/t/testimap2.csia(a)unipd.it Mar 26 09:59:44 imap(testimap2.csia(a)unipd.it): Debug: acl: initializing backend with data: vfile:/etc/dovecot/dovecot-acl Mar 26 09:59:44 imap(testimap2.csia(a)unipd.it): Debug: acl: acl username = testimap2.csia(a)unipd.it Mar 26 09:59:44 imap(testimap2.csia(a)unipd.it): Debug: acl: owner = 1 Mar 26 09:59:44 imap(testimap2.csia(a)unipd.it): Debug: acl vfile: Global ACL file: /etc/dovecot/dovecot-acl Mar 26 09:59:44 imap(testimap2.csia(a)unipd.it): Debug: Namespace : type=private, prefix=_PostaCancellataPerErrore/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=yes location=maildir:/SYSTEM/USERS/mailbox/unipd.it/t/testimap2.csia@unipd.it/expunged Mar 26 09:59:44 imap(testimap2.csia(a)unipd.it): Debug: maildir++: root=/SYSTEM/USERS/mailbox/unipd.it/t/testimap2.csia(a)unipd.it/expunged, index=, indexpvt=, control=, inbox=, alt= Mar 26 09:59:44 imap(testimap2.csia(a)unipd.it): Debug: acl: initializing backend with data: vfile:/etc/dovecot/dovecot-acl Mar 26 09:59:44 imap(testimap2.csia(a)unipd.it): Debug: acl: acl username = testimap2.csia(a)unipd.it Mar 26 09:59:44 imap(testimap2.csia(a)unipd.it): Debug: acl: owner = 1 Mar 26 09:59:44 imap(testimap2.csia(a)unipd.it): Debug: acl vfile: Global ACL file: /etc/dovecot/dovecot-acl Mar 26 09:59:44 imap(testimap2.csia(a)unipd.it): Debug: acl vfile: file /NAS1/unipd.it/mailbox/t/testimap2.csia(a)unipd.it/sdbox/mailboxes/INBOX/dbox-Mails/dovecot-acl not found Mar 26 09:59:44 imap(testimap2.csia(a)unipd.it): Info: Disconnected: Logged out in=77 out=1009 Mar 26 10:01:50 imap(testimap2.csia(a)unipd.it): Debug: acl vfile: file /SYSTEM/USERS/mailbox/unipd.it/t/testimap2.csia(a)unipd.it/expunged/.INBOX\2eTrash/dovecot-acl not found Mar 26 10:01:51 imap(testimap2.csia(a)unipd.it): Debug: acl vfile: file /SYSTEM/USERS/mailbox/unipd.it/t/testimap2.csia(a)unipd.it/expunged/.\2eLEGGIMI/dovecot-acl not found Mar 26 10:01:51 imap(testimap2.csia(a)unipd.it): Debug: acl vfile: file /NAS1/unipd.it/mailbox/t/testimap2.csia(a)unipd.it/sdbox/mailboxes/INBOX.Trash/dbox-Mails/dovecot-acl not found Mar 26 10:01:51 imap-login: Info: Login: user=<testimap2.csia(a)unipd.it>, method=PLAIN, rip=147.162.200.67, lip=147.162.10.86, mpid=2474, session=<VWBCRC0SugCToshD> Mar 26 10:01:51 script-login: Debug: Added userdb setting: mail_location=sdbox:/NAS1/unipd.it/mailbox/t/testimap2.csia@unipd.it/sdbox:INDEX=/INDEX1/unipd.it/t/testimap2.csia@unipd.it:ALT=/ALTSTORAGE1/unipd.it/t/testimap2.csia@unipd.it Mar 26 10:01:51 imap: Debug: Loading modules from directory: /usr/lib/dovecot/modules Mar 26 10:01:51 imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib01_acl_plugin.so Mar 26 10:01:51 imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib02_imap_acl_plugin.so Mar 26 10:01:51 imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib02_lazy_expunge_plugin.so Mar 26 10:01:51 imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib10_quota_plugin.so Mar 26 10:01:51 imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib11_imap_quota_plugin.so Mar 26 10:01:51 imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib15_notify_plugin.so Mar 26 10:01:51 imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_listescape_plugin.so Mar 26 10:01:51 imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_mail_log_plugin.so Mar 26 10:01:51 imap: Debug: Added userdb setting: mail_location=sdbox:/NAS1/unipd.it/mailbox/t/testimap2.csia@unipd.it/sdbox:INDEX=/INDEX1/unipd.it/t/testimap2.csia@unipd.it:ALT=/ALTSTORAGE1/unipd.it/t/testimap2.csia@unipd.it Mar 26 10:01:51 imap(testimap2.csia(a)unipd.it): Debug: Effective uid=1003, gid=1003, home=/SYSTEM/USERS/homes/unipd.it/t/testimap2.csia(a)unipd.it Mar 26 10:01:51 imap(testimap2.csia(a)unipd.it): Debug: acl: No acl_shared_dict setting - shared mailbox listing is disabled Mar 26 10:01:51 imap(testimap2.csia(a)unipd.it): Debug: Quota root: name=User quota backend=dict args=:file:/SYSTEM/USERS/homes/unipd.it/t/testimap2.csia@unipd.it/testimap2.csia@unipd.it.quota Mar 26 10:01:51 imap(testimap2.csia(a)unipd.it): Debug: Quota rule: root=User quota mailbox=* bytes=1153433600 messages=0 Mar 26 10:01:51 imap(testimap2.csia(a)unipd.it): Debug: Quota rule: root=User quota mailbox=Trash bytes=+104857600 messages=0 Mar 26 10:01:51 imap(testimap2.csia(a)unipd.it): Debug: Quota warning: bytes=1095761920 (95%) messages=0 reverse=no command=quota-warning 95 testimap2.csia(a)unipd.it Mar 26 10:01:51 imap(testimap2.csia(a)unipd.it): Debug: Quota warning: bytes=922746880 (80%) messages=0 reverse=no command=quota-warning 80 testimap2.csia(a)unipd.it Mar 26 10:01:51 imap(testimap2.csia(a)unipd.it): Debug: Quota grace: root=User quota bytes=115343360 (10%) Mar 26 10:01:51 imap(testimap2.csia(a)unipd.it): Debug: dict quota: user=testimap2.csia(a)unipd.it, uri=file:/SYSTEM/USERS/homes/unipd.it/t/testimap2.csia@unipd.it/testimap2.csia@unipd.it.quota, noenforcing=0 Mar 26 10:01:51 imap(testimap2.csia(a)unipd.it): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=sdbox:/NAS1/unipd.it/mailbox/t/testimap2.csia@unipd.it/sdbox:INDEX=/INDEX1/unipd.it/t/testimap2.csia@unipd.it:ALT=/ALTSTORAGE1/unipd.it/t/testimap2.csia@unipd.it Mar 26 10:01:51 imap(testimap2.csia(a)unipd.it): Debug: fs: root=/NAS1/unipd.it/mailbox/t/testimap2.csia(a)unipd.it/sdbox, index=/INDEX1/unipd.it/t/testimap2.csia(a)unipd.it, indexpvt=, control=, inbox=, alt=/ALTSTORAGE1/unipd.it/t/testimap2.csia(a)unipd.it Mar 26 10:01:51 imap(testimap2.csia(a)unipd.it): Debug: acl: initializing backend with data: vfile:/etc/dovecot/dovecot-acl Mar 26 10:01:51 imap(testimap2.csia(a)unipd.it): Debug: acl: acl username = testimap2.csia(a)unipd.it Mar 26 10:01:51 imap(testimap2.csia(a)unipd.it): Debug: acl: owner = 1 Mar 26 10:01:51 imap(testimap2.csia(a)unipd.it): Debug: acl vfile: Global ACL file: /etc/dovecot/dovecot-acl Mar 26 10:01:51 imap(testimap2.csia(a)unipd.it): Debug: Namespace : type=private, prefix=_PostaCancellataPerErrore/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=yes location=maildir:/SYSTEM/USERS/mailbox/unipd.it/t/testimap2.csia@unipd.it/expunged Mar 26 10:01:51 imap(testimap2.csia(a)unipd.it): Debug: maildir++: root=/SYSTEM/USERS/mailbox/unipd.it/t/testimap2.csia(a)unipd.it/expunged, index=, indexpvt=, control=, inbox=, alt= Mar 26 10:01:51 imap(testimap2.csia(a)unipd.it): Debug: acl: initializing backend with data: vfile:/etc/dovecot/dovecot-acl Mar 26 10:01:51 imap(testimap2.csia(a)unipd.it): Debug: acl: acl username = testimap2.csia(a)unipd.it Mar 26 10:01:51 imap(testimap2.csia(a)unipd.it): Debug: acl: owner = 1 Mar 26 10:01:51 imap(testimap2.csia(a)unipd.it): Debug: acl vfile: Global ACL file: /etc/dovecot/dovecot-acl Mar 26 10:01:51 imap(testimap2.csia(a)unipd.it): Debug: acl vfile: file /NAS1/unipd.it/mailbox/t/testimap2.csia(a)unipd.it/sdbox/mailboxes/INBOX.Trash/dbox-Mails/dovecot-acl not found Mar 26 10:01:51 imap(testimap2.csia(a)unipd.it): Debug: acl vfile: file /NAS1/unipd.it/mailbox/t/testimap2.csia(a)unipd.it/sdbox/mailboxes/Drafts/dbox-Mails/dovecot-acl not found Mar 26 10:01:52 imap(testimap2.csia(a)unipd.it): Debug: acl vfile: file /NAS1/unipd.it/mailbox/t/testimap2.csia(a)unipd.it/sdbox/mailboxes/Spam/dbox-Mails/dovecot-acl not found Mar 26 10:01:52 imap(testimap2.csia(a)unipd.it): Debug: acl vfile: file /NAS1/unipd.it/mailbox/t/testimap2.csia(a)unipd.it/sdbox/mailboxes/Templates/dbox-Mails/dovecot-acl not found

1 0

Re: Dovecot Oy merger with Open-Xchange AG
by Patrick Coffin 25 Mar '15

25 Mar '15

To Timo and the Dovecot guys - congratulations! I'm sure this merger with OpenXchange is going to provide you with a lot of resources and opportunities. As a longtime user of dovecot, I do have a few concerns. I wonder if you can answer some questions for me. You say that OpenXchange really likes open source and shares your plans for the future. Is this a commitment that future versions core dovecot product will remain free and truly open source? According to Wikipedia (http://en.wikipedia.org/wiki/Open-Xchange#Licensing <http://en.wikipedia.org/wiki/Open-Xchange#Licensing>) , OpenXchange's backend is GPL'd, but the front-end is not - it's released under "Creative Common's Share Alike, Non Commercial, Attribution". The article points out: "The restriction to Non Commercial in the Creative Commons license for the Frontend restricts re-distribution to third parties, i.e. hosted deployments for third parties. However, since the front-end license prohibits commercial re-distribution, the software is neither free software nor open source software since the definitions of both require such re-distribution to be permitted" Do you expect that dovecot is moving in that direction? Here's why I'm asking: As a hosted email provider, I've long used dovecot, and been quite happy with it. But I have some concerns, as is common when any popular open source project gets acquired by a commercial entitiy. The current dovecot license is a mixture of the MIT and LGPL licenses. Will this remain? Or is dovecot going to go the way of OpenXchange licensing? What about other pieces of the dovecot ecosystem, such as the Object Storage plugin - will that remain closed source and proprietary? Or will you follow the lead of companies like RedHat and be truly open source? Is there a possibility that future versions of dovecot that contain what we might consider core features will be available only in the commercial version of the product? If I base a part of my business on a piece of software I've been running for the last 10 years, am I going to find myself in trouble in a year or two, when some new version of dovecot comes out with changes that I need, and I have to move to a commercial product, which I may or may not be able to afford? I'd love to hear that you're going to be following a model like RedHat did when they acquired GlusterFS and created the RedHat Storage Server. Gluster development is still going strong, and still completely open source. But they make money from people like me who know that by buying a contract, we can get the kind of support we need for such a critical part of our infrastructure. Again, congratulations and, as always, thanks for all the hard work creating dovecot in the first place. Patrick

7 13

Upgrading a dovecot director configuration?
by Will Rouesnel 25 Mar '15

25 Mar '15

Is Dovecot Director compatible across Dovecot versions? i.e. 2.0.x to 2.1.x or 2.2.x? I have a 6 host cluster in a director configuration which is getting somewhat aged, but it would be very beneficial if the director hosts could be upgraded seamlessly. Is such a thing possible, or will their be compatibility issues? Would a workaround be possible (i.e. migrate to a user system which enforces proxy destinations by another means, then do an upgrade?)

1 0

Fixing broken UTF-8 handling with MySQL driver
by Felix Zandanel 23 Mar '15

23 Mar '15

Hi, I noticed that dovecot's MySQL driver doesn't play well with UTF-8 encoded strings. I presume this issue has been around for a while. However, it still fails with the current release candidate 2.2.16-rc1. I have been using the sieve extdata plugin with a MySQL-backed dict to retrieve a folder name that is then passed to fileinto: fileinto :create "${extdata.folder_name_drafts}"; Whenever this dict returned a string with non-7byte characters, a line such as the following popped up in sieve.log. (This example query should return "Entwürfe".) error: folder name specified for fileinto command is not utf-8: Entw?rfe. Although my MySQL installation is set up to use UTF-8 as the default charset on every level (config, database, table and field), and the character_set_* runtime variables all yield the value "utf8", it still seems that the mysql client library must be instructed to actually use UTF-8 explicitly. Adding the following statement to driver_mysql_connect() fixes the issue for me: mysql_options(db->mysql, MYSQL_SET_CHARSET_NAME, "utf8"); I checked this against mysql 5.5.41. Regards, Felix

2 2

[PATCH] increase fd_limit to max_client_limit automatically
by Lauri Tirkkonen 23 Mar '15

23 Mar '15

Hi, with a low soft limit on file descriptors, dovecot 2.2.15 warns on startup: Warning: fd limit (ulimit -n) is lower than required under max. load (256 < 1000), because of default_client_limit It could try increasing the limit first, and only report the warning if that fails. I'm attaching a patch that does just this. Without the patch, the soft fd limit is kept at whatever it was on dovecot startup: % pfexec plimit $(pgrep dovecot) 18737: /opt/niksula/sbin/dovecot resource current maximum time(seconds) unlimited unlimited file(blocks) unlimited unlimited data(kbytes) unlimited unlimited stack(kbytes) 10240 unlimited coredump(blocks) unlimited unlimited nofiles(descriptors) 256 65536 vmemory(kbytes) unlimited unlimited and with patch applied, it's increased to max_client_limit: % pfexec plimit $(pgrep dovecot) 18775: /opt/niksula/sbin/dovecot resource current maximum time(seconds) unlimited unlimited file(blocks) unlimited unlimited data(kbytes) unlimited unlimited stack(kbytes) 10240 unlimited coredump(blocks) unlimited unlimited nofiles(descriptors) 1000 65536 vmemory(kbytes) unlimited unlimited It should probably be increased to higher than that to account for fds other than client sockets, but I don't have insights into that. -- Lauri Tirkkonen Niksula systems specialist

2 2

Re: fast doveadm search results
by Joseph Tam 23 Mar '15

23 Mar '15

Steffen Kaiser writes: > e.g. put message-id into mail_always_cache_fields > > - From http://dovecot.org/pipermail/dovecot-cvs/2013-May/023261.html > > lib-storage: Allow mail_*cache_fields settings to specify any hdr.* fields ... but I belatedly wrote ... > Maybe you can even add these items into the cache upon delivery, > but someone more knowlegable than I would have to help you with that. The drawback of getting thing in digest form -- you look like a boob when answering late. I defer to Steffen's superior knowledge. Joseph Tam <jtam.home(a)gmail.com>

3 3

2.2.16 link failure on FreeBSD 10.1, with patch
by Jan Mikkelsen 22 Mar '15

22 Mar '15

Hi, Compiling on FreeBSD 10.1 gives linker errors when linking test-message-snippet. The underlying problem is that libiconv appears on the actual linker line after libcharset.a, which leads to unresolved libiconv symbols. This build process worked fine with 2.2.15. The patch below to src/lib-charset/Makefile.in resolves the problem for me and seems broadly correct. libcharset.a does depend on libiconv so it should probably be declared that way. There is probably a more correct way to make the patch to Makefile.am, but I don't really use automake. Hopefully helpful to someone. Jan Mikkelsen. Patch: --- dovecot-2.2.16/src/lib-charset/Makefile.in 2015-03-13 02:41:16.000000000 +1100 +++ dovecot-2.2.16.new/src/lib-charset/Makefile.in 2015-03-21 13:58:21.951293274 +1100 @@ -92,7 +92,7 @@ CONFIG_CLEAN_FILES = CONFIG_CLEAN_VPATH_FILES = LTLIBRARIES = $(noinst_LTLIBRARIES) -libcharset_la_LIBADD = +libcharset_la_LIBADD = $(LTLIBICONV) am_libcharset_la_OBJECTS = charset-iconv.lo charset-utf8.lo libcharset_la_OBJECTS = $(am_libcharset_la_OBJECTS) AM_V_lt = $(am__v_lt_@AM_V@) Error messages: libtool: link: cc -std=gnu99 -I/usr/local/include -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -Wno-duplicate-decl-specifier -Wstrict-aliasing=2 -Wl,--as-needed -o test-message-snippet test-message-snippet.o .libs/message-snippet.o .libs/mail-html2text.o .libs/message-decoder.o .libs/quoted-printable.o .libs/rfc822-parser.o .libs/rfc2231-parser.o /usr/local/lib/libiconv.so -Wl,-rpath -Wl,/usr/local/lib .libs/message-parser.o .libs/message-header-parser.o .libs/message-header-decode.o .libs/message-size.o -L/usr/local/lib ../lib-charset/.libs/libcharset.a ../lib-test/.libs/libtest.a ../lib/.libs/liblib.a ../lib-charset/.libs/libcharset.a(charset-iconv.o): In function `charset_to_utf8_begin': charset-iconv.c:(.text+0x49): undefined reference to `libiconv_open' ../lib-charset/.libs/libcharset.a(charset-iconv.o): In function `charset_to_utf8_end': charset-iconv.c:(.text+0x151): undefined reference to `libiconv_close' ../lib-charset/.libs/libcharset.a(charset-iconv.o): In function `charset_to_utf8_reset': charset-iconv.c:(.text+0x211): undefined reference to `libiconv' ../lib-charset/.libs/libcharset.a(charset-iconv.o): In function `charset_to_utf8_try': charset-iconv.c:(.text+0x425): undefined reference to `libiconv' cc: error: linker command failed with exit code 1 (use -v to see invocation) ../lib-charset/.libs/libcharset.a(charset-iconv.o): In function `charset_to_utf8_begin': charset-iconv.c:(.text+0x49): undefined reference to `libiconv_open' ../lib-charset/.libs/libcharset.a(charset-iconv.o): In function `charset_to_utf8_end': charset-iconv.c:(.text+0x151): undefined reference to `libiconv_close' ../lib-charset/.libs/libcharset.a(charset-iconv.o): In function `charset_to_utf8_reset': charset-iconv.c:(.text+0x211): undefined reference to `libiconv' ../lib-charset/.libs/libcharset.a(charset-iconv.o): In function `charset_to_utf8_try': charset-iconv.c:(.text+0x425): undefined reference to `libiconv'

1 0