- dovecot - dovecot.org

[Dovecot] Converting a POP3 client to IMAP
by Kristen J. Webb 27 Feb '13

27 Feb '13

I have a dovecot 2.0 dovecot server set up for https/imap with spam, av, and some preliminary sieve filters in place. Our current email is outsourced and so we have used POP3 to keep all email on our systems for many years. I have run tests to move mail to the new imap server and that seems to work pretty well. However, we have lots of mail going back over a decade and used a lot of aliases that forwarded email to many users. I find the moving mail multiple times using Thunderbird results in multiple copies of the same email. Is there a best practice for moving mail such that we can take advantage of the hard link feature for all those older copies that are currently in POP3 files? It would also be nice to be able to auto file things. I don't see the sieve filters being activated when I copy mail in Thunderbird. Many thanks in advance for any guidance. Kris -- This message is NOT encrypted -------------------------------- Mr. Kristen J. Webb Chief Technology Officer Teradactyl LLC. 2450 Baylor Dr. S.E. Albuquerque, New Mexico 87106 Phone: 1-505-338-6000 Email: kwebb(a)teradactyl.com Web: http://www.teradactyl.com Providers of Scalable Backup Solutions for Unique Data Environments -------------------------------- NOTICE TO RECIPIENTS: Any information contained in or attached to this message is intended solely for the use of the intended recipient(s). If you are not the intended recipient of this transmittal, you are hereby notified that you received this transmittal in error, and we request that you please delete and destroy all copies and attachments in your possession, notify the sender that you have received this communication in error, and note that any review or dissemination of, or the taking of any action in reliance on, this communication is expressly prohibited. Regular internet e-mail transmission cannot be guaranteed to be secure or error-free. Therefore, we do not represent that this information is complete or accurate, and it should not be relied upon as such. If you prefer to communicate with Teradactyl LLC. using secure (i.e., encrypted and/or digitally signed) e-mail transmission, please notify the sender. Otherwise, you will be deemed to have consented to communicate with Teradactyl via regular internet e-mail transmission. Please note that Teradactyl reserves the right to intercept, monitor, and retain all e-mail messages (including secure e-mail messages) sent to or from its systems as permitted by applicable law.

3 3

[Dovecot] Dict quota timeout error: Has anything changed in the latest versions?
by Alessio Cecchi 26 Feb '13

26 Feb '13

Hi, I'm using dict quota with mysql for track them via SQL query instead of read maildirsize file. Primary quota and enforcing is provided via userdb and is "maildir" type. Since dovecot 2.1.10-13 (but perhaps even before) when a new user log in via POP/IMAP or receive an email for the first time dovecot created the entry for the users in the table "quota" of dovecot database with quota usage and number of messages (before of this login/delivery the user has no entry in the quota table of dovecot DB). After the update to 2.1.14 when a new user login or receive an email for the first time dovecot was unable to create (immediately) the entry in quota table and in the log print these errors: Feb 12 11:03:49 master: Info: Dovecot v2.1.15 starting up (core dumps disabled) Feb 12 11:04:02 auth-worker(31421): Info: mysql(localhost): Connected to database vpopmail Feb 12 11:04:02 pop3-login: Info: Login: user=<alessio(a)domain.com>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=31422, secured, session=<eK4gJYTV1QB/AAAB> Feb 12 11:04:08 pop3(alessio(a)domain.com): Info: Disconnected: Logged out top=0/0, retr=0/0, del=0/9, size=18618 Feb 12 11:04:41 pop3-login: Info: Login: user=<alessio(a)domain.com>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=31424, secured, session=<D7F0J4TV1gB/AAAB> Feb 12 11:05:11 pop3(alessio(a)domain.com): Info: Disconnected: Logged out top=0/0, retr=0/0, del=1/9, size=18618 Feb 12 11:05:11 dict: Info: mysql(10.10.3.19): Connected to database dovecot [ here is when I "quit" from telnet session] Feb 12 11:05:41 pop3(alessio(a)domain.com): Error: read(/usr/local/dovecot-2.1/var/run/dovecot/dict) failed: Timeout after 30 seconds Feb 12 11:06:11 pop3(alessio(a)domain.com): Error: read(/usr/local/dovecot-2.1/var/run/dovecot/dict) failed: Timeout after 30 seconds Feb 12 11:06:41 pop3(alessio(a)domain.com): Error: read(/usr/local/dovecot-2.1/var/run/dovecot/dict) failed: Timeout after 30 seconds Feb 12 11:07:11 pop3(alessio(a)domain.com): Error: read(/usr/local/dovecot-2.1/var/run/dovecot/dict) failed: Timeout after 30 seconds Feb 12 11:07:41 pop3(alessio(a)domain.com): Error: read(/usr/local/dovecot-2.1/var/run/dovecot/dict) failed: Timeout after 30 seconds Feb 12 11:08:11 pop3(alessio(a)domain.com): Error: read(/usr/local/dovecot-2.1/var/run/dovecot/dict) failed: Timeout after 30 seconds Feb 12 11:08:41 pop3(alessio(a)domain.com): Error: read(/usr/local/dovecot-2.1/var/run/dovecot/dict) failed: Timeout after 30 seconds [ only now telnet close the session ] This is the telnet session: # telnet 0 110 Trying 0.0.0.0... Connected to 0. Escape character is '^]'. +OK Dovecot ready. user alessio(a)domain.com +OK pass ciao +OK Logged in. list +OK 8 messages: 1 1594 2 1594 3 1594 4 1594 5 1594 6 1594 7 3755 8 3714 . dele 8 +OK Marked to be deleted. quit [ here dovecot wait about 3 minuts before close the connecctions ] +OK Logging out, messages deleted. Connection closed by foreign host. After 3 minutes of wait in the mysql database dovecot insert the entry for the new users: mysql> use dovecot Database changed mysql> select * from quota where username='alessio(a)domain.com'; +--------------------------+---------+----------+ | username | bytes | messages | +--------------------------+---------+----------+ | alessio(a)domain.com | 2144030 | 15 | +--------------------------+---------+----------+ Errors like Error: read(/usr/local/dovecot-2.1/var/run/dovecot/dict) failed: Timeout after 30 seconds were present also before the upgrade but they were occasional, now I had to disable "dict quota". Can this be fixed? My dovecot configuration: # cat /usr/local/dovecot-2.1/etc/dovecot/dovecot-dict-sql.conf.ext connect = host=10.10.3.19 dbname=dovecot user=dovecot password=XXX map { pattern = priv/quota/storage table = quota username_field = username value_field = bytes } map { pattern = priv/quota/messages table = quota username_field = username value_field = messages } map { pattern = shared/expire/$user/$mailbox table = expires value_field = expire_stamp fields { username = $user mailbox = $mailbox } } # dovecot -n # 2.1.15: /usr/local/dovecot-2.1/etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-xen-amd64 x86_64 Debian 6.0.6 auth_cache_size = 512 k auth_worker_max_count = 60 default_login_user = nobody dict { acl = mysql:/usr/local/dovecot-2.1/etc/dovecot/dovecot-share-folder.conf sqlquota = mysql:/usr/local/dovecot-2.1/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no dotlock_use_excl = no first_valid_gid = 89 first_valid_uid = 89 last_valid_gid = 89 last_valid_uid = 89 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes log_path = /var/log/dovecot/dovecot.log mail_fsync = always mail_location = maildir:~/Maildir mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = quota acl zlib maildir_very_dirty_syncs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mmap_disable = yes namespace { list = children location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u prefix = shared/%%n/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / } passdb { args = /usr/local/dovecot-2.1/etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile:/usr/local/dovecot-2.1/etc/dovecot/global-acls:cache_secs=300 acl_shared_dict = proxy::acl quota = maildir:UserQuota quota2 = dict:User usage::proxy::sqlquota quota_rule2 = Trash:storage=+100M quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_default = /usr/local/dovecot-2.1/etc/dovecot/sieve/default.sieve sieve_dir = ~/sieve } protocols = imap pop3 sieve sendmail_path = /var/qmail/bin/sendmail service auth { unix_listener auth-userdb { group = vchkpw mode = 0660 user = vpopmail } } service dict { unix_listener dict { group = vchkpw mode = 0660 user = vpopmail } } service imap-login { service_count = 0 } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { service_count = 0 } service quota-warning { executable = script /usr/local/dovecot-2.1/etc/dovecot/scripts/quota-warning.sh unix_listener quota-warning { user = vpopmail } user = vpopmail } ssl_cert = </etc/ssl/certs/wildcard.net.pem ssl_key = </etc/ssl/private/wildcard.net.key userdb { args = /usr/local/dovecot-2.1/etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lda { log_path = /var/log/dovecot/lda.log mail_plugins = quota acl zlib sieve } protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep tb-lsub-flags mail_max_userip_connections = 20 mail_plugins = quota acl zlib imap_quota imap_acl } protocol sieve { mail_max_userip_connections = 10 } protocol pop3 { mail_max_userip_connections = 5 pop3_client_workarounds = outlook-no-nuls oe-ns-eoh } -- Alessio Cecchi is: @ ILS -> http://www.linux.it/~alessice/ on LinkedIn -> http://www.linkedin.com/in/alessice Assistenza Sistemi GNU/Linux -> http://www.cecchi.biz/ @ PLUG -> ex-Presidente, adesso senatore a vita, http://www.prato.linux.it

2 4

Re: [Dovecot] Sieve filters on folders, different from INBOX
by Valery V. Sedletski 26 Feb '13

26 Feb '13

>---- Original Message ---- >From: Robert Schetterer <rs(a)sys4.de> >To: dovecot(a)dovecot.org >Sent: Вт, Фев 26, 2013, 5:55 PM >Subject: Re: [Dovecot] Sieve filters on folders, different from INBOX > >Am 26.02.2013 14:20, schrieb Valery V. Sedletski: >> Hi all >> >> Is it possible to configure Dovecot's sieve plugin to act on message >> arrival to folders, other than INBOX? > >sieve is invoked by lda or lmtp not "as arrive in inbox" > > >> I wish to move messages fetched by pop3 fetcher to special folder, or sort > >if you use i.e getmail and maildir it may possible > >look > >http://pyropus.ca/software/getmail/getmailrc-examples I use mpop with a shell wrapper script. The fetcher is working on IMAP server side (not on user side, as usual). So, it is used to pull email from several POP3 servers to our IMAP server. The mail is stored in Maildir++ format. Yes, it is possible to configure fetcher to sort messages to folders by its own means, but I'd like to implement the mail sorting by means of Sieve filters. The user can easy configure filters in webmail interface, then it work with any IMAP client, because it is done on IMAP server side. So, if sieve is invoked by lda, then, probably, I could invoke dovecot-lda from wrapper script on each mail after it is fetched? But then it will be copied to INBOX... -- Is it possible to specify the other folder to deliver to, to the deliver program? > >> outgoing mail to folders, specific > >outgoing mail is smtp, with i.e imap copy to sent folder etc >if you want other folders your imap client should do it > So, I can invoke Sieve interpreter from SMTP server, or process it via dovecot-lda, like in fetcher case? > >try i.e > >https://addons.mozilla.org/de/thunderbird/addon/send-filter/?src=search > > >> to their recipients. >> >> Thanhs in advance, > >i guess what you want in gneral ,is more advanced ( new ) handling >of mail workflow at all, look at list archives for more info on >some stuff you asked, some may work in the future with new features in >imap and sieve, but meanwhile you have to workaround > I used such features with my old POP3 client (it was the good old PMMail in OS/2). But it worked on POP3 client side, with local folders. It seemed to be not very advanced, but I just got a case to implement the same with Dovecot and Exim :) >> >> WBR, >> valery >> >> >> > > > >Best Regards >MfG Robert Schetterer > >-- >[*] sys4 AG > >http://sys4.de, +49 (89) 30 90 46 64 >Franziskanerstraße 15, 81669 München > >Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 >Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer >Aufsichtsratsvorsitzender: Joerg Heidrich

2 1

[Dovecot] Imap-login service count/limits
by Thomas Hummel 26 Feb '13

26 Feb '13

Hello Timo, I'm trying to configure dovecot-2.1.15 master correctly regarding imap-login limits. I want to use service_count=0 and I'm starting with something like this : #default_process_limit = 100 #default_client_limit = 1000 service imap-login { [...] service_count = 0 process_min_avail = 8 vsz_limit = 1024M } -> Does it make sense to set a process_limit if service_count = 0 ? why ? Doesn't service_count = 0 mean that no additionnal imap-login process would be created (except for process_min_avail) ? -> Does it make sense to set process_min_avail <> 0 if service_count = 0 ? why ? and if yes, what's the rule of thumb to find the correct value according to the number of connections estimation ? -> Assuming every client is configured to use STARTTLS and opens by default 5 imap connections, each client would consume 5 of the 1000 default_client_limit, right ? -> is 1024M too high for vsz_limit and may expose to memory leaks ? In other words, what limit should be raised to scale a lot a connections ? Thanks -- Thomas Hummel | Institut Pasteur <hummel(a)pasteur.fr> | Groupe Exploitation et Infrastructure

1 2

[Dovecot] Sieve filters on folders, different from INBOX
by Valery V. Sedletski 26 Feb '13

26 Feb '13

Hi all Is it possible to configure Dovecot's sieve plugin to act on message arrival to folders, other than INBOX? I wish to move messages fetched by pop3 fetcher to special folder, or sort outgoing mail to folders, specific to their recipients. Thanhs in advance, WBR, valery

2 1

[Dovecot] Broken foldernames in mbox
by Peer Heinlein 26 Feb '13

26 Feb '13

I have a mbox-User with some crazy foldernames: -rw------- 1 vmail vmail 19238931 17. Dez 2011 Foo & Co -rw------- 1 vmail vmail 82415 19. Nov 22:06 Foo &- Co Dovecot can't handle that correctly: # dovecot mailbox list -u user Foo & Co Foo & Co dsyncing those folders produces some errors: dsync(awad): Error: Mailboxes don't have unique GUIDs: 228d0731cb186750e9150000a69b85fa is shared by Foo & Co and Foo & Co Peer -- Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-42 Fax: 030 / 405051-19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin

2 1

[Dovecot] dsync can't sync mbox2mdbox two times
by Peer Heinlein 26 Feb '13

26 Feb '13

Hi, I have a server with Dovecot 2.1.x and I'm trying to convert mbox-storages to mdbox-storages. # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.7 mail_location = mbox:~/mail During the first run everything's okay, but if I run the migration a second time, the later migration is broken: root@mailstore1:/srv/vmail/cklein# rm -R mdbox/ root@mailstore1:/srv/vmail/cklein# doveadm -v -o mail_plugins=zlib sync -u cklein mdbox:/srv/vmail/cklein/mdbox dsync(cklein): Info: test: only in source (guid=0c323b1a430a7350c8590000a69b85fa) dsync(cklein): Info: saved-drafts: only in source (guid=a759b2290cda65504c590000a69b85fa) dsync(cklein): Info: inbox: only in source (guid=a84828310cda65504d590000a69b85fa) dsync(cklein): Info: sent-mail: only in source (guid=a859b2290cda65504c590000a69b85fa) dsync(cklein): Info: spam-mail: only in source (guid=a959b2290cda65504c590000a69b85fa) dsync(cklein): Info: mail-trash: only in source (guid=aa59b2290cda65504c590000a69b85fa) dsync(cklein): Info: Trash: only in source (guid=c0d2c117a785755049640000fd7d4449) dsync(cklein): Info: INBOX.test2: only in source (guid=d6c2d20a2bd013511d030000a69b85fa) dsync(cklein): Info: huhu: only in source (guid=e310ed050ecf1351c37d0000a69b85fa) root@mailstore1:/srv/vmail/cklein# doveadm -v -o mail_plugins=zlib sync -u cklein mdbox:/srv/vmail/cklein/mdbox dsync(cklein): Error: Can't rename mailbox inbox to INBOX: Target mailbox already exists This is what the mbox-folder of the user looks like: root@mailstore1:/srv/vmail/cklein# ls -la mail/ insgesamt 404 drwx------ 4 vmail vmail 4096 26. Feb 10:09 . drwx------ 5 vmail vmail 4096 18. Feb 23:20 .. -rw------- 1 vmail vmail 540 26. Feb 10:09 huhu drwx------ 17 vmail vmail 4096 7. Feb 17:02 .imap -rw------- 1 vmail vmail 97664 26. Feb 10:09 inbox -rw------- 1 vmail vmail 540 26. Feb 10:09 INBOX.test2 drwx------ 2 vmail vmail 4096 26. Feb 09:56 mail -rw------- 1 vmail vmail 18842 26. Feb 10:09 mail-trash -rw------- 1 vmail vmail 2768 26. Feb 10:09 saved-drafts -rw------- 1 vmail vmail 239274 26. Feb 10:09 sent-mail -rw------- 1 vmail vmail 540 26. Feb 10:09 spam-mail -rw------- 1 vmail vmail 78 7. Feb 16:56 .subscriptions -rw------- 1 vmail vmail 598 26. Feb 10:09 test -rw------- 1 vmail vmail 540 26. Feb 10:09 Trash And this is what Dovecot can see accessing the mbox-storage: root@mailstore1:/srv/vmail/cklein# doveadm mailbox list -u cklein test mail-trash saved-drafts sent-mail spam-mail Trash huhu INBOX.test2 inbox mail And this is what Dovecot can see accessing the mdbox-storage: root@mailstore1:/srv/vmail/cklein# doveadm -c /etc/dovecot/mdbox-test.conf mailbox list -u cklein sent-mail saved-drafts Trash spam-mail mail-trash mail huhu test INBOX INBOX.test2 Is it a bug renaming the inbox-Folder to uppercases or do I have a mistake in my mbox-structure? Peer -- Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-42 Fax: 030 / 405051-19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin

1 1

[Dovecot] 2.2.rc2: quota crash
by Lutz Preßler 26 Feb '13

26 Feb '13

Hello, 2.2.rc2 with configuration as sent with my last mail ("2.2beta2: LSUB broke"). The following sequence crashes with INBOX containing unseen message: * PREAUTH [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE BINARY MOVE SEARCH=FUZZY COMPRESS=DEFLATE QUOTA ACL RIGHTS=texk] Logged in as user A0002 STATUS INBOX (MESSAGES UNSEEN) * STATUS INBOX (MESSAGES 5651 UNSEEN 5) A0002 OK Status completed. A0003 SELECT INBOX * FLAGS (\Answered \Flagged \Deleted \Seen \Draft $Forwarded) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft $Forwarded \*)] Flags permitted. * 5651 EXISTS * 0 RECENT * OK [UNSEEN 5647] First unseen. * OK [UIDVALIDITY 1060286197] UIDs valid * OK [UIDNEXT 42051] Predicted next UID * OK [HIGHESTMODSEQ 6878] Highest A0003 OK [READ-WRITE] Select completed. A0004 UID SEARCH 5651 * SEARCH 42050 A0004 OK Search completed (0.000 secs). A0005 GETQUOTAROOT INBOX imap(4140, lpressl) : Panic: file mail-namespace.c: line 654 (mail_namespace_find): assertion failed: (ns != NULL) imap(4140, lpressl) : Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x6079a) [0x7f617b7f679a] -> /usr/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x32) [0x7f617b7f6882] -> /usr/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f617b7b7eaf] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x760e2) [0x7f617bac30e2] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_namespace_find_unalias+0x19) [0x7f617bac3109] -> /usr/lib/dovecot/modules/lib10_quota_plugin.so(+0x5238) [0x7f617a7ec238] -> /usr/lib/dovecot/modules/lib10_quota_plugin.so(quota_get_resource+0xb7) [0x7f617a7ec3b7] -> /usr/lib/dovecot/modules/lib10_quota_plugin.so(quota_root_iter_next+0xf1) [0x7f617a7ece11] -> /usr/lib/dovecot/modules/lib11_imap_quota_plugin.so(+0x1bd5) [0x7f617a5e5bd5] -> /usr/lib/dovecot/imap(command_exec+0x3d) [0x41603d] -> /usr/lib/dovecot/imap() [0x415190] -> /usr/lib/dovecot/imap() [0x41527d] -> /usr/lib/dovecot/imap(client_handle_input+0x11d) [0x4154fd] -> /usr/lib/dovecot/imap(client_input+0x6f) [0x41587f] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7f617b805426] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xaf) [0x7f617b80647f] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7f617b8053c8] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f617b7bcb03] -> /usr/lib/dovecot/imap(main+0x2a7) [0x41eb07] -> /lib/libc.so.6(__libc_start_main+0xfd) [0x7f617b452c8d] -> /usr/lib/dovecot/imap() [0x40b549] Abgebrochen GETQUOTAROOT directly after SELECT INBOX (without UID SEARCH) does not. No crash without imap_quota plugin either, of course... Regards, Lutz

2 1

[Dovecot] What to back up from a mdbox
by Dag Nygren 26 Feb '13

26 Feb '13

Hi short question to the list: - What parts of a mdbox mail store directory can I leave out from my backup? I can see huge *.cache files for eample. Can these be rebuilt? - Can dovecot recover from a backup "on the fly"? Best Dag

2 1

[Dovecot] Dovecot SASL: SCRAM-SHA-1 Authentication Fails
by Thomas Reim 26 Feb '13

26 Feb '13

Dear all, I use Dovecot SASL (2.1.15) on Ubuntu 12.04 for IMAP authentication and Postfix SASL authentication. I tried to setup SCRAM-SHA-1 as SASL mechanism. This works well on Dovecot's client side towards my OpenLDAP server (with libsasl-2), but fails on the server side (IMAP and SMTP). In the following, there's an extract from Dovecot's log, when using mutt as SMTP client: dovecot: auth: Debug: auth client connected (pid=0) dovecot: auth: Debug: client in: AUTH#0111#011 SCRAM-SHA-1#011 service=smtp#011 nologin#011 lip=192.168.0.65#011 rip=192.168.0.65#011 secured#011 resp=<hidden> dovecot: auth: scram-sha-1(?,192.168.0.65): authzid not supported dovecot: auth: Debug: client passdb out: FAIL#0111 postfix/smtpd[7621]: warning: markaurel.gas.de[192.168.0.65]: SASL SCRAM-SHA-1 authentication failed Here's the log, when using mutt as IMAP client: dovecot: auth: Debug: auth client connected (pid=23409) dovecot: auth: Debug: client in: AUTH#0111#011 SCRAM-SHA-1#011 service=imap#011 secured#011 session=<session ID>#011 lip=192.168.0.65#011 rip=192.168.0.65#011 lport=143#011 rport=36543#011 resp=<hidden> auth: scram-sha-1(?,192.168.0.65,<session ID>): authzid not supported auth: Debug: client passdb out: FAIL#0111 In the following is mutt's output: imap_authenticate: Trying method scram-sha-1 SASL local ip: 192.168.0.65;36543, remote ip:192.168.0.65;143 External SSF: 128 External authentication name: myname mutt_sasl_cb_authname: getting authname for mail.mydomain.local:143 mutt_sasl_cb_authname: getting user for mail.gas.de:143 mutt_sasl_cb_pass: getting password for myname@mail.mydomain.local:143 Authentifiziere (SCRAM-SHA-1)... 4> a0002 AUTHENTICATE SCRAM-SHA-1 <uuencoded string> 4< a0002 NO [AUTHENTICATIONFAILED] Authentication failed. IMAP queue drained imap_auth_sasl: scram-sha-1 failed I've configured mutt, so that it immediately retries the SASL authentication using DIGEST-MD5. This 2nd try is succesful and mutt gets access to the imap/smtp service. Any hints, what's going wrong here? Output of dovecot -n: # 2.1.15 (e33fe1a7bb89): /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-37-generic x86_64 Ubuntu 12.04.2 LTS auth_debug = yes auth_mechanisms = scram-sha-1 digest-md5 plain login auth_verbose = yes base_dir = /var/run/dovecot/ log_timestamp = "%Y-%m-%d %H:%M:%S " mail_gid = vmail mail_location = mdbox:~/mdbox mail_privileged_group = mail mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = . } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } postmaster_address = postmaster@localhost protocols = imap lmtp quota_full_tempfail = yes service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail user = vmail } } service imap-login { inet_listener imap { address = 192.168.0.65 port = 143 } inet_listener imaps { address = 192.168.0.65 port = 993 ssl = yes } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } protocol imap { mail_max_userip_connections = 10 mail_plugins = " mail_log notify" }

2 1

[Dovecot] 2.1.12: Panic: file solr-connection.c: line 547 (solr_connection_post_more)
by Marc Schiffbauer 26 Feb '13

26 Feb '13

Hi all, I am having a problem indexing one of my mailboxes using the solr fts backend in dovecot 2.1.12 For many mailboxes it works just fine, but on one mailbox I currently always get a panic. solr setup: Java: icedtea 6.1.11.5 Solr: 3.6.2 running in tomcat 7.0.32 Command to reproduce error: doveadm index -u my@user badmailbox I already noticed that there have been some solr backend fixes just before 2.1.21 release... Is this another bug in the backend? Any idea? IMO relevant logs line parts: java.io.CharConversionException: Invalid UTF-8 start byte 0xf8 (at char #483989, byte #532382) complete dovecot log: doveadm(my@user): Error: fts_solr: Invalid XML input at 85:198: mismatched tag (near: <html><head><title>Apache Tomcat/7.0.32-gentoo - Error report</title><style><!--H1 {font-family:Tahoma,Arial,sans-serif;color:wh) doveadm(my@user): Panic: file solr-connection.c: line 547 (solr_connection_post_more): assertion failed: (maxfd >= 0) doveadm(my@user): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0x4bcdb) [0x34fbd53ecdb] -> /usr/lib64/dovecot/libdovecot.so.0(default_fatal_handler+0x3a) [0x34fbd53edb8] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x34fbd50eeac] -> /usr/lib64/dovecot/lib21_fts_solr_plugin.so(solr_connection_post_more+0x2a4) [0x34fbba81072] -> /usr/lib64/dovecot/lib21_fts_solr_plugin.so(+0x40a5) [0x34fbba7d0a5] -> /usr/lib64/dovecot/lib20_fts_plugin.so(fts_build_mail+0x462) [0x34fbbc8d6dc] -> /usr/lib64/dovecot/lib20_fts_plugin.so(+0xd8c2) [0x34fbbc928c2] -> doveadm(+0x17a30) [0x264ecb7a30] -> doveadm(+0x13a45) [0x264ecb3a45] -> doveadm(+0x14762) [0x264ecb4762] -> doveadm(doveadm_mail_try_run+0x173) [0x264ecb4cfd] -> doveadm(main+0x3e9) [0x264ecbd0d5] -> /lib64/libc.so.6(__libc_start_main+0xfd) [0x34fbd16a48d] -> doveadm(+0x13809) [0x264ecb3809] Aborted complete java exception: Dec 31, 2012 4:12:58 AM org.apache.solr.core.SolrCore execute INFO: [] webapp=/solr-web path=/update params={} status=500 QTime=118 Dec 31, 2012 4:12:58 AM org.apache.solr.common.SolrException log SEVERE: java.lang.RuntimeException: [was class java.io.CharConversionException] Invalid UTF-8 start byte 0xf8 (at char #483989, byte #532382) at com.ctc.wstx.util.ExceptionUtil.throwRuntimeException(ExceptionUtil.java:18) at com.ctc.wstx.sr.StreamScanner.throwLazyError(StreamScanner.java:731) at com.ctc.wstx.sr.BasicStreamReader.safeFinishToken(BasicStreamReader.java:3657) at com.ctc.wstx.sr.BasicStreamReader.getText(BasicStreamReader.java:809) at org.apache.solr.handler.XMLLoader.readDoc(XMLLoader.java:315) at org.apache.solr.handler.XMLLoader.processUpdate(XMLLoader.java:156) at org.apache.solr.handler.XMLLoader.load(XMLLoader.java:79) at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:58) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129) at org.apache.solr.core.SolrCore.execute(SolrCore.java:1376) at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:365) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:260) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Unknown Source) at org.apache.catalina.core.ApplicationFilterChain.doFilter(Unknown Source) at org.apache.catalina.core.StandardWrapperValve.invoke(Unknown Source) at org.apache.catalina.core.StandardContextValve.invoke(Unknown Source) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(Unknown Source) at org.apache.catalina.core.StandardHostValve.invoke(Unknown Source) at org.apache.catalina.valves.ErrorReportValve.invoke(Unknown Source) at org.apache.catalina.valves.AccessLogValve.invoke(Unknown Source) at org.apache.catalina.core.StandardEngineValve.invoke(Unknown Source) at org.apache.catalina.connector.CoyoteAdapter.service(Unknown Source) at org.apache.coyote.http11.AbstractHttp11Processor.process(Unknown Source) at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(Unknown Source) at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(Unknown Source) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) at java.lang.Thread.run(Thread.java:679) Caused by: java.io.CharConversionException: Invalid UTF-8 start byte 0xf8 (at char #483989, byte #532382) at com.ctc.wstx.io.UTF8Reader.reportInvalidInitial(UTF8Reader.java:302) at com.ctc.wstx.io.UTF8Reader.read(UTF8Reader.java:188) at com.ctc.wstx.io.ReaderSource.readInto(ReaderSource.java:84) at com.ctc.wstx.io.BranchingReaderSource.readInto(BranchingReaderSource.java:57) at com.ctc.wstx.sr.StreamScanner.loadMore(StreamScanner.java:992) at com.ctc.wstx.sr.BasicStreamReader.readTextSecondary(BasicStreamReader.java:4628) at com.ctc.wstx.sr.BasicStreamReader.readCoalescedText(BasicStreamReader.java:4126) at com.ctc.wstx.sr.BasicStreamReader.finishToken(BasicStreamReader.java:3701) at com.ctc.wstx.sr.BasicStreamReader.safeFinishToken(BasicStreamReader.java:3649) ... 25 more TIA -Marc -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstraße 15, 81669 München Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Joerg Heidrich

4 9

[Dovecot] Dovecot auth works when tested with doveadm, but fails with Postfix
by Darren Pilgrim 26 Feb '13

26 Feb '13

I have three postfix 2.9.5 servers: chombo, rush, yoshi. Chombo relays to rush and yoshi for outbound email. Outbound relay requires SASL authentication. Rush and yoshi run Dovecot 2.1.12 servers with simple passwd-file backends. If I create a new password hash for chombo's user, houseloki, on either rush or yoshi: # doveadm pw -u houseloki -p <password> {CRAM-MD5}... Then I add that to rush and yoshi's passwd file: houseloki@_auth.bluerosetech.com:{CRAM-MD5}... Then `doveadm reload`, it works fine: # doveadm auth houseloki <password> passdb: houseloki auth succeeded extra fields: user=houseloki(a)_auth.bluerosetech.com So I add that username and password to the smtp_sasl_password_maps hash file on chombo, reload postfix, and then try to relay something from chombo, it fails with rush and yoshi logging warnings like: Feb 19 03:32:33 yoshi postfix/smtpd[75783]: warning: chombo.example.com[2001:db8::2]: SASL DIGEST-MD5 authentication failed: <really long string redacted> Rush and yoshi have other hashes in their passwd files, and if I configure chombo to use one of those, it works fine. Those hashes use digest-md5 and are at least a few years old. I tried that scheme instead of the default cram-md5, as well as several others, but none work. I've poured over the wiki and man pages, but can't find the problem. What am I missing? Why can I not generate new hashes correctly?

2 3

Re: [Dovecot] v2.2.rc1 released
by Michael Grimm 25 Feb '13

25 Feb '13

> Please test and report any bugs found. New in rc1: | doveconf: Error: dlopen(/.../lib/dovecot/settings/libmanagesieve_login_settings.so) failed: /.../lib/dovecot/settings/libmanagesieve_login_settings.so: Undefined symbol "hook_config_parser_begin" | doveconf: Error: dlopen(/.../lib/dovecot/settings/libmanagesieve_settings.so) failed: /.../lib/dovecot/settings/libmanagesieve_settings.so: Undefined symbol "mail_user_setting_parser_info" | doveconf: Error: protocols: Unknown protocol: sieve | doveconf: Fatal: Error in configuration file /.../etc/dovecot/dovecot.conf: protocols: Unknown protocol: sieve Regards, Michael

3 9

[Dovecot] 2.2beta2: LSUB broken
by Lutz Preßler 25 Feb '13

25 Feb '13

Hello, I have some problems with (listing) subscriptions on my test system running 2.2beta2 (compared with 2.1.15, configuration and Maildir content unchanged): With 2.1.15: 0 lsub "" "*" * LSUB () "." "INBOX.Trash" * LSUB () "." "INBOX.in2009" * LSUB () "." "INBOX.test" * LSUB () "." "INBOX.test.test2" * LSUB () "." "INBOX.in2010" * LSUB () "." "INBOX.in" * LSUB () "." "INBOX.virtual.small" * LSUB () "." "INBOX.virtual.sent" * LSUB () "." "INBOX.virtual.allin" * LSUB () "." "INBOX.virtual.week" * LSUB () "." "INBOX.virtual.gmail" 0 OK Lsub completed. With 2.2beta2 (output of doveconf -n attached): 0 lsub "" "*" 0 OK Lsub completed. ... empty list. Same with "list (subscribed)". After disableing the "virtual" namespace in the config, it gets: 0 lsub "" "*" * LSUB () "." Trash * LSUB () "." in2009 * LSUB () "." test * LSUB () "." test.test2 * LSUB () "." in2010 * LSUB () "." in * LSUB () "." INBOX.Trash * LSUB () "." INBOX.in2009 * LSUB () "." INBOX.test * LSUB () "." INBOX.test.test2 * LSUB () "." INBOX.in2010 * LSUB () "." INBOX.in 0 OK Lsub completed. Note mailboxes listed with and without INBOX. prefix. Thanks, Lutz

2 3

[Dovecot] v2.2.rc1 released
by Timo Sirainen 25 Feb '13

25 Feb '13

http://dovecot.org/releases/2.2/rc/dovecot-2.2.rc1.tar.gz http://dovecot.org/releases/2.2/rc/dovecot-2.2.rc1.tar.gz.sig A few fixes since beta2. Also added tcp and tcps (=tcp+ssl) targets for dsync, where the destination needs to be a doveadm-server listener. I'm planning on releasing v2.2.0 in 1-2 weeks if no major problems are found. Please test and report any bugs found. BTW. I've also gone through basically all of my unread emails. If you haven't gotten a reply to something, ask again. Here's again all the biggest changes since v2.1: * When creating home directories, the permissions are copied from the parent directory if it has setgid-bit set. For full details, see http://wiki2.dovecot.org/SharedMailboxes/Permissions * "doveadm auth" command was renamed to "doveadm auth test" * IMAP: ID command now advertises server name as Dovecot by default. It was already trivial to guess this from command replies. * dovecot.index.cache files can be safely accessed only by v2.1.11+. Older versions may think they're corrupted and delete them. * LDA/LMTP: If saving a mail brings user from under quota to over quota, allow it based on quota_grace setting (default: 10% above quota limit). * pop3_lock_session=yes now uses a POP3-only dovecot-pop3-session.lock file instead of actually locking the mailbox (and causing IMAP/LDA/LMTP to wait for the POP3 session to close). * mail_shared_explicit_inbox setting's default switched to "no". * ssl_client_ca_dir setting replaced imapc_ssl_ca_dir and pop3c_ssl_ca_dir settings. + Implemented IMAP MOVE and BINARY extensions + Implemented IMAP CATENATE, URLAUTH and URLAUTH=BINARY extensions (by Stephan Bosch). + Implemented IMAP NOTIFY extension. Requires mailbox_list_index=yes to be enabled. + Redesigned and rewritten dsync. The new design makes the syncing faster, more reliable and more featureful. The new dsync protocol isn't backwards compatible with old dsync versions (but is designed to be forwards compatible with future versions). + All mailbox formats now support per-user message flags for shared mailboxes by using a private index. It can be enabled by adding :INDEXPVT=<path> to mail location. This should be used instead of :INDEX also for Maildir/mbox to improve performance. + Improved mailbox list indexes. They should be usable now, although still disabled by default. + Added LAYOUT=index. The mailbox directories are created using their GUIDs in the filesystem, while the actual GUID <-> name mapping exists only in the index. + LMTP proxy: Implemented XCLIENT extension for passing remote IP address through proxy.

1 0

[Dovecot] Bug when a duplicated file is found
by Angel L. Mateo 25 Feb '13

25 Feb '13

Hello, Last days we had to restore some mailboxes from backup. Our mailboxes are in maildir format and during restore, some duplicated files appeared. The situation is: * A user has messages in his new directory when the backup is made * In some moment after the backup is done, the user accesses to his mailbox, so the message is move to the cur directory. * We restore his mailbox directly to his maildir path, so the message is now at new directory too. When this happens, dovecot detect it and it renames one of the files. This is the reported log: Feb 13 23:08:05 myotis31 dovecot: imap(<user>): Warning: Fixed a duplicate: /home/alumnos/59/122559/Maildir/cur/1360169810.M670208P13643.myotis31,S=6282,W=6409:2, -> 1360793285.M721935P29136.myotis31 The problem with this is that we are using zlib plugin so messages are compressed. When the rename is done, the rename is to a name without the S=XXXX field (neither the W=XXX, although this field is less sensible), so the result is that user's can't access to any message after this one. I think than in this situation, rename one of the files is a good solution (although it provokes duplicate mails, but this an expected/acceptable situation after the restore), but the rename should maintain the S= and W= fields (and even other maildir flags). -- Angel L. Mateo Martínez Sección de Telemática Área de Tecnologías de la Información y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868889150 Fax: 868888337

3 3

[Dovecot] SSL errors for just one client after updaing both dovecot and openssl
by Charles Marcus 25 Feb '13

25 Feb '13

Hi all, Ok, I have a strange problem after updating both dovecot and openssl... OpenSSL was 1.0.0j, now updated to 1.0.1c Dovecot was 2.1.13, now updated to 2.1.15 I'm getting a bunch of lines like the following: Feb 23 10:48:01 myhost dovecot: imap-login: Disconnected (no auth attempts in 29 secs): user=<>, rip=#.#.#.#, lport=993, TLS handshaking: SSL_accept() syscall failed: Connection reset by peer, session=<In+cO2bWngCthJz2> where only the session id (and number of seconds for no auth attempts) is different... This is happening for only the one client. All other clients - I've counted about 25 so far - are working fine. Anyone have any ideas? I can't believe it is a generic openssl problem, since it is only affecting the one client. I've contacted him and asked him to reboot any/all devices that connect to our mail to see if that helps... -- Best regards, */Charles/*

3 3

[Dovecot] understanding namespace configuration
by btb＠bitrate.net 25 Feb '13

25 Feb '13

i'm a little confused about namespace configuration. reading http://wiki2.dovecot.org/Namespaces , and looking at the examples, it seems that when a namespace is declared, you can either do "namespace { ..." or "namespace foo { ..." - i'm having trouble finding clarity on the significance of "foo" though. it would appear it's not required, but then what is its purpose? what does it mean? does it imply something? it's also unclear to me how to create the "default private namespace". i see that there are three types of namespaces, but the list of namespace settings doesn't seem to include a parameter to set the namespace type. what am i missing? it's also not quite clear how to denote a namespace as "default". from coming across this thread [ http://mailman2.u.washington.edu/pipermail/imap-protocol/2010-May/001077.ht… ] it would indicate in theory that a namespace is denoted as default by using an empty prefix - but i wasn't able to find corroboration of that in dovecot's documentation. thanks -ben

2 3

[Dovecot] dovecot-2.2: broken domain quota calculation
by Evgeny Basov 25 Feb '13

25 Feb '13

Hello. Used next version of dovecot: # dovecot --version 20130205 (03a0af22100d+) Quota configuration: plugin { quota = dict:Domain quota:%d:redis:host=127.0.0.1:prefix=domain/ quota_rule = *:storage=0 quota_rule2 = Trash:storage=+5%% quota2 = dict:User quota::redis:host=127.0.0.1:prefix=user/ quota2_rule = *:storage=0 quota2_rule2 = Trash:storage=+5%% } Problem: incorrect quota calculations. Dovecot gets size and messages count of all domain from last user in list. In 2.1 works fine. Steps to reproduce problem: 1. install dovecot 2. create over 50 users with e-mails 3. execute: doveadm quota recalc -A 4. execute: doveadm quota get -A 5. get count of all users message: sum in some application result of execution doveadm quota get -A | grep MESSAGE | grep 'User quota' | awk '{print $5}' (139443 messages) 6. get size of all users message: sum in some application result of execution doveadm quota get -A | grep STORAGE | grep 'User quota' | awk '{print $5}' (2304399 Kb) 7. look at some user user(a)example.org Domain quota STORAGE 82408 51200000 0 user(a)example.org Domain quota MESSAGE 1078 - 0 user(a)example.org User quota STORAGE 0 209715200 0 user(a)example.org User quota MESSAGE 0 - 0 and see 1078 messages and 82408 Kb in domain quota 8. look at last user in list z(a)example.org Domain quota STORAGE 82408 51200000 0 z(a)example.org Domain quota MESSAGE 1078 - 0 z(a)example.org User quota STORAGE 82408 209715200 0 z(a)example.org User quota MESSAGE 1078 - 0 and see matching values.

2 2

[Dovecot] Possible sort optimization (?)
by Michael M Slusarz 25 Feb '13

25 Feb '13

Maybe this is just noise... but I can reproduce this fairly reliably. Mailbox with 21,000+ messages This query: a UID SORT RETURN (ALL COUNT) (DATE) UTF-8 SUBJECT "foo" is always about 10 percent slower than this split query (I've done this 4-5 times, and the numbers are similar): a UID SEARCH RETURN (SAVE) CHARSET UTF-8 SUBJECT "foo" b UID SORT RETURN (ALL COUNT) (DATE) UTF-8 UID $ (The particular query I used matched 5 messages out of the 21,000+) My not-very-scientific benchmarking process: 1.) Stop dovecot process 2.) Delete all dovecot index files for that mailbox 3.) Flush linux paging cache (sync && echo 3 > /proc/sys/vm/drop_caches) 4.) Restart dovecot 5.) Access dovecot via command-line (PREAUTH) 6.) SELECT mailbox 7.) Issue command(s) Could be a potential area for performance improvement or could simply be lazy benchmarking. michael

2 2

[Dovecot] Problem with the command hooks api
by Tony 24 Feb '13

24 Feb '13

I have been trying to use the command hook api in an experimental plugin I have written. The hook is registered using the command_hook_register function, and for most commands my hook functions get called once as expected. But when the client uses one of the "UID" commands (e.g. "UID FETCH" ) the hook functions are executed twice. I am using dovecot version 2.1.12. Am I correct in thinking this is a bug? If I am wrong and this is the intended behaviour, how should I detect whether the hook function call is the first or second for a client's command (in particular for the 'post command' hook)? Assuming it is a bug, I modified the code in the command_exec function to stop the second hook call, a patch for this is below. This appears to apply to later dovecot releases as well. I am happy for this code to be included in future releases of dovecot. Thanks, Tony. diff -ur -x .deps -x Makefile dovecot-2.1.12-orig/src/imap/imap-commands.c dovecot-2.1.12-mod/src/imap/imap-commands.c --- dovecot-2.1.12-orig/src/imap/imap-commands.c 2012-03-22 12:59:17.000000000 +0000 +++ dovecot-2.1.12-mod/src/imap/imap-commands.c 2013-02-20 17:15:50.000000000 +0000 @@ -38,7 +38,7 @@ { "FETCH", cmd_fetch, COMMAND_FLAG_USES_SEQS }, { "SEARCH", cmd_search, COMMAND_FLAG_USES_SEQS }, { "STORE", cmd_store, COMMAND_FLAG_USES_SEQS }, - { "UID", cmd_uid, 0 }, + { "UID", cmd_uid, COMMAND_FLAG_HOOKS_DELAY }, { "UID COPY", cmd_copy, COMMAND_FLAG_BREAKS_SEQS }, { "UID FETCH", cmd_fetch, COMMAND_FLAG_BREAKS_SEQS }, { "UID SEARCH", cmd_search, COMMAND_FLAG_BREAKS_SEQS }, @@ -142,12 +142,20 @@ { const struct command_hook *hook; bool ret; + bool exec_hooks = FALSE; - array_foreach(&command_hooks, hook) - hook->pre(cmd); + if ( !(cmd->cmd_flags & COMMAND_FLAG_HOOKS_DELAY)) { + exec_hooks = TRUE; + array_foreach(&command_hooks, hook) + hook->pre(cmd); + } ret = cmd->func(cmd); - array_foreach(&command_hooks, hook) - hook->post(cmd); + + if (exec_hooks != FALSE) + { + array_foreach(&command_hooks, hook) + hook->post(cmd); + } return ret; } diff -ur -x .deps -x Makefile dovecot-2.1.12-orig/src/imap/imap-commands.h dovecot-2.1.12-mod/src/imap/imap-commands.h --- dovecot-2.1.12-orig/src/imap/imap-commands.h 2011-12-13 11:35:28.000000000 +0000 +++ dovecot-2.1.12-mod/src/imap/imap-commands.h 2013-02-20 17:15:44.000000000 +0000 @@ -30,7 +30,9 @@ Dovecot internally returns it for all kinds of commands, but unfortunately RFC 5530 specifies it only for "delete something" operations. */ - COMMAND_FLAG_USE_NONEXISTENT = 0x10 + COMMAND_FLAG_USE_NONEXISTENT = 0x10, + /* Set when need to delay command hook function calls due to recursive command_exec() */ + COMMAND_FLAG_HOOKS_DELAY = 0x20 }; struct command {

2 1

[Dovecot] LMTP logging
by Peter Rindfuss 24 Feb '13

24 Feb '13

Hi, Is there a way (in Dovecot 2.1.14) to sent LMTP log entries and IMAP log entries to different files? I know I could achieve this with syslog-ng, but as LDA has a log file of its own, I am wondering if this is possible with LMTP as well. I apologize if I missed something in the wiki. Thanks, Peter

3 5

[Dovecot] Problem importing mail from maildir directory
by Thomas Koeller 24 Feb '13

24 Feb '13

Hi, I am trying to import mail from a maildir directory into dovecot using the 'doveadm import' command: ----------- bash-4.0$ doveadm -D import -u marion maildir:${HOME}/Mail '' ALL doveadm(marion): Debug: Loading modules from directory: /usr/lib64/dovecot doveadm(marion): Debug: Module loaded: /usr/lib64/dovecot/lib10_quota_plugin.so doveadm(marion): Debug: Loading modules from directory: /usr/lib64/dovecot/doveadm doveadm(marion): Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intentional, so just ignore this message) doveadm(marion): Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_deinit (this is usually intentional, so just ignore this message) doveadm(marion): Debug: Module loaded: /usr/lib64/dovecot/doveadm/lib10_doveadm_quota_plugin.so doveadm(marion): Debug: Skipping module doveadm_zlib_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_zlib_plugin.so: undefined symbol: i_stream_create_deflate (this is usually intentional, so just ignore this message) doveadm(marion): Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_backend_rescan (this is usually intentional, so just ignore this message) doveadm(marion): Debug: Effective uid=10001, gid=10000, home=/home/marion doveadm(marion): Debug: quota: No quota setting - plugin disabled doveadm(marion): Debug: maildir++: root=/home/marion/Mail, index=, control=, inbox=/home/marion/Mail, alt= doveadm(marion): Debug: Effective uid=10001, gid=10000, home=/home/marion doveadm(marion): Debug: quota: No quota setting - plugin disabled doveadm(marion): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mbox:~/mail:INBOX=/var/spool/mail/marion doveadm(marion): Debug: fs: root=/home/marion/mail, index=, control=, inbox=/var/spool/mail/marion, alt= ----------- What I get is - no mails are imported - no error messages are output - nothing is written to the system log in other words, nothing happens at all. Any hints? tk

2 1

[Dovecot] make install fails on Solaris 10
by Henrik Johansson 24 Feb '13

24 Feb '13

Hello, I am trying to build dovecot-2.1.15 on Solaris 10 update 10 with Solaris Studio 12.3 and get this error: /bin/bash ../../libtool --tag=CC --mode=link /opt/SUNWspro/bin/cc -fast -xipo=2 -I/usr/sfw/include -I/usr/sfw/include -no-undefined -o doveadm doveadm-mail.o doveadm-mail-altmove.o doveadm-mail-expunge.o doveadm-mail-fetch.o doveadm-mail-import.o doveadm-mail-index.o doveadm-mail-iter.o doveadm-mail-mailbox.o doveadm-mail-mailbox-status.o doveadm-mail-copymove.o doveadm-mailbox-list-iter.o doveadm-mail-search.o doveadm-mail-server.o doveadm-print.o doveadm-settings.o doveadm-util.o server-connection.o doveadm.o doveadm-auth.o doveadm-director.o doveadm-dump.o doveadm-dump-dbox.o doveadm-dump-index.o doveadm-dump-log.o doveadm-dump-mailboxlog.o doveadm-dump-thread.o doveadm-instance.o doveadm-kick.o doveadm-log.o doveadm-master.o doveadm-mount.o doveadm-mutf7.o doveadm-penalty.o doveadm-print-flow.o doveadm-print-pager.o doveadm-print-tab.o doveadm-print-table.o doveadm-proxy.o doveadm-pw.o doveadm-sis.o doveadm-stats.o doveadm-who.o dsync/libdsync.a ../auth/libpassword.a ../lib-ntlm/libntlm.a ../lib-otp/libotp.a ../../src/lib-storage/libdovecot-storage.la -R/usr/sfw/lib -L/usr/sfw/lib -lssl -lcrypto -lsocket -lnsl -ldl ../../src/lib-dovecot/libdovecot.la -export-dynamic -lnsl -lsocket -lrt -lsendfile libtool: link: /opt/SUNWspro/bin/cc -fast -xipo=2 -I/usr/sfw/include -I/usr/sfw/include -o .libs/doveadm doveadm-mail.o doveadm-mail-altmove.o doveadm-mail-expunge.o doveadm-mail-fetch.o doveadm-mail-import.o doveadm-mail-index.o doveadm-mail-iter.o doveadm-mail-mailbox.o doveadm-mail-mailbox-status.o doveadm-mail-copymove.o doveadm-mailbox-list-iter.o doveadm-mail-search.o doveadm-mail-server.o doveadm-print.o doveadm-settings.o doveadm-util.o server-connection.o doveadm.o doveadm-auth.o doveadm-director.o doveadm-dump.o doveadm-dump-dbox.o doveadm-dump-index.o doveadm-dump-log.o doveadm-dump-mailboxlog.o doveadm-dump-thread.o doveadm-instance.o doveadm-kick.o doveadm-log.o doveadm-master.o doveadm-mount.o doveadm-mutf7.o doveadm-penalty.o doveadm-print-flow.o doveadm-print-pager.o doveadm-print-tab.o doveadm-print-table.o doveadm-proxy.o doveadm-pw.o doveadm-sis.o doveadm-stats.o doveadm-who.o dsync/libdsync.a ../auth/libpassword.a ../lib-ntlm/libntlm.a ../lib-otp/libotp.a ../../src/lib-storage/.libs/libdovecot-storage.so -L/usr/sfw/lib /home/henrikj/Build/dovecot-2.1.15/src/lib-dovecot/.libs/libdovecot.so -lssl -lcrypto -ldl ../../src/lib-dovecot/.libs/libdovecot.so -lnsl -lsocket -lrt -lsendfile -R/opt/HNKSdovecot/lib/dovecot -R/usr/sfw/lib ld: warning: file ../../src/lib-dovecot/.libs/libdovecot.so: linked to /home/henrikj/Build/dovecot-2.1.15/src/lib-dovecot/.libs/libdovecot.so: attempted multiple inclusion of file ld: warning: file ../../src/lib-dovecot/.libs/libdovecot.so: linked to /home/henrikj/Build/dovecot-2.1.15/src/lib-dovecot/.libs/libdovecot.so: attempted multiple inclusion of file Undefined first referenced symbol in file $XBKaiwbjOCHRV5w.array_append_array_i..L93 dsync/libdsync.a(dsync-brain.o) $XBKaiwbjOCHRV5w.array_append_array_i..L94 dsync/libdsync.a(dsync-brain.o) $XBKaiwbjOCHRV5w.array_append_array_i..L95 dsync/libdsync.a(dsync-brain.o) ld: fatal: symbol referencing errors. No output written to .libs/doveadm *** Error code 2 make: Fatal error: Command failed for target `doveadm' Current working directory /home/henrikj/Build/dovecot-2.1.15/src/doveadm *** Error code 1 Any suggestions? Thanks Henrik

1 0

Re: [Dovecot] problems with imaps
by Joseph Tam 23 Feb '13

23 Feb '13

On 2013-02-22, Matthias Leopold wrote: > with thunderbird 10.0.12 i can't connect to port 993 and get errors in > the logs like > > TLS: SSL_read() failed: error:14094412:SSL > routines:SSL3_READ_BYTES:sslv3 alert bad certificate > > (certificate generated by dovecot mkcert.sh) I haven't come across any problems with our use of self-signed certificates, but I run the latest 2.1.x dovecot so maybe there's some SSL changes between our version and your's. The fact that the same certificate works for other clients, and also for TLS on Thunderbird seem to suggest Thunderbird is fumbling it. But maybe you can try the command diagnostic from the command line "openssl s_client -connect yourserver:993 ..." or use one of the online certificate checkers to get some useful diagnostics. > TLS: SSL_read() failed: error:14094418:SSL > routines:SSL3_READ_BYTES:tlsv1 alert unknown ca This error entry pops up in my logs once in a while. I think the error might be misleading since the error message happen in the middle of a long sequence of successful connections. Also check that the client is actually using the right security mode (not TLS or clear), perhaps by doing a network snoop. Joseph Tam <jtam.home(a)gmail.com>

2 1