April 2012 - dovecot - dovecot.org

[Dovecot] 2.1.x changes and dsync -- Wiki suggestion
by Jeff Kletsky 26 Apr '12

26 Apr '12

There are a couple things that show up on the Upgrading/2.1 wiki page that would be useful to have on pages describing dsync (Tools/Dsync, Migration/MailFormat, Tools, perhaps others): * dsync was merged into doveadm * You can't dsync 2.0.x to/from 2.1.x That second point is especially "interesting" to me as it seems that Apple MacOS X Server is still on 2.0.16, at least from what I see on opensource.apple.com. I was planning on migrating mail off the current server onto my friend's new MacMini, but I'll have to figure out how to "downgrade" the mail jail to a 2.0 version, it seems. Thanks for all the great work, Jeff

1 0

[Dovecot] Reading Mutt mboxes from Thunderbird
by Leonardo M. Ramé 26 Apr '12

26 Apr '12

Hi, I'm a user of Mutt, and before moving to Thunderbird I'm trying to share mboxes between them. To do this, I installed Dovecot to create an IMAP server in my local machine, to serve mutt mboxes to be read by Thunderbird. So far, I can read my inbox from /var/mail/%u, but in mutt, I have many folders in ~/mail, like 2010-mails, 2011-mails, mailing-list-x, mailing-list-y, and so on. How can I configure Dovecot to read them?. In /etc/dovecot/conf.d/10-mail.conf I have this: mail_location = mbox:~/Mail:INBOX=/var/mail/%u I'm using Ubuntu 11.10, and Dovecot 2.0.13. Regards, -- Leonardo M. Ramé Medical IT - Griensu S.A. Av. Colón 636 - Piso 8 Of. A X5000EPT -- Córdoba Tel.: +54(351)4246924 +54(351)4247788 +54(351)4247979 int. 19 Cel.: +54(351)156629292

3 2

[Dovecot] How to remove duplicate GUID messages from storage?
by Daniel Parthey 26 Apr '12

26 Apr '12

Hi, I tried to import messages like this: doveadm import -u username(a)example.org mdbox:/mail/dovecot/example.org/username/mail mbox:/root/mail.txt all This seemed to have imported the same messages in the mail storage, as they were already there. And now I have got a lot of duplicates. Then I deleted the mbox:/root/mail mail stuff from "mailboxes" folder and the storage remained, with duplicate GUIDs. The following command doveadm -v force-resync -u username(a)example.org INBOX outputs lots of messages like this one, with different GUID doveadm(username(a)example.org): Error: mdbox /mail/dovecot/example.org/username/mail/storage: Duplicate GUID 0b8a032d66a0924fb42c0000de5f8128 in m.55:45484041 and m.14:52173045 The messages at m.55:45484041 and m.14:52173045 have the same content, since they were seemingly imported from the mail store itself, they are in the storage twice now and require twice as much disk space as before. How can I manually remove these identical, duplicate messages from the storage to save space? Dovecot does not do it automatically. Kind regards, Daniel

2 3

[Dovecot] dovecot-lda error
by Hadi Salem 25 Apr '12

25 Apr '12

Hi, im getting the fallowing error. from dovecot-lda log Apr 25 17:30:41 lda(jamal(a)example.com): Fatal: setgid(5003(vmail) from userdb lookup) failed with euid=8(mail), gid=12(mail), egid=12(mail): Operation not permitted (This binary should probably be called with process group set to 5003(vmail) instead of 12(mail)) this error occur if im using different uid and gid part from mail uid.. jamal@example.com:{PLAIN}123:5003:5003::/var/vmail/example.com/jamal/::userdb_mail=maildir:~/Maildir but if i use mail uid it work fine.. jamal@example.com:{PLAIN}123:8:12::/var/vmail/example.com/jamal/::userdb_mail=maildir:~/Maildir i tried using multiple uids as mention in wiki2.dovecot.org/LDA bye setting up setuid-root for dovecot-lda but im getting on-there error from sendmail :- Apr 25 17:30:41 host1 sendmail[31024]: q3PEUen2031022: to=<jamal(a)example.com>, delay=00:00:00, xdelay=00:00:00, mailer=dovecot, pri=120359, relay=dovecot, dsn=4.0.0, stat=Deferred: dovecot mailer (/usr/local/libexec/dovecot/dovecot-lda) exited with EX_TEMPFAIL im using sendmail. [root@host1 conf.d]# doveconf -n # 2.0.20: /usr/local/etc/dovecot/dovecot.conf # OS: Linux 2.6.18-164.el5 x86_64 CentOS release 5.4 (Final) auth_debug = yes auth_debug_passwords = yes auth_verbose = yes auth_verbose_passwords = plain debug_log_path = /var/log/dovecot.log disable_plaintext_auth = no first_valid_gid = 12 first_valid_uid = 8 hostname = host1.bigmama.com info_log_path = /var/log/dovecot.log last_valid_gid = 50000 last_valid_uid = 50000 log_path = /var/log/dovecot.log mail_debug = yes mail_gid = mail mail_location = maildir:~/Maildir mail_uid = mail passdb { args = scheme=PLAIN username_format=%u /etc/dovecot/users driver = passwd-file } postmaster_address = root(a)host1.bigmama.com service auth { unix_listener auth-userdb { group = mail mode = 0666 user = mail } } ssl = no userdb { args = username_format=%u /etc/dovecot/users driver = passwd-file } protocol lda { info_log_path = /var/log/dovecot-lda.log log_path = /var/log/dovecot-lda-errors.log }

2 1

[Dovecot] 2.1.5 problem with mail_location
by postmaster 25 Apr '12

25 Apr '12

I've been advised to set : mail_location = maildir:~/ as the home directory is found through a sql request. this has been working perfectly up to and including 2.1.4 from 2.1.5 however this setting gives cause to a problem : instead of looking in the mail home eg /var/mail/domain/user\@domain/ dovecot is looking for mail in /var/mail/domain/user\@domain/~ the '~' directory is created upon the first request for mail and all future mail transactions in dovecot is done relative to this folder. is this behavior a bug or a feature ??? -- Bjarne D Mathiesen København N ; Danmark ; Europa ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ denne besked er skrevet i et totalt M$-frit miljø MacOS X 10.7.3 Lion ; 2.8GHz Intel Core i7 ; 16GB 1067MHz DDR3

2 1

[Dovecot] sieve vacation redirect problem
by Robert Schetterer 25 Apr '12

25 Apr '12

Hi , since upgrade sieve vacation, redirect stopped working getting postfix error while sending end of data -- message may be sent more than once i played a lot about sieve , lda submission host conf entries etc but all failed , i am not seeing any heavy bug in the logs -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria

4 15

[Dovecot] Error compiling pigeonhole 0.3.0 with dovecot-2.1.5 in openbsd 5.0
by Joseba Torre 25 Apr '12

25 Apr '12

Hi, I've just tried to compile dovecot & pigeonhole in my openbsd box, and got this: gcc -DHAVE_CONFIG_H -I. -I../.. -I/home/seajob/build/dovecot-2.1.5 -I/home/seajob/build/dovecot-2.1.5/src/lib -I/home/seajob/build/dovecot-2.1.5/src/lib-dict -I/home/seajob/build/dovecot-2.1.5/src/lib-dns -I/home/seajob/build/dovecot-2.1.5/src/lib-mail -I/home/seajob/build/dovecot-2.1.5/src/lib-imap -I/home/seajob/build/dovecot-2.1.5/src/lib-fs -I/home/seajob/build/dovecot-2.1.5/src/lib-charset -I/home/seajob/build/dovecot-2.1.5/src/lib-index -I/home/seajob/build/dovecot-2.1.5/src/lib-storage -I/home/seajob/build/dovecot-2.1.5/src/lib-storage/index -I/home/seajob/build/dovecot-2.1.5/src/lib-storage/index/raw -I../.. -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict-aliasing=2 -I/usr/include -MT managesieve-quote.o -MD -MP -MF .deps/managesieve-quote.Tpo -c -o managesieve-quote.o managesieve-quote.c mv -f .deps/managesieve-quote.Tpo .deps/managesieve-quote.Po gcc -DHAVE_CONFIG_H -I. -I../.. -I/home/seajob/build/dovecot-2.1.5 -I/home/seajob/build/dovecot-2.1.5/src/lib -I/home/seajob/build/dovecot-2.1.5/src/lib-dict -I/home/seajob/build/dovecot-2.1.5/src/lib-dns -I/home/seajob/build/dovecot-2.1.5/src/lib-mail -I/home/seajob/build/dovecot-2.1.5/src/lib-imap -I/home/seajob/build/dovecot-2.1.5/src/lib-fs -I/home/seajob/build/dovecot-2.1.5/src/lib-charset -I/home/seajob/build/dovecot-2.1.5/src/lib-index -I/home/seajob/build/dovecot-2.1.5/src/lib-storage -I/home/seajob/build/dovecot-2.1.5/src/lib-storage/index -I/home/seajob/build/dovecot-2.1.5/src/lib-storage/index/raw -I../.. -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict-aliasing=2 -I/usr/include -MT managesieve-parser.o -MD -MP -MF .deps/managesieve-parser.Tpo -c -o managesieve-parser.o managesieve-parser.c managesieve-parser.c: In function 'quoted_string_istream_read': managesieve-parser.c:639: error: 'EPROTO' undeclared (first use in this function) managesieve-parser.c:639: error: (Each undeclared identifier is reported only once managesieve-parser.c:639: error: for each function it appears in.) *** Error code 1 Stop in /home/seajob/build/dovecot-2.1-pigeonhole-0.3.0/src/lib-managesieve (line 92 of /usr/share/mk/sys.mk). *** Error code 1 Stop in /home/seajob/build/dovecot-2.1-pigeonhole-0.3.0/src (line 289 of Makefile). *** Error code 1 Stop in /home/seajob/build/dovecot-2.1-pigeonhole-0.3.0 (line 474 of Makefile). *** Error code 1 Stop in /home/seajob/build/dovecot-2.1-pigeonhole-0.3.0 (line 353 of Makefile).

2 2

[Dovecot] dsync on large mailbox "fails"
by Jeff Kletsky 25 Apr '12

25 Apr '12

I've been trying to convert an existing set of mbox mail to maildir using dsync, but it seems to fail when it gets to the large boxes. $ dsync -Dv mirror maildir:~/Maildir Everything seems to work reasonably well until the first of the large boxes hits: dsync(jeff): Warning: Maildir /home/jeff/Maildir/.cron.2010-07-10: Synchronization took 1210 seconds (102289 new msgs, 0 flag change attempts, 0 expunge attempts) dsync(jeff): Warning: Transaction log file /home/jeff/Maildir/.cron.2010-07-10/dovecot.index.log was locked for 1210 seconds After this, the doveadm process goes from ~75% of the CPU core utilization to 100% and stays there, even overnight. I've also tried $ dsync -Dv backup maildir:~/Maildir with similar results. While I did see some threads on dsync speed, they seemed to be minutes for a few GB of data, not hours. There is plenty of space on the drive, and, from what I understand, there is not a file-count limit on FreeBSD's ufs (at least not one that I'm anywhere near) Any suggestions? Thanks! Jeff [jeff@mail ~]$ du -h -d 0 ~/mail 3.9G /home/jeff/mail [jeff@mail ~]$ ls -lh /var/mail/jeff -rw------- 1 jeff jeff 554M Apr 23 11:27 /var/mail/jeff [jeff@mail ~]$ df -h Filesystem Size Used Avail Capacity Mounted on /dev/ada0s2g 38G 18G 16G 53% / (Note that the hostname and the location of the ssl certificate has been manually edited for this message in the following output) From dmesg.boot: Copyright (c) 1992-2012 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 9.0-STABLE #0: Sat Apr 21 17:13:07 PDT 2012 root@my.host.name:/usr/obj/usr/src/sys/GENERIC i386 CPU: Intel(R) Atom(TM) CPU 330 @ 1.60GHz (1600.03-MHz 686-class CPU) Origin = "GenuineIntel" Id = 0x106c2 Family = 6 Model = 1c Stepping = 2 Features=0xbfe9fbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE> Features2=0x40e31d<SSE3,DTES64,MON,DS_CPL,TM2,SSSE3,CX16,xTPR,PDCM,MOVBE> AMD Features=0x20100000<NX,LM> AMD Features2=0x1<LAHF> TSC: P-state invariant, performance statistics real memory = 2147483648 (2048 MB) avail memory = 2077757440 (1981 MB) [jeff@mail ~]$ doveconf -n # 2.1.3: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 9.0-STABLE i386 auth_mechanisms = plain login disable_plaintext_auth = no first_valid_gid = 1000 first_valid_uid = 1000 listen = * mail_location = mbox:~/mail/:INBOX=/var/mail/%u mail_privileged_group = mail namespace { inbox = yes location = prefix = separator = / } passdb { args = session=yes dovecot driver = pam } protocols = imap service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { mode = 0600 } user = root } service imap-login { inet_listener imap { port = 0 } process_limit = 200 } ssl = required ssl_cert = </path/to/certificate.pem ssl_key = </path/to/certificate.pem userdb { args = blocking=yes driver = passwd } verbose_proctitle = yes protocol imap { imap_client_workarounds = tb-extra-mailbox-sep }

2 5

[Dovecot] trash plugin bug?
by Cor Bosman 25 Apr '12

25 Apr '12

Hey all, has anyone ever tried turning on the trash plugin when the directory is already over quota? I see some messages being deleted, but it seems it just deletes enough to fit the new email, not enough to go below quota. Example: . getquotaroot "Spam" * QUOTAROOT "Spam" "User quota" "Spam Quota" * QUOTA "User quota" (STORAGE 591036 5242880) * QUOTA "Spam Quota" (STORAGE 21173 20480) I now move a 5K message into this folder, and I see: Apr 23 22:26:43 lmtp1 dovecot: imap(cor): expunge: box=Spam, uid=226337, msgid=<3YVKIIE4II6R0064BA7IM55C2Q4MD01VX12U1I(a)shedevils.com>, size=12984 Apr 23 22:26:43 lmtp1 dovecot: imap(cor): expunge: box=Spam, uid=226338, msgid=<aab6bffa3ad83767d4a7bc571c31449c(a)bonus-news.com>, size=5623 Apr 23 22:26:43 lmtp1 dovecot: imap(cor): save: box=Spam, uid=227759, msgid=<20120423191509.F3B584A355B(a)signal.groundspeak.com>, size=2694 And now: . getquotaroot "Spam" * QUOTAROOT "Spam" "User quota" "Spam Quota" * QUOTA "User quota" (STORAGE 591016 5242880) * QUOTA "Spam Quota" (STORAGE 21158 20480) . OK Getquotaroot completed. This seems like a possible bug. For one, it shouldnt be allowed to actually save a message into that folder, but it does. The email does end up in the Spam folder even though the folder is over quota. And of course it doesnt clear up enough space to have the new email fit, it just deleted enough to match the 5K. Without the trash plugin quota is being properly enforced. Everything works fine if you start out below the quota limit btw. Regards, Cor ps: this is 2.1.4, but with the recent trash and quota patches applied.

2 3

[Dovecot] sievec segfaults
by interfaSys sàrl 24 Apr '12

24 Apr '12

Hello, sievec segfaults when it reads a file. I've tried with both the standard and gold linker. I've tried with various sieve files and they all make it crash. I've compiled pigeonhole with -ggdb, but I'm not getting much info Program received signal SIGSEGV, Segmentation fault. 0x0000000800b8e587 in strlen () from /lib/libc.so.7 (gdb) bt full #0 0x0000000800b8e587 in strlen () from /lib/libc.so.7 No symbol table info available. #1 0x0000000800a12e8c in str_append () from /usr/lib/dovecot/libdovecot.so.0 No symbol table info available. #2 0x000000080077f02d in sieve_binary_save () from /usr/lib/dovecot/libdovecot-sieve.so.0 No symbol table info available. #3 0x0000000000605bf0 in environ () No symbol table info available. #4 0x0000000000000000 in ?? () No symbol table info available. #5 0x00007fffffffeb6e in ?? () No symbol table info available. #6 0x0000000000000001 in ?? () No symbol table info available. #7 0x0000000000000000 in ?? () No symbol table info available. #8 0x000000080060878d in ?? () from /libexec/ld-elf.so.1 No symbol table info available. #9 0x0000000000605cd9 in ?? () No symbol table info available. #10 0x0000000801000ea8 in ?? () No symbol table info available. #11 0x0000000000005008 in ?? () No symbol table info available. #12 0x0000000000000000 in ?? () No symbol table info available. #13 0x0000000801099040 in ?? () No symbol table info available. #14 0x0000000000000000 in ?? () No symbol table info available. #15 0x0000000000000180 in ?? () No symbol table info available. #16 0x0000000000605bf0 in environ () No symbol table info available. #17 0x0000000000000000 in ?? () No symbol table info available. #18 0x00007fffffffeb6e in ?? () No symbol table info available. #19 0x0000000000000001 in ?? () No symbol table info available. #20 0x0000000000000000 in ?? () No symbol table info available. #21 0x0000000000000000 in ?? () No symbol table info available. #22 0x0000000000402f93 in main () No symbol table info available. Cheers, Olivier

2 5