July 2012 - dovecot - dovecot.org

Re: [Dovecot] Dovecot 2.1.8 crashes when doing POP3 UIDL on empty INBOX
by Joseph Tam 08 Jul '12

08 Jul '12

Timo Sirainen <tss(a)iki.fi> writes: >> #0 i_panic (format=0xff2302f8 "Trying to allocate %u bytes") at failures.c:259 >> #1 0xff2068a4 in pool_alloconly_malloc (pool=0x60330, size=0) at mempool-alloconly.c:259 >> #2 0x00018248 in client_uidls_save (client=0x54d28) at pop3-commands.c:761 >> #3 0x00018444 in cmd_uidl_init (client=0x54d28, seq=0) at pop3-commands.c:793 >> #4 0x000185a8 in cmd_uidl (client=0x54d28, args=0x19eb8 "") at pop3-commands.c:824 >> #5 0x00018a24 in client_command_execute (client=0x54d28, name=0x2b550 "UIDL", args=0x19eb8 "") >> at pop3-commands.c:889 > > Fixed: http://hg.dovecot.org/dovecot-2.1/rev/ea18b2ddb67b > > Date: Sat, 7 Jul 2012 05:52:03 +0300 2 hours after I reported it; do you ever sleep?! Thanks. Joseph Tam <jtam.home(a)gmail.com>

4 3

[Dovecot] + sub addressing setup
by Voytek Eymont 07 Jul '12

07 Jul '12

I have Dovecot/Postfix/MySQL/PostfixAdmin, I'd like to setup + sub addressing (for +spam and possibly user-defined +folders) I have setup a user+spam folder path in PostfixAdmin as so; vvv+spam@tld path:tld/vvv@tld/.spam/ that requires me to put a 'duplicate' user with the + and +path for each user, the folks on PostfixAdmin suggested that Dovecot might have a better way of handling this, how do I accomplish this in Dovecot ? thanks for any suggestions or tips -- Voytek

2 6

[Dovecot] Dovecot 2.1.8 crashes when doing POP3 UIDL on empty INBOX
by Joseph Tam 07 Jul '12

07 Jul '12

I noticed a bunch of crashes when Gmail users tried to slurp up their (empty) mailboxes. The problem is not noticed by clients though, but it crashes the pop3 process. POP3 session S: +OK Ready. C: USER user S: +OK C: PASS password S: +OK Logged in. C: UIDL ... server crash and disconnects ... Resulting log Jul 06 16:58:05 pop3(user): Panic: Trying to allocate 0 bytes Jul 06 16:58:05 pop3(user): Error: Raw backtrace: 0xff1e6454 -> 0xff1e4f78 -> 0xff20689c -> 0x18240 -> 0x1843c - > 0x185a0 -> 0x18a1c -> 0x1576c -> 0x159cc -> 0xff1fee6c -> 0xff200e24 -> 0xff1fef60 -> 0xff1d8010 -> 0x13584 - > 0x1285c Jul 06 16:58:14 pop3(user): Fatal: master: service(pop3): child 24972 killed with signal 6 (core dumps disabled) GDB traceback: #0 i_panic (format=0xff2302f8 "Trying to allocate %u bytes") at failures.c:259 #1 0xff2068a4 in pool_alloconly_malloc (pool=0x60330, size=0) at mempool-alloconly.c:259 #2 0x00018248 in client_uidls_save (client=0x54d28) at pop3-commands.c:761 #3 0x00018444 in cmd_uidl_init (client=0x54d28, seq=0) at pop3-commands.c:793 #4 0x000185a8 in cmd_uidl (client=0x54d28, args=0x19eb8 "") at pop3-commands.c:824 #5 0x00018a24 in client_command_execute (client=0x54d28, name=0x2b550 "UIDL", args=0x19eb8 "") at pop3-commands.c:889 #6 0x00015774 in client_handle_input (client=0x54d28) at pop3-client.c:629 #7 0x000159d4 in client_input (client=0x54d28) at pop3-client.c:682 #8 0xff1fee74 in io_loop_call_io (io=0x37298) at ioloop.c:379 #9 0xff200e2c in io_loop_handler_run (ioloop=0x34138) at ioloop-poll.c:211 #10 0xff1fef68 in io_loop_run (ioloop=0x34138) at ioloop.c:398 #11 0xff1d8018 in master_service_run (service=0x33c88, callback=0x13120 <client_connected>) at master-service.c:543 #12 0x0001358c in main (argc=1, argv=0xffbffe0c) at main.c:268 Some non-trivial changes in pop3-commands.c were done between 2.1.3 and 2.1.8 (expecially pop3_uidl_duplicates changes in 2.1.7). I guess this bug has crept in there. Joseph Tam <jtam.home(a)gmail.com>

2 1

[Dovecot] Pigeonhole Sieve SetFlag question
by Vyacheslav Biruk 06 Jul '12

06 Jul '12

Hello, I use FreeBSD 8.2-RELEASE-p7 i386 dovecot-2.1.6 dovecot-pigeonhole-0.3.0_1 I have the following problem: When I use the following script - the flag is set in \Seen : require ["imap4flags"]; # rule:[test] if anyof (header :contains "Subject" "test") { setflag "\\Seen"; stop; } . SELECT INBOX * OK [CLOSED] Previous mailbox closed. * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 1 EXISTS * 1 RECENT * OK [UIDVALIDITY 1338600150] UIDs valid * OK [UIDNEXT 9] Predicted next UID * OK [NOMODSEQ] No permanent modsequences . OK [READ-WRITE] Select completed. . FETCH 1 (UID FLAGS BODY.PEEK[HEADER.FIELDS (DATE SUBJECT)]) * 1 FETCH (UID 8 FLAGS (\Seen \Recent) BODY[HEADER.FIELDS (DATE SUBJECT)] {57} Date: Fri, 6 Jul 2012 14:02:49 +0000 Subject: test 1 ) . OK Fetch completed. But when I use following script - the flag is not set in \Seen require ["fileinto","imap4flags"]; # rule:[test] if anyof (header :contains "Subject" "test") { fileinto "INBOX.SPAM"; setflag "\\Seen"; stop; } . SELECT INBOX.SPAM * OK [CLOSED] Previous mailbox closed. * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 1 EXISTS * 1 RECENT * OK [UNSEEN 1] First unseen. * OK [UIDVALIDITY 1338600159] UIDs valid * OK [UIDNEXT 7] Predicted next UID * OK [NOMODSEQ] No permanent modsequences . OK [READ-WRITE] Select completed. . FETCH 1 (UID FLAGS BODY.PEEK[HEADER.FIELDS (DATE SUBJECT)]) * 1 FETCH (UID 6 FLAGS (\Recent) BODY[HEADER.FIELDS (DATE SUBJECT)] {57} Date: Fri, 6 Jul 2012 13:53:29 +0000 Subject: test 1 ) . OK Fetch completed. so it should be or is it a bug? -- Best regards, magic

3 2

[Dovecot] I changed the separator from . to / and it still seems to work.
by Hans de Groot 06 Jul '12

06 Jul '12

Hello, Just as an experiment I changed the separator from . to / restarted dovecot (v2.1.1). When adding an existing account with lots of mail folders to thunderbird everything still seems to work. My directory layout is like this: .Info.mailinglists .Info.mailinglists.Horde .Info.mailinglists.modperl .Info.mailinglists.PDNS .Info.mailinglists.Sogo .Info.mailinglists.tinc .Info.mailinglists.Zabbix I added a new folder to the horde mailing using thunderbird list and got an extra folder .Info.mailinglists.Horde.testinhorde Does this mean the separator has nothing to do with the . in the directory names and I am safe to switch saparators without having to do anything else? Regards Hans de Groot

1 0

[Dovecot] Dovecot v2 shared mailboxes , a . separator and complete emailaddress as username.
by Hans de Groot 06 Jul '12

06 Jul '12

Hello, I've been trying to get shared mailboxes to work and got stuck. I tried lots of examples made the shared dict but the shared mail boxes never showed up. I am using the . separator and I think this the problem. I changed it to a / separator and now I could see my shared mailboxes. Checking the maillog in debug mode I saw a few failed login attempts between the succesful logins. The weird thing is that the username was changed, instead of hansg(a)debushalte.nl the login was hansg@debushalte without the .nl part and that user is not in my database. So I suspect that dovecot splits the shared path based hansg(a)debushalte.nl shares mailboxes with dean(a)debushalte.nl below a few lines from the log: Debug: Namespace : type=shared, prefix=INBOX.shared.%u., sep=., inbox=no, hidden=no, list=yes, subscriptions=no location=maildir:%h/mail:INDEX=/mail/debushalte.nl/dean/mail/shared.%u Debug: shared: Tried to access mails of nonexistent user hansg@debushalte Debug: Namespace INBOX.shared.hansg@debushalte.: Creating storage despite: Root mail directory doesn't exist Is there a work arround for this? I really like to keep using '.' as a seperator so I do not have to change all the existing mailboxes. If I do rename and move all existing mailboxes the '/' separator way and of course change the separator in the namespaces would my users notice this? (ie would they have to change something in their mail clients?) Regards Hans

1 0

[Dovecot] dovecot and nfs readdir vs readdirplus operations
by Angel L. Mateo 06 Jul '12

06 Jul '12

Hello, We are having performance problems trying to migrate our pop/imap servers to a new version. Our old servers are 4 debian lenny with 5GB of RAM running of XenServer VMs with kernel 2.6.32-4-amd64 and dovecot 1.1.16. New servers are 4 ubuntu 12.04 with dovecot 2.1.5 running on vmware vm with 6 cores and 16GB of RAM and kernel 3.2.0-24-generic. On both server we are using nfs 3 with same configuration (regardless of internal kernel differences, but we have no customized any of them, we are using vanilla kernels with default configurations). The problem we have is that new servers have performance problems. Even when have a small part of our total users (about 25%) directed to the new farm, performance is very poor, even useless. Looking for NFS problems, we have found a lot of differences in nfs operations. For example, this is the nfsstat of one of a new servers at this moment: myotis21:~# nfsstat Client rpc stats: calls retrans authrefrsh 414528349 885 37 Client nfs v3: null getattr setattr lookup access readlink 0 0% 95673837 23% 3961938 0% 89586364 21% 110097351 26% 2930961 0% read write create mkdir symlink mknod 20009850 4% 6065319 1% 3757720 0% 1557 0% 0 0% 0 0% remove rmdir rename link readdir readdirplus 6378134 1% 281 0% 2602358 0% 555097 0% 53126619 12% 15615402 3% fsstat fsinfo pathconf commit 113256 0% 26152 0% 0 0% 4026151 0% and this is the same on one of the new ones: amateo_adm@myotis31:~$ nfsstat Server rpc stats: calls badcalls badclnt badauth xdrcall 0 0 0 0 0 Client rpc stats: calls retrans authrefrsh 178040318 675 178040800 Client nfs v3: null getattr setattr lookup access readlink 0 0% 24350345 13% 5045924 2% 10939469 6% 30185146 16% 142865 0% read write create mkdir symlink mknod 8818016 4% 6058614 3% 2877653 1% 420 0% 0 0% 0 0% remove rmdir rename link readdir readdirplus 2842562 1% 69 0% 2961239 1% 634038 0% 0 0% 82921863 46% fsstat fsinfo pathconf commit 70861 0% 18754 0% 9377 0% 152702 0% Although nfs configuration is the same, there are a lot of differences on readdir vs readdirplus nfs operations. In fact, in the old one we have 12% readdir operations and 3% of readdirplus. And in the new one we have 46% of readdirplus and no readdir operations. Although readdirplus is supposed to be an optimization in nfs3, in situations when you have big directories and uses just a few entries of these directories it could be worse. So we think if this could be the problem (or one of them). Any idea of this difference? And if this difference could be significative? PS: I have attached doveconf -n of the new server. -- Angel L. Mateo Martínez Sección de Telemática Área de Tecnologías de la Información y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868887590 Fax: 868888337

5 12

[Dovecot] Dovecot mailstorage migration uppon logging / delivery with dsync
by Xavier Beaudouin 05 Jul '12

05 Jul '12

Hi there, I have a pretty standard setup with "simple" dovecot 2,0 configuration (eg /var/mailboxes on NFS with old netapp) and local ldap directory and Maildir. I wanted to find a good way to migrate from NFS old netapp to NFS new server (this one is not a netapp !). There 3 kind way (according to my own experience) - rsync old spool to new spool being patient stop services and then doing last rsync and mount /var/mailboxes mount point from old netapp to new nfs server). - doing imap_login (and other stuff like this) doing an rsync per box AFTER doing the first rsync with all boxes... - using dsync to fetch the maildir stuff from old server to new one, doing a simple flag, and doing "au fil de l'eau" migration. The last one seems to me a good idea, but I cannot figure host to make this correctly. Any hints or do someone here has already done this kind of stuff? Kind regards, -- Xavier Beaudouin

2 1

[Dovecot] Migration Question
by Peter Fraser 05 Jul '12

05 Jul '12

Hi all I got a shiny new server and I want to install the latest and greatest of everything on it. The old server has dovecot-1.2.17 working with postfix-2.8.4,1, dovecot quotas, sieve etc. My question is: Would it work of I installed dovecot 2 on this server along with everything I want and just copy the /home/virtualmail directory where all the user mail directories are? I use the Maildir format by the way.

3 2

[Dovecot] error: director left/right disconnected
by Patrick Westenberg 05 Jul '12

05 Jul '12

Hello, yesterday I set up a second director and even it works fine, some errors occur in the logfile on the new director: director: Error: Director 172.17.1.3:9090/left disconnected director: Error: Director 172.17.1.3:9090/right disconnected 172.17.1.3 belongs to the first director which has no errors. Where is the problem? Regards Patrick # 2.1.7: /usr/local/etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.5 auth_debug = yes auth_verbose = yes director_mail_servers = 172.17.1.1 director_servers = 172.17.1.3 172.17.1.4 lmtp_proxy = yes log_path = /var/log/dovecot.log managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave passdb { args = proxy=y nopassword=y starttls=any-cert driver = static } protocols = imap pop3 lmtp sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { user = dovecot } } service director { fifo_listener login/proxy-notify { mode = 0666 } inet_listener { address = 172.17.1.4 port = 9090 } unix_listener director-userdb { mode = 0600 } unix_listener login/director { mode = 0666 } } service imap-login { executable = imap-login director } service lmtp { inet_listener lmtp { address = 172.17.1.4 port = 24 } } service managesieve-login { executable = managesieve-login director inet_listener sieve { port = 4190 } } service pop3-login { executable = pop3-login director } ssl_cert = </etc/ssl/certs/imap.wk-serv.de.crt ssl_key = </etc/ssl/private/imap.wk-serv.de.key protocol lmtp { auth_socket_path = director-userdb } # 2.1.6: /usr/local/etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.5 director_mail_servers = 172.17.1.1 director_servers = 172.17.1.3 172.17.1.4 lmtp_proxy = yes log_path = /var/log/dovecot.log managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave passdb { args = proxy=y nopassword=y starttls=any-cert driver = static } protocols = imap pop3 lmtp sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { user = dovecot } } service director { fifo_listener login/proxy-notify { mode = 0666 } inet_listener { address = 172.17.1.3 port = 9090 } unix_listener director-userdb { mode = 0600 } unix_listener login/director { mode = 0666 } } service imap-login { executable = imap-login director } service lmtp { inet_listener lmtp { address = 172.17.1.3 port = 24 } } service managesieve-login { executable = managesieve-login director inet_listener sieve { port = 4190 } } service pop3-login { executable = pop3-login director } protocol lmtp { auth_socket_path = director-userdb }

2 1