- dovecot - dovecot.org

[Dovecot] configuring imap_stats
by Reinhard Vicinus 09 Jul '12

09 Jul '12

Hi, i'm trying to configure imap_stats like it's documented in the wiki: http://wiki2.dovecot.org/Statistics. But as soon as i activate the imap_stats plugin i get the following error message trying to login via imap: dovecot: imap: Error: Can't load plugin imap_stats_plugin: Plugin stats must be loaded also (you must set: mail_plugins=$mail_plugins stats) But the stats plugin is configured as you can see in the attached configurations. Also i can get statistics without the imap_stats enabled, but as far as i know only of the pop3 users. Kind regards Reinhard

2 1

[Dovecot] mailboxes missing after upgrade from 2.1.4 to 2.1.7
by Micah Anderson 09 Jul '12

09 Jul '12

Hi all, I mentioned this on the #dovecot irc channel, but I thought I would post here so I can provide more details. The basic problem is that when I upgraded from 2.1.4 to 2.1.7, some users no longer are able to see their folders in pine/alpine. The folders are actually there, and are subscribed (according to doveadm) and its possible to do operations on those folders, if you know the name (for example, opening the folder works fine if you know the name). When I downgrade to 2.1.4 again, the folders appear again, so its clearly something that changed between the two versions. I looked through the changelog, and found a few possibile culprits, I think pine/alpine use imapc, so that could be related: . imapc: Use imapc_list_prefix also for listing subscriptions . Fixed looking up parent mailbox name with different namespace vs. layout separators. . imapc: Don't list mailboxes that don't match list patterns. . layout=fs: Fixed listing mailboxes with prefix=INBOX/ . LIST with mailbox {} settings incorrectly set subscribed-flags. Here is my dovecot -n output: # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.5 auth_default_realm = example.net auth_verbose = yes default_process_limit = 256 default_vsz_limit = 512 M dict { expire = mysql:/etc/dovecot/dovecot-dict-sql.conf quota = mysql:/etc/dovecot/dovecot-dict-sql.conf } disable_plaintext_auth = no first_valid_gid = 8 first_valid_uid = 8 last_valid_gid = 8 last_valid_uid = 8 listen = * login_greeting = howdy, ready. mail_location = mdbox:~/mdbox:INDEX=/srv/dovecot_indexes/%d/%1n/%n mail_plugins = expire quota zlib stats maildir_very_dirty_syncs = yes namespace { inbox = yes location = prefix = separator = . } namespace { alias_for = hidden = yes inbox = no list = no location = prefix = INBOX. separator = . } passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } plugin { antispam_allow_append_to_spam = yes antispam_backend = pipe antispam_debug_target = syslog antispam_pipe_program = /usr/local/bin/train_spam antispam_pipe_program_args = -d;10.0.1.109 antispam_pipe_program_notspam_arg = ham antispam_pipe_program_spam_arg = spam antispam_pipe_tmpdir = /var/tmp antispam_signature = X-Spam-Flag antispam_signature_missing = error antispam_spam_pattern_ignorecase = SPAM antispam_trash_pattern = trash;Trash;Deleted * expire = Trash expire2 = Trash/* expire3 = Spam expire_dict = proxy::expire quota = dict:Your mail quota::proxy::quota quota_rule = *:bytes=100663296 quota_rule2 = Trash:bytes=+20%% quota_rule3 = Spam:bytes=+10%% quota_rule4 = INBOX.Trash:bytes=+20%% quota_rule5 = INBOX.Spam:bytes=+10%% quota_rule6 = INBOX.restored_from_backups:bytes=+500%% sieve = ~/.dovecot.sieve sieve_after = /var/lib/dovecot/sieve/after.sieve sieve_before = /var/lib/dovecot/sieve/default.sieve sieve_dir = ~/sieve stats_refresh = 30 secs stats_track_cmds = yes zlib_save = gz zlib_save_level = 6 } postmaster_address = postmaster(a)example.net protocols = " imap pop3" service anvil { unix_listener anvil { group = dovecot mode = 0660 user = root } } service auth { unix_listener auth-userdb { group = mail mode = 0600 user = mail } } service dict { unix_listener dict { group = mail mode = 0600 user = mail } } service imap-login { process_min_avail = 10 service_count = 0 vsz_limit = 512 M } service imap-postlogin { executable = script-login /usr/local/sbin/postlogin_imap } service imap { executable = imap imap-postlogin process_limit = 2048 } service pop3-login { process_min_avail = 10 service_count = 0 vsz_limit = 512 M } service pop3-postlogin { executable = script-login /usr/local/sbin/postlogin_pop } service pop3 { executable = pop3 pop3-postlogin } service stats { fifo_listener stats-mail { mode = 0600 user = mail } } ssl_cert = </etc/certs/wildcard/cert.pem ssl_cipher_list = HIGH:-ADH:-aNULL ssl_key = </etc/certs/wildcard/key.pem userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } verbose_proctitle = yes protocol lda { mail_plugins = expire quota zlib stats sieve plugin { quota_exceeded_message = Sorry, your message cannot be delivered to that person because their mailbox is full. If you can contact them another way, you may wish to tell them of this problem. quota_rule7 = INBOX:bytes=+10%% } } protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep mail_max_userip_connections = 20 mail_plugins = expire quota zlib stats imap_quota imap_zlib antispam imap_stats plugin { quota_exceeded_message = You are over quota. To avoid losing mail, immediately empty your Trash and Sent folders and delete emails with large attachments. Visit https://help.example.net/quota for more help. } } protocol pop3 { mail_plugins = expire quota zlib stats pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_uidl_format = %g } As requested by tss in #dovecot, I attempted to add 'rawlog' to: service imap-postlogin { executable = script-login /usr/local/sbin/postlogin_imap } to get: service imap-postlogin { executable = script-login rawlogin /usr/local/sbin/postlogin_imap } but with that, it doesn't even open the INBOX folder, and there is nothing in the user's rawlog folder, I get this error: dovecot: imap-postlogin: Error: Fatal: This process must not be run as root it didn't open even the INBOX imap folder I went over the http://wiki2.dovecot.org/Debugging/Rawlog and made sure everything was correct there, but it still didn't work right. Any ideas or suggestions of things to try would be greatly appreciated! thanks, micah --

1 1

[Dovecot] Howto add another disk storage
by Adrian Minta 09 Jul '12

09 Jul '12

Hi all What is the best strategy to add another storage to an existing virtual mail system ? Move some domains to the new storage and create symlinks ? Switch to dovecot hashing ? But in this case what is the easy-east way to migrate ? Thanks for any suggestions or tips !

15 50

Re: [Dovecot] Dovecot 2.1.8 crashes when doing POP3 UIDL on empty INBOX
by Joseph Tam 08 Jul '12

08 Jul '12

Timo Sirainen <tss(a)iki.fi> writes: >> #0 i_panic (format=0xff2302f8 "Trying to allocate %u bytes") at failures.c:259 >> #1 0xff2068a4 in pool_alloconly_malloc (pool=0x60330, size=0) at mempool-alloconly.c:259 >> #2 0x00018248 in client_uidls_save (client=0x54d28) at pop3-commands.c:761 >> #3 0x00018444 in cmd_uidl_init (client=0x54d28, seq=0) at pop3-commands.c:793 >> #4 0x000185a8 in cmd_uidl (client=0x54d28, args=0x19eb8 "") at pop3-commands.c:824 >> #5 0x00018a24 in client_command_execute (client=0x54d28, name=0x2b550 "UIDL", args=0x19eb8 "") >> at pop3-commands.c:889 > > Fixed: http://hg.dovecot.org/dovecot-2.1/rev/ea18b2ddb67b > > Date: Sat, 7 Jul 2012 05:52:03 +0300 2 hours after I reported it; do you ever sleep?! Thanks. Joseph Tam <jtam.home(a)gmail.com>

4 3

[Dovecot] + sub addressing setup
by Voytek Eymont 07 Jul '12

07 Jul '12

I have Dovecot/Postfix/MySQL/PostfixAdmin, I'd like to setup + sub addressing (for +spam and possibly user-defined +folders) I have setup a user+spam folder path in PostfixAdmin as so; vvv+spam@tld path:tld/vvv@tld/.spam/ that requires me to put a 'duplicate' user with the + and +path for each user, the folks on PostfixAdmin suggested that Dovecot might have a better way of handling this, how do I accomplish this in Dovecot ? thanks for any suggestions or tips -- Voytek

2 6

[Dovecot] Dovecot 2.1.8 crashes when doing POP3 UIDL on empty INBOX
by Joseph Tam 07 Jul '12

07 Jul '12

I noticed a bunch of crashes when Gmail users tried to slurp up their (empty) mailboxes. The problem is not noticed by clients though, but it crashes the pop3 process. POP3 session S: +OK Ready. C: USER user S: +OK C: PASS password S: +OK Logged in. C: UIDL ... server crash and disconnects ... Resulting log Jul 06 16:58:05 pop3(user): Panic: Trying to allocate 0 bytes Jul 06 16:58:05 pop3(user): Error: Raw backtrace: 0xff1e6454 -> 0xff1e4f78 -> 0xff20689c -> 0x18240 -> 0x1843c - > 0x185a0 -> 0x18a1c -> 0x1576c -> 0x159cc -> 0xff1fee6c -> 0xff200e24 -> 0xff1fef60 -> 0xff1d8010 -> 0x13584 - > 0x1285c Jul 06 16:58:14 pop3(user): Fatal: master: service(pop3): child 24972 killed with signal 6 (core dumps disabled) GDB traceback: #0 i_panic (format=0xff2302f8 "Trying to allocate %u bytes") at failures.c:259 #1 0xff2068a4 in pool_alloconly_malloc (pool=0x60330, size=0) at mempool-alloconly.c:259 #2 0x00018248 in client_uidls_save (client=0x54d28) at pop3-commands.c:761 #3 0x00018444 in cmd_uidl_init (client=0x54d28, seq=0) at pop3-commands.c:793 #4 0x000185a8 in cmd_uidl (client=0x54d28, args=0x19eb8 "") at pop3-commands.c:824 #5 0x00018a24 in client_command_execute (client=0x54d28, name=0x2b550 "UIDL", args=0x19eb8 "") at pop3-commands.c:889 #6 0x00015774 in client_handle_input (client=0x54d28) at pop3-client.c:629 #7 0x000159d4 in client_input (client=0x54d28) at pop3-client.c:682 #8 0xff1fee74 in io_loop_call_io (io=0x37298) at ioloop.c:379 #9 0xff200e2c in io_loop_handler_run (ioloop=0x34138) at ioloop-poll.c:211 #10 0xff1fef68 in io_loop_run (ioloop=0x34138) at ioloop.c:398 #11 0xff1d8018 in master_service_run (service=0x33c88, callback=0x13120 <client_connected>) at master-service.c:543 #12 0x0001358c in main (argc=1, argv=0xffbffe0c) at main.c:268 Some non-trivial changes in pop3-commands.c were done between 2.1.3 and 2.1.8 (expecially pop3_uidl_duplicates changes in 2.1.7). I guess this bug has crept in there. Joseph Tam <jtam.home(a)gmail.com>

2 1

[Dovecot] Pigeonhole Sieve SetFlag question
by Vyacheslav Biruk 06 Jul '12

06 Jul '12

Hello, I use FreeBSD 8.2-RELEASE-p7 i386 dovecot-2.1.6 dovecot-pigeonhole-0.3.0_1 I have the following problem: When I use the following script - the flag is set in \Seen : require ["imap4flags"]; # rule:[test] if anyof (header :contains "Subject" "test") { setflag "\\Seen"; stop; } . SELECT INBOX * OK [CLOSED] Previous mailbox closed. * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 1 EXISTS * 1 RECENT * OK [UIDVALIDITY 1338600150] UIDs valid * OK [UIDNEXT 9] Predicted next UID * OK [NOMODSEQ] No permanent modsequences . OK [READ-WRITE] Select completed. . FETCH 1 (UID FLAGS BODY.PEEK[HEADER.FIELDS (DATE SUBJECT)]) * 1 FETCH (UID 8 FLAGS (\Seen \Recent) BODY[HEADER.FIELDS (DATE SUBJECT)] {57} Date: Fri, 6 Jul 2012 14:02:49 +0000 Subject: test 1 ) . OK Fetch completed. But when I use following script - the flag is not set in \Seen require ["fileinto","imap4flags"]; # rule:[test] if anyof (header :contains "Subject" "test") { fileinto "INBOX.SPAM"; setflag "\\Seen"; stop; } . SELECT INBOX.SPAM * OK [CLOSED] Previous mailbox closed. * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 1 EXISTS * 1 RECENT * OK [UNSEEN 1] First unseen. * OK [UIDVALIDITY 1338600159] UIDs valid * OK [UIDNEXT 7] Predicted next UID * OK [NOMODSEQ] No permanent modsequences . OK [READ-WRITE] Select completed. . FETCH 1 (UID FLAGS BODY.PEEK[HEADER.FIELDS (DATE SUBJECT)]) * 1 FETCH (UID 6 FLAGS (\Recent) BODY[HEADER.FIELDS (DATE SUBJECT)] {57} Date: Fri, 6 Jul 2012 13:53:29 +0000 Subject: test 1 ) . OK Fetch completed. so it should be or is it a bug? -- Best regards, magic

3 2

[Dovecot] I changed the separator from . to / and it still seems to work.
by Hans de Groot 06 Jul '12

06 Jul '12

Hello, Just as an experiment I changed the separator from . to / restarted dovecot (v2.1.1). When adding an existing account with lots of mail folders to thunderbird everything still seems to work. My directory layout is like this: .Info.mailinglists .Info.mailinglists.Horde .Info.mailinglists.modperl .Info.mailinglists.PDNS .Info.mailinglists.Sogo .Info.mailinglists.tinc .Info.mailinglists.Zabbix I added a new folder to the horde mailing using thunderbird list and got an extra folder .Info.mailinglists.Horde.testinhorde Does this mean the separator has nothing to do with the . in the directory names and I am safe to switch saparators without having to do anything else? Regards Hans de Groot

1 0

[Dovecot] Dovecot v2 shared mailboxes , a . separator and complete emailaddress as username.
by Hans de Groot 06 Jul '12

06 Jul '12

Hello, I've been trying to get shared mailboxes to work and got stuck. I tried lots of examples made the shared dict but the shared mail boxes never showed up. I am using the . separator and I think this the problem. I changed it to a / separator and now I could see my shared mailboxes. Checking the maillog in debug mode I saw a few failed login attempts between the succesful logins. The weird thing is that the username was changed, instead of hansg(a)debushalte.nl the login was hansg@debushalte without the .nl part and that user is not in my database. So I suspect that dovecot splits the shared path based hansg(a)debushalte.nl shares mailboxes with dean(a)debushalte.nl below a few lines from the log: Debug: Namespace : type=shared, prefix=INBOX.shared.%u., sep=., inbox=no, hidden=no, list=yes, subscriptions=no location=maildir:%h/mail:INDEX=/mail/debushalte.nl/dean/mail/shared.%u Debug: shared: Tried to access mails of nonexistent user hansg@debushalte Debug: Namespace INBOX.shared.hansg@debushalte.: Creating storage despite: Root mail directory doesn't exist Is there a work arround for this? I really like to keep using '.' as a seperator so I do not have to change all the existing mailboxes. If I do rename and move all existing mailboxes the '/' separator way and of course change the separator in the namespaces would my users notice this? (ie would they have to change something in their mail clients?) Regards Hans

1 0

[Dovecot] dovecot and nfs readdir vs readdirplus operations
by Angel L. Mateo 06 Jul '12

06 Jul '12

Hello, We are having performance problems trying to migrate our pop/imap servers to a new version. Our old servers are 4 debian lenny with 5GB of RAM running of XenServer VMs with kernel 2.6.32-4-amd64 and dovecot 1.1.16. New servers are 4 ubuntu 12.04 with dovecot 2.1.5 running on vmware vm with 6 cores and 16GB of RAM and kernel 3.2.0-24-generic. On both server we are using nfs 3 with same configuration (regardless of internal kernel differences, but we have no customized any of them, we are using vanilla kernels with default configurations). The problem we have is that new servers have performance problems. Even when have a small part of our total users (about 25%) directed to the new farm, performance is very poor, even useless. Looking for NFS problems, we have found a lot of differences in nfs operations. For example, this is the nfsstat of one of a new servers at this moment: myotis21:~# nfsstat Client rpc stats: calls retrans authrefrsh 414528349 885 37 Client nfs v3: null getattr setattr lookup access readlink 0 0% 95673837 23% 3961938 0% 89586364 21% 110097351 26% 2930961 0% read write create mkdir symlink mknod 20009850 4% 6065319 1% 3757720 0% 1557 0% 0 0% 0 0% remove rmdir rename link readdir readdirplus 6378134 1% 281 0% 2602358 0% 555097 0% 53126619 12% 15615402 3% fsstat fsinfo pathconf commit 113256 0% 26152 0% 0 0% 4026151 0% and this is the same on one of the new ones: amateo_adm@myotis31:~$ nfsstat Server rpc stats: calls badcalls badclnt badauth xdrcall 0 0 0 0 0 Client rpc stats: calls retrans authrefrsh 178040318 675 178040800 Client nfs v3: null getattr setattr lookup access readlink 0 0% 24350345 13% 5045924 2% 10939469 6% 30185146 16% 142865 0% read write create mkdir symlink mknod 8818016 4% 6058614 3% 2877653 1% 420 0% 0 0% 0 0% remove rmdir rename link readdir readdirplus 2842562 1% 69 0% 2961239 1% 634038 0% 0 0% 82921863 46% fsstat fsinfo pathconf commit 70861 0% 18754 0% 9377 0% 152702 0% Although nfs configuration is the same, there are a lot of differences on readdir vs readdirplus nfs operations. In fact, in the old one we have 12% readdir operations and 3% of readdirplus. And in the new one we have 46% of readdirplus and no readdir operations. Although readdirplus is supposed to be an optimization in nfs3, in situations when you have big directories and uses just a few entries of these directories it could be worse. So we think if this could be the problem (or one of them). Any idea of this difference? And if this difference could be significative? PS: I have attached doveconf -n of the new server. -- Angel L. Mateo Martínez Sección de Telemática Área de Tecnologías de la Información y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868887590 Fax: 868888337

5 12