October 2012 - dovecot

[Dovecot] 76Gb to 146Gb [Resolved]
by Spyros Tsiolis 23 Oct '12

23 Oct '12

Hello all, I would like to thank you all for your kind replies and feedback in regards to migrating from a smaller hdd to a bigger one (namely from 72gb to 146gb). I finally found a painless way of doing this. Since I believe that this is still an off-topic post, if anyone is interested in the solution i've adopted for this, let me know by replying to me privately. If, however, you don't mind me posting here, let me know. Many many thanks go to Alexander Hoogerhuis, the "mad Norwegian" :-) who helped me on this too much to describe here. Alex, you are a true sport. Thank you again people. All the Best, spyros ---- "I merely function as a channel that filters music through the chaos of noise" - Vangelis

1 0

[Dovecot] Dovecot LDA message save logging
by Dominic Malolepszy 23 Oct '12

23 Oct '12

Hi, Is there any option in Dovecot that enables logging the full path of where a message is saved in the backend? Dominic

2 1

[Dovecot] Anybody recognize these log lines?
by Knute Johnson 23 Oct '12

23 Oct '12

WARN: Duplicate profile 'Dovecot POP3', using last found WARN: Duplicate profile 'Dovecot Secure POP3', using last found WARN: Duplicate profile 'Dovecot IMAP', using last found WARN: Duplicate profile 'Dovecot Secure IMAP', using last found Anybody know if these are dovecot generated? Thanks, -- Knute Johnson

2 2

[Dovecot] (new) director issues in 2.1.10
by Kelsey Cummings 23 Oct '12

23 Oct '12

Timo - I upgraded to 2.1.10 on our director servers two nights ago and apart from errors associated with the directors processes restarting everything looked great for ~24 hours until I failed our the real servers last night to update the nfs mount options for the spools. I followed the suggested procedure for each backend server, just run on one of the directors, which seemed to work as expected. doveadm director add x.x.x.x 0 doveadm director flush x.x.x.x The following errors on the directors that started after this went unnoticed until this AM. director: User bb host lookup failed: Timeout - queued for 30 secs (Ring synced for 36 secs) director: User cc host lookup failed: Timeout - queued for 48 secs (Ring synced for 66 secs, user refreshed 12 secs ago) director: User dd host lookup failed: Timeout - queued for 124 secs (Ring synced for 119 secs, weak user, user refreshed 155 secs ago) director: User ee host lookup failed: Timeout - queued for 79 secs (Ring synced for 119 secs, weak user, user refreshed 113 secs ago) ... User ff host lookup failed: Timeout - queued for 30 secs (Ring synced for 7427 secs, weak user, user refreshed 620 secs ago) This continued, combined with occasional login timeouts (as reported by some internal imap clients.) The login delays/timeouts got bad enough that our load balancers dropped both the servers while I was investigating. They seem to be okay after being restarted. -K

2 5

[Dovecot] auth timeout state=2, bad?
by Bernhard Schmidt 22 Oct '12

22 Oct '12

Hello, we run Dovecot 2.1.7 as SASL backend for our Postfix SMTP-AUTH farm and see this error message occasionally Oct 22 16:15:32 lxmhs52 dovecot: auth: PLAIN(?,xx.xx.xx.xx): Request 0.21 timeouted after 150 secs, state=2 Since it is mostly the same IP repeating I'm assuming it's a client issue. Is that correct? What could cause this? Can we safely ignore it? Thanks, Bernhard

2 1

[Dovecot] Marking all mail in one folder of public mailbox as read
by Frerich Raabe 22 Oct '12

22 Oct '12

Hi, I'm running Dovecot 1.2.17 on FreeBSD 9 to serve an archive of a few internal mailinglists. The archive is implemented using a public namespace: namespace private { separator = / prefix = inbox = yes } namespace public { separator = / prefix = Lists/ location = maildir:/home/vmail/lists/Maildir:CONTROL=~/Maildir/lists:INDEX=~/Maildir/lists subscriptions = no } As you can see, the CONTROL/INDEX files are stored per-user to allow private \Seen flags. The different mailinglists are all sent to the 'lists' user which has a Sieve script to file them into different folders, so I have directories on my harddisk like /home/vmail/lists/Maildir/.somelist /home/vmail/lists/Maildir/.anotherlist Now, I'd like to mark the mail in *one* of those folders as \Seen by default. If the INDEX files weren't per-user, it would simply be a matter of using 'addflag "\Seen";' in the Sieve script of the lists user. Alas, this has no effect. Hence my question - how can I have the mail of just one mailinglist get marked as "read" for all users? So far, the only option I see is to add a second public namespace, with a different prefix - and this namespace doesn't use private CONTROL/INDEX files. However, I'd like to keep using the "Lists" prefix if possible to avoid too many changes to the clients. -- Frerich Raabe - raabe(a)froglogic.com www.froglogic.com - Multi-Platform GUI Testing

2 2

[Dovecot] Segmentation fault in doveadm with lib01_acl_plugin.so
by Alessio Cecchi 22 Oct '12

22 Oct '12

Hi, I'm running dovecot 2.1.10 on Debian 6. When I run "doveadm expunge -A mailbox Trash savedbefore 30d" it crash with "Segmentation fault" [15022673.496902] doveadm[13072]: segfault at 8 ip 00007f4b7041f551 sp 00007fffdab4f8c0 error 4 in lib01_acl_plugin.so[7f4b70415000+10000] If I add -D to doveadm I can see this: doveadm(myuser(a)mydomain.com): Debug: Added userdb setting: plugin/quota_rule=*:backend=524288000S doveadm(myuser(a)mydomain.com): Debug: Effective uid=89, gid=89, home=/home/vpopmail/domains/2/mydomain.com/myuser doveadm(myuser(a)mydomain.com): Debug: Quota root: name=UserQuota backend=maildir args= doveadm(myuser(a)mydomain.com): Debug: Quota rule: root=UserQuota mailbox=* bytes=524288000 messages=0 doveadm(myuser(a)mydomain.com): Debug: Quota rule: root=UserQuota mailbox=Trash bytes=+104857600 messages=0 doveadm(myuser(a)mydomain.com): Debug: Quota root: name=User quota backend=dict args=:noenforcing:proxy::quota doveadm(myuser(a)mydomain.com): Debug: dict quota: user=myuser(a)mydomain.com, uri=proxy::quota, noenforcing=1 doveadm(myuser(a)mydomain.com): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:~/Maildir doveadm(myuser(a)mydomain.com): Debug: maildir++: root=/home/vpopmail/domains/2/mydomain.com/myuser/Maildir, index=, control=, inbox=/home/vpopmail/domains/2/mydomain.com/myuser/Maildir, alt= doveadm(myuser(a)mydomain.com): Debug: acl: initializing backend with data: vfile:/usr/local/dovecot-2.1/etc/dovecot/global-acls:cache_secs=300 doveadm(myuser(a)mydomain.com): Debug: acl: acl username = myuser(a)mydomain.com doveadm(myuser(a)mydomain.com): Debug: acl: owner = 1 doveadm(myuser(a)mydomain.com): Debug: acl vfile: Global ACL directory: /usr/local/dovecot-2.1/etc/dovecot/global-acls doveadm(myuser(a)mydomain.com): Debug: Namespace : type=shared, prefix=shared/%n/, sep=/, inbox=no, hidden=no, list=children, subscriptions=no location=maildir:%h/Maildir:INDEX=~/Maildir/shared/%u doveadm(myuser(a)mydomain.com): Debug: shared: root=/usr/local/dovecot-2.1/var/run/dovecot, index=, control=, inbox=, alt= doveadm(myuser(a)mydomain.com): Debug: acl: initializing backend with data: vfile:/usr/local/dovecot-2.1/etc/dovecot/global-acls:cache_secs=300 doveadm(myuser(a)mydomain.com): Debug: acl: acl username = myuser(a)mydomain.com doveadm(myuser(a)mydomain.com): Debug: acl: owner = 0 doveadm(myuser(a)mydomain.com): Debug: acl vfile: Global ACL directory: /usr/local/dovecot-2.1/etc/dovecot/global-acls doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=276 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=277 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=278 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=279 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=280 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=281 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=282 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=283 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=284 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=285 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=286 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=287 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=288 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=289 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=290 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=291 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=292 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=293 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=294 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=295 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=296 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=297 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=298 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=299 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=300 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=301 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=302 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=303 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=304 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=305 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=306 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=307 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=308 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=309 doveadm(myuser(a)mydomain.com): Debug: expunge: box=Trash uid=310 doveadm(myuser(a)mydomain.com): Debug: acl vfile: file /usr/local/dovecot-2.1/etc/dovecot/global-acls//.DEFAULT not found doveadm(myuser(a)mydomain.com): Debug: Namespace : Using permissions from /home/vpopmail/domains/2/mydomain.com/myuser/Maildir: mode=0700 gid=-1 doveadm(myuser(a)mydomain.com): Debug: acl vfile: file /usr/local/dovecot-2.1/etc/dovecot/global-acls/Drafts not found doveadm(myuser(a)mydomain.com): Debug: acl vfile: file /home/vpopmail/domains/2/mydomain.com/myuser/Maildir/.Drafts/dovecot-acl not found doveadm(myuser(a)mydomain.com): Debug: acl vfile: file /usr/local/dovecot-2.1/etc/dovecot/global-acls/Spam not found doveadm(myuser(a)mydomain.com): Debug: acl vfile: file /home/vpopmail/domains/2/mydomain.com/myuser/Maildir/.Spam/dovecot-acl not found doveadm(myuser(a)mydomain.com): Debug: acl vfile: file /usr/local/dovecot-2.1/etc/dovecot/global-acls/Sent not found doveadm(myuser(a)mydomain.com): Debug: acl vfile: file /home/vpopmail/domains/2/mydomain.com/myuser/Maildir/.Sent/dovecot-acl not found doveadm(myuser(a)mydomain.com): Debug: acl vfile: file /usr/local/dovecot-2.1/etc/dovecot/global-acls/Trash not found doveadm(myuser(a)mydomain.com): Debug: acl vfile: file /home/vpopmail/domains/2/mydomain.com/myuser/Maildir/.Trash/dovecot-acl not found doveadm(myuser(a)mydomain.com): Debug: acl vfile: file /usr/local/dovecot-2.1/etc/dovecot/global-acls/INBOX not found doveadm(myuser(a)mydomain.com): Debug: acl vfile: file /home/vpopmail/domains/2/mydomain.com/myuser/Maildir/dovecot-acl not found Segmentation fault If I disable "acl" plugin in dovecot all works fine. I think that this problem is connected with "Dovecot deliver Segmentation fault when arrive the first message" http://www.dovecot.org/list/dovecot/2012-September/068343.html that I'm still experiencing. How can get core dumps from "doveadm"? This is my dovecot config with acl enabled: # 2.1.10: /usr/local/dovecot-2.1/etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.6 auth_cache_size = 512 k auth_worker_max_count = 60 default_login_user = nobody dict { acl = mysql:/usr/local/dovecot-2.1/etc/dovecot/dovecot-share-folder.conf quota = mysql:/usr/local/dovecot-2.1/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no dotlock_use_excl = no first_valid_gid = 89 first_valid_uid = 89 last_valid_gid = 89 last_valid_uid = 89 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes log_path = /var/log/dovecot/dovecot.log mail_fsync = always mail_location = maildir:~/Maildir mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = quota acl maildir_very_dirty_syncs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mmap_disable = yes namespace { list = children location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u prefix = shared/%%n/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / } passdb { args = /usr/local/dovecot-2.1/etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile:/usr/local/dovecot-2.1/etc/dovecot/global-acls:cache_secs=300 acl_shared_dict = proxy::acl quota = maildir:UserQuota quota2 = dict:User quota::noenforcing:proxy::quota quota_rule2 = Trash:storage=+100M sieve = ~/.dovecot.sieve sieve_default = /usr/local/dovecot-2.1/etc/dovecot/sieve/default.sieve sieve_dir = ~/sieve } protocols = imap pop3 sieve sendmail_path = /var/qmail/bin/sendmail service auth { unix_listener auth-userdb { group = vchkpw mode = 0660 user = vpopmail } } service dict { unix_listener dict { group = vchkpw mode = 0660 user = vpopmail } } service imap-login { service_count = 0 } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { service_count = 0 } ssl_cert = </etc/ssl/certs/wildcard.net.pem ssl_key = </etc/ssl/private/wildcard.net.key userdb { args = /usr/local/dovecot-2.1/etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lda { log_path = /var/log/dovecot/lda.log mail_plugins = quota acl sieve } protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep tb-lsub-flags mail_max_userip_connections = 20 mail_plugins = quota acl imap_quota imap_acl } protocol sieve { mail_max_userip_connections = 10 } protocol pop3 { mail_max_userip_connections = 5 pop3_client_workarounds = outlook-no-nuls oe-ns-eoh } Thanks

4 6

Re: [Dovecot] still having difficulties with per-user quotas
by Daniel Parthey 22 Oct '12

22 Oct '12

David Mehler wrote: > Thanks, so if I understand what your saying the reason I'm getting the > column update issues is Dovecot is reading from and writing to the > quota and quota_messages columns in my virtual_users table? > > My database user I believe only has select permissions on that table. > > So, I either need another table and to adjust my dovecot-dict.sql file > for that table, that's where Dovecot will write to, or two more > columns in the virtual_users table? > > Which way do you recommend? I would recommend to create a new table for dovecot_usage where dovecot is granted write permission. Regards Daniel

2 1

Re: [Dovecot] still having difficulties with per-user quotas
by Daniel Parthey 21 Oct '12

21 Oct '12

Hi Dave, David Mehler wrote: > Thanks for all your help so far. I have per-user quotas now working, I > had to also alter my dict config file as well. I am having two > outstanding issues, actually one outstanding issue and one question. > > Here's the question, given that the userdb sql query returns a default > quota entry for rows of zero in quota and quota_messages is the > default quota section needed in 90-quota.conf? > > plugin { > quota_rule = *:storage=1G > quota_rule2 = Trash:storage=+100M > } You need quota_rule2 to give the user some additional space in the Trash folder if he/she wants to delete messages when over quota. The dict is also needed for quota lookup from the database. The only thing which might be omitted is the global quota_rule since it is returned by the userdb/passwd in any case, but I'm not sure what happens if you only configure a "quota_rule2" without configuring a "quota_rule". > My outstanding issue is whenever I as the root mysql user update a > user's quota the other user also gets an update, I noticed with one > the messages column on the other user went from 0 to 2, another time > the quota value went up from 0 to 3500 it seems random. You should not be accounting the actual mailbox usage in the same virtual_users table as the quota is read from. Use *different* column or table name in your dict file where dovecot may write the current storage/message count. > dovecot-dict-sql.conf.ext > > map { > pattern = priv/quota/storage > table = virtual_users > username_field = user > value_field = quota value_field should be current_quota_storage (writable column) > } > map { > pattern = priv/quota/messages > table = virtual_users > username_field = user > value_field = quota_messages value_field should be current_quota_messages (writable column) > I'd like to know why these columns are updating. Dovecot stores the current storage and mailcount in there. These columns should be different from the columns defining the maximum limit. Regards Daniel

1 0

[Dovecot] fstat() failed with file */dovecot.index.log
by Nicolás 21 Oct '12

21 Oct '12

Hi list! I'm using Dovecot along with Postfix (with MySQL) and I'm having some curious error messages in the mail log. Everything runs normally and suddenly I start viewing messages like these: Oct 12 14:24:23 dovecot: last message repeated 5 times Oct 12 14:25:23 dovecot: last message repeated 6 times Oct 12 14:26:23 dovecot: last message repeated 6 times Oct 12 14:27:23 dovecot: last message repeated 6 times Oct 12 14:29:22 mail dovecot: imap(nicolas(a)devels.es): Error: fstat() failed with file /home/vmail/devels.es/nicolas/Maildir/dovecot.index.log: No such file or directory Oct 12 14:30:23 dovecot: last message repeated 5 times Oct 12 14:31:23 dovecot: last message repeated 6 times Oct 12 14:33:22 mail dovecot: imap(nicolas(a)devels.es): Error: fstat() failed with file /home/vmail/devels.es/nicolas/Maildir/dovecot.index.log: No such file or directory Oct 12 14:34:23 dovecot: last message repeated 5 times Oct 12 14:35:23 dovecot: last message repeated 6 times Oct 12 14:36:01 mail dovecot: imap(nicolas(a)devels.es): Error: fstat() failed with file /home/vmail/devels.es/nicolas/Maildir/dovecot.index.log: No such file or directory This file which Dovecot references to indeed exists, is accesible, etc. Once I get the first of these messages, the user stops receiving e-mails (the mail server keeps receiving them normally, though) until he restarts the mail client. Then the error msg is gone and he receives all their unreceived messages. This error appears in 6-12h. intervals once the user starts their client. Version is 2.0.19, and dovecot -n is: root@mail:~# dovecot -n # 2.0.19: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-32-generic-pae i686 Ubuntu 12.04.1 LTS ext4 disable_plaintext_auth = no log_timestamp = "%Y-%m-%d %H:%M:%S " mail_location = maildir:/home/vmail/%d/%n/Maildir mailbox_idle_check_interval = 2 mins namespace { inbox = yes location = prefix = INBOX. separator = . type = private } passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } protocols = imap pop3 service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { mode = 0600 user = vmail } user = root } ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { args = uid=5000 gid=5000 home=/home/vmail/%d/%n allow_all_users=yes driver = static } protocol lda { auth_socket_path = /var/run/dovecot/auth-master log_path = /home/vmail/dovecot-deliver.log postmaster_address = postmaster(a)devels.es } protocol pop3 { pop3_uidl_format = %08Xu%08Xv } Thanks so much for any help! Nicolás

2 5