- dovecot - dovecot.org

mail-storage.c:2222:mailbox_copy assertion failed: (!ctx->unfinished)
by Giel van Schijndel 10 Nov '14

10 Nov '14

Hi, I see a lot of crashes in my syslog lately. Specifically a sequence of errors exactly like this (only the timestamp differs). > Nov 10 21:29:53 khitomer dovecot: imap-login: Login: user=<user@hostname>, method=PLAIN, rip=XXXX, lip=YYYY, mpid=ZZZZ, TLS, session=<TTTT> > Nov 10 21:29:53 khitomer dovecot: imap(user@hostname): Panic: file mail-storage.c: line 2222 (mailbox_copy): assertion failed: (!ctx->unfinished) > Nov 10 21:29:53 khitomer dovecot: imap(user@hostname): Fatal: master: service(imap): child 35108 killed with signal 6 (core not dumped) I have the mail storage on ZFS, one separate filesystem per user and another for the lucene indexes. I.e. these are separate ZFS filesystems (not pools): > /var/mail/vhosts/%d/%n > /var/mail/vhosts/%d/%n/lucene-indexes Any idea what could be going wrong? partial config (without LDA, SSL and auth portions): > # 2.2.15: /usr/local/etc/dovecot/dovecot.conf > # OS: FreeBSD 10.0-RELEASE-p12 amd64 > mail_gid = mail > mail_location = maildir:~/Maildir/ > mail_plugins = acl mailbox_alias quota virtual > mail_privileged_group = mail > mail_uid = vmail > namespace { > list = yes > location = maildir:/var/mail/public:INDEXPVT=~/Maildir/public > prefix = Public. > separator = . > subscriptions = no > type = public > } > namespace { > list = children > location = maildir:%%h/Maildir/:INDEX=~/Maildir/shared/%%n > prefix = shared.%%n. > separator = . > subscriptions = no > type = shared > } > namespace { > location = virtual:~/Maildir/virtual > prefix = virtual. > separator = . > type = private > } > namespace inbox { > inbox = yes > location = > mailbox Drafts { > special_use = \Drafts > } > mailbox Junk { > auto = create > special_use = \Junk > } > mailbox Sent { > auto = create > special_use = \Sent > } > mailbox Trash { > auto = create > special_use = \Trash > } > mailbox virtual.All { > special_use = \All > } > prefix = > separator = . > } > plugin { > acl = vfile:/usr/local/etc/dovecot/global-acls:cache_secs=10 > acl_anyone = allow > acl_shared_dict = file:/var/mail/vhosts/%d/shared-mailboxes.db > antispam_backend = mailtrain > antispam_mail_notspam = -g > antispam_mail_sendmail = /usr/bin/nice > antispam_mail_sendmail_args = /usr/local/bin/python2;-W;ignore;/usr/local/bin/sb_filter.py;-d;%h/.hammiedb;-f > antispam_mail_spam = -s > antispam_spam = SPAM;Spam;Junk > antispam_trash = Trash > antispam_unsure = Filtered-Spam;Possible-Spam > fetchmail_pidfile = %h/.fetchmail.pid > fts = lucene > fts_autoindex = yes > fts_autoindex_max_recent_msgs = 30 > fts_decoder = decode2text > fts_index_timeout = 60 > fts_lucene = whitespace_chars=@. mime_parts > mailbox_alias_new = Sent Messages > mailbox_alias_new2 = Sent Items > mailbox_alias_old = Sent > mailbox_alias_old2 = Sent > quota = maildir:User quota > quota_grace = 10%% > quota_rule = *:storage=1G > quota_rule2 = Trash:storage=+100M > quota_rule3 = Junk:ignore > quota_rule4 = Possible-Spam:ignore > quota_rule5 = Filtered-Spam:ignore > recipient_delimiter = + > } > postmaster_address = postmaster@$hostname > protocols = imap lmtp sieve > quota_full_tempfail = yes > service auth-worker { > user = $default_internal_user > } > service imap-login { > inet_listener imaps { > port = 993 > ssl = yes > } > } > service imap { > drop_priv_before_exec = yes > } > userdb { > args = username_format=%u /usr/local/etc/dovecot/users > default_fields = home=/var/mail/vhosts/%d/%n > driver = passwd-file > } > protocol imap { > mail_max_userip_connections = 25 > mail_plugins = acl mailbox_alias quota virtual imap_acl zlib imap_zlib imap_quota expire fetchmail_wakeup antispam > } -- Met vriendelijke groet, With kind regards, Giel van Schijndel -- "It would seem that perfection is attained not when no more can be added, but when no more can be removed." -- Antoine de Saint Exupéry

1 0

mail location change results in various errors
by Cliff Hayes 10 Nov '14

10 Nov '14

I have a sendmail/dovecot imap/pop3 system that has been running with the following mail_location: mail_location = mbox:/var/empty:INBOX=/var/spool/mail/%u:INDEX=/var/indexes/%u In order to reduce errors and simplify operation I removed imap and am now only responding to pop3. I'd like to also simplify the mail_location to get rid of index errors since I don't need indexes: mail_location = mbox:/var/spool/mail:INBOX=/var/spool/mail/%n But when I applied the new mail_location I began to get the following five errors: Nov 6 23:17:24 sendmail dovecot: pop3(chayes): Warning: UIDVALIDITY changed (1132434125 -> 1205169149) in mbox file /var/spool/mail/chayes Nov 6 23:17:26 sendmail dovecot: pop3(chayes): Panic: Message unexpectedly expunged from index Nov 6 23:17:26 sendmail dovecot: pop3(chayes): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0() [0x3340045e2a] -> /usr/lib64/dovecot/libdovecot.so.0() [0x3340045e6e] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x3340019eb3] -> /usr/lib64/dovecot/libdovecot-storage.so.0() [0x3ef62567ed] -> /usr/lib64/dovecot/libdovecot-storage.so.0() [0x3ef6256e75] -> /usr/lib64/dovecot/libdovecot-storage.so.0() [0x3ef62928ed] -> /usr/lib64/dovecot/libdovecot-storage.so.0(index_mail_set_seq+0x76) [0x3ef6294ae6] -> /usr/lib64/dovecot/libdovecot-storage.so.0() [0x3ef625698c] -> dovecot/pop3() [0x405ec7] -> dovecot/pop3(client_command_execute+0x6d7) [0x4071c7] -> dovecot/pop3(client_handle_input+0x78) [0x405618] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x3340052c36] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0xa7) [0x3340053a57] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x3340052778] -> /usr/lib64/dovecot/libdovecot.so.0(master_service_run+0x13) [0x334003e3c3] -> dovecot/pop3(main+0x283) [0x403cc3] -> /lib64/libc.so.6(__libc_start_main+0xf5) [0x359f821a05] -> dovecot/pop3() [0x403e2d] Nov 6 23:17:26 sendmail dovecot: pop3(chayes): Fatal: master: service(pop3): child 3358 killed with signal 6 (core dumps disabled) Nov 6 23:18:00 sendmail dovecot: pop3(jbkirk): Error: open(/var/spool/mail/.imap/INBOX/dovecot.index.log) failed: Permission denied (euid=2151(jbkirk) egid=12(mail) missing +r perm: /var/spool/mail/.imap/INBOX/dovecot.index.log, dir owned by 3575:12 mode=0770) dovecot -n output # 2.1.16: /etc/dovecot/dovecot.conf # OS: Linux 3.9.2-200.fc18.x86_64 x86_64 Fedora release 18 (Spherical Cow) ext4 auth_mechanisms = plain login auth_verbose = yes auth_verbose_passwords = plain disable_plaintext_auth = no mail_location = mbox:/var/empty:INBOX=/var/spool/mail/%u:INDEX=/var/indexes/%u mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } protocols = pop3 ssl = no ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { driver = passwd } What do I need to do to transition to the new mail_location without the errors? Thanks in advance.

1 0

Performance issue
by absolutely_free＠libero.it 10 Nov '14

10 Nov '14

Hi, Since few days I noticed very high load on my mailserver (Centos 6.6 64bit, 8 GB RAM, 2 x CPU 3.00GHz I am using Dovecot + Postfix + Roundcube + Nginx. I have about 10000 users. Spool is on network attached storage (Coraid). File system is ext4 (mounted with noatime). Problem appears almost every morning (while load is normal during afternoon). I suspect that this can be related to some user that have so many messages in his mailbox. How can I troubleshoot this? Here some messages that I got in maillog: Warning: Maildir: Scanning /var/spool/pop/domains/xxxx.it/YYYYYYYYY/Maildir/new took 71 seconds (1 readdir()s, 1 rename()s to cur/) Warning: Maildir /var/spool/pop/domains/zzzz/WWWWWWWWWWWW/Maildir/.Trash: Synchronization took 74 seconds (5 new msgs, 0 flag change attempts, 0 expunge attempts) dovecot: imap(xxxx(a)zzzz.it): Warning: Inotify instance limit for user 89 (UID postfix) exceeded, disabling. Increase /proc/sys/fs/inotify/max_user_instances tail: inotify cannot be used, reverting to polling: Too many open files My relevant dovecot conf: mail_location = maildir:/coraid-s2l2/domains namespace { type = private separator = . prefix = INBOX. inbox = yes } mail_uid = 89 mail_gid = 89 mail_fsync = never first_valid_uid = 89 first_valid_gid = 89 maildir_very_dirty_syncs = yes mbox_write_locks = fcntl thank you very much!

2 1

Best practise for deleting with Thunderbird
by Stefan G. Weichinger 09 Nov '14

09 Nov '14

As I mentioned in another thread I set up these 2 namespaces for a couple of users: namespace { inbox = yes location = prefix = separator = / type = private } namespace { location = maildir:/home/vmail/oeffentlich:INDEXPVT=/home/vmail/public/index/%d/%u/index prefix = Oeffentlich/ separator = / subscriptions = yes type = public } It is planned that they all will use Thunderbird (on MS Windows) to access their mailboxes. Now when I create a folder in the public space and try to delete it via thunderbird I get something like: "Renaming not supported across non-private namespaces" As far as I found out by browsing the web this is related to Thunderbird trying to move (=rename) the mail from the public to the private namespace, correct? Setting TB to immediately remove mails (tested that, this works) seems a bit scary to me: this removes a safety layer for the users because this would also apply to their personal maildirs. Is there any more elegant way of solving this? Do I have to set up some kind of ACLs? Some kind of "public paperbin folder" ?? Pls help me to understand this better ;-) Regards, Stefan

3 6

Improvement proposal
by Jorge Bastos 09 Nov '14

09 Nov '14

Hi, I'd like to purpose a small improvement. When a user has a quota set in message limit instead of bytes, the returning message it's the same as in bytes limit quota (Quota exceeded (mailbox for user is full)) If possible, when the user has the message limit, it could return something different like: Quota exceeded (max messages reached for user) Thanks, Jorge,

1 0

Re: Help on dict with QUOTA / perms
by Gedalya 09 Nov '14

09 Nov '14

On 11/08/2014 10:55 AM, Jorge Bastos wrote: > Hi, > > Ok managed to solve this with the permissions on the socket. > > One related question, the quota units are only Kb,M,G ? not possible to > define it in bytes? You can http://wiki2.dovecot.org/Quota/Configuration#Limit_configuration

2 1

Dovecot quota via custom column
by Filip Bartmann 08 Nov '14

08 Nov '14

Hello, we have multiple domains connected to single user account and we want to have quota counted via this column - called account_id. Users are stored in mysql database. --------------------------------------------------------------------------------- iterate_query = SELECT email AS user FROM mailboxes user_query=SELECT email, 501 AS uid, 501 AS gid, CONCAT('*:storage=',quota,'M') AS quota_rule FROM mailboxes AS m WHERE email='%u' password_query=SELECT email AS user, pw_hash AS password, CONCAT('*:storage=',quota,'M') AS userdb_quota_rule FROM mailboxes AS e WHERE email='%u' --------------------------------------------------------------------------------- We have quota stored in dovecot dictionary and as usable variables we found only - http://wiki2.dovecot.org/Variables. Is there any way to do use account_id as quota username? Thanks, Filip Bartmann

1 0

RE: Help on dict with QUOTA / perms
by Jorge Bastos 08 Nov '14

08 Nov '14

Hi, Ok managed to solve this with the permissions on the socket. One related question, the quota units are only Kb,M,G ? not possible to define it in bytes? > -----Original Message----- > From: dovecot [mailto:dovecot-bounces@dovecot.org] On Behalf Of Jorge > Bastos > Sent: sábado, 8 de Novembro de 2014 14:22 > To: 'Dovecot Mailing List' > Subject: Help on dict with QUOTA / perms > > I'm setting up quota for my users, my users have a UID starting on > >5000 and GID = 5000, and when I query the quota, for example in IMAP, > I get: > > > > Nov 8 14:13:28 fastmail dovecot: imap-login: Login: user=<a(a)a.com>, > method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=18660, secured, > session=<uByciFkH2gB/AAAB> > > Nov 8 14:13:37 fastmail dovecot: imap(a(a)a.com): Error: > net_connect_unix(/var/run/dovecot/dict) failed: Permission denied > (euid=5000(<unknown>) egid=5000(<unknown>) missing +r perm: > /var/run/dovecot/dict, dir owned by 0:0 mode=0755) > > > > Question is, should I have the GID on the users set to 0, or is there > another way to workaround it? > > > > Thanks,

1 0

Help on dict with QUOTA / perms
by Jorge Bastos 08 Nov '14

08 Nov '14

I'm setting up quota for my users, my users have a UID starting on >5000 and GID = 5000, and when I query the quota, for example in IMAP, I get: Nov 8 14:13:28 fastmail dovecot: imap-login: Login: user=<a(a)a.com>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=18660, secured, session=<uByciFkH2gB/AAAB> Nov 8 14:13:37 fastmail dovecot: imap(a(a)a.com): Error: net_connect_unix(/var/run/dovecot/dict) failed: Permission denied (euid=5000(<unknown>) egid=5000(<unknown>) missing +r perm: /var/run/dovecot/dict, dir owned by 0:0 mode=0755) Question is, should I have the GID on the users set to 0, or is there another way to workaround it? Thanks,

1 0

Virtual alias with dovecot
by Jorge Bastos 08 Nov '14

08 Nov '14

Hi, I've setup virtual alias/users/domains with postfix and dovecot, so far so good. In the alias table I set the information of the source and destination address, but then I try to send an email to the alias, dovecot complains about it. What am I doing wrong? Nov 7 23:04:13 fastmail dovecot: lmtp(4687): Connect from local Nov 7 23:04:13 fastmail postfix/lmtp[6556]: 1D2AC100E0A: to=<b(a)a.com>, relay=fastmail.domain.pt[private/dovecot-lmtp], delay=6.3, delays=6.2/0/0/0.06, dsn=5.1.1, status=bounced (host fastmail.domain.pt[private/dovecot-lmtp] said: 550 5.1.1 <b(a)a.com> User doesn't exist: b(a)a.com (in reply to RCPT TO command)) Nov 7 23:04:13 fastmail dovecot: lmtp(4687): Disconnect from local: Successful quit Postfix alias conf: virtual_alias_maps = mysql:/etc/postfix/mysql-virtual-alias-maps.cf cat mysql-virtual-alias-maps.cf user = posuser password = popass hosts = 127.0.0.1 dbname = postfix query = SELECT deliver_to FROM dovecot_aliases WHERE alias='%s' where the table structure is: CREATE TABLE `dovecot_aliases` ( `id` int(11) NOT NULL, `alias` varchar(255) NOT NULL, `deliver_to` varchar(255) NOT NULL, PRIMARY KEY (`id`) ) ENGINE=MyISAM DEFAULT CHARSET=utf8 ROW_FORMAT=DYNAMIC; Records are, considering that the main address is a(a)a.com: Insert into dovecot_alias values (1,'b(a)a.com','a(a)a.com'); Should be postfix that should had send this to the main address right? What could be wrong? SQL Logs for this, show's that dovecot considered the alias to check if the users exists instead of the real address: 141107 23:18:12 45 Connect postfix_usr@localhost on postfix 45 Query SELECT deliver_to FROM dovecot_aliases WHERE alias='ola.pt' 46 Connect postfix_usr@localhost on postfix 46 Query SELECT 1 FROM dovecot_domains WHERE domain='ola.pt' and status='true' 141107 23:18:16 45 Query SELECT deliver_to FROM dovecot_aliases WHERE alias='a.com' 46 Query SELECT 1 FROM dovecot_domains WHERE domain='a.com' and status='true' 47 Connect postfix_usr@localhost on postfix 47 Query SELECT deliver_to FROM dovecot_aliases WHERE alias='b(a)a.com' 141107 23:18:22 45 Query SELECT deliver_to FROM dovecot_aliases WHERE alias='a.com' 46 Query SELECT 1 FROM dovecot_domains WHERE domain='a.com' and status='true' 48 Connect postfix_usr(a)192.168.69.223 on postfix 48 Query select uid,gid from dovecot_users where username='b(a)a.com' 49 Connect postfix_usr@localhost on postfix 49 Query SELECT deliver_to FROM dovecot_aliases WHERE alias='ola(a)ola.pt' 49 Query SELECT deliver_to FROM dovecot_aliases WHERE alias='@ola.pt' 45 Query SELECT deliver_to FROM dovecot_aliases WHERE alias='ola.pt' 46 Query SELECT 1 FROM dovecot_domains WHERE domain='ola.pt' and status='true' PS: offtopic, don't understand why postfix queries the sender domain in the domains table and the sender email in the alias table. Thanks in advanced, Jorge,

1 0