- dovecot - dovecot.org

deliver an email to a large number of local users directly via doveadm
by Mahdi Mahdi 11 Nov '14

11 Nov '14

Hello,We have a mail service that uses postfix and dovecot. We would like to send an email to a large number of users(about 100K). However, it takes too long to send the email through smtp. Is there any solution to deliver the email locally to all user mailboxes directly.dovecot uses lmtp for transfering local emails. the worst solutoin is that copy the email to all mailboxes via linux file system. But we would prefer to use some tools provided by dovecot like doveadm. is there any way to do this job?

2 1

help by recovering a mailbox - maildir and dovecot 2.2.13
by Götz Reinicke - IT Koordinator 11 Nov '14

11 Nov '14

Hi, an user screwd up his mailbox in such a way, that I dont see how to get it back in the right order. E.g. in the subcriptions file there is a folder Studienjahr 2014 - 2015.Pitchings in the filesystem there this folder is in trash and without spaces between the years: .Trash.Studienjahr 2014-2015.Pitchings in the Filesystem ther is no folder Studienjahr 2014-2015 Currently he uses our sogo as email client ant there are some folders to showing up but some are empty, some cant be deleted ... So any help and suggestion in recovering this structure is welcome! Regards . Götz -- Götz Reinicke IT-Koordinator Tel. +49 7141 969 82 420 E-Mail goetz.reinicke(a)filmakademie.de Filmakademie Baden-Württemberg GmbH Akademiehof 10 71638 Ludwigsburg www.filmakademie.de Eintragung Amtsgericht Stuttgart HRB 205016 Vorsitzender des Aufsichtsrats: Jürgen Walter MdL Staatssekretär im Ministerium für Wissenschaft, Forschung und Kunst Baden-Württemberg Geschäftsführer: Prof. Thomas Schadt

2 1

mail-storage.c:2222:mailbox_copy assertion failed: (!ctx->unfinished)
by Giel van Schijndel 10 Nov '14

10 Nov '14

Hi, I see a lot of crashes in my syslog lately. Specifically a sequence of errors exactly like this (only the timestamp differs). > Nov 10 21:29:53 khitomer dovecot: imap-login: Login: user=<user@hostname>, method=PLAIN, rip=XXXX, lip=YYYY, mpid=ZZZZ, TLS, session=<TTTT> > Nov 10 21:29:53 khitomer dovecot: imap(user@hostname): Panic: file mail-storage.c: line 2222 (mailbox_copy): assertion failed: (!ctx->unfinished) > Nov 10 21:29:53 khitomer dovecot: imap(user@hostname): Fatal: master: service(imap): child 35108 killed with signal 6 (core not dumped) I have the mail storage on ZFS, one separate filesystem per user and another for the lucene indexes. I.e. these are separate ZFS filesystems (not pools): > /var/mail/vhosts/%d/%n > /var/mail/vhosts/%d/%n/lucene-indexes Any idea what could be going wrong? partial config (without LDA, SSL and auth portions): > # 2.2.15: /usr/local/etc/dovecot/dovecot.conf > # OS: FreeBSD 10.0-RELEASE-p12 amd64 > mail_gid = mail > mail_location = maildir:~/Maildir/ > mail_plugins = acl mailbox_alias quota virtual > mail_privileged_group = mail > mail_uid = vmail > namespace { > list = yes > location = maildir:/var/mail/public:INDEXPVT=~/Maildir/public > prefix = Public. > separator = . > subscriptions = no > type = public > } > namespace { > list = children > location = maildir:%%h/Maildir/:INDEX=~/Maildir/shared/%%n > prefix = shared.%%n. > separator = . > subscriptions = no > type = shared > } > namespace { > location = virtual:~/Maildir/virtual > prefix = virtual. > separator = . > type = private > } > namespace inbox { > inbox = yes > location = > mailbox Drafts { > special_use = \Drafts > } > mailbox Junk { > auto = create > special_use = \Junk > } > mailbox Sent { > auto = create > special_use = \Sent > } > mailbox Trash { > auto = create > special_use = \Trash > } > mailbox virtual.All { > special_use = \All > } > prefix = > separator = . > } > plugin { > acl = vfile:/usr/local/etc/dovecot/global-acls:cache_secs=10 > acl_anyone = allow > acl_shared_dict = file:/var/mail/vhosts/%d/shared-mailboxes.db > antispam_backend = mailtrain > antispam_mail_notspam = -g > antispam_mail_sendmail = /usr/bin/nice > antispam_mail_sendmail_args = /usr/local/bin/python2;-W;ignore;/usr/local/bin/sb_filter.py;-d;%h/.hammiedb;-f > antispam_mail_spam = -s > antispam_spam = SPAM;Spam;Junk > antispam_trash = Trash > antispam_unsure = Filtered-Spam;Possible-Spam > fetchmail_pidfile = %h/.fetchmail.pid > fts = lucene > fts_autoindex = yes > fts_autoindex_max_recent_msgs = 30 > fts_decoder = decode2text > fts_index_timeout = 60 > fts_lucene = whitespace_chars=@. mime_parts > mailbox_alias_new = Sent Messages > mailbox_alias_new2 = Sent Items > mailbox_alias_old = Sent > mailbox_alias_old2 = Sent > quota = maildir:User quota > quota_grace = 10%% > quota_rule = *:storage=1G > quota_rule2 = Trash:storage=+100M > quota_rule3 = Junk:ignore > quota_rule4 = Possible-Spam:ignore > quota_rule5 = Filtered-Spam:ignore > recipient_delimiter = + > } > postmaster_address = postmaster@$hostname > protocols = imap lmtp sieve > quota_full_tempfail = yes > service auth-worker { > user = $default_internal_user > } > service imap-login { > inet_listener imaps { > port = 993 > ssl = yes > } > } > service imap { > drop_priv_before_exec = yes > } > userdb { > args = username_format=%u /usr/local/etc/dovecot/users > default_fields = home=/var/mail/vhosts/%d/%n > driver = passwd-file > } > protocol imap { > mail_max_userip_connections = 25 > mail_plugins = acl mailbox_alias quota virtual imap_acl zlib imap_zlib imap_quota expire fetchmail_wakeup antispam > } -- Met vriendelijke groet, With kind regards, Giel van Schijndel -- "It would seem that perfection is attained not when no more can be added, but when no more can be removed." -- Antoine de Saint Exupéry

1 0

mail location change results in various errors
by Cliff Hayes 10 Nov '14

10 Nov '14

I have a sendmail/dovecot imap/pop3 system that has been running with the following mail_location: mail_location = mbox:/var/empty:INBOX=/var/spool/mail/%u:INDEX=/var/indexes/%u In order to reduce errors and simplify operation I removed imap and am now only responding to pop3. I'd like to also simplify the mail_location to get rid of index errors since I don't need indexes: mail_location = mbox:/var/spool/mail:INBOX=/var/spool/mail/%n But when I applied the new mail_location I began to get the following five errors: Nov 6 23:17:24 sendmail dovecot: pop3(chayes): Warning: UIDVALIDITY changed (1132434125 -> 1205169149) in mbox file /var/spool/mail/chayes Nov 6 23:17:26 sendmail dovecot: pop3(chayes): Panic: Message unexpectedly expunged from index Nov 6 23:17:26 sendmail dovecot: pop3(chayes): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0() [0x3340045e2a] -> /usr/lib64/dovecot/libdovecot.so.0() [0x3340045e6e] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x3340019eb3] -> /usr/lib64/dovecot/libdovecot-storage.so.0() [0x3ef62567ed] -> /usr/lib64/dovecot/libdovecot-storage.so.0() [0x3ef6256e75] -> /usr/lib64/dovecot/libdovecot-storage.so.0() [0x3ef62928ed] -> /usr/lib64/dovecot/libdovecot-storage.so.0(index_mail_set_seq+0x76) [0x3ef6294ae6] -> /usr/lib64/dovecot/libdovecot-storage.so.0() [0x3ef625698c] -> dovecot/pop3() [0x405ec7] -> dovecot/pop3(client_command_execute+0x6d7) [0x4071c7] -> dovecot/pop3(client_handle_input+0x78) [0x405618] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x3340052c36] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0xa7) [0x3340053a57] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x3340052778] -> /usr/lib64/dovecot/libdovecot.so.0(master_service_run+0x13) [0x334003e3c3] -> dovecot/pop3(main+0x283) [0x403cc3] -> /lib64/libc.so.6(__libc_start_main+0xf5) [0x359f821a05] -> dovecot/pop3() [0x403e2d] Nov 6 23:17:26 sendmail dovecot: pop3(chayes): Fatal: master: service(pop3): child 3358 killed with signal 6 (core dumps disabled) Nov 6 23:18:00 sendmail dovecot: pop3(jbkirk): Error: open(/var/spool/mail/.imap/INBOX/dovecot.index.log) failed: Permission denied (euid=2151(jbkirk) egid=12(mail) missing +r perm: /var/spool/mail/.imap/INBOX/dovecot.index.log, dir owned by 3575:12 mode=0770) dovecot -n output # 2.1.16: /etc/dovecot/dovecot.conf # OS: Linux 3.9.2-200.fc18.x86_64 x86_64 Fedora release 18 (Spherical Cow) ext4 auth_mechanisms = plain login auth_verbose = yes auth_verbose_passwords = plain disable_plaintext_auth = no mail_location = mbox:/var/empty:INBOX=/var/spool/mail/%u:INDEX=/var/indexes/%u mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } protocols = pop3 ssl = no ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { driver = passwd } What do I need to do to transition to the new mail_location without the errors? Thanks in advance.

1 0

Performance issue
by absolutely_free＠libero.it 10 Nov '14

10 Nov '14

Hi, Since few days I noticed very high load on my mailserver (Centos 6.6 64bit, 8 GB RAM, 2 x CPU 3.00GHz I am using Dovecot + Postfix + Roundcube + Nginx. I have about 10000 users. Spool is on network attached storage (Coraid). File system is ext4 (mounted with noatime). Problem appears almost every morning (while load is normal during afternoon). I suspect that this can be related to some user that have so many messages in his mailbox. How can I troubleshoot this? Here some messages that I got in maillog: Warning: Maildir: Scanning /var/spool/pop/domains/xxxx.it/YYYYYYYYY/Maildir/new took 71 seconds (1 readdir()s, 1 rename()s to cur/) Warning: Maildir /var/spool/pop/domains/zzzz/WWWWWWWWWWWW/Maildir/.Trash: Synchronization took 74 seconds (5 new msgs, 0 flag change attempts, 0 expunge attempts) dovecot: imap(xxxx(a)zzzz.it): Warning: Inotify instance limit for user 89 (UID postfix) exceeded, disabling. Increase /proc/sys/fs/inotify/max_user_instances tail: inotify cannot be used, reverting to polling: Too many open files My relevant dovecot conf: mail_location = maildir:/coraid-s2l2/domains namespace { type = private separator = . prefix = INBOX. inbox = yes } mail_uid = 89 mail_gid = 89 mail_fsync = never first_valid_uid = 89 first_valid_gid = 89 maildir_very_dirty_syncs = yes mbox_write_locks = fcntl thank you very much!

2 1

Best practise for deleting with Thunderbird
by Stefan G. Weichinger 09 Nov '14

09 Nov '14

As I mentioned in another thread I set up these 2 namespaces for a couple of users: namespace { inbox = yes location = prefix = separator = / type = private } namespace { location = maildir:/home/vmail/oeffentlich:INDEXPVT=/home/vmail/public/index/%d/%u/index prefix = Oeffentlich/ separator = / subscriptions = yes type = public } It is planned that they all will use Thunderbird (on MS Windows) to access their mailboxes. Now when I create a folder in the public space and try to delete it via thunderbird I get something like: "Renaming not supported across non-private namespaces" As far as I found out by browsing the web this is related to Thunderbird trying to move (=rename) the mail from the public to the private namespace, correct? Setting TB to immediately remove mails (tested that, this works) seems a bit scary to me: this removes a safety layer for the users because this would also apply to their personal maildirs. Is there any more elegant way of solving this? Do I have to set up some kind of ACLs? Some kind of "public paperbin folder" ?? Pls help me to understand this better ;-) Regards, Stefan

3 6

Improvement proposal
by Jorge Bastos 09 Nov '14

09 Nov '14

Hi, I'd like to purpose a small improvement. When a user has a quota set in message limit instead of bytes, the returning message it's the same as in bytes limit quota (Quota exceeded (mailbox for user is full)) If possible, when the user has the message limit, it could return something different like: Quota exceeded (max messages reached for user) Thanks, Jorge,

1 0

Re: Help on dict with QUOTA / perms
by Gedalya 09 Nov '14

09 Nov '14

On 11/08/2014 10:55 AM, Jorge Bastos wrote: > Hi, > > Ok managed to solve this with the permissions on the socket. > > One related question, the quota units are only Kb,M,G ? not possible to > define it in bytes? You can http://wiki2.dovecot.org/Quota/Configuration#Limit_configuration

2 1

Dovecot quota via custom column
by Filip Bartmann 08 Nov '14

08 Nov '14

Hello, we have multiple domains connected to single user account and we want to have quota counted via this column - called account_id. Users are stored in mysql database. --------------------------------------------------------------------------------- iterate_query = SELECT email AS user FROM mailboxes user_query=SELECT email, 501 AS uid, 501 AS gid, CONCAT('*:storage=',quota,'M') AS quota_rule FROM mailboxes AS m WHERE email='%u' password_query=SELECT email AS user, pw_hash AS password, CONCAT('*:storage=',quota,'M') AS userdb_quota_rule FROM mailboxes AS e WHERE email='%u' --------------------------------------------------------------------------------- We have quota stored in dovecot dictionary and as usable variables we found only - http://wiki2.dovecot.org/Variables. Is there any way to do use account_id as quota username? Thanks, Filip Bartmann

1 0

RE: Help on dict with QUOTA / perms
by Jorge Bastos 08 Nov '14

08 Nov '14

Hi, Ok managed to solve this with the permissions on the socket. One related question, the quota units are only Kb,M,G ? not possible to define it in bytes? > -----Original Message----- > From: dovecot [mailto:dovecot-bounces@dovecot.org] On Behalf Of Jorge > Bastos > Sent: sábado, 8 de Novembro de 2014 14:22 > To: 'Dovecot Mailing List' > Subject: Help on dict with QUOTA / perms > > I'm setting up quota for my users, my users have a UID starting on > >5000 and GID = 5000, and when I query the quota, for example in IMAP, > I get: > > > > Nov 8 14:13:28 fastmail dovecot: imap-login: Login: user=<a(a)a.com>, > method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=18660, secured, > session=<uByciFkH2gB/AAAB> > > Nov 8 14:13:37 fastmail dovecot: imap(a(a)a.com): Error: > net_connect_unix(/var/run/dovecot/dict) failed: Permission denied > (euid=5000(<unknown>) egid=5000(<unknown>) missing +r perm: > /var/run/dovecot/dict, dir owned by 0:0 mode=0755) > > > > Question is, should I have the GID on the users set to 0, or is there > another way to workaround it? > > > > Thanks,

1 0