June 2015 - dovecot - dovecot.org

Re: Dovecot 2.2.16: disappearing messages, mismatched summaries, duplicated messages, excessive full re-downloads
by Joseph Tam 22 Jun '15

22 Jun '15

David Gessel writes: > As far as anyone has been able to determine, all artifacts are > resolved. I believe it is fair to say "SOLVED." As I often start > trying to solve problems by searching the list archives, I'll append my > description of the artifacts as googlebait to the bottom of this > message. To say that disabling the use of index files solved your problems is akin to saying amputating your foot solved your bunion problems. Ordinarily, indices ought to be a benefit -- it will help with I/O bottlenecks when mailboxes or number of users get huge. I can't tell from your list of problems whether they are the result of one or many causes, but fixing the index consistency problem would go a long way toward clearing up most of your problems. If INDEX=MEMORY is working for you and you don't see performance degradation, there's no harm in using it, but in my opinion, it may benefit you in the future to get to the bottom of the indexing problem rather than to lop it off altogether. > I am curious if setting INDEX=MEMORY "disables the index completely" as > per http://wiki2.dovecot.org/MailLocation: "If you really want to, you > can also disable the index files completely by appending > :INDEX=MEMORY." Or if there are index files in memory as one might > assume taking the directive literally, and if so, if these are > functionally equivalent to, say, Courier IMAP's caching model. The latter I believe. The important words in the wiki sentence is "index files", not "indexing". Dovecot is still indexing, exept that it builds it from scratch each and every time a worker process accesses a mailbox, so incurs a fixed overhead that cannot be used for the next session. Joseph Tam <jtam.home(a)gmail.com>

1 0

Re: Virtual Mailboxes
by dmiller＠amfes.com 22 Jun '15

22 Jun '15

Any ideas on what I need to check or should post to help find the problem? -- Daniel On 2015-06-20 14:50, dmiller(a)amfes.com wrote: > The first bonehead maneuver seems to be: > location = virtual:/var/mail/%%d/%%n/mdbox/virtual > I'm thinking it should be: > location = virtual:/var/mail/%%d/%%n/mdbox/mailboxes/virtual > > But...it didn't seem to make a difference. And if I have the > "virtual" folder tree under a location other than > "/var/mail/domain/user/mdbox/mailboxes" no names appear - so I think I > have the files in the right place. Any ideas? > > -- > Daniel > > > On 2015-06-20 14:34, dmiller(a)amfes.com wrote: >> >> Having some trouble with my first attempt at virtual mailboxes. I've >> enabled the plugin in 10-mail.conf, added a virtual namespace, and >> created the dovecot-virtual files in the folders. >> >> I see the folder names in the list when I refresh the folders >> available for subscription - but the folders cannot be subscribed to >> and I can't view their contents. What obvious mistake did I make? >> >> doveconf -n: >> auth_cache_size = 4 k >> auth_mechanisms = plain login >> default_login_user = nobody >> default_vsz_limit = 1 G >> dict { >> acl = mysql:/usr/local/etc/dovecot/dovecot-dict-sql.conf.ext >> } >> disable_plaintext_auth = no >> listen = * >> mail_attachment_dir = /var/mail/attachments >> mail_plugins = fts fts_solr acl zlib virtual >> mail_shared_explicit_inbox = yes >> managesieve_notify_capability = mailto >> managesieve_sieve_capability = fileinto reject envelope >> encoded-character vacation subaddress comparator-i;ascii-numeric >> relational regex imap4flags copy include variables body enotify >> environment mailbox date index ihave duplicate >> mdbox_rotate_interval = 1 days >> mdbox_rotate_size = 32 M >> namespace { >> hidden = no >> inbox = yes >> list = yes >> location = >> prefix = >> separator = / >> subscriptions = yes >> type = private >> } >> namespace { >> list = children >> location = mdbox:/var/mail/%%d/%%n/mdbox >> prefix = shared/%%n/ >> separator = / >> subscriptions = no >> type = shared >> } >> namespace { >> location = virtual:/var/mail/%%d/%%n/mdbox/virtual >> prefix = virtual/ >> separator = / >> } >> passdb { >> args = /usr/local/etc/dovecot/dovecot-ldap.conf >> driver = ldap >> } >> plugin { >> acl = vfile:/usr/local/etc/dovecot/global-acls:cache_secs=300 >> acl_shared_dict = proxy::acl >> fts = solr >> fts_autoindex = yes >> fts_solr = break-imap-search url=http://solr.amfes.lan:8983/solr/ >> sieve = ~/.dovecot.sieve >> sieve_dir = ~/sieve >> } >> protocols = imap lmtp sieve >> service auth { >> unix_listener /var/spool/postfix/private/auth { >> group = postfix >> mode = 0660 >> user = postfix >> } >> unix_listener auth-userdb { >> group = mail >> mode = 0600 >> user = vmail >> } >> } >> service dict { >> unix_listener dict { >> group = mail >> mode = 0660 >> user = vmail >> } >> } >> service imap-login { >> process_limit = 200 >> process_min_avail = 10 >> service_count = 1 >> } >> service lmtp { >> process_min_avail = 5 >> unix_listener /var/spool/postfix/private/dovecot-lmtp { >> group = mail >> mode = 0666 >> user = vmail >> } >> } >> service managesieve-login { >> inet_listener sieve { >> port = 4190 >> } >> inet_listener sieve_deprecated { >> port = 2000 >> } >> process_min_avail = 0 >> service_count = 1 >> } >> ssl_cert = </usr/local/etc/dovecot/ssl/certs/mail.amfes.com.crt >> ssl_key = </usr/local/etc/dovecot/ssl/private/mail.amfes.com.key >> userdb { >> driver = prefetch >> } >> userdb { >> args = /usr/local/etc/dovecot/dovecot-ldap.conf >> driver = ldap >> } >> verbose_proctitle = yes >> protocol lmtp { >> mail_plugins = fts fts_solr acl zlib virtual sieve >> } >> protocol lda { >> mail_plugins = fts fts_solr acl zlib virtual sieve >> } >> protocol imap { >> imap_client_workarounds = tb-extra-mailbox-sep >> imap_idle_notify_interval = 29 mins >> mail_max_userip_connections = 50 >> mail_plugins = fts fts_solr acl zlib virtual imap_acl >> } >> local 192.168.0.2 { >> protocol imap { >> ssl_cert = </usr/local/etc/dovecot/ssl/certs/mail.amfes.com.crt >> ssl_key = </usr/local/etc/dovecot/ssl/private/mail.amfes.com.key >> } >> } >> >> Given my mail storage location of /var/mail/%%d/%%n, I have created: >> /var/mail/mydomain/myname/virtual/newfolder >> >> and within that folder created a dovecot-virtual. I created a few like >> this from the wiki samples - the folder names are visible but no >> contents. >> >> -- >> Daniel

1 0

Dovecot as Proxy for __MORE__ Exchange-Servers
by Luca Bertoncello 22 Jun '15

22 Jun '15

Hi list! I'm trying to configure Dovecot 2.2.18 to act as proxy. Dovecot has to authentificate the users against an LDAP-Server (AD) and then act as IMAP-Proxy to an Exchange Server. Now the problem is, that we have TWO Exchange servers (and two ADs, too). How can I say to Dovecot that it has to search for the user in the first AD (and if found proxy to the first Exchange server) and if the user was not found, to search in the second AD (and if found proxy to the second Exchange server)? Thanks a lot Luca Bertoncello (lucabert(a)lucabert.de)

1 0

Quota SQL separate queries?
by Akos Vandra 22 Jun '15

22 Jun '15

Hello, We are trying to enforce per-domain quotas. Currently my quota-sql.conf looks like this: connect = host=/var/run/postgresql dbname=mail user=mailreader map { pattern = priv/quota/storage table = quota username_field = username value_field = bytes } map { pattern = priv/quota/messages table = quota username_field = username value_field = messages } With quota = dict:Domain:%d:proxy::sqlquota This works with a trigger by updating and , however I am unable to show the administrators a list of which of their users are using the most space. That is to be purely informative, and is not to be enforced. I would appreciate if there was a documented way to specify exact SQL queries to run for inserting, updating and selecting from the quota storage, something like this: -- CREATE VIEW quota_domain AS SELECT domain, sum(bytes), sum(messages) FROM quotas GROUP BY domain INSERT/UPDATE INTO quotas(username, domain, bytes, messages) SELECT bytes, messages from quota_domain WHERE domain = %d Is there such a possibility? If not, can you suggest a workaround to have a list of per-user quota usages as well as enforced per-domain quotas? Thanks, Akos Vandra

1 0

Mailbox aliases problem
by azurIt 22 Jun '15

22 Jun '15

Hi, i'm trying to implement malbox aliases but it's not fully working as i expected. This is my configuration: mail_plugins = acl mailbox_alias plugin { mailbox_alias_old = INBOX/Odoslane mailbox_alias_new = INBOX/SentTest } That 'INBOX/' must be there because of this (we were moving from Courier IMAP): namespace inbox { type = private prefix = INBOX/ separator = / inbox = yes list = yes } All of this is working fine, if i create folder SentTest, the link to folder Odoslane is correctly created on filesystem. The problem is that folder SentTest is invisible even after creation: 1 CREATE "INBOX/SentTest" 1 OK Create completed. 2 LIST "" "*" <all folders except SentTest are listed> 2 OK List completed. 3 LIST "INBOX/SentTest" "*" 3 OK List completed. 4 LIST "INBOX/Odoslane" "*" 4 LIST (\HasNoChildren \Sent) "/" INBOX/Odoslane 4 OK List completed. 5 CREATE "INBOX/SentTest" 5 NO [ALREADYEXISTS] Mailbox already exists 6 DELETE "INBOX/SentTest" 6 OK Delete completed. None of the e-mail clients i tried can see the folder. I'm using Dovecot 2.2.13 from Debian Wheezy (wheezy-backports). Any hints? azur

1 1

help with t/s retrieval 'hangs' disconnect for inactivity
by voytek＠sbt.net.au 22 Jun '15

22 Jun '15

I have Dovecot 2.1.17 on Centos, all working well since yesterday one user complaining he can not retrieve emails, TBird mail client says like '1 of 9' and, doesn't go any further. that's on several of his PCs using TBird, on a LAN behind f/wall, quite physically remote to server, server in Sydney, remote client is SEAsia looking at logs I see emails access, looking at server Maildir , new emails get moved from 'new' to 'cur' what else can I do from server end ? what else should be done from user end ? Jun 19 11:28:31 pop3(it(a)aaaa.com.au): Info: Disconnected for inactivity in reading our output top=0/0, retr=1/0, del=0/56, size=6562805 Jun 19 11:29:20 pop3(it(a)aaa.com.au): Info: Connection closed top=0/0, retr=1/0, del=0/56, size=6562805

3 4

[Dovecot] question about /var/mail/xxx
by Mickael Choisnard 22 Jun '15

22 Jun '15

Hi, I need your help to use dovecot with sendmail I use a fresh debian 8 jessie and i installed sendmail and dovecot 2. Sendmail works fine. All mails go to /var/mail/xxx this is problem for dovecot. dovecot cannot get it. # 2.2.13: /etc/dovecot/dovecot.conf # OS: Linux 3.16.0-4-amd64 x86_64 Debian 8.1 auth_mechanisms = plain login auth_verbose = yes auth_verbose_passwords = yes disable_plaintext_auth = no first_valid_uid = 116 last_valid_uid = 116 log_path = /var/log/dovecot.log mail_home = /srv/mail/%u mail_location = mbox:~/mail:INBOX=/var/mail/%u mail_privileged_group = mail namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = scheme=SHA-CRYPT /etc/dovecot/users driver = passwd-file } postmaster_address = root@arpagon protocols = " imap pop3" service auth { unix_listener auth-userdb { group = vmail user = vmail } } ssl = no userdb { args = uid=vmail gid=vmail home=/srv/vmail/%d/%n driver = static } cat /var/log/dovecot.log Jun 19 08:14:18 imap-login: Info: Login: user=<mc110771>, method=PLAIN, rip=10.11.12.30, lip=88.179.182.93, mpid=18799, session=<z46U1dgY+gAKCwwe> Jun 19 08:14:18 imap(mc110771): Info: Disconnected: Logged out in=8 out=395 Jun 19 08:14:26 imap-login: Info: Login: user=<mc110771>, method=PLAIN, rip=10.11.12.30, lip=88.179.182.93, mpid=18801, session=<bNcE1tgY+wAKCwwe> Jun 19 08:14:26 imap-login: Info: Login: user=<mc110771>, method=PLAIN, rip=10.11.12.30, lip=88.179.182.93, mpid=18803, session=<sEIP1tgY/AAKCwwe> Jun 19 08:14:26 imap(mc120771): Error: open() failed with mbox file /var/mail/mc120771: Permission denied Jun 19 08:14:57 imap(mc120771): Info: Disconnected: Logged out in=137 out=640 Jun 19 08:14:57 imap(mc120771): Info: Disconnected: Logged out in=74 out=547 Jun 19 08:18:47 imap-login: Info: Disconnected (no auth attempts in 0 secs): user=<>, rip=10.11.12.45, lip=88.179.182.93, session=<H/mV5dgYhwAKCwwt> Jun 19 08:18:47 imap-login: Info: Disconnected (no auth attempts in 0 secs): user=<>, rip=10.11.12.45, lip=88.179.182.93, session=<2gOX5dgYigAKCwwt> Jun 19 08:18:47 imap-login: Info: Disconnected (no auth attempts in 0 secs): user=<>, rip=10.11.12.45, lip=88.179.182.93, session=<ojeY5dgYjQAKCwwt>

3 5

setting quota through IMAP
by Daniel Tröder 22 Jun '15

22 Jun '15

I'd like to set the quota of a user through the IMAP protocol. I use Pythons imaplib: imap.setquota("test1m(a)uni.dtr", "(storage 8192)") ('NO', ['Quota can be changed only by admin.']) So... which user is the "admin" user in a virtual user setting (passwd: PAM, userdb: LDAP)? Greetings Daniel

2 3

how do I conceptualize system & virtual users?
by lejeczek 22 Jun '15

22 Jun '15

I guess this would be a common case, I am hoping for some final clarification. a few Linux boxes share ldap (multi-master) backend that PAM/SSSD uses to authenticated users, and these LDAPs are also is used by Samba, users start @ uid 1000. Boxes are in the same both DNS and Samba domains. Do I treat these users as system or virtual users from postfix/dovecot perspective? If it can be a matter of choice then which is better/best? many thanks.

3 4

dovecot auth using 100% CPU
by Edward Betts 21 Jun '15

21 Jun '15

Every few days I find that dovecot auth is using all my CPU. This is from dovecot 2.2.13, I've just upgraded to 2.2.18 strace -r -p 17956 output: Process 17956 attached 0.000000 lseek(19, 0, SEEK_CUR) = -1 ESPIPE (Illegal seek) 0.000057 getsockname(19, {sa_family=AF_LOCAL, NULL}, [2]) = 0 0.000043 epoll_ctl(15, EPOLL_CTL_ADD, 19, {EPOLLIN|EPOLLPRI|EPOLLERR|EPOLLHUP, {u32=850618928, u64=140128453618224}}) = 0 0.000040 write(19, "VERSION\tauth-worker\t1\t0\nDBHASH\t5"..., 97) = -1 EPIPE (Broken pipe) 0.000035 --- SIGPIPE {si_signo=SIGPIPE, si_code=SI_USER, si_pid=17956, si_uid=108} --- 0.000020 epoll_wait(15, {{EPOLLIN|EPOLLHUP, {u32=850618928, u64=140128453618224}}}, 14, 12614) = 1 0.000031 read(19, "", 8192) = 0 0.000026 epoll_ctl(15, EPOLL_CTL_DEL, 19, 7fff77616870) = 0 0.000027 close(19) = 0 0.000029 socket(PF_LOCAL, SOCK_STREAM, 0) = 19 0.000027 fcntl(19, F_GETFL) = 0x2 (flags O_RDWR) 0.000028 fcntl(19, F_SETFL, O_RDWR|O_NONBLOCK) = 0 0.000029 connect(19, {sa_family=AF_LOCAL, sun_path="auth-worker"}, 110) = 0 0.000033 fstat(19, {st_mode=S_IFSOCK|0777, st_size=0, ...}) = 0 0.000033 lseek(19, 0, SEEK_CUR) = -1 ESPIPE (Illegal seek) 0.000026 getsockname(19, {sa_family=AF_LOCAL, NULL}, [2]) = 0 0.000030 epoll_ctl(15, EPOLL_CTL_ADD, 19, {EPOLLIN|EPOLLPRI|EPOLLERR|EPOLLHUP, {u32=850618928, u64=140128453618224}}) = 0 0.000035 write(19, "VERSION\tauth-worker\t1\t0\nDBHASH\t5"..., 97) = -1 EPIPE (Broken pipe) 0.000029 --- SIGPIPE {si_signo=SIGPIPE, si_code=SI_USER, si_pid=17956, si_uid=108} --- 0.000015 epoll_wait(15, {{EPOLLIN|EPOLLHUP, {u32=850618928, u64=140128453618224}}}, 14, 12614) = 1 0.000031 read(19, "", 8192) = 0 0.000026 epoll_ctl(15, EPOLL_CTL_DEL, 19, 7fff77616870) = 0 0.000027 close(19) = 0 0.000028 socket(PF_LOCAL, SOCK_STREAM, 0) = 19 0.000036 fcntl(19, F_GETFL) = 0x2 (flags O_RDWR) 0.000026 fcntl(19, F_SETFL, O_RDWR|O_NONBLOCK) = 0 0.000024 connect(19, {sa_family=AF_LOCAL, sun_path="auth-worker"}, 110) = 0 0.000034 fstat(19, {st_mode=S_IFSOCK|0777, st_size=0, ...}) = 0 0.000030 lseek(19, 0, SEEK_CUR) = -1 ESPIPE (Illegal seek) 0.000025 getsockname(19, {sa_family=AF_LOCAL, NULL}, [2]) = 0 0.000031 epoll_ctl(15, EPOLL_CTL_ADD, 19, {EPOLLIN|EPOLLPRI|EPOLLERR|EPOLLHUP, {u32=850618928, u64=140128453618224}}) = 0 0.000036 write(19, "VERSION\tauth-worker\t1\t0\nDBHASH\t5"..., 97) = -1 EPIPE (Broken pipe) 0.000030 --- SIGPIPE {si_signo=SIGPIPE, si_code=SI_USER, si_pid=17956, si_uid=108} --- 0.000016 epoll_wait(15, {{EPOLLIN|EPOLLHUP, {u32=850618928, u64=140128453618224}}}, 14, 12614) = 1 0.000031 read(19, "", 8192) = 0 0.000027 epoll_ctl(15, EPOLL_CTL_DEL, 19, 7fff77616870) = 0 0.000028 close(19) = 0 Any ideas what's wrong? The machine is running Debian. -- Edward.

3 2