- dovecot - dovecot.org

[Dovecot] Dovecot 2.2.10 crash / infinite loop bug
by Jani Hast 14 Feb '14

14 Feb '14

Hello, I though this bug should be reported, although there is workaround already made and in use. Dovecot 2.2.10 crashes into out of memory error when there is defined system users (userdb+passdb) and own virtual users (userdb+passdb). Removing either one solves the issue and Dovecot is working as it should. When memory leak (I replaced pw_init and gr_init with the version that is found from 2.1.17) is fixed from lib/ipwd.c source, the auth worker gets to infinite loop and authentication timeouts(timeout was increased, but worker does not end what ever it's doing). This far I got chance to debug this before other passdb was removed due lack of time. Here's logs, configs and backtrace: Feb 1 07:39:19 openbsd dovecot: auth-worker(30906): Fatal: pool_system_realloc(268435456): Out of memory Feb 1 07:39:19 openbsd dovecot: auth: Error: auth worker: Aborted request: Worker process died unexpectedly Feb 1 07:39:19 openbsd dovecot: auth-worker(30906): Fatal: master: service(auth-worker): child 30906 returned error 83 (Out of memory (service auth-worker { vsz_limit=256 MB }, you may need to increase it) - set CORE_OUTOFMEM=1 environment to get core dump) Feb 1 07:39:19 openbsd dovecot: auth: Error: static(email@localhost): passdb doesn't support lookups, can't verify user's existence Feb 1 07:39:19 openbsd dovecot: lda: Error: user email@localhost: Auth USER lookup failed Feb 1 07:39:19 openbsd dovecot: lda: Fatal: Internal error occurred. Refer to server log for more information. Feb 1 07:39:19 openbsd postfix/pipe[17487]: 5DBAE5F289: to=<email@localhost>, relay=dovecot, delay=37607, delays=37606/0.02/0/0.67, dsn=4.3.0, status=deferred (temporary failure) # 2.2.10: /etc/dovecot/dovecot.conf # OS: OpenBSD 5.5 i386 ffs auth_debug = yes auth_verbose = yes first_valid_uid = 1000 imap_client_workarounds = delay-newmail tb-extra-mailbox-sep tb-lsub-flags mail_debug = yes mail_location = maildir:/var/vmail/mydomain/%n mbox_write_locks = fcntl mmap_disable = yes namespace inbox { inbox = yes location = mailbox Spam { auto = subscribe } prefix = } passdb { driver = bsdauth } passdb { args = scheme=CRYPT username_format=%u /etc/dovecot/users driver = passwd-file } pop3_client_workarounds = outlook-no-nuls oe-ns-eoh protocols = imap lmtp service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } } ssl_cert = </cert.pem ssl_key = </cert.pem userdb { driver = passwd override_fields = uid=vmail gid=vmail quota_rule=*:storage=1G } userdb { args = username_format=%u /etc/dovecot/users driver = passwd-file override_fields = uid=vmail gid=vmail home=/var/vmail/%d/%u quota_rule=*:storage=1G } verbose_ssl = yes protocol imap { mail_plugins = } (gdb) bt full #0 0x0221be9d in kill () at <stdin>:2 No locals. #1 0x02285e36 in raise (s=6) at /usr/src/lib/libc/gen/raise.c:39 No locals. #2 0x02285d5c in abort () at /usr/src/lib/libc/stdlib/abort.c:70 p = (struct atexit *) 0x7fc2c000 mask = 4294967263 cleanup_called = 1 #3 0x0245dcd4 in default_fatal_finish (type=Variable "type" is not available. ) at failures.c:193 backtrace = Variable "backtrace" is not available. (gdb) bt #0 0x0221be9d in kill () at <stdin>:2 #1 0x02285e36 in raise (s=6) at /usr/src/lib/libc/gen/raise.c:39 #2 0x02285d5c in abort () at /usr/src/lib/libc/stdlib/abort.c:70 #3 0x0245dcd4 in default_fatal_finish (type=Variable "type" is not available. ) at failures.c:193 #4 0x0245dd4d in i_internal_fatal_handler (ctx=0xcfbec0f4, format=0x22406990 "pool_system_realloc(%lu): Out of memory", args=0xcfbec118 "") at failures.c:657 #5 0x0245cee3 in i_fatal_status (status=Could not find the frame base for "i_fatal_status". ) at failures.c:295 #6 0x02475543 in pool_system_realloc (pool=Could not find the frame base for "pool_system_realloc". ) at mempool-system.c:120 #7 0x02464c47 in i_realloc (mem=0x86122000, old_size=134217728, new_size=268435456) at imem.c:14 #8 0x0246505c in pw_init () at ipwd.c:23 #9 0x024651f7 in i_getpwnam (name=0x76941140"email@localhost", pwd_r=0xcfbec1cc) at ipwd.c:51 #10 0x164eef8e in bsdauth_verify_plain (request=0x76941020, password=0x78a183a2 "testi", callback=0x164e0320 <verify_plain_callback>) at passdb-bsdauth.c:26 #11 0x164e0bf4 in auth_worker_input (client=0x7b386460) at auth-worker-client.c:205 #12 0x0246f9c2 in io_loop_call_io (io=0x7d1ae8c0) at ioloop.c:388 #13 0x02470e97 in io_loop_handler_run (ioloop=0x7d1ae3c0) at ioloop-kqueue.c:151 #14 0x0246f928 in io_loop_run (ioloop=0x7d1ae3c0) at ioloop.c:412 #15 0x0241609d in master_service_run (service=0x7e433d00, callback=0x164e66a0 <worker_connected>) at master-service.c:566 #16 0x164e6cc8 in main (argc=Cannot access memory at address 0x0 ) at main.c:393 Current language: auto; currently asm Sincerelly, Jani Hast

2 1

[Dovecot] sqlite queries for master user
by Alan Chandler 14 Feb '14

14 Feb '14

Hi I am trying to achieve the following functionality "usera" can't login because his account is set non active. there is a deny query that checks this. a master user ("masteruser") should be able login using "usera*masteruser" syntax to this disabled account I just tried it with auth_debug set on, but the deny query is being run for usera, presumably because my master definition is passdb { driver = sql master = yes args = /etc/dovecot/sqlite-master.conf # Unless you're using PAM, you probably still want the destination user to # be looked up from passdb that it really exists. pass=yes does that. pass = yes } with pass=yes, and that causes usera to be validated through both the deny and accept phase of authorisation. In the password_query defined in sqlite-master.conf I user '%u' to locate my master user. Is there any variable I could use to (in that query) to also check that "usera" exists? I could then remove the pass = yes, both to avoid two more queries and to avoid the trap that this account is locked out. Alternatively some other parameter in the passdb segment above to tell the other login to miss the deny stage.

1 1

[Dovecot] v2.2.11 released
by Timo Sirainen 13 Feb '14

13 Feb '14

http://dovecot.org/releases/2.2/dovecot-2.2.11.tar.gz http://dovecot.org/releases/2.2/dovecot-2.2.11.tar.gz.sig I haven't had time to read through the Dovecot mailing list yet, so there are likely some reported bugs that haven't been fixed yet. I'll try to get to them next week in San Francisco. (Probably can't get much done this week in Tokyo.) In the mean time here's v2.2.11 with some new features. + acl plugin: Added an alternative global ACL file that can contain mailbox patterns. See http://wiki2.dovecot.org/ACL for details. + imap proxy: Added proxy_nopipelining passdb setting to work around other IMAP servers' bugs (MS Exchange 2013 especially). + Added %{auth_user}, %{auth_username} and %{auth_domain} variables. See http://wiki2.dovecot.org/Variables for details. + Added support for LZ4 compression. + stats: Track also wall clock time for commands. + pop3_migration plugin improvements to try harder to match the UIDLs correctly. - imap: SEARCH/SORT PARTIAL reponses may have been too large. - doveadm backup: Fixed assert-crash when syncing mailbox deletion.

11 15

Re: [Dovecot] Hybrid of linux user accounts and virtual user accounts configuration
by Derek Winterstien 13 Feb '14

13 Feb '14

Murry my mail delivery is working fine. The first message even automatically creates the Maildir structure like it should, all permissions correct. Steffen Kaiser I will place the output of dovecot n at the bottom of this message. I've configured checkpassword which should be a script that comes with dovecot. However, I cant find it in my install. Which I thought was standard. Not sure where to go get it from either. See this error from the log: dovecot: auth: Fatal: execv(/usr/bin/checkpassword) failed: No such file or directory dovecot: auth: Error: checkpassword(foo,127.0.0.1): Child 29179 exited with status 84 And the pop client sees: -ERR [IN-USE] Temporary authentication failure. Isn't it a script rather than a binary? Is it what should be using to read my simple virtual user flat text file? dovecot -n # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-xxx.xxx.i686 i686 CentOS release 6.4 (Final) auth_failure_delay = 10 secs auth_mechanisms = plain login auth_verbose = yes default_process_limit = 50 disable_plaintext_auth = no listen = * login_greeting = Greetings! mail_location = maildir:~/Maildir mbox_write_locks = fcntl passdb { driver = pam } passdb { args = /usr/bin/checkpassword driver = checkpassword } service auth { unix_listener auth-userdb { group = postfix user = postfix } } ssl_cert = </etc/pki/arj22/certs/d.pem ssl_key = </etc/pki/arj22/private/d.pem userdb { driver = passwd } userdb { driver = prefetch } userdb { args = /etc/dovecot/passwd/%d driver = passwd-file } protocol pop3 { pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_uidl_format = %08Xu%08Xv } EOF

1 0

[Dovecot] Mailbox storage maintenance tools
by Roman Gelfand 13 Feb '14

13 Feb '14

My storage scheme is Maildir. Could someone point me to tools for maintaining or identifying problems problems with mail store. Also, description of common problems and how to resolve/prevent them. Thanks in advance

2 1

[Dovecot] Storage Quotas
by Roman Gelfand 13 Feb '14

13 Feb '14

My dovecot server storage scheme is Maildir. Is there no default mail box size quota? If yes, where do you set it? Thanks in advance

2 1

[Dovecot] Getting Director Proxy Working
by Murray Trainer 13 Feb '14

13 Feb '14

Hi All, I can't get directory proxying of pop3 and imap working. The director stuff appears to be OK - see below. The ldap authentication is working on the backend mail server. I just get connection refused when I telnet to the proxy on the pop3 and imap ports. Nothing appears to be running on the pop3 and imap ports despite the lines in the config below. I am not sure what to do from here as nothing is showing up in the logs. Some assistance would be greatly appreciated. Thanks Murray # doveadm director status mail server ip vhosts users x.x.x.x 100 0 # doveadm director map user mail server ip expire time # doveconf -n # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.1 auth_cache_size = 32 M auth_cache_ttl = 2 hours auth_debug = yes auth_mechanisms = plain login auth_verbose = yes base_dir = /var/run/dovecot/ director_mail_servers = x.x.x.x director_servers = y.y.y.y disable_plaintext_auth = no mail_debug = yes passdb { args = nopassword=y proxy=y driver = static } service director { fifo_listener login/proxy-notify { mode = 0666 user = $default_login_user } inet_listener { port = 9090 } unix_listener director-userdb { mode = 0600 } unix_listener login/director { mode = 0666 } } service imap-login { executable = imap-login director inet_listener imap { port = 143 } } service pop3-login { executable = pop3-login director inet_listener pop3 { port = 110 } } ssl_cert =

1 2

[Dovecot] can not see public mailbox
by David Mehler 13 Feb '14

13 Feb '14

Hello, I'm running Dovecot2 and trying to set up public mailboxes. I've got a virtual user system set up with postfix and using MySQL authentication. I'm wanting to create several public mailboxes for shared messages. I've followed the wiki and have the public folder created. I've got a folder /home/vmail/public/public1 public1 being the maildir of the public mailbox. I can see in my folder list of my webmail client the root public folder but I can't change in to it and I can not see the public1 public mailbox. I'm using one user vmail set up for this setup, permissions on the public1 folder allow the vmail user to read and execute. In public1 I have a file dovecot-acl which has the user attempting to access the public folder with the flags l and r. Below is my config with doveconf -n. I'd appreciate any suggestions. Thanks. Dave. # 2.1.16: /etc/dovecot/dovecot.conf # OS: Linux 3.12.6-x86-linode55 i686 Fedora release 17 (Beefy Miracle) ext3 dict { quota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } first_valid_gid = 5000 first_valid_uid = 5000 hostname = xxx last_valid_gid = 5000 last_valid_uid = 5000 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes listen = * mail_gid = vmail mail_home = /home/vmail/%d/%n/home mail_location = maildir:/home/vmail/%d/%n:LAYOUT=fs mail_plugins = " acl quota zlib" mail_uid = vmail maildir_very_dirty_syncs = yes namespace { list = yes location = maildir:/home/vmail/public:LAYOUT=fs prefix = Public/ separator = / subscriptions = yes type = public } namespace inbox { hidden = no inbox = yes list = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / subscriptions = yes type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile autocreate = Spam autosubscribe = Spam quota = dict:User quota::proxy::quota quota_rule = *:storage=1G quota_rule2 = Trash:storage=+100M quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u } postmaster_address = postmaster@xxx protocols = imap service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { mode = 0600 user = vmail } } service dict { unix_listener dict { mode = 0600 user = vmail } } service imap-login { inet_listener imap { address = 127.0.0.1 ::1 } inet_listener imaps { address = xxx xxx ssl = yes } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh user = vmail } ssl_cert = </etc/ssl/certs/server.crt ssl_key = </etc/ssl/private/server.key userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lda { mail_plugins = " acl quota zlib quota" } protocol imap { mail_plugins = " acl quota zlib autocreate imap_acl imap_quota imap_zlib" }

3 2

[Dovecot] Panic on one specific user
by LuKreme 13 Feb '14

13 Feb '14

dovecot: imap(john(a)example.com): Error: /usr/local/virtual/john(a)example.com/dovecot.index: modseq_hdr.log_offset too large dovecot: imap(john(a)example.com): Error: /usr/local/virtual/john(a)example.com/dovecot.index: modseq_hdr.log_offset too large dovecot: imap(john(a)example.com): Panic: file mail-transaction-log-file.c: line 1148 (mail_transaction_log_file_get_highest_modseq_at): assertion failed: (offset <= file->sync_offset) dovecot: imap(john(a)example.com): Fatal: master: service(imap): child 88284 killed with signal 6 (core not dumped - set service imap { drop_priv_before_exec=yes }) and also: dovecot: lda(john(a)southgaylord.com): Error: /usr/local/virtual/john(a)southgaylord.com/dovecot.index: modseq_hdr.log_offset too large dovecot: lda(john(a)southgaylord.com): Error: /usr/local/virtual/john(a)southgaylord.com/dovecot.index: modseq_hdr.log_offset too large dovecot: lda(john(a)southgaylord.com): Panic: file mail-transaction-log-file.c: line 1148 (mail_transaction_log_file_get_highest_modseq_at): assertion failed: (offset <= file->sync_offset) (this block does not generate a fatal error) It doesn't appear to be affecting the user's ability to check mail (or at least no complaints about that). The only instances of "LDA" in my logs are this error. The user is a virtual user in MySQL like all the other virtual, including other users on the domain who do not show this problem. I think I may have posted about this before (last month?), but I haven't found a solution. $ dovecot -n # 2.2.9: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 9.1-RELEASE i386 auth_mechanisms = PLAIN LOGIN disable_plaintext_auth = no first_valid_uid = 89 login_log_format_elements = user=<%u> %r %m %c mail_location = maildir:~/Maildir mail_max_userip_connections = 90 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox NotJunk { auto = subscribe } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocols = imap sieve service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } } service imap-login { inet_listener imaps { port = 993 ssl = yes } } ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { driver = passwd } userdb { args = /etc/dovecot/dovecot-sql.conf.ext default_fields = uid=vpopmail gid=vchkpw mail_location=/usr/local/virtual/%u mail=maildir:/usr/local/virtual/%u driver = sql } -- The truth isn't easily pinned to a page. In the bathtub of history the truth is harder to hold than soap, and much more difficult to find...

1 2

[Dovecot] one 2.2.11 POP3 thread is enough
by Reindl Harald 12 Feb '14

12 Feb '14

why are people starting now every minute a new thread about the same problem already reported as reply of the release announce? -------- Original-Nachricht -------- Betreff: Re: [Dovecot] v2.2.11 released Datum: Wed, 12 Feb 2014 10:05:17 +0100 Von: Ralf Hildebrandt <Ralf.Hildebrandt(a)charite.de> Antwort an: dovecot(a)dovecot.org An: Dovecot Mailing List <dovecot(a)dovecot.org> * Timo Sirainen <tss(a)iki.fi>: > http://dovecot.org/releases/2.2/dovecot-2.2.11.tar.gz > http://dovecot.org/releases/2.2/dovecot-2.2.11.tar.gz.sig > > I haven't had time to read through the Dovecot mailing list yet, so there are likely some reported bugs that haven't been fixed yet. I'll try to get to them next week in San Francisco. (Probably can't get much done this week in Tokyo.) In the mean time here's v2.2.11 with some new features. > > + acl plugin: Added an alternative global ACL file that can contain > mailbox patterns. See http://wiki2.dovecot.org/ACL for details. > + imap proxy: Added proxy_nopipelining passdb setting to work around > other IMAP servers' bugs (MS Exchange 2013 especially). > + Added %{auth_user}, %{auth_username} and %{auth_domain} variables. > See http://wiki2.dovecot.org/Variables for details. > + Added support for LZ4 compression. > + stats: Track also wall clock time for commands. > + pop3_migration plugin improvements to try harder to match the UIDLs > correctly. > - imap: SEARCH/SORT PARTIAL reponses may have been too large. > - doveadm backup: Fixed assert-crash when syncing mailbox deletion. pop3 keeps crashing with a sigsegv in that version. Gotta go back. Feb 12 10:02:52 postamt dovecot: pop3(mhippler) LJZ31jHyygAKK4EU: Fatal: master: service(pop3): child 14635 killed with signal 11 (core dumped) Feb 12 10:02:54 postamt dovecot: pop3(fem-qm-sfb) HlCP1jHyGgCNKtkP: Fatal: master: service(pop3): child 14692 killed with signal 11 (core dumped)

1 0