July 2014 - dovecot - dovecot.org

1.2.4 disk full errors
by Iain Hallam 11 Jul '14

11 Jul '14

Hi. A user on a rather old mail system we have filled their disk space, and Dovecot has started to give lots of errors in the logs about "Expunged message reappeared" and "Duplicate file entry". The user can only see a few new messages, not the 33,551 in their inbox. In the TODO file in the current source code[1], Timo notes that (line 147): maildir: out-of-disk-space failures apparently cause all kinds of problems, e.g. "Expunged message reappeared", "Duplicate file entry"? [1] http://hg.dovecot.org/dovecot-2.2/file/c55c660d6e9d/TODO Does anyone know what's happening with Dovecot here and how to recover so that this user can see mail again? Unforuntately we're on a very old version, 1.2.4. Though there is a plan for migrating to a newer platform, I need to get this user accessing email again rather more urgently. Thanks, Iain Hallam.

2 1

dovecot lda invalid user settings
by CJ Keist 10 Jul '14

10 Jul '14

I'm now dealing with issue with some users on mbox getting invalid user settings in /var/adm/messages. /var/log/syslog has: Jul 10 11:21:42 mail2 dovecot: [ID 583609 mail.error] lda(ejames): Error: user ejames: Initialization failed: Namespace '': Mail storage autodetection failed with home=/top/academic/Atmos/people/ejames/home Jul 10 11:21:42 mail2 dovecot: [ID 583609 mail.crit] lda(ejames): Fatal: Invalid user settings. Refer to server log for more information. I checked this users home directory and the mail folder is there and permissions are all correct. I'm running in a mixed mbox and Maildir environment. I read to support this environment you simply comment out the mail_location lines in 10-mail.conf file which will force dovecot to auto detect what format a user is using. This worked fine in dovecot 1.2.12, but seems to failing here. root@mail2:/userM/mail-services/dovecot/sbin# ./dovecot -n # 2.2.13: /userM/mail-services/dovecot/etc/dovecot/dovecot.conf # OS: SunOS 5.11 i86pc auth_failure_delay = 5 secs auth_mechanisms = plain login cram-md5 auth_worker_max_count = 3000 base_dir = /userM/mail-services/dovecot/var/run/dovecot/ default_client_limit = 30000 default_process_limit = 5000 disable_plaintext_auth = no hostname = mail2.engr.colostate.edu managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave duplicate namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } passdb { driver = passwd } postmaster_address = cjay(a)engr.colostate.edu service auth { unix_listener /var/lib/postfix/private/auth { mode = 0666 } unix_listener auth-userdb { group = postfix mode = 0666 user = postfix } user = root } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } ssl_cert = </userM/mail-services/dovecot/etc/ssl/dovecot.pem ssl_key = </userM/mail-services/dovecot/etc/ssl/privkey.pem userdb { args = blocking=yes driver = passwd } protocol imap { mail_max_userip_connections = 50 } protocol lda { mail_plugins = sieve } protocol pop3 { mail_max_userip_connections = 50 } -- C. J. Keist Email: cj.keist(a)colostate.edu Systems Group Manager Solaris 10 OS (SAI) Engineering Network Services Phone: 970-491-0630 College of Engineering, CSU Fax: 970-491-5569 Ft. Collins, CO 80523-1301 All I want is a chance to prove 'Money can't buy happiness'

1 0

SIGSEGV in 2.2.13 with IMAP Proxying to an Exchange Server
by Ralf Hildebrandt 10 Jul '14

10 Jul '14

100% reproducible. User is using alpine to write an email. Continue postponed composition (answering "No" won't erase it)? y -> [>Empty folder! No messages really postponed!<] Can't delete {mproxy.charite.de/ssl/novalidate-cert/user=theusername}postponed-msgs Setup: ====== http://wiki2.dovecot.org/HowTo/ImapcProxy coredump available for further inspection Full backtrace: =============== Attaching to program: /usr/lib/dovecot/imap, process 15573 [New LWP 15573] Core was generated by `dovecot/imap'. Program terminated with signal SIGSEGV, Segmentation fault. #0 imapc_client_mailbox_cmd (box=0x0, callback=callback@entry=0x7f6ba2ed40e0 <imapc_simple_callback>, context=context@entry=0x7fff68b7f1a0) at imapc-client.c:351 #0 imapc_client_mailbox_cmd (box=0x0, callback=callback@entry=0x7f6ba2ed40e0 <imapc_simple_callback>, context=context@entry=0x7fff68b7f1a0) at imapc-client.c:351 cmd = <optimized out> __FUNCTION__ = "imapc_client_mailbox_cmd" #1 0x00007f6ba2ed4815 in imapc_mailbox_noop (mbox=mbox@entry=0x1294060) at imapc-storage.c:154 cmd = <optimized out> sctx = {client = 0x123b400, ret = -2} #2 0x00007f6ba2ed2d30 in imapc_mailbox_sync_init (box=0x1294060, flags=(MAILBOX_SYNC_FLAG_FULL_READ | MAILBOX_SYNC_FLAG_FIX_INCONSISTENT)) at imapc-sync.c:476 mbox = 0x1294060 list = <optimized out> capabilities = <optimized out> changes = true ret = 0 #3 0x00007f6ba2ee53c9 in mailbox_sync_init (box=box@entry=0x1294060, flags=(MAILBOX_SYNC_FLAG_FULL_READ | MAILBOX_SYNC_FLAG_FIX_INCONSISTENT)) at mail-storage.c:1677 _data_stack_cur_id = 4 ctx = <optimized out> #4 0x00007f6ba2ee54d7 in mailbox_sync (box=box@entry=0x1294060, flags=<optimized out>, flags@entry=MAILBOX_SYNC_FLAG_FULL_READ) at mail-storage.c:1725 ctx = 0x1294060 status = {sync_delayed_expunges = 0} #5 0x00007f6ba2f0fdcb in mailbox_expunge_all_data (box=0x1294060) at index-storage.c:648 ctx = 0x7fff68b7f35c t = 0x7fff68b7f35c mail = 0x0 search_args = 0x0 #6 index_storage_mailbox_delete (box=0x1294060) at index-storage.c:701 metadata = {guid = "\000\000\000\000\000\000\000\000\030\377\347\242\000\000\000", virtual_size = 19480672, cache_fields = 0x0, precache_fields = (MAIL_FETCH_RECEIVED_DATE | MAIL_FETCH_SAVE_DATE | MAIL_FETCH_PHYSICAL_SIZE | MAIL_FETCH_IMAP_ENVELOPE | MAIL_FETCH_UIDL_FILE_NAME | MAIL_FETCH_GUID | unknown: 16777216), backend_ns_prefix = 0x7f6ba2ee64b0 <mailbox_open+16> "\211\302\061\300\205\322x\bH\203\304\030[]Ð\366\203\230\002", backend_ns_type = (unknown: 0)} status = {messages = 0, recent = 0, unseen = 19029536, uidvalidity = 0, uidnext = 1, first_unseen_seq = 0, first_recent_uid = 2730247353, last_cached_seq = 32619, highest_modseq = 19480672, highest_pvt_modseq = 140100271760191, keywords = 0x1, permanent_flags = 0, permanent_keywords = 0, allow_new_keywords = 0, nonpermanent_modseqs = 0, no_modseq_tracking = 0, have_guids = 0, have_save_guids = 0, have_only_guid128 = 0} ret_guid = <optimized out> #7 0x00007f6ba2ee66a7 in mailbox_delete (box=0x1294060) at mail-storage.c:1319 ret = <optimized out> #8 0x000000000040d0e1 in cmd_delete (cmd=0x125ce40) at cmd-delete.c:39 client = <optimized out> ns = <optimized out> box = 0x1294060 name = 0x121b2b8 "postponed-msgs" errstr = <optimized out> error = 32767 disconnect = false #9 0x0000000000416cfc in command_exec (cmd=0x125ce40) at imap-commands.c:158 hook = 0x12240e0 ret = <optimized out> #10 0x0000000000415d5f in client_command_input (cmd=0x125ce40) at imap-client.c:778 client = 0x1268c10 command = <optimized out> __FUNCTION__ = "client_command_input" #11 0x0000000000415e15 in client_command_input (cmd=0x125ce40) at imap-client.c:839 client = 0x1268c10 command = <optimized out> __FUNCTION__ = "client_command_input" #12 0x0000000000416115 in client_handle_next_command (remove_io_r=<synthetic pointer>, client=0x1268c10) at imap-client.c:877 No locals. #13 client_handle_input (client=client@entry=0x1268c10) at imap-client.c:889 _data_stack_cur_id = 3 remove_io = false handled_commands = false __FUNCTION__ = "client_handle_input" #14 0x00000000004164a2 in client_input (client=0x1268c10) at imap-client.c:931 cmd = 0x1234630 output = 0x125cd30 bytes = 32 __FUNCTION__ = "client_input" #15 0x00007f6ba2c19e6f in io_loop_call_io (io=0x125ae10) at ioloop.c:441 ioloop = 0x1223730 t_id = 2 __FUNCTION__ = "io_loop_call_io" #16 0x00007f6ba2c1ad77 in io_loop_handler_run_internal (ioloop=ioloop@entry=0x1223730) at ioloop-epoll.c:220 ctx = 0x12243c0 list = 0x1225e20 io = <optimized out> tv = {tv_sec = 1739, tv_usec = 977960} events_count = <optimized out> msecs = <optimized out> ret = 1 i = 0 call = <optimized out> __FUNCTION__ = "io_loop_handler_run_internal" #17 0x00007f6ba2c19ed9 in io_loop_handler_run (ioloop=ioloop@entry=0x1223730) at ioloop.c:488 No locals. #18 0x00007f6ba2c19f58 in io_loop_run (ioloop=0x1223730) at ioloop.c:465 __FUNCTION__ = "io_loop_run" #19 0x00007f6ba2bc9133 in master_service_run (service=0x12235c0, callback=callback@entry=0x41ee50 <client_connected>) at master-service.c:566 No locals. #20 0x000000000040b06f in main (argc=1, argv=0x1223390) at main.c:400 set_roots = {0x426ca0 <imap_setting_parser_info>, 0x0} login_set = {auth_socket_path = 0x121b048 "\001", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x41f200 <login_client_connected>, failure_callback = 0x41ef30 <login_client_failed>, request_auth_token = 1} service_flags = <optimized out> storage_service_flags = <optimized out> username = 0x0 c = <optimized out> -- Ralf Hildebrandt Geschäftsbereich IT | Abteilung Netzwerk Charité - Universitätsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt(a)charite.de | http://www.charite.de

2 1

Dovecot ldap quotas in MB
by Murray Trainer 09 Jul '14

09 Jul '14

Hi All, I have the Dovecot quota value coming from LDAP using the line below but my values are stored in MB, not bytes. What can I put in the line to set quotas in MB? user_attrs = homeDirectory=home,mailUID=uid,mailGID=gid,mailQuota=quota_rule=*:bytes=%$ Thanks Murray

2 1

Trigger for using an sqlite dictionary for quota
by David Anderson 09 Jul '14

09 Jul '14

Hi, I'm using Dovecot 2.0.9, and was trying to set up a dictionary process to use an sqlite database for quota management. The wiki page has examples for MySQL and PostgreSQL: http://wiki2.dovecot.org/Quota/Dict For sqlite, a trigger needs to be created to get it to work. But I was not sufficiently skilled in sqlite to adapt the PostgreSQL trigger (given on the above URL) for use. Nor did Googling find any example of anyone else who had done it. Does anyone here have an example, or the ability? (Through Googling I found an example trigger for using sqlite with expiries - but I was looking at quotas). Best wishes, David -- UpdraftPlus - best WordPress backups - http://updraftplus.com WordShell - WordPress fast from the CLI - http://wordshell.net

2 1

HIGHESTMODSEQ tracking
by Kostya Vasilyev 09 Jul '14

09 Jul '14

Hello, I'd like to follow up on someone else's old thread: http://dovecot.org/list/dovecot/2012-April/082624.html I understand that Dovecot (that 2012 discussion was about version 2.0.18) can return "HIGHESTMODSEQ 1" upon SELECT if persistent modseq tracking was never enabled for a mailbox. I'd like to get a clarification on how to enable proper persistent modseq tracking. Per RFC 4551, "A client supporting CONDSTORE.... indicates its willingness to receive mod-sequence updates... by issuing:" SELECT mailbox (CONDSTORE) STATUS (... HIGHESTMODSEQ ...) ... others ... It seems that Dovecot 2.1.7 (Debian 7.5) enables persistent modseq tracking after one of the above two commands (and maybe others). So far so good. So my questions are: 1 - Is this (enabling persistent modseq) also the case for all Dovecot versions prior to 2.1.7 that advertise CONDSTORE? There must be people running older versions out there, older than 2.1.7. If not, how can I branch my logic to not use HIGHESTMODSEQ, given that Dovecot doesn't appear to return any version info via its greeting or via the ID command? 2 - Is persistent modseq tracking (assuming it's been enabled) available for all types of backend mailbox formats that Dovecot might be using? To be more specific, can it ever be the case that Dovecot appears to enable modseq tracking, returning nice looking HIGHESTMODSEQ values from SELECT / STATUS, but the actual values get reset or not get updated because they're not properly persistent? I'm excluding changes to UIDVALIDITY here, obviously when that changes, the entire mailbox state must be assumed to have changed completely. 3 - I guess the change to return NOMOSEQ instead of "1" for mailboxes with modseq tracking disabled, as mentioned in that discussion from 2012, never happened? At least on the 2.1 branch? Thanks, -- K

2 1

Multiple email clients not in sync
by Marc Perkel 09 Jul '14

09 Jul '14

Hello everyone, I'm not sure if this is an issue with dovecot or my various email clients, or my settings. I'm running 2.2.13 and I have Thunderbird on my desktop and K@mail on my android phone. In theory if I delete email on one it should delete it on the other. It does delete it on the server - but the other client isn't always "aware" of it. Same thing sometimes with read messages. I read on one device but the other didn't know it's read unless I shut down and restart the app. Not knowing the details of how this all works I'm assuming there is some form of notification that goes on in the background so as to let other clients know what other clients do so they can sync up. And that where my setup isn't working consistently. Maybe my expectations are just too high? Maybe I don't have things set up correctly? What am I missing? Thanks in advance.

2 4

Problem with virtual mailbox when using K9 mail (android)
by Henrik Kjölhede 08 Jul '14

08 Jul '14

Hi! I've managed to setup a virtual mailbox that shows all unread or flagged mail from a selection of IMAP folders. This works great with Roundcube, which I use as webmail client. However, using K9 mail on my android phone, a mail that is opened seems to be immediately marked as read, and any flagging I do doesn't take. Presumably this is because it can't be reached any longer in the virtual folder. I tried adding the recent flag to the virtual search line, but that doesn't make any difference. I haven't been able to locate any information about anyone else experiencing this problem, so I was hoping that someone here could help. I realise that this is not exactly a "dovecot problem", but perhaps someone here has found a solution that they are willing to share. The search line in dovecot-virtual is currently "OR RECENT (OR UNSEEN FLAGGED). Regards

1 0

Limit confusion
by Micah Anderson 08 Jul '14

08 Jul '14

Hi, On one of my dovecot servers, i've got a limit problem... and I'm a little confused about which knobs I should adjust to solve it. I've been getting both of these: Error: net_connect_unix(imap) failed: Resource temporarily unavailable - http://wiki2.dovecot.org/SocketUnavailableess This one caused me to go read that wiki page, but none of those seem to apply to me: . i'm running 2.2.9 . i dont have service imap { client_limit }, although I do have service auth ( client_limit = 1024 } . my dovecot/auth process shows: dovecot/auth [91 wait, 0 passdb, 0 userdb] . it doesn't appear the master process is using very much cpu (in fact the system is mostly low load in general) . I have service_count = 0 set for imap-login for the 'high performance mode' dovecot: master: Warning: service(imap): process_limit (2560) reached, client connections are being dropped The second is because I have process_limit of 2560 for the imap service... I can raise that to 4096, but I suspect there are other limits I need to juggle? Thanks a lot for any suggestions! I have ulimit -n 2048 set for the dovecot processes (in /etc/default/dovecot) and the following is my dovecot -n: # 2.2.9: /etc/dovecot/dovecot.conf auth_verbose = yes default_process_limit = 256 default_vsz_limit = 512 M dict { expire = mysql:/etc/dovecot/dovecot-dict-sql.conf quota = mysql:/etc/dovecot/dovecot-dict-sql.conf } disable_plaintext_auth = no first_valid_gid = 8 first_valid_uid = 8 last_valid_gid = 8 last_valid_uid = 8 listen = * login_greeting = howdy, ready. mail_location = mdbox:~/mdbox:INDEX=/srv/dovecot_indexes/%d/%1n/%n mail_plugins = expire quota zlib maildir_very_dirty_syncs = yes namespace { inbox = yes location = prefix = separator = . } namespace { alias_for = hidden = yes inbox = no list = no location = prefix = INBOX. separator = . } passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } plugin { antispam_allow_append_to_spam = yes antispam_backend = pipe antispam_debug_target = syslog antispam_pipe_program = /usr/local/bin/train_spam antispam_pipe_program_args = -d;10.0.1.109 antispam_pipe_program_notspam_arg = ham antispam_pipe_program_spam_arg = spam antispam_pipe_tmpdir = /var/tmp antispam_signature = X-Spam-Flag antispam_signature_missing = error antispam_spam_pattern_ignorecase = SPAM antispam_trash_pattern = trash;Trash;Deleted * expire = Trash expire2 = Trash/* expire3 = Spam expire_dict = proxy::expire quota = dict:Your mail quota::proxy::quota quota_rule = *:bytes=100663296 quota_rule2 = Trash:bytes=+20%% quota_rule3 = Spam:bytes=+10%% quota_rule4 = INBOX.Trash:bytes=+20%% quota_rule5 = INBOX.Spam:bytes=+10%% sieve = ~/.dovecot.sieve sieve_after = /var/lib/dovecot/sieve/after.sieve sieve_before = /var/lib/dovecot/sieve/default.sieve sieve_dir = ~/sieve zlib_save = gz zlib_save_level = 6 } protocols = " imap pop3" service anvil { unix_listener anvil { group = dovecot mode = 0660 user = root } } service auth { client_limit = 1024 unix_listener auth-userdb { group = mail mode = 0600 user = mail } } service dict { unix_listener dict { group = mail mode = 0600 user = mail } } service imap-login { process_min_avail = 10 service_count = 0 vsz_limit = 512 M } service imap-postlogin { executable = script-login /usr/local/sbin/postlogin_imap } service imap { executable = imap imap-postlogin process_limit = 4096 } service pop3-login { process_min_avail = 10 service_count = 0 vsz_limit = 512 M } service pop3-postlogin { executable = script-login /usr/local/sbin/postlogin_pop } service pop3 { executable = pop3 pop3-postlogin } service stats { fifo_listener stats-mail { mode = 0600 user = mail } } ssl_cert = </etc/certs/wildcard/cert.pem ssl_cipher_list = HIGH:-ADH:-aNULL ssl_key = </etc/certs/wildcard/key.pem userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } verbose_proctitle = yes protocol lda { mail_plugins = expire quota zlib sieve plugin { quota_exceeded_message = Sorry, your message cannot be delivered to that person because their mailbox is full. If you can contact them another way, you may wish to tell them of this problem. quota_rule7 = INBOX:bytes=+10%% } } protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep mail_max_userip_connections = 10 mail_plugins = expire quota zlib imap_quota imap_zlib antispam plugin { quota_exceeded_message = You are over quota. To avoid losing mail, immediately empty your Trash and Sent folders and delete emails with large attachments. } } protocol pop3 { mail_plugins = expire quota zlib pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_uidl_format = %g }

1 0

Dovecot ignores existing mailboxes and creates its own
by Martin Vegter 08 Jul '14

08 Jul '14

Hello, I have Postfix with Maildir format. User's emails are being delivered into $HOME/mail/inbox Apart from ~/mail/inbox, there are the usual folders: $HOME/mail/archive $HOME/mail/drafts $HOME/mail/inbox $HOME/mail/trash Now I have installed dovecot, and set mail_location = maildir:~/mail:LAYOUT=fs additionally, I have defined mailboxes as follows: namespace inbox { mailbox drafts { special_use = \Drafts } mailbox sent { special_use = \Sent } mailbox trash { special_use = \Trash } } The problem I am having is following: 1) dovecot ignores the folders (drafts, sent, trash) and creates its own folders begining with capiotal letter: Drafts Sent Trash 2) dovecot ignores ~/mail/inbox and instead creates ~/mail/cur ~/mail/new ~/mail/tmp can somebody please advise how to tell dovecot, to use my existing folder structure, ie: ~/mail/inbox/{cur,new,tmp} ~/mail/drafts/{cur,new,tmp} ~/mail/sent/{cur,new,tmp} ~/mail/trash/{cur,new,tmp} any advice would be much appreciated thanks, Martin

1 0