- dovecot - dovecot.org

[Dovecot] Mbox corruption - Inbox beginning with 'FFrom' or 'FrFrom'
by Dimos Alevizos 08 Mar '14

08 Mar '14

Hello, we're having some problems with our dovecot setup. I've seen similar problems in the mailing list some years ago but alas wasn't able to find a solution. Our setup is as follows : An MX farm (postfix) sends mails via LMTP to a director farm (dovecot 2.1.12) which proxies pop3/imap/lmtp traffic to a dovecot farm (dovecot 2.1.16). All mailboxes and indexes are on NFS and all servers are Centos. The problem is that at times we see mailboxes (all of them are in mbox format) beginning with FFrom or FrFrom and of course dovecot says it's not a valid mbox file. If we manually remove the offending extra characters from the beginning of the file everything is working again, but often the same user will show the problem again tomorrow. However it's very rare and so far we haven't been able to reproduce the problem. After activating the mail_log plugin hoping it'll help us locate the problem we run across this case : The user (let's call him user(a)domain.gr) logs in via pop3 and deletes some mails but one of them fails: Jun 19 11:09:18 pop01 dovecot: pop3-login: Login: user=<user(a)domain.gr>, method=PLAIN, rip=83.235.173.26, lip=83.235.66.40, mpid=1389, secured, session=<Ao+rWH3fHgBT660a> Jun 19 11:09:18 director5 dovecot: pop3-login: proxy(user(a)domain.gr): started proxying to 83.235.66.40:110: user=<user(a)domain.gr>, method=PLAIN, rip=83.235.173.26, lip=83.235.66.65, session=<Ao+rWH3fHgBT660a> Jun 19 11:09:24 pop01 dovecot: pop3(user(a)domain.gr): expunge: box=INBOX, uid=20670, msgid=<9f5b1a20a9428ed31a9e7e42ce4411f08d0.20130612070424(a)mail84.us2.rsgsv.net>, size=36526 Jun 19 11:09:24 pop01 dovecot: pop3(user(a)domain.gr): expunge: box=INBOX, uid=20671, msgid=<b27d72dc5a47a3235a232494c6fe8aa0(a)newsletter.stockout.gr>, size=4637 Jun 19 11:09:24 pop01 dovecot: pop3(user(a)domain.gr): expunge: box=INBOX, uid=20672, msgid=<1113670779560.1111910791405.1470.2.32032003(a)scheduler.constantcontact.com>, size=38655 Jun 19 11:09:24 pop01 dovecot: pop3(user(a)domain.gr): expunge: box=INBOX, uid=20673, msgid=<83600a274c1407c5aa4c263e2592cb54(a)debop.gr>, size=1181688 Jun 19 11:09:24 pop01 dovecot: pop3(user(a)domain.gr): expunge: box=INBOX, uid=20674, msgid=<F2A59BE7-007A-4567-9BA5-803446C3D7F8(a)bernier-eliades.gr>, size=61116 Jun 19 11:09:26 pop01 dovecot: pop3(user(a)domain.gr): Error: Next message unexpectedly corrupted in mbox file /var/mail/K/Y/V/domain_gr_user_007 at 1 Jun 19 11:09:26 pop01 dovecot: pop3(user(a)domain.gr): Error: Cached message offset 1 is invalid for mbox file /var/mail/K/Y/V/domain_gr_user_007 Jun 19 11:09:27 pop01 dovecot: pop3(user(a)domain.gr): Disconnected: Logged out top=0/0, retr=2/1502843, del=122/359, size=137448432 Jun 19 11:09:27 pop01 dovecot: pop3(user(a)domain.gr): Warning: Our dotlock file /var/mail/K/Y/V/domain_gr_user_007.lock was deleted (locked 9 secs ago, touched 9 secs ago) Jun 19 11:09:27 pop01 dovecot: pop3(user(a)domain.gr): Error: file_dotlock_delete() failed with mbox file /var/mail/K/Y/V/domain_gr_user_007: No such file or directory Jun 19 11:09:27 director5 dovecot: pop3-login: proxy(user(a)domain.gr): disconnecting 83.235.173.26 (Disconnected by server): user=<user(a)domain.gr>, method=PLAIN, rip=83.235.173.26, lip=83.235.66.65, session=<Ao+rWH3fHgBT660a> However he's still able to log in again : Jun 19 11:11:36 pop01 dovecot: pop3-login: Login: user=<user(a)domain.gr>, method=PLAIN, rip=85.74.231.10, lip=83.235.66.40, mpid=10094, secured, session=<QDLrYH3f7ABVSucK> Jun 19 11:11:36 director3 dovecot: pop3-login: proxy(user(a)domain.gr): started proxying to 83.235.66.40:110: user=<user(a)domain.gr>, method=PLAIN, rip=85.74.231.10, lip=83.235.66.63, session=<QDLrYH3f7ABVSucK> Jun 19 11:11:51 pop01 dovecot: pop3(user(a)domain.gr): Disconnected: Logged out top=0/0, retr=0/0, del=0/237, size=75036938 Jun 19 11:11:51 director3 dovecot: pop3-login: proxy(user(a)domain.gr): disconnecting 85.74.231.10 (Disconnected by server): user=<user(a)domain.gr>, method=PLAIN, rip=85.74.231.10, lip=83.235.66.63, session=<QDLrYH3f7ABVSucK> A few minutes later he receives another mail which is delivered with no problem : Jun 19 11:30:39 corvus amavis[546]: (00546-22) Passed CLEAN, [91.190.168.40] [91.190.168.40] <tk-14439(a)free.splio.com> -> <user(a)domain.gr>, Message-ID: <58175-bWFyaW5hQGJlcm5pZXItZWxpYWR lcy5ncg==(a)free.splio.com>, mail_id: J1P-0WpmQksJ, Hits: 1.412, size: 9025, queued_as: 02BA4AE00414, Tests: [DKIM_VALID=-0.1,DKIM_VERIFIED=-0.1,FREEMAIL_FROM=0.001,HTML_IMAGE_RATIO_04=0.61,INVALID_MSGID=1,URIBL_BLOCKED=0.001], autolearn=disabled, 1533 ms Jun 19 11:30:39 corvus smtp/smtpd[1283]: proxy-accept: END-OF-MESSAGE: 250 2.0.0 from MTA(smtp:[127.0.0.1]:10025): 250 2.0.0 Ok: queued as 02BA4AE00414; from=<tk-14439(a)free.splio.com> to=<marina(a)bernier-eliades.gr> proto=ESMTP helo=<poc-pbcs2.splio.com> Jun 19 11:30:39 pop01 dovecot: lmtp(4099, user(a)domain.gr) 77O4IHlGwVEDEAAAYg/qxw: msgid=58175-bWFyaW5hQGJlcm5pZXItZWxpYWRlcy5ncg==(a)free.splio.com: from=residence.suddenly(a)gmx.com size=9610 saved mail to INBOX Jun 19 11:30:39 corvus postfix/lmtp[1350]: 02BA4AE00414: to=<user(a)domain.gr>, relay=lmtp.otenet.gr[62.103.147.209]:24, delay=0.12, delays=0.01/0/0/0.11, dsn=2.0.0, status=sent (250 2.0.0 <user(a)domain.gr> 77O4IHlGwVEDEAAAYg/qxw Saved) And then RIGHT after the successful delivery, the mbox somehow ends up corrupted with an FFrom in the beginning : Jun 19 11:31:27 pop01 dovecot: pop3-login: Login: user=<user(a)domain.gr>, method=PLAIN, rip=83.235.173.26, lip=83.235.66.40, mpid=14630, secured, session=<eBLjp33fUwBT660a> Jun 19 11:31:27 pop01 dovecot: pop3(user(a)domain.gr): Error: Syncing INBOX failed: Mailbox isn't a valid mbox file Jun 19 11:31:27 pop01 dovecot: pop3(user(a)domain.gr): Error: Couldn't init INBOX: Mailbox isn't a valid mbox file Jun 19 11:31:27 pop01 dovecot: pop3(user(a)domain.gr): Mailbox init failed top=0/0, retr=0/0, del=0/0, size=0 Jun 19 11:31:27 director5 dovecot: pop3-login: proxy(user(a)domain.gr): Login failed to 83.235.66.40:110: Mailbox isn't a valid mbox file Jun 19 11:31:27 pop01 dovecot: pop3-login: Login: user=<user(a)domain.gr>, method=PLAIN, rip=83.235.173.26, lip=83.235.66.40, mpid=14642, secured, session=<eBLjp33fUwBT660a> Jun 19 11:31:27 pop01 dovecot: pop3(user(a)domain.gr): Error: Syncing INBOX failed: Mailbox isn't a valid mbox file Jun 19 11:31:27 pop01 dovecot: pop3(user(a)domain.gr): Error: Couldn't init INBOX: Mailbox isn't a valid mbox file Jun 19 11:31:27 pop01 dovecot: pop3(user(a)domain.gr): Mailbox init failed top=0/0, retr=0/0, del=0/0, size=0 Jun 19 11:31:27 director5 dovecot: pop3-login: proxy(user(a)domain.gr): Login failed to 83.235.66.40:110: Mailbox isn't a valid mbox file Jun 19 11:31:27 director5 dovecot: pop3-login: Aborted login (proxy dest auth failed): user=<user(a)domain.gr>, method=PLAIN, rip=83.235.173.26, lip=83.235.66.65, session=<eBLjp33fUwBT660a Our config : # 2.1.16: /opt/dovecot-2.1.16/etc/dovecot/dovecot.conf # OS: Linux 2.6.18-92.1.22.el5 x86_64 CentOS release 5.9 (Final) auth_cache_negative_ttl = 10 mins auth_cache_size = 5 M auth_cache_ttl = 10 mins auth_verbose = yes default_client_limit = 5000 default_process_limit = 500 deliver_log_format = msgid=%m: from=%f size=%p %$ dict { sqlquota = mysql:/opt/dovecot/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no first_valid_uid = 20 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes listen = * log_timestamp = "%Y-%m-%d %H:%M:%S " login_greeting = ready login_trusted_networks = 83.235.66.0/24 mail_access_groups = mail disk root mail_fsync = always mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = quota managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave imapflags notify mbox_lock_timeout = 3 secs mbox_read_locks = dotlock fcntl mmap_disable = yes passdb { args = /opt/dovecot/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename flag_change append mail_log_fields = uid box msgid size quota = dict:User quota::noenforcing:proxy::sqlquota sieve = ~/.sieve sieve_dir = ~/sieve sieve_extensions = +notify +imapflags } postmaster_address = postmaster(a)otenet.gr quota_full_tempfail = yes service auth-worker { user = dovenull } service dict { unix_listener dict { group = mail mode = 0666 } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service lmtp { client_limit = 1 inet_listener lmtp { port = 24 } } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } service quota-warning { executable = script /opt/dovecot/etc/dovecot/quota-warning.sh user = dovecot } ssl = no userdb { args = /opt/dovecot/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } verbose_proctitle = yes protocol lmtp { mail_plugins = quota sieve quota } protocol lda { mail_plugins = quota sieve quota } protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep mail_max_userip_connections = 100 mail_plugins = quota imap_quota quota notify mail_log } protocol pop3 { mail_max_userip_connections = 100 mail_plugins = quota quota mail_log notify pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_fast_size_lookups = yes pop3_lock_session = yes pop3_reuse_xuidl = yes pop3_uidl_format = %08Xu%08Xv } Thank you for your time. Dimos Alevizos

4 10

[Dovecot] Planning migration
by Alan Chandler 08 Mar '14

08 Mar '14

I think I have a working dovecot installation, and the time has come to migrate my users. There are only 4 of us, so it can be done manually per user. I looked at this page in the wiki http://wiki2.dovecot.org/Migration/Dsync but I am totally confused. 1st off, it uses doveadm, but with commands parameters that dont match my doveadm's man page. In fact they look more like dsync parameters. Is there an error, or am I totally misunderstanding 2nd - if I assume its a dsync set of parameters, the imapc: at the end is a specification of location2. However, again my man page doesn't give any explanation of this. I am wondering, is this an example of an proxy 3rd - where do the imapc_* parameters go in the configuration I can't find any reference to them in the wiki

2 1

[Dovecot] BUG: segmentation fault in auth
by Vesa Muhonen 08 Mar '14

08 Mar '14

Hi I'm getting segmentation fault in Dovecot 2.2.11. This happens when trying to do a user lookup by "doveadm user". The machine is running Arch Linux on i686 on ext3. dovecot -n (I took this when running the previous version that works) # 2.2.9: /etc/dovecot/dovecot.conf # OS: Linux 3.12.9-x86-linode56 i686 auth_cache_size = 32 k default_client_limit = 500 default_process_limit = 50 default_vsz_limit = 128 M log_timestamp = "%Y-%m-%d %H:%M:%S " mail_gid = vmail mail_location = sdbox:~/sdbox mail_privileged_group = mail mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Archive { auto = create special_use = \Archive } mailbox Drafts { auto = create special_use = \Drafts } mailbox Junk { auto = create special_use = \Junk } mailbox Sent { auto = create special_use = \Sent } mailbox Trash { auto = create special_use = \Trash } prefix = separator = / subscriptions = yes type = private } passdb { args = /etc/dovecot/deny-users deny = yes driver = passwd-file } passdb { args = /etc/dovecot/master-users driver = passwd-file master = yes pass = yes } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_max_script_size = 1M sieve_quota_max_scripts = 10 sieve_quota_max_storage = 10M } postmaster_address = postmaster@<domain> protocols = imap lmtp sieve service auth-worker { user = $default_internal_user } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0600 user = vmail } user = $default_internal_user } service imap-login { inet_listener imap { port = 143 } process_min_avail = 1 service_count = 1 vsz_limit = 64 M } service imap { process_limit = 256 } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } user = vmail } service managesieve-login { inet_listener sieve { port = 4190 } service_count = 1 vsz_limit = 64 M } service managesieve { process_limit = 128 } ssl = required ssl_ca = </etc/ssl/myCA/certs/ca.cert ssl_cert = </etc/ssl/myCA/certs/imap.cert ssl_key = </etc/ssl/myCA/private/imap.key userdb { args = uid=vmail gid=vmail home=/var/vmail/%d/%n driver = static } protocol lda { mail_plugins = " sieve" } protocol imap { mail_max_userip_connections = 30 } protocol lmtp { mail_plugins = " sieve" postmaster_address = postmaster@<domain> } This is the error I get: # doveadm user ... doveadm(root): Error: userdb lookup(...): Disconnected unexpectedly field value This appears in logs: Mar 08 00:18:40 kernel: auth[15182]: segfault at 4 ip 0805dbbd sp bfd87ec0 error 4 in auth[8048000+4b000] Mar 08 00:18:40 dovecot[15177]: auth: Fatal: master: service(auth): child 15182 killed with signal 11 (core dumped) Mar 08 00:18:40 systemd-coredump[15227]: Process 15182 (auth) dumped core. And the coredump (if I got it out correctly) # systemd-coredumpctl gdb 15182 TIME PID UID GID SIG EXE Sat 2014-03-08 00:18:40 CET 15182 76 76 11 /usr/lib/dovecot/auth Reading symbols from /usr/lib/dovecot/auth...(no debugging symbols found)...done. [New LWP 15182] Core was generated by `dovecot/auth'. Program terminated with signal SIGSEGV, Segmentation fault. #0 0x0805dbbd in auth_fields_exists () I'm no expert in debugging, but do tell if you need more info. -vesa

1 0

[Dovecot] unsebscribe
by Aziz KNINA 07 Mar '14

07 Mar '14

*unsebscribe*

2 1

[Dovecot] How to run a program with mail_filter plugin
by Stanislas SABATIER 07 Mar '14

07 Mar '14

Hi, I'm using mail_filter plugin but I don't want it to launch a script but a program I wrote instead. In 10-master, if I put the absolute path to my program in the plugin settings ie : (…) service mail-filter { executable = /usr/local/bin/mail/my_email_filter (…) But I've got the following error from Dovecot : dovecot: master: Error: service(mail-filter): Initial status notification not received in 30 seconds, killing the process h ow do I need to configure the service to launch my program ? Thanks, Regards, Stan. --------------------------------------------------------------- Stanislas SABATIER s.sabatier(a)pobox.com ---------------------------------------------------------------

1 0

[Dovecot] no sieve with lmtp_save_to_detail_mailbox=yes
by Dennis Kuhn 06 Mar '14

06 Mar '14

i have a problem with sieve and lmtp_save_to_detail_mailbox = yes. If the mailbox "detail" exists everything works fine, but if the mailbox detail does not exist then sieve does not work. The .dovecot.sieve.log file says sieve: info: started log at Mar 06 14:28:47. error: msgid=<531877EE.7070806(a)heinlein-support.de>: failed to store into mailbox 'test2': Mailbox doesn't exist: test2. I think this is the reason why no sieve script is executed, but why is sieve here involved? Is there any relation between lmtp_save_to_detail_mailbox=yes and sieve or is this a bug? The same sieve file works with the same mailaddress without mailextension, so the sieve script is not the reason for the failure. I am using dovecot version 2.2.12 Dennis Kuhn -- Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-57 Fax: 030 / 405051-19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin

2 1

[Dovecot] Public Namespace and INBOX
by Dieter Knopf 06 Mar '14

06 Mar '14

Hello, i added a existing MAILDIR as a Public Namespace and i can subscribe to this Namespace without a problem. I can access every folder except the INBOX. Thunderbird just shows a GREY "INBOX". Is there any way to access the INBOX of a maildir? Thanks Dieter Knopf

4 6

[Dovecot] Still no emails since Feb. 6
by Steve Campbell 06 Mar '14

06 Mar '14

I checked my settings on the dovecot mailman page, and although my account was set to "disable" email, after changing it and attempting to have the list resend my password, I'm still not seeing emails. The last time I received emails, the outgoing server for the list was sent from the IP 193.210.130.67. Is that still correct? I've checked my logs to see if there's anything blocked, and I don't see anything. I've checked my access file and firewall, and nothing is blocked there. I'm not sure why my account settings showed "disabled", but it sounds like email was either bounced back to the list or my server is in some type of outgoing list to prevent sending to me. I'm at a loss. Is there any way an admin can check for me, please, to see if there's a problem they might spot? Thanks, steve

4 6

[Dovecot] Pigeonhole Sieve Extprograms Plugin
by dovecot＠voidptr.de 06 Mar '14

06 Mar '14

Hi, I upgraded to Dovecot 2.2.9 from Debian's wheezy-backports today (which should contain the "sieve_extprograms" plugin and thus also the vnd.dovecot.{pipe,filter,execute} capabilities. However when I add require "vnd.dovecot.filter"; to my sieve script via managesieve, the server reports error: require command: unknown Sieve capability: 'vnd.dovecot.filter' What am I missing and what should I do to get pipe/filter/execute to work? postconf -n attached. Nils

2 2

[Dovecot] whole user mailbox read only
by Francesco 06 Mar '14

06 Mar '14

Hello, i was browsing the dovecot wiki for some documentation related to the use of ACLs but i couldn't find an answer. i'm in the need to prevent users from deleting emails, yet being able to add new content via imap, what i mean is that a user should be able to create an email in its mailbox (maildir actually is used), but once the email is there the user shouldn't be able to delete it. do you know if there is a way to accomplish this for each subfolder on a Maildir environment? Thanks in advance Francesco

1 0