- dovecot - dovecot.org

[Dovecot] Dovecot2 vs. AD, "Inactivity during authentication"
by Jeroen Scheerder 28 Feb '14

28 Feb '14

Hi, I'm trying to setup Dovecot2 for o IMAP client access o LDA for postfix mail delivery (with SIEVE) ... on a FreeBSD host. The FreeBSD server has no users (by intention), so I've set up a virtual mail domain, using LDAP lookups in Postfix. So far so good. Mail delivers into the proper mailbox. But I'm stuck getting Dovecot to authenticate. User- and passwd DB's are set up for LDAP lookups to AD, using an authenticated bind (the AD server offers no anonymous binds, yet). I've enabled all the debugging I can find, but my logs have little information to offer. Any help in getting me a step further would be much appreciated. In particular, I'd like to learn how do diagnose these userdb/passdb issues properly. Here's what I see in the logs: Feb 27 12:25:49 <mail.info> ponyboy dovecot: imap-login: Disconnected: Inactivity during authentication (disconnected while authenticating, waited 172 secs): user=<>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured, session=<r/ERi2HzQAB/AAAB> Feb 27 12:26:42 <mail.err> ponyboy dovecot: auth: Error: PLAIN(js,127.0.0.1,<r/ERi2HzQAB/AAAB>): Request 74099.1 timed out after 225 secs, state=1 This logging is related to the folloging IMAP session: ponyboy% telnet localhost 143 Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN AUTH=LOGIN] Dovecot ready. a login js suppressed * OK Waiting for authentication process to respond.. * BYE Disconnected for inactivity during authentication. Connection closed by foreign host. Here's my config: $ dovecot -n # 2.2.10: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 10.0-RELEASE amd64 ufs auth_debug = yes auth_mechanisms = plain login auth_username_format = %Ln auth_verbose = yes first_valid_gid = 1000 first_valid_uid = 1000 imap_client_workarounds = delay-newmail last_valid_gid = 1000 last_valid_uid = 1000 mail_gid = 1000 mail_location = maildir:/var/mail/on2it/%Ln mail_uid = 1000 maildir_very_dirty_syncs = yes namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /usr/local/etc/dovecot/on2it-ldap-users.cfg driver = ldap } protocols = imap service auth-worker { user = root } service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } unix_listener auth-userdb { group = postfix mode = 0666 user = postfix } } service imap-login { inet_listener imap { port = 143 } } shutdown_clients = no ssl = no userdb { args = /usr/local/etc/dovecot/on2it-ldap-users-userdb.cfg driver = ldap } valid_chroot_dirs = /var/mail/on2it $ cat /usr/local/etc/dovecot/on2it-ldap-users.cfg hosts = dc2.office.on2it.net ldap_version = 3 base = dc=office,dc=on2it,dc=net scope=subtree auth_bind = yes dn = [suppressed] dnpass = [suppressed] pass_attrs = sAMAccountName=user user_attrs = \ =home=/var/mail/on2it/%{ldap:sAMAccountName}, \ =mail=maildir:/var/mail/on2it/%{ldap:sAMAccountName} user_filter = (&(ObjectClass=person)(sAMAccountName=%u)) pass_filter = (&(ObjectClass=person)(sAMAccountName=%u)) iterate_attrs = sAMAccountName=user iterate_filter = (objectClass=person) $ ls -l /usr/local/etc/dovecot/on2it-ldap-users-userdb.cfg lrwxr-xr-x 1 root wheel 20 Feb 27 12:07 /usr/local/etc/dovecot/on2it-ldap-users-userdb.cfg -> on2it-ldap-users.cfg

3 5

Re: [Dovecot] Error "Initializing mail storage ..." after upgrading to 2.2.10
by Joseph Tam 28 Feb '14

28 Feb '14

G?tz Reinicke writes: > mail_location = mbox:~/:INBOX=/var/mail/%u > ... > Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, > list=yes, subscriptions=yes > location=mbox:~/:INBOX=/var/mail/rechnungseingang-animationsinstitut > Feb 27 17:02:11 imap(rechnungseingang-animationsinstitut): Error: user > rechnungseingang-animationsinstitut: Initialization failed: Namespace > '': Home directory not set for user. Can't expand ~/ for mail root dir > in: ~/:INBOX=/var/mail/rechnungseingang-animationsinstitut Hmm, I don't have a trialing '/' in my mail_location, so maybe you can try leaving it off too just to check. mbox:~:INBOX=/var/mail/%u Also, is your home directory well defined in your userdb? Check output of doveadm user rechnungseingang-animationsinstitut Joseph Tam <jtam.home(a)gmail.com>

1 0

[Dovecot] Quota-Status issue
by Cyberonic Turbo 27 Feb '14

27 Feb '14

Following this guide: http://sys4.de/en/blog/2013/04/08/postfix-dovecot-mailbox-quota/ I can't seem to get it to work, as soon as I add the smtpd_recipient_restrictions setting to postfix I can no longer send mail at all. I get the message SMTP Error (450): Failed to add recipient "postmaster(a)example.com" (4.7.1 : Recipient address rejected: Internal error occurred. Refer to server log for more information.). I googled around and found this command to test the quota-status service: printf "recipient=postmaster at example.com\nsize=1234\n\n" | nc 127.0.0.1 12340 It seems to always return the quota_status_nouser message. I'm really stumped here. What logs do I need to check for errors and does anyone have any experience with this? I'm running Dovect 2.2.10 with Postfix 2.6.6 Here's my dovecot -n result: # 2.2.10: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-431.5.1.el6.x86_64 x86_64 CentOS release 6.5 (Final) auth_master_user_separator = * auth_mechanisms = PLAIN LOGIN dict { acl = mysql:/etc/dovecot/dovecot-share-folder.conf quotadict = mysql:/etc/dovecot/dovecot-used-quota.conf } first_valid_uid = 2000 last_valid_uid = 2000 listen = * log_path = /var/log/dovecot.log mail_gid = 2000 mail_location = maildir:/%Lh/Maildir/:INDEX=/%Lh/Maildir/ mail_plugins = quota mail_uid = 2000 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { inbox = yes location = prefix = separator = / type = private } namespace { list = children location = maildir:/%%Lh/Maildir/:INDEX=/%%Lh/Maildir/Shared/%%u prefix = Shared/%%u/ separator = / subscriptions = yes type = shared } passdb { args = /etc/dovecot/dovecot-mysql.conf driver = sql } passdb { args = /etc/dovecot/dovecot-master-users-password driver = passwd-file master = yes } plugin { acl = vfile acl_shared_dict = proxy::acl auth_socket_path = /var/run/dovecot/auth-master autocreate = INBOX autocreate2 = Sent autocreate3 = Trash autocreate4 = Drafts autocreate5 = Junk autosubscribe = INBOX autosubscribe2 = Sent autosubscribe3 = Trash autosubscribe4 = Drafts autosubscribe5 = Junk quota = dict:user::proxy::quotadict quota_grace = 10%% quota_rule = *:storage=1G quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO quota_warning = storage=85%% quota-warning 85 %u quota_warning2 = storage=90%% quota-warning 90 %u quota_warning3 = storage=95%% quota-warning 95 %u sieve = /%Lh/sieve/dovecot.sieve sieve_dir = /%Lh/sieve sieve_global_dir = /var/vmail/sieve sieve_global_path = /var/vmail/sieve/dovecot.sieve } protocols = pop3 imap sieve service auth { unix_listener /var/spool/postfix/dovecot-auth { group = postfix mode = 0666 user = postfix } unix_listener auth-master { group = vmail mode = 0666 user = vmail } unix_listener auth-userdb { group = vmail mode = 0660 user = vmail } } service dict { unix_listener dict { group = vmail mode = 0660 user = vmail } } service imap-login { process_limit = 500 service_count = 1 } service pop3-login { service_count = 1 } service quota-status { client_limit = 1 executable = quota-status -p postfix inet_listener { port = 12340 } } service quota-warning { executable = script /usr/local/bin/dovecot-quota-warning.sh unix_listener quota-warning { group = vmail mode = 0660 user = vmail } } ssl = required ssl_cert = </etc/pki/tls/certs/iRedMail_CA.pem ssl_key = </etc/pki/tls/private/iRedMail.key userdb { args = /etc/dovecot/dovecot-mysql.conf driver = sql } protocol lda { auth_socket_path = /var/run/dovecot/auth-master lda_mailbox_autocreate = yes log_path = /var/log/sieve.log mail_plugins = quota sieve autocreate postmaster_address = root } protocol imap { imap_client_workarounds = tb-extra-mailbox-sep mail_plugins = quota imap_quota autocreate } protocol pop3 { mail_plugins = quota pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_uidl_format = %08Xu%08Xv } For my postfix/main.cf I have this relevant setting: smtpd_recipient_restrictions = reject_unknown_sender_domain, reject_unknown_recipient_domain, reject_non_fqdn_sender, reject_non_fqdn_recipient, reject_unlisted_recipient, check_policy_service inet:127.0.0.1:7777, check_policy_service inet:127.0.0.1:10031, check_policy_service inet:127.0.0.1:12340, permit_mynetworks, permit_sasl_authenticated, reject_unauth_destination

2 2

Re: [Dovecot] Error "Initializing mail storage ..." after upgrading to 2.2.10
by Joseph Tam 27 Feb '14

27 Feb '14

G?tz Reinicke - IT Koordinator <goetz.reinicke(a)filmakademie.de> wrote: > But on one mailbox I do get an error: > > Error: user rechnnugseingang-animationsinstitut: Initialization failed: > Initializing mail storage from mail_location setting failed > > Error: Invalid user settings. Refer to server log for more information. And the server logs says ...? Maybe the '-' is not one of the allowed characters (is there a missing 'e' at the end?) Joseph Tam <jtam.home(a)gmail.com>

2 1

[Dovecot] dsync mirror to mailstores in director setup
by Murray Trainer 27 Feb '14

27 Feb '14

Hi All, I have dsync mirror command working between a standalone dovecot server and a backend mailstore in a Dovecot Director setup. Is it safe to do the dsync directly to the backend mailstore in this setup? It doesn't seem to work via the director proxy. Thanks Murray

1 0

Re: [Dovecot] Removing Mount Points
by Jeff Geiger 26 Feb '14

26 Feb '14

That's exactly where I pulled that information from. Are you saying that my assumption is correct and I can run that without ending the world as I know it? :) Thanks! Jeff Geiger jeff.geiger(a)firespring.com On Wed, Feb 26, 2014 at 1:03 AM, Steffen Kaiser < skdovecot(a)smail.inf.fh-brs.de> wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > > On Tue, 25 Feb 2014, Jeff Geiger wrote: > > dsync(sales(a)foo.com): Error: Couldn't create index dir >> /mnt/ssd/indexes/6/a/ >> sales(a)foo.com/mailboxes: Can't create mailbox root dir >> /mnt/ssd/indexes/6/a/ >> sales(a)foo.com/mailboxes: Mountpoint /mnt/ssd isn't mounted. Mount it or >> remove it with doveadm mount remove >> >> Would doing a `doveadm mount remove /mnt/ssd` fix my issue, or cause some >> type of catastrophe? >> > > ;-) http://wiki2.dovecot.org/Tools/Doveadm/Mount > > - -- Steffen Kaiser > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1.4.11 (GNU/Linux) > > iQEVAwUBUw2R3XD1/YhP6VMHAQLoRQf+LBey9f2o1+MLRSgJB+Sptp0aC746kAz6 > 8cddo6qfNGMogQ7ilfflqCpm1YA/iD29d+8/TL10616cDKZ0Tb1a4M+w8pNnImUa > ViUSBlf59QA6k9b7dshB6f191NPmFT5/lHusDZJywDcS1kal+D/lIsOPToy+Hfon > zkEslqh3Gksjj60yYrBbOBw0a2lesy7eSYunBcabTfumwFHJofWSlWuvQdxfBXKW > IMQ4yzKL1bv+UgfnJpfo6qzReV++sKS9IehGEygqEU7gCE/jhRZyZIICfXRqQAnC > 0jrboJwtfDdY7BX7LrjhaFYtQNCgNF3VqTPnHbyH+eT2KhlLkgMMMA== > =xo3d > -----END PGP SIGNATURE----- >

2 1

[Dovecot] 2 users database on same LDAP with different mail location
by Francesco 26 Feb '14

26 Feb '14

Hello, i know i know, i'm getting annoying but appearently i always come up with weird ideas and i cant seem to accomplish such a task. the scenario is that i have an LDAP server with a bunch of users. some of them are in a specific OU, and i'd like to define for all these users belonging to this OU an alternative mail location/storage. in details for all the users i'd like to use maildir storage in a directory, while for the users belonging to a specific OU i'd like to use dbox with an alternative storage attached. so i created 2 userdb like this: userdb { driver = ldap args = /etc/dovecot/dovecot-ldap-maildir.conf.ext } userdb { driver = ldap args = /etc/dovecot/dovecot-ldap-dbox.conf.ext } and then defined these 2 args files: maildir: hosts = localhost dn = CN=ldapadmin,OU=administrators,DC=plutone,DC=local dnpass = <password> auth_bind = yes ldap_version = 3 base = DC=plutone,DC=local user_attrs = sAMAccountName=home=/var/vmail/%$ dbox: hosts = localhost dn = CN=ldapadmin,OU=administrators,DC=plutone,DC=local dnpass = <password> auth_bind = yes ldap_version = 3 base = OU=dboxusers,OU=lowpriority,DC=plutone,DC=local user_attrs = sAMAccountName=home=/var/local_dbox/%$, =mail=dbox:/var/local_dbox/%$:ALT=/var/iscsi_dbox/%$ user_filter = (&(ObjectClass=person)(mail=%u)) yet it doesn't matter how hard i try if i send an email to a user belonging to the dboxusers OU i still have the user to be addressed to the maildir storage in /var/vmail am i missing something? Thanks Francesco

4 7

[Dovecot] Dovecot upgrade 1 to 2 on Debian Squeeze : broken /var/run/dovecot
by Si L 26 Feb '14

26 Feb '14

Hi, I just upgraded from version 1 to version on Debian Squeeze using their backports. Like I expected my dovecot1 config had to be converted using doveconf and this I did. However, I see problems with files inside directory: drwxr-xr-x 4 dovenull root 4096 Feb 25 20:35 /var/run/dovecot All of them were created owned by root:root rw. I tried to changed, for example : chown postfix:dovecot /var/run/dovecot/auth-master but noticed when I restarted dovecot it reset the permissions back to root:root rw. Here's the version: # dovecot --version 2.1.7 Here's my slightly redacted conf. # grep -v ^# dovecot.conf|grep -v ^$ auth_mechanisms = plain login auth_verbose = yes dict { quotadict = mysql:/etc/dovecot/dovecot-dict-quota.conf } disable_plaintext_auth = no first_valid_uid = 106 log_timestamp = "%Y-%m-%d %H:%M:%S " mail_location = maildir:/var/xx/%d/%u/ mail_plugins = quota mail_privileged_group = mail maildir_very_dirty_syncs = yes passdb { args = /etc/dovecot/dovecot-mysql.conf driver = sql } plugin { quota_rule = *:storage=262144:messages=20000 quota_rule2 = Trash:storage=282144:messages=23000 } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { mode = 0600 user = vmail } user = root } service imap-login { chroot = login inet_listener imap { address = 127.0.0.1 port = 3993 } inet_listener imaps { address = * port = 993 } process_limit = 256 process_min_avail = 24 service_count = 1 vsz_limit = 48 M } service pop3-login { chroot = login process_limit = 256 process_min_avail = 24 service_count = 1 vsz_limit = 48 M } ssl = required ssl_ca = </etc/ssl/certs/xxx.combined_for_dovecot.pem ssl_cert = </etc/ssl/private/xx.xx.xx.crt ssl_cipher_list = TLSv1+HIGH:!SSLv2:RC4+MEDIUM:!aNULL:!eNULL:!3DES:@STRENGTH ssl_key = </etc/ssl/private/xx.xx.xx.key ssl_verify_client_cert = yes userdb { args = uid=5000 gid=5000 home=/var/xx/%d/%u allow_all_users=yes driver = static } userdb { args = /etc/dovecot/dovecot-mysql.conf driver = sql } valid_chroot_dirs = /var/xx protocol imap { mail_max_userip_connections = 96 mail_plugins = quota imap_quota } protocol pop3 { pop3_uidl_format = %08Xu%08Xv } protocol lda { auth_socket_path = /var/run/dovecot/auth-master log_path = mail_plugins = sieve quota postmaster_address = xxxx@xxxxx } I really don't understand how I should make this work, and the after I read the docs on dovecot.org and googled I realised I was really lost getting this back up and runing :( I should be really grateful if somebody would give me some advice. Thanks, Soph'

3 6

[Dovecot] Upgrading from 1.2.x -> 2.2.x in one step possible
by Götz Reinicke - IT Koordinator 26 Feb '14

26 Feb '14

Hi, after some off-ML discussions to and some reconsiderations, we might do the "big jump" from our current 1.2.17 to the atrpms 2.2. From googling and reading the dovecot upgrade wiki I don't see any (big) pitfalls. Basically we use the default config options, mbox, pop3s/imaps on RH EL 5. So "just" run the upgrade-config script, fingers crossed and thats it? Ii it possible to do such a big step form 1.2 to 2.2? Thanks for comments and suggestions . Götz -- Götz Reinicke IT-Koordinator Tel. +49 7141 969 82 420 E-Mail goetz.reinicke(a)filmakademie.de Filmakademie Baden-Württemberg GmbH Akademiehof 10 71638 Ludwigsburg www.filmakademie.de Eintragung Amtsgericht Stuttgart HRB 205016 Vorsitzender des Aufsichtsrats: Jürgen Walter MdL Staatssekretär im Ministerium für Wissenschaft, Forschung und Kunst Baden-Württemberg Geschäftsführer: Prof. Thomas Schadt

3 2

[Dovecot] Removing Mount Points
by Jeff Geiger 26 Feb '14

26 Feb '14

Dovecot version 2.1.7 If a dovecot mount point (drive) dies, and the data is restored into the same path that's no longer a mount point (subfolder), dovecot complains about a missing mount point. Is it safe to do a `doveadm mount remove {path}` to fix the error since it's no longer a legit mount point? Example: We were storing indexes on an SSD drive mounted at /mnt/ssd. That drive died. I was able to put everything back into the /mnt/ssd folder (no longer mounted, just a folder). Everything seems to be working as expected. But, when I just went to dsync an account from another server to this one, I got the following error: dsync(sales(a)foo.com): Error: Couldn't create index dir /mnt/ssd/indexes/6/a/ sales(a)foo.com/mailboxes: Can't create mailbox root dir /mnt/ssd/indexes/6/a/ sales(a)foo.com/mailboxes: Mountpoint /mnt/ssd isn't mounted. Mount it or remove it with doveadm mount remove Would doing a `doveadm mount remove /mnt/ssd` fix my issue, or cause some type of catastrophe? Thanks, Jeff Geiger jeff.geiger(a)firespring.com

2 1

[Dovecot] Auto-response
by Si L 26 Feb '14

26 Feb '14

Dear Sir, Thank-you for your message. I shall not be reading Yahoo Mail for quite some time. You should presume that your message remains unloved and unread. ** If you know who I am (in other words you are not a Bulk Emailer), then you already know how to contact me either on my _normal_ EMail address, or on the telephone. Yours faithfully.

1 0

Re: [Dovecot] AUTH_USER variable has invalid value in checkpassword Script
by dovecot.pkoch＠dfgh.net 26 Feb '14

26 Feb '14

answering my own questions: > This has somehow changed and now AUTH_USER always > contains the username. This has fatal consequences as no > every owner of a valid certificate can logon as any user. I now use auth_ssl_username_from_cert = yes and this temporarily fixes my problem. Now if user A authenticates with his certificate and claims to be user B he will be logged on as user A. With ssl_username_from_cert = no (default) he was logged in as User B. > I'm absolutely sure that the value of the x500UniqueIdentifier > was stored into the AUTH_USER when I tested my setup > last year. If one looks at the source code, in particular routine env_put_auth_vars() in src/auth/db-checkpassword.c and routine auth_request_get_var_expand_table() in src/auth/auth-request.c it is clear, that this has never worked. The environemnt variable AUTH_USER always contais the username (in all Dovecot versions). It dows NOT contain the Dovecot auth_user-variable. Comparing AUTH_USER with the username makes no sense in a checkpassword-script So here's my next question: How do I find out the original username from within a chackpassword script after it has been replaced by the x500UniqueIdentifier value from a client certificate? Why is request->requested_login_user == NULL in env_put_auth_vars(). request->user contains the x500UniqueIdentifier value from the clients certificate so the original username was replaced and therefore should have been moved into request->requested_login_user. Kind regards Peter Koch

1 0

[Dovecot] Oldies but Goldies - Dovecot 1.2 and Sieve
by Götz Reinicke - IT Koordinator 25 Feb '14

25 Feb '14

Hi, we still run dovecot 1.2.17 and upgrading is not planed for some time. But I'm asked to install a sieve system to be used with SOGo soon. What do I have to install / configure? Is installing/configuring the dovecot-sieve-0.1.19 and dovecot-managesieve-0.11.13 enough? We still use mostly the default settings for imaps/pop3s. And of course configure SOGo. Thanks for any feedback. Regards . Götz -- Götz Reinicke IT-Koordinator Tel. +49 7141 969 82 420 E-Mail goetz.reinicke(a)filmakademie.de Filmakademie Baden-Württemberg GmbH Akademiehof 10 71638 Ludwigsburg www.filmakademie.de Eintragung Amtsgericht Stuttgart HRB 205016 Vorsitzender des Aufsichtsrats: Jürgen Walter MdL Staatssekretär im Ministerium für Wissenschaft, Forschung und Kunst Baden-Württemberg Geschäftsführer: Prof. Thomas Schadt

4 3

Re: [Dovecot] Error - zlib & fts
by Daniel L. Miller 25 Feb '14

25 Feb '14

On 2/25/2014 10:50 AM, Daniel L. Miller wrote: > Just upgraded to a new Solr, so I did a full re-index. Saw some of > these friendly messages: > > doveadm(csmith(a)amfes.com): Error: > zlib.read(/var/mail/amfes.com/csmith/mdbox/storage/m.20): gz trailer > has wrong CRC value at 28579617 > doveadm(csmith(a)amfes.com): Error: > read(zlib(/var/mail/amfes.com/csmith/mdbox/storage/m.20)) failed: > Invalid argument > doveadm(csmith(a)amfes.com): Error: > read(zlib(/var/mail/amfes.com/csmith/mdbox/storage/m.20)) failed: > Invalid argument (uid=5251) > Also some of these: doveadm(csmith(a)amfes.com): Error: zlib.read(/var/mail/amfes.com/csmith/mdbox/storage/m.20): missing gz header at 27877205 Running 2.2.12. -- Daniel

1 0

[Dovecot] Error - zlib & fts
by Daniel L. Miller 25 Feb '14

25 Feb '14

Just upgraded to a new Solr, so I did a full re-index. Saw some of these friendly messages: doveadm(csmith(a)amfes.com): Error: zlib.read(/var/mail/amfes.com/csmith/mdbox/storage/m.20): gz trailer has wrong CRC value at 28579617 doveadm(csmith(a)amfes.com): Error: read(zlib(/var/mail/amfes.com/csmith/mdbox/storage/m.20)) failed: Invalid argument doveadm(csmith(a)amfes.com): Error: read(zlib(/var/mail/amfes.com/csmith/mdbox/storage/m.20)) failed: Invalid argument (uid=5251) -- Daniel

1 0

[Dovecot] AUTH_USER variable has invalid value in checkpassword Script
by dovecot.pkoch＠dfgh.net 25 Feb '14

25 Feb '14

Dear dovecot experts: We are using client certificates to authenthicate against a Dovecot server. Our certificates contain a x500UniqueIdentifier. I'm absolutely sure that the value of the x500UniqueIdentifier was stored into the AUTH_USER when I tested my setup last year. This has somehow changed and now AUTH_USER always contains the username. This has fatal consequences as now every owner of a valid certificate can logon as any user. Here are some more details of our setup: We are using a checkpassword-Script that does the following: 1. Read Username and Password from file descriptor 3 2. If (AUTH_CERT=="valid") and (AUTH_USER==Username) then user is authenticated 3 If (AUTH_CERT=="valid") and (AUTH_USER<>Username) then authentication is rejected (User a tries to logon as User B) 4 If (AUTH_CERT<>"valid) we calculate the current OATH value for Usernames TOTP-token and compare that with the provided password. The last step is the reason why we are using a checkpassword script. Our smartphone users cannot use a smartcard but enter a password that was created by an OTP generator, so programming my own checkpassword script was my only option. AUTH_USER contains the username even if the x500UniqueIdentifier from the users certificate does not, so step 2 happens when step 3 should happen. I did the initial testing with Dovecot 2.2.6. At that time we were using both port 143 and 993. We now use Dovecot 2.2.7 and port 993 only. This should not make a difference but I will recompile 2.2.6 right after sending this posting. Kind regards and thank you very much for this wonderful IMAP server Peter Koch current dovecot.conf: --------------------------------------------------------- # Dovecot configuration file default_process_limit = 2048 protocols = imap listen = * base_dir = /var/dovecot/ mail_location = maildir:/mail/%u:LAYOUT=fs ssl_cert = </etc/ssl/certs/imap.crt ssl_key = </etc/ssl/private/imap.key ssl_ca = </etc/ssl/certs/imap-ca.crt ssl_verify_client_cert = yes ssl_cert_username_field = x500UniqueIdentifier service imap-login { inet_listener imap { port = 0 } } service auth { client_limit = 4096 } service anvil { client_limit = 5000 } passdb { driver = checkpassword args = /usr/dovecot/bin/checkpassword } userdb { driver = passwd override_fields = home=/mail/%u } protocol imap { mail_max_userip_connections = 1000 }

1 0

[Dovecot] A question regarding doveadm replicator status
by XarHs 25 Feb '14

25 Feb '14

Hello, I am using Dovecot version 2.2.10. I am quite familiar with ssh replication and I managed to set it up correctly. The only problem I see is that when i run the command: doveadm replicator status I get a wrong "Total number of known users" which is a) is different between the two (2) replicated dovecot servers, i.e. in mail1 I get a total of 21 users and in mail2 I get a total of 20 users (it should be the same, correct?) b) is not matching the total number of users I have in each server (mail1, mail2) which I am also getting when counting the total users with "doveadm" service enabled. (the command doveadm user '*' | wc lists a total of 16 users for both mail1, mail2 servers, which is also the total number of users that exist indeed in the LDAP structure with the doveadm service enabled. Is there any way to reset the value of "Total number of known users"? Do I have to delete a file in /var/run/dovecot or something in order to do it? The only way I tried (not successfully though) to reset it is by executing the command: for i in `doveadm user '*'` ;do doveadm replicator remove $i ; done which does empties all existing users (16), but leaves me with Queued 'sync' requests 0 Queued 'high' requests 0 Queued 'low' requests 0 Queued 'failed' requests 0 Queued 'full resync' requests 0 Waiting 'failed' requests 0 Total number of known users 5 in mail1 server and Queued 'sync' requests 0 Queued 'high' requests 0 Queued 'low' requests 0 Queued 'failed' requests 0 Queued 'full resync' requests 0 Waiting 'failed' requests 0 Total number of known users 4 in mail2 server, i.e. the value is 5 (21-16) for mail1 and 4 (20-16) for mail2 server. After seeing that I tried to restart dovecot service, which again ended in the following numbers: Queued 'sync' requests 0 Queued 'high' requests 0 Queued 'low' requests 0 Queued 'failed' requests 0 Queued 'full resync' requests 0 Waiting 'failed' requests 0 Total number of known users 21 in mail1 server and Queued 'sync' requests 0 Queued 'high' requests 0 Queued 'low' requests 0 Queued 'failed' requests 0 Queued 'full resync' requests 0 Waiting 'failed' requests 0 Total number of known users 20 in mail2 server thus their values augmented back to +16, meaning dovecot read succesfully my 16 users. I have not found a way to successfully reset the "Total number of known users" numbers back to the valid 16 users, which is also returned by running the command: doveadm user '*' | wc Why do I have those differences? How is the "Total number of known users" being calculated? What should I do to effectively reset to to the normal value (which in my case is 16)? Thanks in advance.

1 1

[Dovecot] tests with metadata module
by Mihai Badici 25 Feb '14

25 Feb '14

--Repost after subscription as list member --- I made some tests with metadata support in dovecot 2.2.10. Previously I had dovecot 2.2.4 with external metadata plugin who work well. I use dovecot with roundcube and roundcube plugins from kolab project . First, the feature activation was tricky and rather undocumented. I spent about half hour googling, after that I set: imap_metadata = yes and mail_attribute_dict = file:%h/shared_metadata I think you cold put those lines in the 20-imap.conf example file commented; that way will be easy for us to activate. Because I changed the location of shared_metadata, all folders was unannotated . I went in folder manager in roundcube and set folder "calendar" as calendar type and so on. That worked and i have: cat shared_metadata: shared/c4268a04da44bb527c5b0000193e0904/vendor/kolab/folder-type event shared/cd5792367fc9cd5196170000193e0904/vendor/kolab/folder-type event shared/33f55d2e8912195209290000193e0904/vendor/kolab/folder-type event shared/32f55d2e8912195209290000193e0904/vendor/kolab/folder-type contact However, it looks like the metadata is not properly read after. Calendar and Contacts folders don't appear in roundcube. I have this crash in dovecot's log: Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x67d81) [0xb7625d81] -> /usr/lib/dovecot/libdovecot.so.0(+0x67e11) [0xb7625e11] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0xb75d6af9] -> dovecot/imap() [0x805d3b2] -> dovecot/imap() [0x805d5bc] -> dovecot/imap() [0x805d6c9] -> dovecot/imap(client_handle_input+0x56) [0x805d836] -> dovecot/imap(client_input+0x72) [0x805dcc2] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x38) [0xb7638d98] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x10e) [0xb7639d6e] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x48) [0xb7638818] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x28) [0xb75dcb68] -> dovecot/imap(main+0x284) [0x8050f34] -> /lib/libc.so.6(__libc_start_main+0xf5) [0xb743f5a5] -> dovecot/imap() [0x80510a5] Dec 26 09:28:49 imap(mihai.badici): Fatal: master: service(imap): child 4919 killed with signal 6 (core dumps disabled) I logged imap sessions in roundcube and I have: A0003 GETMETADATA "*" (/private/vendor/kolab/folder-type /shared/vendor/kolab/folder-type) On a similar server with the "old" metadata plugin, I have here listed all folders with coresponding annotations. How I can debug further? This is a test server so I can stress it. -- Mihai Bădici http://mihai.badici.ro -----------------------------------------

3 6

[Dovecot] Detail improvement: %c variable
by Hadmut Danisch 25 Feb '14

25 Feb '14

Hi, although dovecot is great and almost exactly solving my problems and fitting my requirements, there is an odd detail that causes me problems: The %c variable. (See http://wiki2.dovecot.org/Variables ) I'm managing an IMAP server for an association, which is connected to an LDAP server. Users can connect in three ways: IMAPS from the internet, IMAP from local acccounts, and IMAP through a Web->IMAP interface, which is protected through additional one-time-passwords. The web gateway is intended to be used from untrusted computers as well, so the IMAP password entered through the Web site must not be the same as the password used on IMAPS. I have solved this problem by using %s%c as part of the LDAP user_filter. When people connect over IMAPS, this becomes imapsecured (%s=imap, %c=secured), while an unencrypted connect becomes imap (%s=imap, %c=) Unfortunately, this works only, if the web interface and the IMAP server are located on different (virtual) machines. But if the web gateway and dovecot are no the /same/ machine, this does not work anymore, since %c becomes "secured" on localhost, even if unencrypted. It causes a lot of trouble and headache. Please add a configuration variable to configure, whether %c should become "secured" for unencrypted traffic on the loopback device (localhost). regards Hadmut

5 9

[Dovecot] realtime backup with LDA?
by Francesco 25 Feb '14

25 Feb '14

Hello everyone, i was reading the dovecot-lda documentation as i'm using LDA as a delivery agent on my current mailserver configuration. I was curious to know if there are some options for having a message to be delivered to a "twin mailbox" upon delivery. this twin mailbox would work as a backup archive for recovering emails in case the user accidentally deletes them. so if i have a user which is alice i would create a second mailbox named backup_alice or whatever respecting a predictable schema and then every mail delivered to alice would also be delivered to backup_alice. do you know if this can be done? have any example? i was also planning to use shared folders + ACLS to have backup_alice accessible as a read only mailbox directly from the alice imap account. thanks in advance Francesco

6 20

[Dovecot] Dovecot hooks
by rhklinux 25 Feb '14

25 Feb '14

Hello people, I am absolute newbie in the world of Dovecot. Before I start learning configuration and plugin writing I want to ensure that what I am trying to do can be done using Dovecot. I want to have a IMAP proxy setup with a module (written by me) that scans email data for some specific content. Any help appriciated. -- View this message in context: http://dovecot.2317879.n4.nabble.com/Dovecot-hooks-tp46887.html Sent from the Dovecot mailing list archive at Nabble.com.

2 2

[Dovecot] Why are ACLs for non-existent mailboxes accepted?
by Boris 25 Feb '14

25 Feb '14

Dovecot 2.2.9-1 accepts SETACL commands that share mailboxes to non-existent mailboxes. There is no error message. Is this intended behavior? I think it's bad because clients present a success message when indeed the intent of the user failed. Typos are hard to catch.

4 6

[Dovecot] dsync, a zero-way synchronisation tool?
by Fabiano Sidler 24 Feb '14

24 Feb '14

Hi folks! I have set up dsync replication with SSH according to http://wiki2.dovecot.org/Replication with the exception of having system users and calling doveadm dsync-server directly from authorized_keys, because the wrapper script posted on the above site is needless (at least in 2.2.10). However, while the two instances connect well to each other, no synchronisation is performed at all, the mailboxes happily remain untouched. I've then temporarily replaced SSH with socat and captured the traffic. Any hints what goes wrong? Unfortunately there are no logs to provide... Greetings, Fabiano

1 1

[Dovecot] Dovecot stopped with "master: Fatal: kevent(): Invalid argument"
by Michael Galapchuk 24 Feb '14

24 Feb '14

Hi, after more than 20 days uptime, Dovecot stopped with the following logged in /var/log/messages: - master: Fatal: kevent(): Invalid argument dovecot -n: # 2.2.10: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 9.2-RELEASE-p3 amd64 auth_default_realm = xxx.com.ua auth_mechanisms = plain login default_client_limit = 3000 dict { quotadict = mysql:/usr/local/etc/dovecot/dovecot-dict-quota.conf } disable_plaintext_auth = no doveadm_password = xxx doveadm_port = xxx first_valid_gid = 6 first_valid_uid = 26 listen = 10.xx.xx.xx 10.xx.xx.xx login_log_format_elements = user=<%u> method=%m rip=%r %c mail_location = mdbox:~/mdbox mail_plugins = quota mail_log notify replication mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mdbox_rotate_interval = 2 weeks mdbox_rotate_size = 25 M passdb { args = /usr/local/etc/dovecot/dovecot-mysql.conf driver = sql } plugin { mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size mail_replica = tcp:xxx.xxx.com.ua quota = dict:user::proxy::quotadict quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=85%% quota-warning 85 %u replication_full_sync_interval = 12 hours sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap pop3 lmtp sieve service aggregator { fifo_listener replication-notify-fifo { user = mailnull } unix_listener replication-notify { user = mailnull } } service dict { unix_listener dict { group = mail mode = 0600 user = mailnull } } service doveadm { inet_listener { port = xxx } } service imap-login { client_limit = 3000 process_min_avail = 8 service_count = 0 vsz_limit = 256 M } service lmtp { executable = lmtp -L group = mail process_min_avail = 5 unix_listener lmtp { mode = 0666 } user = mailnull } service managesieve-login { process_min_avail = 2 service_count = 1 } service managesieve { process_limit = 128 } service pop3-login { process_limit = 1024 process_min_avail = 8 service_count = 1 } service quota-warning { executable = script /usr/local/bin/quota-warning.sh group = mail unix_listener quota-warning { group = mail mode = 0600 user = mailnull } user = mailnull } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0600 user = mailnull } } ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { args = /usr/local/etc/dovecot/dovecot-mysql.conf driver = sql } valid_chroot_dirs = /var/mail verbose_proctitle = yes protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep tb-lsub-flags mail_plugins = quota mail_log notify replication imap_quota } protocol pop3 { pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_enable_last = yes pop3_fast_size_lookups = yes pop3_no_flag_updates = yes pop3_uidl_format = %08Xu%08Xv } protocol lda { info_log_path = /var/log/dovecot/lda.log log_path = /var/log/dovecot/lda_error.log postmaster_address = postmaster(a)xxx.com.ua quota_full_tempfail = no sendmail_path = /usr/local/sbin/exim } protocol lmtp { info_log_path = /var/log/dovecot/deliver.log log_path = /var/log/dovecot/error_lmtp.log postmaster_address = postmaster(a)xxx.com.ua quota_full_tempfail = no sendmail_path = /usr/local/sbin/exim } Best regards, Mike

1 0

[Dovecot] dsync: possible cosmetic bug
by Andrei Dobrotsvetov 23 Feb '14

23 Feb '14

Hello Everyone, I use dovecot2-2.2.10, FreeBSD 9.2-RELEASE. Replication was set up according to: http://wiki2.dovecot.org/Replication, dsync wrapper script is used. It seems that all is worked as desired, but i see the following into log file: doveadm: Error: dsync-remote(XXX@YYY): Info: save: box=INBOX, ... There were no such log records when i tried replication without wrapper script. Best regards, Andrei

2 1

[Dovecot] doveadm mailbox command in multi instance setup
by Peer Heinlein 22 Feb '14

22 Feb '14

We're running Dovecot in a multipe instance cluster with individual userdb-querys to different LDAP-Servers. As far as I can see there's no way to use the doveadm mailbox command with different Auth-Sockets or different configurations. While root@dobby4:/etc/dovecot# doveadm user -a /var/run/dovecot-xy/auth-master p.heinlein(a)example.com field value uid 10000 gid 10000 home /mail/example.com/123456/ mail mdbox:~/mdbox quota_rule2 *:storage=50G is working, using doveadm -c /etc/dovecot/dovecot-xy.conf mailbox list -u p.heinlein(a)example.com does NOT an (user unknown). How can use a different auth socket with "doveadm mailbox" commands? (Maybe using the network socket could be a working way, but what about normal way on the command line?) Peer -- Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-42 Fax: 030 / 405051-19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin

1 0

[Dovecot] version question
by voytek＠sbt.net.au 22 Feb '14

22 Feb '14

I have Dovecot server from a iRedMail install, version 2.0.21 dovecot --version 2.0.21 yum update wants to update as so from iRedMail repo: --> Running transaction check ---> Package dovecot.x86_64 1:2.0.21-0_136.el6 will be updated ---> Package dovecot.x86_64 1:2.1.17-0_136.el6 will be an update ---> Package dovecot-managesieve.x86_64 2:0.2.6-22.el6 will be updated ---> Package dovecot-managesieve.x86_64 2:0.3.6-26.el6 will be an update ---> Package dovecot-pigeonhole.x86_64 2:0.2.6-22.el6 will be updated ---> Package dovecot-pigeonhole.x86_64 2:0.3.6-26.el6 will be an update --> Finished Dependency Resolution Package Arch Version Repository Size ========================================================================================================= Updating: dovecot x86_64 1:2.1.17-0_136.el6 iRedMail 2.4 M dovecot-managesieve x86_64 2:0.3.6-26.el6 iRedMail 45 k dovecot-pigeonhole x86_64 2:0.3.6-26.el6 iRedMail 348 k so, if I run this update, I'll update to '2.1.17-0', yes ? ahem, dumb question ahead: what's the '1' in front ? 1:2.1.17-0_136 (dumb user worrying that I don't attempt to install ver 1...) apart from /etc/dovecot/*, should I backup anything else ? sorry for dumb q... thanks

2 1

[Dovecot] Dovecot / Postfix and the quota-status
by nathan＠schultheiss.fr 22 Feb '14

22 Feb '14

Dovecot Version: 2.2.12 Postfix Version: 2.9.6 Hello I've configured the quota-status service (socket and port). When I call the service with shell, he replied request=smtpd_access_policy sender=sender(a)domain.tld recipient=recipient(a)domain.tld size=100000 action=552 5.2.2 Mailbox is full In shell the service returns a 552 when the quota is exceeded, but when postfix call it, the service return alway DUNNO. How it's possible to debug the quota-status for understand why to postfix the service return DUNNO and not 552 ? The mailbox it's overquota already, all quota check with shell return the good reply (552). Thank in advance for your help, Nathan => Postfix trace INET Call ************************** connect(21, {sa_family=AF_INET, sin_port=htons(12340), sin_addr=inet_addr("127.0.0.1")}, 16) = -1 EINPROGRESS (Operation now in progress) poll([{fd=21, events=POLLOUT}], 1, 100000) = 1 ([{fd=21, revents=POLLOUT}]) getsockopt(21, SOL_SOCKET, SO_ERROR, [0], [4]) = 0 fcntl(21, F_GETFL) = 0x802 (flags O_RDWR|O_NONBLOCK) fcntl(21, F_SETFL, O_RDWR) = 0 fcntl(21, F_GETFD) = 0 fcntl(21, F_SETFD, FD_CLOEXEC) = 0 epoll_ctl(11, EPOLL_CTL_ADD, 21, {EPOLLIN, {u32=21}}) = 0 poll([{fd=21, events=POLLIN}], 1, 0) = 0 (Timeout) poll([{fd=21, events=POLLOUT}], 1, 100000) = 1 ([{fd=21, revents=POLLOUT}]) write(21, "request=smtpd_access_policy\nprot"..., 518) = 518 poll([{fd=21, events=POLLIN}], 1, 100000) = 1 ([{fd=21, revents=POLLIN}]) read(21, "action=DUNNO\n\n", 4096) = 14 => Postfix trace SOCKET Call **************************** connect(21, {sa_family=AF_FILE, path="private/quota-status"}, 110) = 0 fcntl(21, F_GETFL) = 0x802 (flags O_RDWR|O_NONBLOCK) fcntl(21, F_SETFL, O_RDWR) = 0 fcntl(21, F_GETFD) = 0 fcntl(21, F_SETFD, FD_CLOEXEC) = 0 epoll_ctl(11, EPOLL_CTL_ADD, 21, {EPOLLIN, {u32=21}}) = 0 poll([{fd=21, events=POLLIN}], 1, 0) = 0 (Timeout) poll([{fd=21, events=POLLOUT}], 1, 100000) = 1 ([{fd=21, revents=POLLOUT}]) write(21, "request=smtpd_access_policy\nprot"..., 516) = 516 poll([{fd=21, events=POLLIN}], 1, 100000) = 1 ([{fd=21, revents=POLLIN}]) read(21, "action=DUNNO\n\n", 4096) = 14

1 0

[Dovecot] Dovecot auth query
by Murray Trainer 21 Feb '14

21 Feb '14

Hi All, I have my initial mailproxy setup with director through to my initial backend mailstore. POP3 and IMAP user authentication is working ok on the proxy and the mailstore. I just noticed when I do a "doveadm auth lookup" on the proxy it appears to give correct results but when I do it on the backend mailstore I get the error below. Config on the mailstore below. Any ideas? Murray root@mailproxy01:~# doveadm auth lookup mail1(a)example.com passdb: lookup auth succeeded extra fields: user=lookup proxy pass=mail1(a)example.com root@mailstore01:~# doveadm auth lookup mail1(a)example.com passdb: lookup auth failed extra fields: user=lookup root@mailstore01:~# doveconf -n # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.1 auth_debug = yes auth_debug_passwords = yes auth_mechanisms = plain login auth_verbose = yes auth_verbose_passwords = plain disable_plaintext_auth = no dotlock_use_excl = no mail_debug = yes mail_fsync = always mail_location = maildir:~/ mmap_disable = yes namespace { inbox = yes location = prefix = INBOX. type = private } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { mail_log_fields = uid box msgid size sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = " imap lmtp pop3" service lmtp { inet_listener lmtp { address = 27.54.95.41 127.0.01 ::1 port = 24 } } ssl_cert =

1 0

[Dovecot] Bug Report
by Jon Thompson 21 Feb '14

21 Feb '14

So when I try and create a sub mailbox in shared-folders, I get this error… imap(pid 56143 user -----): Fatal: master: service(imap): child 56143 killed with signal 11 (core dumps disabled) I’ve not been able to figure out how to get dovecot in OS X to core dump, so I haven’t included that. The documentation on the web doesn’t seem to apply to the version Apple ships. Here’s dovecotd -n, with the ssl certs removed and the domain replaced with the word domain. # 2.2.5: /Library/Server/Mail/Config/dovecot/dovecot.conf # OS: Darwin 13.0.0 x86_64 hfs aps_topic = com.apple.mail.XServer.b137086a-440f-45fe-89c4-8ddf798318a3 auth_debug = yes auth_debug_passwords = yes auth_mechanisms = cram-md5 plain login apop digest-md5 auth_realms = office.domain.com auth_socket_path = /var/run/dovecot/auth-userdb auth_username_format = %n auth_verbose = yes debug_log_path = /Library/Logs/Mail/mail-debug.log default_internal_user = _dovecot default_login_user = _dovenull disable_plaintext_auth = no first_valid_gid = 6 first_valid_uid = 6 imap_id_log = * imap_id_send = "name" * "version" * imap_urlauth_submit_user = submit info_log_path = /Library/Logs/Mail/mail-info.log log_path = /Library/Logs/Mail/mail-err.log login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c mail_access_groups = mail mail_attribute_dict = file:/Library/Server/Mail/Data/attributes/attributes.dict mail_debug = yes mail_location = maildir:/Volumes/PromiseRAID/Library/Server/Mail/Data/mail/%u mail_log_prefix = "%s(pid %p user %u): " mail_plugins = quota zlib acl fts fts_sk managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mdbox_rotate_size = 200 M namespace acl-mailboxes { list = children location = maildir:/Library/Server/Mail/Data/mail/users/%%u:INDEX=/Library/Server/Mail/Data/mail/shared/%%u prefix = shared.%%u. separator = . subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } namespace list-archives { list = children location = maildir:/Library/Server/Mail/Data/listserver/messages/archive/lists/%%u:INDEX=/Library/Server/Mail/Data/listserver/messages/archive/shared/%%u prefix = archives.%%u. separator = . subscriptions = no type = shared } namespace shared-folders { list = yes location = maildir:/Volumes/PromiseRAID/Library/Server/Mail/Data/Shared prefix = shared-folders. separator = . subscriptions = no type = shared } passdb { driver = od } passdb { args = /Library/Server/Mail/Config/dovecot/submit.passdb driver = passwd-file } plugin { acl = vfile:/Library/Server/Mail/Config/dovecot/global-acls:cache_secs=300 acl_anyone = allow acl_shared_dict = file:/Library/Server/Mail/Data/shared/shared-mailboxes fts = sk quota = maildir:User quota quota_warning = storage=100%% quota-exceeded %u sieve = /Library/Server/Mail/Data/rules/%u/dovecot.sieve sieve_dir = /Library/Server/Mail/Data/rules/%u stats_refresh = 30 secs stats_track_cmds = yes } postmaster_address = postmaster(a)office.domain.com protocols = imap pop3 lmtp sieve quota_full_tempfail = yes service auth { extra_groups = _keytabusers idle_kill = 15 mins unix_listener auth-userdb { user = _dovecot } } service dns_client { unix_listener dns-client { mode = 0600 } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } service_count = 0 } service imap { client_limit = 5 process_limit = 200 service_count = 0 } service indexer-worker { user = _dovecot } service lmtp { unix_listener lmtp { mode = 0600 } } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } service pop3 { client_limit = 5 process_limit = 200 service_count = 0 } service quota-exceeded { executable = script /Applications/Server.app/Contents/ServerRoot/usr/libexec/dovecot/quota-exceeded.sh unix_listener quota-exceeded { group = mail mode = 0660 user = _dovecot } user = _dovecot } service quota-warning { executable = script /Applications/Server.app/Contents/ServerRoot/usr/libexec/dovecot/quota-warning.sh unix_listener quota-warning { group = mail mode = 0660 user = _dovecot } user = _dovecot } service stats { fifo_listener stats-mail { mode = 0600 user = _dovecot } } ssl = required ssl_ca = ssl_cert = ssl_cipher_list = ALL:!LOW:!SSLv2:!EXP:!aNULL:!ADH:!eNULL ssl_key = ssl_key_path = userdb { args = partition=/Library/Server/Mail/Config/dovecot/partition_map.conf enforce_quotas=no driver = od } userdb { args = /Library/Server/Mail/Config/dovecot/submit.passdb driver = passwd-file } verbose_proctitle = yes protocol lmtp { mail_plugins = quota zlib acl fts fts_sk sieve push_notify } protocol lda { mail_plugins = quota zlib acl fts fts_sk acl sieve push_notify } protocol imap { mail_max_userip_connections = 20 mail_plugins = quota zlib acl fts fts_sk acl imap_acl imap_quota imap_zlib } protocol pop3 { mail_max_userip_connections = 6 } — - Jon

3 3

[Dovecot] Enable mail logger plugin
by Alexandre Ellert 20 Feb '14

20 Feb '14

Hello, I'm trying to get more info about user activity (especially when they delete some email). So, I follow info from http://wiki2.dovecot.org/Plugins/MailLog to enabled mail logger plugin, but I don't see anything in my logs. Can you tell me what I'm missing ? Thanks. # doveconf -n # 2.2.10.3: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.4 ext4 auth_mechanisms = plain login base_dir = /var/run/dovecot/ hostname = mail.numeezy.com imap_capability = +XLIST lda_mailbox_autocreate = yes listen = 188.165.154.169 login_greeting = Ready. mail_gid = 5000 mail_location = maildir:/var/vmail/%d/%n/Maildir mail_plugins = quota mail_log notify mail_privileged_group = mail mail_uid = 5000 namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } mailbox name { special_use = \Drafts \Junk \Sent \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } plugin { antispam_backend = mailtrain antispam_mail_notspam = --ham antispam_mail_sendmail = /usr/local/bin/sa-learn-pipe.sh antispam_mail_spam = --spam antispam_spam = Junk antispam_trash = Trash mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size quota = dict:user::file:/var/vmail/%d/%n/.quotausage quota_grace = 10%% quota_rule = Trash:storage=+200M quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = /var/vmail/%d/%n/.sieve sieve_before = /etc/dovecot/sieve_before sieve_vacation_send_from_recipient = yes } postmaster_address = postmaster(a)numeezy.com protocols = imap pop3 service auth-worker { user = vmail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0600 user = vmail } user = dovecot } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } service_count = 1 } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } service_count = 1 } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { mode = 0666 user = vmail } user = vmail } ssl_cert = </etc/postfix/smtpd.cert ssl_key = </etc/postfix/smtpd.key userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } protocol lda { mail_plugins = sieve quota } protocol imap { mail_max_userip_connections = 80 mail_plugins = quota imap_quota antispam } protocol pop3 { mail_max_userip_connections = 30 mail_plugins = quota }

4 6

[Dovecot] dovecot with maildir not using mtime on reindex
by Richard Platel 20 Feb '14

20 Feb '14

Hi. It seems that dovecot is using the current time, not a maildir file's mtime for INTERNALDATE when a message is re-indexed: $ cd Index $ rm -rf .INBOX $ cd ../Maildir/cur $ stat * File: `1392914632.P54451Q0M08633.smtpin01,S=2215,W=2249:2,' Size: 960 Blocks: 8 IO Block: 1048576 regular file Device: 36h/54d Inode: 11132959 Links: 1 Access: (0600/-rw-------) Uid: ( 8/ mail) Gid: ( 8/ mail) Access: 2012-01-01 00:00:00.000000000 +0000 Modify: 2012-01-01 00:00:00.000000000 +0000 Change: 2014-02-20 16:46:20.000000000 +0000 Birth: - $ telnet imap01 143 Trying 10.5.45.1... Connected to imap01.dev.firefly.tucows.com. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN] Dovecot ready. A LOGIN rplatel(a)ff-dev.com ******** A OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE BINARY MOVE QUOTA] Logged in A SELECT INBOX * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 1 EXISTS * 0 RECENT * OK [UNSEEN 1] First unseen. * OK [UIDVALIDITY 1265835133] UIDs valid * OK [UIDNEXT 4548] Predicted next UID A OK [READ-WRITE] Select completed (0.035 secs). A FETCH 1:* FULL * 1 FETCH (FLAGS () INTERNALDATE "20-Feb-2014 16:59:51 +0000" RFC822.SIZE 2249 ENVELOPE ("Thu, 20 Feb 2014 11:43:50 -0500" "Test message" (("Richard Platel" NIL "rplatel" "tucows.com")) (("Richard Platel" NIL "rplatel" "tucows.com")) (("Richard Platel" NIL "rplatel" "tucows.com")) ((NIL NIL "rplatel" "ff-dev.com")) NIL NIL NIL "<BED6EB46-CC88-4BDB-AE8B-98C1CDEAD67C(a)tucows.com>") BODY ("text" "plain" ("charset" "us-ascii") NIL NIL "7bit" 23 4)) A OK Fetch completed. A LOGOUT * BYE Logging out A OK Logout completed. Connection closed by foreign host. $ date Thu Feb 20 16:59:58 UTC 2014 Stracing the imap process, it seems dovecot does not stat the message file at all. Performing the above with an old dovecot 1 server yields the expected result, the INTERNALDATE of the message is the file's mtime. $ dovecot -n -c /he/dovecot/conf/dovecot.conf # 2.2.10.3: /he/dovecot/conf/dovecot.conf # OS: Linux 3.4.46-dom0-2.0.0 x86_64 Debian 7.0 debug_log_path = syslog disable_plaintext_auth = no first_valid_uid = 8 info_log_path = syslog lock_method = dotlock log_timestamp = mail_fsync = always mail_gid = mail mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = zlib quota tc_mail_log notify tc_proc mail_temp_dir = /var/run/dovecot_tmp mail_uid = mail maildir_very_dirty_syncs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mmap_disable = yes namespace inbox { inbox = yes location = prefix = } passdb { args = host=localhost port=1143 username=%L{user}::%L{service}::%L{rip}::%L{session} driver = imap } plugin { antispam_backend = pipe antispam_debug_target = syslog antispam_pipe_program = /he/dovecot/utils/he_spamtrain.pl antispam_pipe_program_args = --user=%u antispam_pipe_program_notspam_arg = --falsepositive antispam_pipe_program_spam_arg = --missed antispam_pipe_tmpdir = /var/run/dovecot_as_tmp antispam_signature_missing = move antispam_spam = Spam;Inbox.Spam;INBOX.Spam;Junk;INBOX.Junk antispam_trash_pattern_ignorecase = trash mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename flag_change append mail_log_fields = uid box msgid flags hetag memcached_servers = 10.5.47.223,10.5.47.222 zlib_save = gz zlib_save_level = 6 } protocols = imap pop3 service anvil { unix_listener anvil-auth-penalty { mode = 00 } } service imap-login { inet_listener imap { address = 0 } inet_listener imaps { port = 0 } process_limit = 29 process_min_avail = 14 service_count = 0 } service imap-postlogin { executable = script-login -d /he/dovecot/utils/post_login.sh } service imap { executable = imap imap-postlogin process_limit = 1270 vsz_limit = 0 } service pop3-login { inet_listener pop3 { address = 0 } inet_listener pop3s { port = 0 } process_limit = 29 process_min_avail = 14 service_count = 0 } service pop3-postlogin { executable = script-login -d /he/dovecot/utils/post_login.sh } service pop3 { executable = pop3 pop3-postlogin process_limit = 206 vsz_limit = 512 M } ssl = no userdb { args = /he/dovecot/conf/dovecot-tc-dict-auth.conf driver = dict } verbose_proctitle = yes protocol imap { mail_max_userip_connections = 30 mail_plugins = zlib quota tc_mail_log notify tc_proc imap_quota antispam } protocol pop3 { mail_max_userip_connections = 30 pop3_uidl_format = %08Xv%08Xu }

1 1

[Dovecot] Syntax of pattern in map section
by da-dovecotlist-15＠abelonline.de 20 Feb '14

20 Feb '14

I can't seem to find any documentation on the meaning/syntax of the "pattern" variable in map sections that are found in dovecot-dict-sql.conf.ext for example. I am trying to setup shared folders. The only thing[1] I found is: >>First you'll need to know what kind of dict paths the code uses. ACL >>plugin uses these paths: >> >>shared/shared-boxes/anyone/$owner >>shared/shared-boxes/user/$user/$owner >>shared/shared-boxes/group/$group/$owner What is a "dict path"? Is this some kind of hard coded identifier in the Dovecot code? I need to understand how they work because I can't use the example in http://wiki2.dovecot.org/SharedMailboxes/Shared. This is because in my PostreSQL table users are not a single column but two columns with the local and domain part[2]: Table "public.shared_mailboxes" Column | Type -----------------------+------------------------ shared_mailbox_local | character varying(64) shared_mailbox_domain | character varying(253) shared_to_local | character varying(64) shared_to_domain | character varying(253) How should a map section look in this case? [1]http://www.dovecot.org/list/dovecot/2009-April/038922.html [2]I did this in order to use REFERENCES to ensure the user exist. Kind regards

2 1

[Dovecot] v1.x vs v2.x
by Jos Chrispijn 20 Feb '14

20 Feb '14

Should I migrate to v2 or are there no significant pro's on this migration? Thanks! -- Best regards, Jos Chrispijn --- Artificial intelligence is no match for natural stupidity

3 2

[Dovecot] Warning: mysql: Query failed, retrying: Unknown column 'filter' in 'where clause'
by Thomas Creutz 20 Feb '14

20 Feb '14

Hi List, I have a problem with dovecot 2.2.12 and sieve-filter call: su -c 'sieve-filter -D -v -W -C -u account(a)domain.tld /var/vmail/domain.tld/account/.sieve INBOX.Refilter' vmail gives me sieve-filter(vmail): Error: user account(a)domain.tld: Auth USER lookup failed sieve-filter(vmail): Fatal: Internal error occurred. Refer to server log for more information. on log file I see this: Feb 17 16:21:34 mail1 dovecot: auth-worker(8430): Warning: mysql: Query failed, retrying: Unknown column 'filter' in 'where clause' Feb 17 16:21:34 mail1 dovecot: auth-worker(8430): Error: sql(account(a)domain.tld): User query failed: Unknown column 'filter' in 'where clause' but I never used filter in dovecot: grep -iR filter /etc/dovecot/ gives me no result (and yes the dir is right). Any Idea whats wrong? I know it tells me, that the column is missing in the Database - but why I need it? I also never see it documented somewhere: http://wiki2.dovecot.org/AuthDatabase/SQL http://wiki2.dovecot.org/PasswordDatabase/ExtraFields Thomas

2 6

[Dovecot] virtualfolders all mails minus duplicates
by Francesco 19 Feb '14

19 Feb '14

Hello everyone, i'm trying to mess up a bit with virtual folders and i'm trying to perform something like this: i'd like to create an IMAP virtual folder which shows me all the emails in in INBOX and subfolders but by removing "duplicates" what i mean as duplicates? simply i can recognize duplicate emails as the ones with the same message-id in the header (this was just an idea). in that way if i have a message which is present in more then one folder then it's displayed only once. i considered the idea of using message-id in the header as a criteria, but i don't know if this can be done in this way or in any way at all. any suggestion is really welcome. i'm using dovecot 1.2.15. this is a namespace example just for reference: for INBOX: namespace private { separator = . prefix = INBOX. #subscriptions = yes #list = no inbox = yes } for virtuals: namespace private { prefix = v. separator = . location = virtual:/var/utenti/%Ld/%n/VirtualFolders list = yes inbox = no subscriptions = yes hidden = no } as of now i'm running a virtualfolder which shows messages flagged as important which is done like this: INBOX INBOX.* all flagged hope you can provide me with some hints. Thanks very much Francesco

2 1

[Dovecot] Use header from instead envelope sender - quota exceed
by pgala 19 Feb '14

19 Feb '14

Hi, i want use dovecot and plugin quota to inform users about exceeded space. I also configure postfix to rewrite envelope_sender so envelope_sender<>header: from. Dovecot sent mail with information about exceeded space to email in envelope_sender. It is possible to configure that dovecot sent mail to header from address? I need use sender_canonical_maps in postfix because i want also relay mail outgoing. Thanks for helping me, Piotr -- View this message in context: http://dovecot.2317879.n4.nabble.com/Use-header-from-instead-envelope-sende… Sent from the Dovecot mailing list archive at Nabble.com.

3 2

[Dovecot] Filtering spam in an offlineimap + dovecot setup
by Alan Schmitt 19 Feb '14

19 Feb '14

Hello, To easily access my mail both offline on my computer and on my phone, I am synchronizing a local copy on my computer using offlineimap. As the spam filtering options provided on the server are not sufficient, I am now looking into client-side spam filtering. My current setup is as follows. Mail is synchronized using offlineimap, and delivered to a local dovecot server: --8<---------------cut here---------------start------------->8--- [Repository LocalIMAP] type = IMAP preauthtunnel = /usr/local/Cellar/dovecot/2.2.10/libexec/dovecot/imap -c ~/.dovecotzimbra.rc --8<---------------cut here---------------end--------------->8--- The configuration of the local server is simply: --8<---------------cut here---------------start------------->8--- protocols = imap mail_location = maildir:~/.Maildir/zimbra:INBOX=~/.Maildir/zimbra/.INBOX --8<---------------cut here---------------end--------------->8--- I then read my mail using gnus, and index it using notmuch. A suggestion I've been considering is use the pigeonhole sieve extprograms plugin (http://wiki2.dovecot.org/Pigeonhole/Sieve/Plugins/Extprograms) to call the spam filter (I've been looking at dspam at the moment). However, I could not find how to configure the use of sieves in the context of offlineimap. Hence my questions: Is it possible to use dovecot sieves in such a setting? Is there a howto that explains how to do it? Should I try to do things in a different way? (I'm ready to change my setup, as long as I can keep an offline copy of my email in sync with a server copy.) Thanks a lot for any suggestion, Alan PS: I used to use SpamSieve (http://c-command.com/spamsieve/) on a Mac Mini that was running continuously as a spam filter drone. This machine has been retired and I'm basically looking for leaner ways to do a similar thing.

5 9

[Dovecot] dovecot antispam plugin not found
by Alan Schmitt 19 Feb '14

19 Feb '14

Hello, I'm trying to setup dovecot-antispam, and even though the configuration and the installation seem to have gone well, dovecot is telling me it's not finding it. Here is the symptom: schmitta@top-wifi ~> /usr/local/Cellar/dovecot/2.2.10/libexec/dovecot/imap -c ~/.dovecotzimbra.rc Fatal: Plugin 'antispam' not found from directory /usr/local/Cellar/dovecot/2.2.10/lib/dovecot However there seems to be a plugin there: schmitta@top-wifi ~> ls -al /usr/local/Cellar/dovecot/2.2.10/lib/dovecot/ | grep antispam -rwxr-xr-x 1 schmitta admin 38460 18 fév 22:40 lib90_antispam_plugin.bundle I note that it is the only plugin with the ".bundle" extension, if it's important. My configuration file is as follows (I'm not finished with the antispam configuration yet): --8<---------------cut here---------------start------------->8--- protocols = imap mail_location = maildir:~/.Maildir/zimbra:INBOX=~/.Maildir/zimbra/.INBOX default_login_user = _dovenull default_internal_user = _dovecot protocol imap { # mail_plugins = $mail_plugins antispam } protocol lda { log_path = ~/.logs/dovecot-lda-errors.log info_log_path = ~/.logs/dovecot-lda.log mail_plugins = $mail_plugins sieve } plugin { sieve = ~/.dovecot.sieve sieve_plugins = sieve_extprograms sieve_extensions = +vnd.dovecot.filter sieve_filter_bin_dir = /usr/local/lib/dovecot/sieve-filter antispam_backend = DSPAM antispam_signature = X-DSPAM-Signature } --8<---------------cut here---------------end--------------->8--- Should I do something special to be able to load the antispam plugin? Thanks, Alan

2 3

[Dovecot] Virtual folder for selected users only? (1.2.15)
by Sebastian Schäfer 19 Feb '14

19 Feb '14

hi, i want to set up virtual folders just for some users on our mailserver. the server is set up with a virtual system-user for each of our clients having multiple mailboxes/users (provided by dovecot-mysql). mailboxes are located: /var/mails/SYSUSER/MAILBOX f.e. my mailbox-folder is set to /var/mails/bergschaf/sebastian[at]bergschaf.net {homedir} = /var/mails {maildir} = bergschaf/sebastian[at]bergschaf.net user_query = SELECT homedir AS home, concat('maildir:', maildir) AS mail, uid, gid, concat('maildir:storage=', (quota*1024)) as quota FROM mail_users WHERE username = '%u' now i want to add virtual folders to my mailbox without affecting any other client/mailbox on the server. i already tried to add a namespace "virtual" like mentioned in the wiki and in some other hotwo-guides, but this points to the need to create a "virtual"-folder for each mailbox what i would like to avoid. (f.e. location = %h/%u/virtual => /var/mails/sebastian[at]bergschaf.net). is it possible to enable a namespace just for some selected users on the server? if that's not possible - i'm not sure how to set the location-directive correctly, because i can't find a variable pointing to the maildir: %u => sebastian[at]bergschaf.net %h => /var/mails ...but how should i point the location to {homedir}/{maildir}/virtual? thanks! sebastian dovecot --version 1.2.15

4 3

[Dovecot] failed: Message has been copied too many times
by Angel L. Mateo 19 Feb '14

19 Feb '14

Hello, I'm running dovecot 2.1.16 in a ubuntu 12.04 server, with lazy_expunge, SiS and mdbox format. The problem I'm having is that the index for one the mailboxes of one of my users is growing too much. This is not the first time of this problem. In previous cases, is because a message is duplicated thousand of times (I haven't found any reason for this). In these cases, moving messages to other folder and moving again to this same folder fixes the problem. So I have tried this, and I have moved all messages from this folder to another one. But this time, after this, indexes directory is still using a lot of space. And the folder seems to have more serious problems: amateo_adm@myotis51:~$ sudo doveadm search -u vlo mailbox BORRADOS.INBOX.MNCS doveadm(vlo): Error: Syncing mailbox BORRADOS.INBOX.MNCS failed: Message has been copied too many times (59306 + -1) I have tried to delete the folder, with the same result: amateo_adm@myotis51:~$ sudo doveadm mailbox delete -u vlo BORRADOS.INBOX.MNCS doveadm(vlo): Error: Can't delete mailbox BORRADOS.INBOX.MNCS: Message has been copied too many times (59306 + -1) And to purge user's mailbox, but it didn't fix the problem. PS: If this could help, BORRADOS. is the namespace used by lazy_expunge plugin. -- Angel L. Mateo Martínez Sección de Telemática Área de Tecnologías de la Información y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868887590 Fax: 868888337

4 9

Re: [Dovecot] Virtual folder for selected users only? (1.2.15)
by Sebastian Schäfer 19 Feb '14

19 Feb '14

> thats very outdated, you should upgrade 2.1.x / 2.2.x latest I would like to avoid this, because the 1.2.15 is running extremely stable for a long time. (also it's the most recent version on this old squeeze-machine if not using backports) As far as I see, the virtual folders are fully supported since 1.2.x - am I wrong? What are the advantages of upgrading to 2.x? Are there security issues? Thanks! best, sebastian

2 1

[Dovecot] Dovecot, mysql, and quota
by David Mehler 19 Feb '14

19 Feb '14

Hello, I'm running dovecot 2.2 and wanting to get quotas going. I've got the plugins loaded appropriately and am wanting to configure a dictionary backend to talk to my mysql database. I've got a single database called mail which has all the mail-related items in it. One table is for virtual users which postfix uses. It looks like this: CREATE TABLE `virtual_users` ( `id` int(11) NOT NULL auto_increment, `domain_id` int(11) NOT NULL, `password` varchar(128) NOT NULL, `email` varchar(100) NOT NULL, PRIMARY KEY (`id`), UNIQUE KEY `email` (`email`), FOREIGN KEY (domain_id) REFERENCES virtual_domains(id) ON DELETE CASCADE ) ENGINE=InnoDB DEFAULT CHARSET=utf8; and a user looks like: INSERT INTO `mail`.`virtual_users` ( `id` , `domain_id` , `password` , `email` ) VALUES ( '1', '1', SHA2( 'PasswordGoesHere', 512) , 'username(a)domain.com' ); plugin { # SQL backend: quota = dict:User quota::proxy::sqlquota } dict { sqlquota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } Now when creating the quota table i'd like to have the username field linked to my virtual_users table username field, so I don't have to set up two tables both with the same username information in it. Can someone check me on this design so that if I delete a virtual user out of the virtual_users table the coresponding row in the quota table is also eliminated? My second question has to do with global and per user quotas. If I have something like this: CREATE TABLE quota ( username varchar(100) not null, bytes bigint not null default 262144, messages integer not null default 0, primary key (username) ); 256MB for all users by default, but then if I give a user a 100MB value in the bytes field of their quota entry would that be a per-user quota? Thanks. Dave.

2 1

[Dovecot] Index corruption with 2.2.12 when moving a message
by Bojan Smojver 19 Feb '14

19 Feb '14

Just bumped into this today, when I upgraded to a testing package in Fedora: https://admin.fedoraproject.org/updates/FEDORA-2014-2672/dovecot-2.2.12-1.f… For details, see this bug: https://bugzilla.redhat.com/show_bug.cgi?id=1066709 Haven't seen this kind of thing before. Sure, it worked the second time I tried to move the message to another folder (I'm guessing index got rebuilt or something), but still, looks suspicious. Anyway, I'm using mbox format mailboxes, if it matters. Client was Gnome Evolution 3.10.4. -- Bojan

1 0

[Dovecot] Problems with dovecot 2.1.7, spamassassin 3.3.2 and antispam plugin
by Dean Carpenter 18 Feb '14

18 Feb '14

This might be a fairly long message, but I wanted to be sure to include as much information as possible. I'm having an issue with the dovecot-antispam plugin in that it seems to be unable to successfully run anything from the pipe backend. To qualify that, they run, but they fail ... Running /usr/bin/sa-learn directly always returns with an error code of 1, and the bayes DB isn't actually updated. Running the /usr/local/bin/sa-learn-pipe.sh script from the example will run sa-learn successfully, but sa-learn fails partway through, right on a sql DB access. I have both bayes and FuzzyOcr data stored in mysql, and the error occurs on accessing either one. That is, I've tested with FuzzyOcr enabled, and it fails on the db access to the FuzzyOcr DB, and I've tried it with FuzzyOcr disabled. In that case, it fails on the access to the bayes DB. The error line right there is : libgcc_s.so.1 must be installed for pthread_cancel to work Since sa-learn terminated prematurely, the bayes DB isn't updated at all. Running /usr/bin/sa-learn or the script /usr/local/bin/sa-learn-pipe.sh directly from cmdline works fine though - sa-learn completes correctly and updates the bayes DB properly, I can see the new tokens. $ sa-learn-pipe.sh --spam < /usr/share/doc/spamassassin/examples/sample-spam.txt $ sa-learn --spam /usr/share/doc/spamassassin/examples/sample-spam.txt I think it would be great to have a dedicated logfile for antispam, one that would capture both stdout as well as stderr. These tests are being done on a clean Ubuntu 13.04 system. I'm rebuilding the VM repeatedly as I configure the various pieces, and can test any changes or whatever you might suggest very easily. I've fully scripted the install and configuration of Exim4, Dovecot, Spamassassin, Clamav, Percona/Mysql, Roundcube, and can build a full VM under Virtualbox or any VPS in less than 10 minutes. Ubuntu 13.04 Dovecot 2.1.7 dovecot-antispam 2.0+20120225-3 Anyone else using the antispam plugin with spamassassin 3.3.2 ? Anything I can check to see what's causing this problem ? -------------------------------------------------------- $ cat /usr/local/bin/sa-learn-pipe.sh #!/bin/bash echo /usr/bin/sa-learn $* /tmp/sendmail-msg-$$.txt echo "$$-start ($*)" >> /var/log/sa-learn-pipe.log cat<&0 >> /tmp/sendmail-msg-$$.txt /usr/bin/sa-learn -D $* /tmp/sendmail-msg-$$.txt >> /tmp/sa-learn-pipe.$$.log 2>&1 echo $$ sa-learn rc=$? id=$(id) HOME=$HOME >> /var/log/sa-learn-pipe.log while read line; do echo $$-sa-learn "$line" >> /var/log/sa-learn-pipe.log done < /tmp/sa-learn-pipe.$$.log rm -f /tmp/sendmail-msg-$$.txt echo "$$-end" >> /var/log/sa-learn-pipe.log exit 0 -------------------------------------------------------- With FuzzyOcr DISabled, fails right after Bayes DB access $ cat /var/log/sa-learn-pipe.log 4505-start (--spam) 4505 sa-learn rc=134 id=uid=108(Debian-exim) gid=113(Debian-exim) groups=113(Debian-exim) HOME= 4505-sa-learn Nov 8 09:05:26.134 [4507] dbg: logger: adding facilities: all 4505-sa-learn Nov 8 09:05:26.134 [4507] dbg: logger: logging level is DBG 4505-sa-learn Nov 8 09:05:26.134 [4507] dbg: generic: SpamAssassin version 3.3.2 4505-sa-learn Nov 8 09:05:26.134 [4507] dbg: generic: Perl 5.014002, PREFIX=/usr, DEF_RULES_DIR=/usr/share/spamassassin, LOCAL_RULES_DIR=/etc/spamassassin, LOCAL_STATE_DIR=/var/lib/spamassassin : : 4505-sa-learn Nov 8 09:05:27.131 [4507] dbg: replacetags: done replacing tags 4505-sa-learn Nov 8 09:05:27.131 [4507] dbg: FreeMail: loaded freemail_domains entries: 2470 normal, 29 wildcard 4505-sa-learn Nov 8 09:05:27.132 [4507] dbg: plugin: Mail::SpamAssassin::Plugin::Bayes=HASH(0x3879e88) implements 'learner_new', priority 0 4505-sa-learn Nov 8 09:05:27.132 [4507] dbg: bayes: learner_new self=Mail::SpamAssassin::Plugin::Bayes=HASH(0x3879e88), bayes_store_module=Mail::SpamAssassin::BayesStore::MySQL 4505-sa-learn Nov 8 09:05:27.151 [4507] dbg: bayes: using username: debian-spamd 4505-sa-learn Nov 8 09:05:27.151 [4507] dbg: bayes: learner_new: got store=Mail::SpamAssassin::BayesStore::MySQL=HASH(0x3ec0388) 4505-sa-learn Nov 8 09:05:27.152 [4507] dbg: plugin: Mail::SpamAssassin::Plugin::Bayes=HASH(0x3879e88) implements 'learner_is_scan_available', priority 0 4505-sa-learn libgcc_s.so.1 must be installed for pthread_cancel to work 4505-end 7235-start () -------------------------------------------------------- With FuzzyOcr ENabled, fails right after FuzzyOcr DB access $ cat /var/log/sa-learn-pipe.log : : 7804-sa-learn Nov 8 09:37:09.612 [7806] info: FuzzyOcr: Using scan ocrad-invert: /usr/bin/ocrad -s5 -i $input 7804-sa-learn Nov 8 09:37:09.612 [7806] info: FuzzyOcr: Using scan ocrad-decolorize-invert: /usr/bin/ocrad -s5 -i $input 7804-sa-learn Nov 8 09:37:09.612 [7806] info: FuzzyOcr: Using scan ocrad-decolorize: /usr/bin/ocrad -s5 $input 7804-sa-learn Nov 8 09:37:09.612 [7806] info: FuzzyOcr: Using scan gocr: /usr/bin/gocr -i $input 7804-sa-learn Nov 8 09:37:09.612 [7806] info: FuzzyOcr: Using scan gocr-180: /usr/bin/gocr -l 180 -d 2 -i $input 7804-sa-learn Nov 8 09:37:09.612 [7806] info: FuzzyOcr: Using scan tesseract: /usr/bin/tesseract $input $output 7804-sa-learn Nov 8 09:37:09.612 [7806] info: FuzzyOcr: Importing for MLDBM databases not available (dependencies missing) 7804-sa-learn Nov 8 09:37:09.612 [7806] dbg: FuzzyOcr: Connecting to: dbi:mysql:database=FuzzyOcr;mysql_socket=/var/run/mysqld/mysqld.sock 7804-sa-learn libgcc_s.so.1 must be installed for pthread_cancel to work 7804-end -------------------------------------------------------- syslog entries from running with sa-learn-pipe.sh script antispam_pipe_program = /usr/local/bin/sa-learn-pipe.sh Nov 8 09:36:41 newgalah1 imap: antispam: plugin initialising (2.0-notgit) Nov 8 09:36:41 newgalah1 imap: antispam: verbose debug enabled Nov 8 09:36:41 newgalah1 imap: antispam: "Junk" is exact match spam folder Nov 8 09:36:41 newgalah1 imap: antispam: "Spam" is exact match spam folder Nov 8 09:36:41 newgalah1 imap: antispam: no unsure folders Nov 8 09:36:41 newgalah1 imap: antispam: "Trash" is wildcard match trash folder Nov 8 09:36:41 newgalah1 imap: antispam: "Deleted *" is wildcard match trash folder Nov 8 09:36:41 newgalah1 imap: antispam: pipe backend spam argument = --spam Nov 8 09:36:41 newgalah1 imap: antispam: pipe backend not-spam argument = --ham Nov 8 09:36:41 newgalah1 imap: antispam: pipe backend program = /usr/local/bin/sa-learn-pipe.sh Nov 8 09:36:41 newgalah1 imap: antispam: pipe backend tmpdir /tmpNov 8 09:37:08 newgalah1 imap: antispam: mailbox_is_unsure(Junk): 0 Nov 8 09:37:08 newgalah1 imap: antispam: mailbox_is_trash(INBOX): 0 Nov 8 09:37:08 newgalah1 imap: antispam: mailbox_is_trash(Junk): 0 Nov 8 09:37:08 newgalah1 imap: antispam: mail copy: from trash: 0, to trash: 0 Nov 8 09:37:08 newgalah1 imap: antispam: mailbox_is_spam(INBOX): 0 Nov 8 09:37:08 newgalah1 imap: antispam: mailbox_is_spam(Junk): 1 Nov 8 09:37:08 newgalah1 imap: antispam: mailbox_is_unsure(INBOX): 0 Nov 8 09:37:08 newgalah1 imap: antispam: mail copy: src spam: 0, dst spam: 1, src unsure: 0 Nov 8 09:37:08 newgalah1 imap: antispam: running mailtrain backend program /usr/local/bin/sa-learn-pipe.sh Nov 8 09:37:08 newgalah1 imap: antispam: running mailtrain backend program /usr/local/bin/sa-learn-pipe.sh Nov 8 09:37:08 newgalah1 imap: antispam: running mailtrain backend program parameter 1 --spam -------------------------------------------------------- syslog entries from running with sa-learn directly antispam_pipe_program = /usr/bin/sa-learn Nov 8 09:44:57 newgalah1 imap: antispam: plugin initialising (2.0-notgit) Nov 8 09:44:57 newgalah1 imap: antispam: verbose debug enabled Nov 8 09:44:57 newgalah1 imap: antispam: "Junk" is exact match spam folder Nov 8 09:44:57 newgalah1 imap: antispam: "Spam" is exact match spam folder Nov 8 09:44:57 newgalah1 imap: antispam: no unsure folders Nov 8 09:44:57 newgalah1 imap: antispam: "Trash" is wildcard match trash folder Nov 8 09:44:57 newgalah1 imap: antispam: "Deleted *" is wildcard match trash folder Nov 8 09:44:57 newgalah1 imap: antispam: pipe backend spam argument = --spam Nov 8 09:44:57 newgalah1 imap: antispam: pipe backend not-spam argument = --ham Nov 8 09:44:57 newgalah1 imap: antispam: pipe backend program = /usr/bin/sa-learn Nov 8 09:44:57 newgalah1 imap: antispam: pipe backend tmpdir /tmp Nov 8 09:44:57 newgalah1 imap: antispam: mailbox_is_unsure(Junk): 0 Nov 8 09:44:57 newgalah1 imap: antispam: mailbox_is_trash(INBOX): 0 Nov 8 09:44:57 newgalah1 imap: antispam: mailbox_is_trash(Junk): 0 Nov 8 09:44:57 newgalah1 imap: antispam: mail copy: from trash: 0, to trash: 0 Nov 8 09:44:57 newgalah1 imap: antispam: mailbox_is_spam(INBOX): 0 Nov 8 09:44:57 newgalah1 imap: antispam: mailbox_is_spam(Junk): 1 Nov 8 09:44:57 newgalah1 imap: antispam: mailbox_is_unsure(INBOX): 0 Nov 8 09:44:57 newgalah1 imap: antispam: mail copy: src spam: 0, dst spam: 1, src unsure: 0 Nov 8 09:44:57 newgalah1 imap: antispam: running mailtrain backend program /usr/bin/sa-learn Nov 8 09:44:57 newgalah1 imap: antispam: running mailtrain backend program /usr/bin/sa-learn Nov 8 09:44:57 newgalah1 imap: antispam: running mailtrain backend program parameter 1 --spam Nov 8 09:44:58 newgalah1 imap: antispam: run program failed with exit code -1 -------------------------------------------------------- $ cat 90-plugin.conf plugin { antispam_debug_target = syslog antispam_verbose_debug = 1 antispam_backend = pipe antispam_trash_pattern = Trash;Deleted * antispam_spam = Junk;Spam antispam_pipe_program = /usr/local/bin/sa-learn-pipe.sh # antispam_pipe_program_args = --progress antispam_pipe_program_spam_arg = --spam antispam_pipe_program_notspam_arg = --ham antispam_pipe_tmpdir = /tmp } -------------------------------------------------------- $ dovecot -n # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.8.0-32-generic x86_64 Ubuntu 13.04 auth_mechanisms = cram-md5 login plain first_valid_uid = 108 mail_location = maildir:~/Maildir:LAYOUT=fs:INBOX=~/Maildir/INBOX managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;as cii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = } passdb { args = scheme=plain username_format=%u /var/mail/%d/PASSWD driver = passwd-file } plugin { antispam_backend = pipe antispam_debug_target = syslog antispam_pipe_program = /usr/local/bin/sa-learn-pipe.sh antispam_pipe_program_notspam_arg = --ham antispam_pipe_program_spam_arg = --spam antispam_pipe_tmpdir = /tmp antispam_spam = Junk;Spam antispam_trash_pattern = Trash;Deleted * antispam_verbose_debug = 1 sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = " imap lmtp sieve" service auth { unix_listener auth-client { mode = 0666 } } ssl = required ssl_cert = </etc/ssl/certs/dovecot1.crt ssl_key = </etc/ssl/private/dovecot1.pkcs8.key userdb { args = username_format=%u /var/mail/%d/PASSWD default_fields = uid=Debian-exim gid=Debian-exim home=/var/mail/%d/%n driver = static } protocol lmtp { mail_plugins = " sieve" } protocol lda { mail_plugins = " sieve" } protocol imap { mail_plugins = " antispam" }

6 10

[Dovecot] SMTP configuration for director mail cluster
by Murray Trainer 18 Feb '14

18 Feb '14

HI All, I have setup my Dovecot director proxies and Dovecot backend mail stores. I intend setting up several incoming and outgoing Exim MTA's. I am a bit confused about what I need to run on the backend Dovecot MTA's to get the incoming mail delivered to them. Do I need to install Exim on them or use LMTP to receive mail from the MTA's? Also, can I directly deliver mail to the mailstores or do I have to go through the director proxies using lmtp? Note that I am using Director with the mailboxes on NFS backed storage. Thanks Murray

2 1

[Dovecot] Bug report
by Ramon 18 Feb '14

18 Feb '14

I'm using release 2.2.12, during a copy operation i get segfault on imap process. I have full bt of the issue: (gdb) bt #0 0x00007fcc521029cd in mail_cache_header_fields_read (cache=0x15c7210) at mail-cache-fields.c:369 #1 0x00007fcc52100664 in mail_cache_open_and_verify (cache=0x15c7210) at mail-cache.c:497 #2 0x00007fcc5210244d in mail_cache_register_get_list (cache=0x15c7210, pool=0x1573608, count_r=0x7fff7b3b2418) at mail-cache-fields.c:194 #3 0x00007fcc520ef845 in index_mail_parse_header_register_all_wanted (mail=0x15d4b60, headers=<value optimized out>) at index-mail-headers.c:170 #4 index_mail_parse_header_init (mail=0x15d4b60, headers=<value optimized out>) at index-mail-headers.c:230 #5 0x00007fcc520efdb8 in index_mail_cache_parse_init (_mail=0x15d4b60, input=0x15ddb38) at index-mail-headers.c:376 #6 0x00007fcc520bb163 in maildir_save_add (_ctx=0x15d3b20, tmp_fname=0x15735e8 "1392731650.M182940P5176.pecpop5", src_mail=0x0) at maildir-save.c:225 #7 0x00007fcc520bb4b8 in maildir_save_begin (_ctx=0x15d3b20, input=0x15debb8) at maildir-save.c:415 #8 0x00007fcc511e7360 in quota_save_begin (ctx=0x15d3b20, input=0x15debb8) at quota-storage.c:274 #9 0x00007fcc520cc182 in mailbox_save_begin (ctx=0x7fff7b3b25a8, input=0x15debb8) at mail-storage.c:2025 #10 0x00007fcc520c6242 in mail_storage_try_copy (ctx=0x15d3b20, mail=<value optimized out>) at mail-copy.c:76 #11 mail_storage_copy (ctx=0x15d3b20, mail=<value optimized out>) at mail-copy.c:101 #12 0x00007fcc520b6916 in maildir_copy (ctx=0x15d3b20, mail=0x15cf300) at maildir-copy.c:148 #13 0x00007fcc50dd7461 in notify_copy (ctx=0x15d3b20, mail=0x15cf300) at notify-storage.c:107 #14 0x00007fcc511e7183 in quota_copy (ctx=0x15d3b20, mail=0x15cf300) at quota-storage.c:220 #15 0x00007fcc520cc01f in mailbox_copy (_ctx=<value optimized out>, mail=0x15cf300) at mail-storage.c:2133 #16 0x000000000040c63b in fetch_and_copy (cmd=0x1593810, move=false) at cmd-copy.c:70 #17 cmd_copy_full (cmd=0x1593810, move=false) at cmd-copy.c:123 #18 0x0000000000416fbd in command_exec (cmd=0x1593810) at imap-commands.c:158 #19 0x00000000004160e0 in client_command_input (cmd=0x1593810) at imap-client.c:780 #20 0x00000000004161cd in client_command_input (cmd=0x1593810) at imap-client.c:841 #21 0x000000000041644d in client_handle_next_command (client=0x1592fb0) at imap-client.c:879 #22 client_handle_input (client=0x1592fb0) at imap-client.c:891 #23 0x00000000004167bf in client_input (client=0x1592fb0) at imap-client.c:933 #24 0x00007fcc51e1f336 in io_loop_call_io (io=0x158c1d0) at ioloop.c:388 #25 0x00007fcc51e203a7 in io_loop_handler_run (ioloop=<value optimized out>) at ioloop-epoll.c:220 #26 0x00007fcc51e1f2a8 in io_loop_run (ioloop=0x157b720) at ioloop.c:412 #27 0x00007fcc51dcdf73 in master_service_run (service=0x157b5b0, callback=<value optimized out>) at master-service.c:566 #28 0x000000000041fd07 in main (argc=1, argv=0x157b390) at main.c:400 Here's config: auth_debug = yes auth_master_user_separator = * auth_username_format = default_vsz_limit = 512 M disable_plaintext_auth = no dotlock_use_excl = no first_valid_gid = 101 first_valid_uid = 102 imap_id_send = import_environment = TZ info_log_path = /var/log/dovecot.log log_path = /var/log/dovecot.log log_timestamp = "%Y-%m-%d %H:%M:%S " mail_fsync = always mail_gid = 101 mail_location = maildir:%h/Maildir mail_max_userip_connections = 50 mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = quota expire fts fts_lucene mail_log notify mail_uid = 102 maildir_broken_filename_sizes = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mbox_write_locks = fcntl mmap_disable = yes namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = INBOX. separator = . subscriptions = yes type = private } passdb { args = /opt/dovecot-2.2.10/etc/dovecot/passwd.masterusers driver = passwd-file master = yes } passdb { args = /opt/dovecot-2.2.10/etc/dovecot/dovecot-ldap.conf driver = ldap } passdb { args = /opt/dovecot-2.2.10/etc/dovecot/dovecot-ldap-multiuser.conf driver = ldap master = yes } plugin { fts = lucene fts_lucene = mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size quota = maildir quota_rule2 = INBOX.Trash:storage=+100M } protocols = imap pop3 service anvil { client_limit = 3000 } service auth { client_limit = 4096 unix_listener auth-userdb { mode = 0600 } } service imap-login { inet_listener imap { address = 10.11.47.49 port = 143 } inet_listener imaps { address = 10.11.47.49 port = 993 ssl = yes } process_limit = 2500 process_min_avail = 5 } service imap { drop_priv_before_exec = yes process_limit = 2500 process_min_avail = 5 } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 0 service_count = 1 vsz_limit = 64 M } service managesieve { drop_priv_before_exec = yes process_limit = 1024 } service pop3-login { inet_listener pop3 { address = 10.11.47.49 port = 110 } inet_listener pop3s { address = 10.11.47.49 port = 995 ssl = yes } process_limit = 300 process_min_avail = 5 } service pop3 { drop_priv_before_exec = yes process_limit = 300 process_min_avail = 5 } ssl_cert = </opt/dovecot-2.2.10/certs/imapd.pem ssl_key = </opt/dovecot-2.2.10/certs/imapd.pem userdb { args = /opt/dovecot-2.2.10/etc/dovecot/dovecot-ldap.conf driver = ldap } protocol lmtp { mail_plugins = quota expire fts fts_lucene mail_log notify sieve } protocol lda { mail_plugins = quota expire fts fts_lucene mail_log notify sieve } protocol imap { mail_plugins = quota imap_quota mail_log notify } protocol pop3 { mail_plugins = quota mail_log notify pop3_uidl_format = UID%u-%v } Regards, Ramon

1 0

[Dovecot] PARTIAL results and UIDs
by Anders Thøgersen 18 Feb '14

18 Feb '14

Hi, I have had a look at dovecot 2.2.12 and think that I may have run into an issue with PARTIAL results. I have a mailbox with 9 emails having UIDs from 1 - 9. One of these emails contains the STRING "RFC" in the Subject header. The following SORT command with this mailbox selected does not return any emails: A4 UID SORT RETURN (COUNT PARTIAL 1:3) (FROM) UTF-8 (SUBJECT "RFC") * ESEARCH (TAG "A4") UID PARTIAL (1:3 NIL) COUNT 1 A4 OK Sort completed (0.000 secs). Here COUNT is 1, but the result is NIL. Changing the partial range to 1:5 returns the expected result: A4 UID SORT RETURN (COUNT PARTIAL 1:5) (FROM) UTF-8 (SUBJECT "RFC") * ESEARCH (TAG "A4") UID PARTIAL (1:5 5) COUNT 1 A4 OK Sort completed (0.000 secs). It may be that UIDs are used instead of sequence numbers. Regards Anders

1 0

[Dovecot] Possible error in function mailbox_autocreate
by Potapov Sergey 18 Feb '14

18 Feb '14

Hi! in mailbox_autocreate: if (mailbox_create(box, NULL, FALSE) < 0) { errstr = mailbox_get_last_error(box, &error); if (error != MAIL_ERROR_NOTFOUND) { <<< May be MAIL_ERROR_EXISTS should be here? mail_storage_set_critical(box->storage, "Failed to autocreate mailbox %s: %s", box->vname, errstr); return -1; } Some time I got this error when two connections tries to create INBOX at same time. ______ С уважением, Сергей Потапов

1 0

[Dovecot] Dsync crash (v2.2.10, sdbox+sis → mbox)
by Gilles Chauvin 18 Feb '14

18 Feb '14

Hi, I'm trying to use dsync to convert sdbox + sis mailboxes to mbox (mbox is chosen here to "re-attach" the attachments to their original place) # dsync -Dv -u $LOGIN -o "mail_location=sdbox:/zfspool/clone_srv_mail/$LOGIN" -o "mail_attachment_dir=/zfspool/clone_srv_attachments" backup "mbox:/zfspool/restore/$LOGIN/mbox:DIRNAME=mBoX-MeSsAgEs:INDEX=/zfspool/restore/$LOGIN/indexes:CONTROL=/zfspool/restore/$LOGIN/control" For 5 users out of a sample of 24, here is what's happening: dsync(user1): Error: read(/zfspool/clone_srv_attachments/cb/0a/cb0aad465a4ff95bf6fa6ece0fba94b43e8892cf-19dc51309fc2f3527e31000044c1c7e7-b55eb9176ca1b350e565000094b229f9-30810[base64:19 b/l]) failed: Stream is larger than expected (163244 > 163243, eof=1) dsync(user1): Error: copy: i_stream_read() failed: Invalid argument dsync(user1): Panic: file mail-index-transaction-update.c: line 19 (mail_index_transaction_lookup): assertion failed: (seq >= t->first_new_seq && seq <= t->last_new_seq) dsync(user1): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x6889a) [0x7f58a95a189a] -> /usr/local/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x32) [0x7f58a95a19a2] -> /usr/local/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f58a955b1cf] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xc0287) [0x7f58a98ca287] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xc3145) [0x7f58a98cd145] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_cache_decision_state_update+0xb6) [0x7f58a98bcb06] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_cache_lookup_headers+0x91) [0x7f58a98be5e1] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xa0ac3) [0x7f58a98aaac3] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_mail_get_first_header+0x4a) [0x7f58a98ab04a] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x9c021) [0x7f58a98a6021] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x9c151) [0x7f58a98a6151] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_mail_close+0xf5) [0x7f58a98a6295] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_save_cancel+0x48) [0x7f58a98867c8] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_storage_copy+0x92) [0x7f58a9880e32] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_copy+0x5f) [0x7f58a9886c2f] -> dsync() [0x42f750] -> dsync(dsync_brain_sync_mails+0x459) [0x42e9c9] -> dsync(dsync_brain_run+0x2a1) [0x42ac51] -> dsync() [0x42876f] -> dsync() [0x411c97] -> dsync(doveadm_mail_try_run+0x238) [0x4120a8] -> dsync(main+0x3d1) [0x41aaa1] -> /lib64/libc.so.6(__libc_start_main+0xfd) [0x7f58a91c3d1d] -> dsync() [0x411419] dsync(user2): Error: read(/zfspool/clone_srv_attachments/ad/0c/ad0cef35cc6f0b2dae2197c4ff2b61a2bd58070d-9e8345192ccbf352c210000044c1c7e7-6efa5f2e522db350ed3d000094b229f9-15470[base64:18 b/l]) failed: Stream is larger than expected (194476 > 194475, eof=1) dsync(user2): Error: copy: i_stream_read() failed: Invalid argument dsync(user2): Panic: file mail-index-transaction-update.c: line 19 (mail_index_transaction_lookup): assertion failed: (seq >= t->first_new_seq && seq <= t->last_new_seq) dsync(user2): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x6889a) [0x7f2e2248d89a] -> /usr/local/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x32) [0x7f2e2248d9a2] -> /usr/local/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f2e224471cf] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xc0287) [0x7f2e227b6287] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xc3145) [0x7f2e227b9145] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_cache_decision_state_update+0xb6) [0x7f2e227a8b06] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_cache_lookup_headers+0x91) [0x7f2e227aa5e1] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xa0ac3) [0x7f2e22796ac3] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_mail_get_first_header+0x4a) [0x7f2e2279704a] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x9c021) [0x7f2e22792021] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x9c151) [0x7f2e22792151] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_mail_close+0xf5) [0x7f2e22792295] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_save_cancel+0x48) [0x7f2e227727c8] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_storage_copy+0x92) [0x7f2e2276ce32] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_copy+0x5f) [0x7f2e22772c2f] -> dsync() [0x42f750] -> dsync(dsync_brain_sync_mails+0x459) [0x42e9c9] -> dsync(dsync_brain_run+0x2a1) [0x42ac51] -> dsync() [0x42876f] -> dsync() [0x411c97] -> dsync(doveadm_mail_try_run+0x238) [0x4120a8] -> dsync(main+0x3d1) [0x41aaa1] -> /lib64/libc.so.6(__libc_start_main+0xfd) [0x7f2e220afd1d] -> dsync() [0x411419] dsync(user3): Error: read(/zfspool/clone_srv_attachments/23/8a/238a781b53bb4d1b1bee989a5ff38636b616d5c5-41ba47152912f4522c6f000044c1c7e7-f3b06c2f5aa1b350d565000094b229f9-38650[base64:19 b/l]) failed: Stream is larger than expected (33191 > 33190, eof=1) dsync(user3): Error: copy: i_stream_read() failed: Invalid argument dsync(user3): Panic: file mail-index-transaction-update.c: line 19 (mail_index_transaction_lookup): assertion failed: (seq >= t->first_new_seq && seq <= t->last_new_seq) dsync(user3): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x6889a) [0x7f88d4bde89a] -> /usr/local/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x32) [0x7f88d4bde9a2] -> /usr/local/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f88d4b981cf] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xc0287) [0x7f88d4f07287] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xc3145) [0x7f88d4f0a145] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_cache_decision_state_update+0xb6) [0x7f88d4ef9b06] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_cache_lookup_headers+0x91) [0x7f88d4efb5e1] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xa0ac3) [0x7f88d4ee7ac3] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_mail_get_first_header+0x4a) [0x7f88d4ee804a] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x9c021) [0x7f88d4ee3021] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x9c151) [0x7f88d4ee3151] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_mail_close+0xf5) [0x7f88d4ee3295] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_save_cancel+0x48) [0x7f88d4ec37c8] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_storage_copy+0x92) [0x7f88d4ebde32] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_copy+0x5f) [0x7f88d4ec3c2f] -> dsync() [0x42f750] -> dsync(dsync_brain_sync_mails+0x459) [0x42e9c9] -> dsync(dsync_brain_run+0x2a1) [0x42ac51] -> dsync() [0x42876f] -> dsync() [0x411c97] -> dsync(doveadm_mail_try_run+0x238) [0x4120a8] -> dsync(main+0x3d1) [0x41aaa1] -> /lib64/libc.so.6(__libc_start_main+0xfd) [0x7f88d4800d1d] -> dsync() [0x411419] dsync(user4): Error: read(/zfspool/clone_srv_attachments/11/fa/11fa090f48879e8514a07040a837b5544364e091-d5dd321af54ff452790f000044c1c7e7-98da7910e38db350b75a000094b229f9-50167[base64:19 b/l]) failed: Stream is larger than expected (56522 > 56521, eof=1) dsync(user4): Error: copy: i_stream_read() failed: Invalid argument dsync(user4): Panic: file mail-index-transaction-update.c: line 19 (mail_index_transaction_lookup): assertion failed: (seq >= t->first_new_seq && seq <= t->last_new_seq) dsync(user4): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x6889a) [0x7f416564a89a] -> /usr/local/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x32) [0x7f416564a9a2] -> /usr/local/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f41656041cf] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xc0287) [0x7f4165973287] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xc3145) [0x7f4165976145] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_cache_decision_state_update+0xb6) [0x7f4165965b06] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_cache_lookup_headers+0x91) [0x7f41659675e1] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xa0ac3) [0x7f4165953ac3] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_mail_get_first_header+0x4a) [0x7f416595404a] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x9c021) [0x7f416594f021] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x9c151) [0x7f416594f151] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_mail_close+0xf5) [0x7f416594f295] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_save_cancel+0x48) [0x7f416592f7c8] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_storage_copy+0x92) [0x7f4165929e32] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_copy+0x5f) [0x7f416592fc2f] -> dsync() [0x42f750] -> dsync(dsync_brain_sync_mails+0x459) [0x42e9c9] -> dsync(dsync_brain_run+0x2a1) [0x42ac51] -> dsync() [0x42876f] -> dsync() [0x411c97] -> dsync(doveadm_mail_try_run+0x238) [0x4120a8] -> dsync(main+0x3d1) [0x41aaa1] -> /lib64/libc.so.6(__libc_start_main+0xfd) [0x7f416526cd1d] -> dsync() [0x411419] dsync(user5): Error: read(/zfspool/clone_srv_attachments/77/aa/77aa90d73107cc35fd0305c22a84eb00e793c935-a0d2ef302a20f552de5a000044c1c7e7-2accb7218264b350a423000094b229f9-11713[base64:19 b/l]) failed: Stream is larger than expected (43663 > 43662, eof=1) dsync(user5): Error: copy: i_stream_read() failed: Invalid argument dsync(user5): Panic: file mail-index-transaction-update.c: line 19 (mail_index_transaction_lookup): assertion failed: (seq >= t->first_new_seq && seq <= t->last_new_seq) dsync(user5): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x6889a) [0x7f2ab375489a] -> /usr/local/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x32) [0x7f2ab37549a2] -> /usr/local/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f2ab370e1cf] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xc0287) [0x7f2ab3a7d287] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xc3145) [0x7f2ab3a80145] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_cache_decision_state_update+0xb6) [0x7f2ab3a6fb06] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_cache_lookup_headers+0x91) [0x7f2ab3a715e1] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xa0ac3) [0x7f2ab3a5dac3] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_mail_get_first_header+0x4a) [0x7f2ab3a5e04a] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x9c021) [0x7f2ab3a59021] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x9c151) [0x7f2ab3a59151] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_mail_close+0xf5) [0x7f2ab3a59295] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_save_cancel+0x48) [0x7f2ab3a397c8] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_storage_copy+0x92) [0x7f2ab3a33e32] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_copy+0x5f) [0x7f2ab3a39c2f] -> dsync() [0x42f750] -> dsync(dsync_brain_sync_mails+0x459) [0x42e9c9] -> dsync(dsync_brain_run+0x2a1) [0x42ac51] -> dsync() [0x42876f] -> dsync() [0x411c97] -> dsync(doveadm_mail_try_run+0x238) [0x4120a8] -> dsync(main+0x3d1) [0x41aaa1] -> /lib64/libc.so.6(__libc_start_main+0xfd) [0x7f2ab3376d1d] -> dsync() [0x411419] Regards, Gilles.

1 1