From jcea at jcea.es Wed Oct 1 12:37:46 2014 From: jcea at jcea.es (Jesus Cea) Date: Wed, 01 Oct 2014 14:37:46 +0200 Subject: virtualfolders under mdbox storage backend Message-ID: <542BF59A.2030908@jcea.es> Reading docs in http://wiki2.dovecot.org/Plugins/Virtual I wonder how is that used if I am using MDBOX as my storage backend. The only references there are about Maildir. -- Jes?s Cea Avi?n _/_/ _/_/_/ _/_/_/ jcea at jcea.es - http://www.jcea.es/ _/_/ _/_/ _/_/ _/_/ _/_/ Twitter: @jcea _/_/ _/_/ _/_/_/_/_/ jabber / xmpp:jcea at jabber.org _/_/ _/_/ _/_/ _/_/ _/_/ "Things are not so easy" _/_/ _/_/ _/_/ _/_/ _/_/ _/_/ "My name is Dump, Core Dump" _/_/_/ _/_/_/ _/_/ _/_/ "El amor es poner tu felicidad en la felicidad de otro" - Leibniz -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 473 bytes Desc: OpenPGP digital signature URL: From jcea at jcea.es Wed Oct 1 12:42:09 2014 From: jcea at jcea.es (Jesus Cea) Date: Wed, 01 Oct 2014 14:42:09 +0200 Subject: Supporting RFC 5466 (IMAP4 Extension for Named Searches (Filters)) Message-ID: <542BF6A1.9080306@jcea.es> I wonder if Dovecot supports RFC 5466 (IMAP4 Extension for Named Searches (Filters)) or if there is any plan about it. -- Jes?s Cea Avi?n _/_/ _/_/_/ _/_/_/ jcea at jcea.es - http://www.jcea.es/ _/_/ _/_/ _/_/ _/_/ _/_/ Twitter: @jcea _/_/ _/_/ _/_/_/_/_/ jabber / xmpp:jcea at jabber.org _/_/ _/_/ _/_/ _/_/ _/_/ "Things are not so easy" _/_/ _/_/ _/_/ _/_/ _/_/ _/_/ "My name is Dump, Core Dump" _/_/_/ _/_/_/ _/_/ _/_/ "El amor es poner tu felicidad en la felicidad de otro" - Leibniz -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 473 bytes Desc: OpenPGP digital signature URL: From jcea at jcea.es Wed Oct 1 13:43:18 2014 From: jcea at jcea.es (Jesus Cea) Date: Wed, 01 Oct 2014 15:43:18 +0200 Subject: [Dovecot] mdbox-files over 2 MB In-Reply-To: <53683543.6050404@hardwarefreak.com> References: <5326987F.3060403@gmx.de> <53679BDE.3060207@gmx.de> <53679D33.1070808@thelounge.net> <20140505152305.Horde.RPh72252cnResSssDZVBSw1@mail.patrickdk.com> <53683543.6050404@hardwarefreak.com> Message-ID: <542C04F6.3080703@jcea.es> I keep the quoted message complete because the original thread was posted six months ago. I am top-posting, no comments inside the quoted text. I plan to write a blog about mdbox oddities but in the meantime I can tell you that if you store attachments "detached" in your mdbox storage the issue is this: 1. You have a 200Kbytes MB m.* file you are currently targeting. 2. You have a new email to store. Lets say it has a 3MB attachment. 3. You have a 2MB mdbox max file size . 4. Dovecot notices that 0.2+3 > 2, so it will create a new m.* file. 5. When storing the message, it will store the attachment outside of the mbox, so the new m.* file will be, lets say, 5Kbytes only. 6. Now you have 2 m.* files: one of 200 Kbytes and other of 5Kbytes. 7. Dovecot tries to reuse undersized m.* files, but it is quite forgiving. I have some private patches to increase its agressiveness. If you don't detach attachment, you probably have the same issue: when a new message makes a m.* file to oversize, dovecot creates a new m.* file and leave the old one alone, so it will be undersized. On 06/05/14 03:05, Stan Hoeppner wrote: > On 5/5/2014 2:23 PM, Patrick Domack wrote: >> Quoting Reindl Harald : >> >>> Am 05.05.2014 16:10, schrieb Hardy Flor: >>>> Is there really no one with this problem? >>> >>> next time quote the problem instead demand >>> others to seek for you in the archives >> >> Even searching for him in the archives, I have no idea what he thinks is >> a problem. >> >> I know I have no issues using mdbox, with 2mb or 50mb rotate sizes. > > > He's wondering why many of his mdbox files are much smaller than 2 MB. > His original post: > > > On 3/17/2014 1:29 AM, Hardy Flor wrote: >> Hello, >> >> there are copies with different size in 3 mailboxes of the user >> sequentially about 3800 emails. >> why not something 2MB files? >> >> After the big file "m.00000034" with 14MB follow very many small ... >> >> ------------------------------------- doveconf: >> >> # 2.2.12: /etc/dovecot/dovecot.conf >> # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.4 ext4 >> mail_attachment_dir = /var/mail/attachments >> mail_attachment_hash = %{md5} >> mail_attachment_min_size = 16 k >> mail_location = mdbox:/var/mail/user/%n >> mdbox_rotate_interval = 1 weeks >> mdbox_rotate_size = 2 M >> >> ------------------------------------- directory: >> >> root at xxx:/var/mail/user/xxx/storage# ls -al >> insgesamt 76532 >> drwx--S--- 2 vmail mail 4096 M?r 16 13:52 . >> drwx--S--- 6 vmail mail 4096 M?r 16 12:10 .. >> -rw------- 1 vmail mail 74360 M?r 16 12:39 dovecot.map.index >> -rw------- 1 vmail mail 25204 M?r 16 13:52 dovecot.map.index.log >> -rw------- 1 vmail mail 63544 M?r 16 12:39 dovecot.map.index.log.2 >> -rw------- 1 vmail mail 2092921 M?r 16 12:15 m.00000001 >> -rw------- 1 vmail mail 2086746 M?r 16 12:15 m.00000002 >> -rw------- 1 vmail mail 2084182 M?r 16 12:15 m.00000003 >> -rw------- 1 vmail mail 2096826 M?r 16 12:15 m.00000004 >> -rw------- 1 vmail mail 1882666 M?r 16 12:15 m.00000005 >> -rw------- 1 vmail mail 1903965 M?r 16 12:15 m.00000006 >> -rw------- 1 vmail mail 2091169 M?r 16 12:15 m.00000007 >> -rw------- 1 vmail mail 2086396 M?r 16 12:15 m.00000008 >> -rw------- 1 vmail mail 507205 M?r 16 12:16 m.00000009 >> -rw------- 1 vmail mail 2031456 M?r 16 12:17 m.00000010 >> -rw------- 1 vmail mail 2095697 M?r 16 12:17 m.00000011 >> -rw------- 1 vmail mail 1689071 M?r 16 12:17 m.00000012 >> -rw------- 1 vmail mail 2092124 M?r 16 12:17 m.00000013 >> -rw------- 1 vmail mail 1950602 M?r 16 12:17 m.00000014 >> -rw------- 1 vmail mail 2092215 M?r 16 12:17 m.00000015 >> -rw------- 1 vmail mail 2087463 M?r 16 12:17 m.00000016 >> -rw------- 1 vmail mail 2079795 M?r 16 12:17 m.00000017 >> -rw------- 1 vmail mail 2014121 M?r 16 12:17 m.00000018 >> -rw------- 1 vmail mail 2081893 M?r 16 12:17 m.00000019 >> -rw------- 1 vmail mail 2092088 M?r 16 12:17 m.00000020 >> -rw------- 1 vmail mail 2090508 M?r 16 12:17 m.00000021 >> -rw------- 1 vmail mail 1929296 M?r 16 12:17 m.00000022 >> -rw------- 1 vmail mail 2067685 M?r 16 12:17 m.00000023 >> -rw------- 1 vmail mail 1745743 M?r 16 12:20 m.00000024 >> -rw------- 1 vmail mail 866452 M?r 16 12:20 m.00000025 >> -rw------- 1 vmail mail 296379 M?r 16 12:20 m.00000026 >> -rw------- 1 vmail mail 433541 M?r 16 12:39 m.00000027 >> -rw------- 1 vmail mail 92526 M?r 16 12:39 m.00000028 >> -rw------- 1 vmail mail 19094 M?r 16 12:39 m.00000029 >> -rw------- 1 vmail mail 106837 M?r 16 12:39 m.00000030 >> -rw------- 1 vmail mail 162012 M?r 16 12:39 m.00000031 >> -rw------- 1 vmail mail 412080 M?r 16 13:51 m.00000032 >> -rw------- 1 vmail mail 1715868 M?r 16 13:51 m.00000033 >> -rw------- 1 vmail mail 14433784 M?r 16 13:51 m.00000034 >> -rw------- 1 vmail mail 3280 M?r 16 13:51 m.00000035 >> -rw------- 1 vmail mail 6308 M?r 16 13:51 m.00000036 >> -rw------- 1 vmail mail 534274 M?r 16 13:51 m.00000037 >> -rw------- 1 vmail mail 378719 M?r 16 13:51 m.00000038 >> -rw------- 1 vmail mail 458528 M?r 16 13:51 m.00000039 >> -rw------- 1 vmail mail 192504 M?r 16 13:51 m.00000040 >> -rw------- 1 vmail mail 1277766 M?r 16 13:51 m.00000041 >> -rw------- 1 vmail mail 33417 M?r 16 13:51 m.00000042 >> -rw------- 1 vmail mail 142866 M?r 16 13:51 m.00000043 >> -rw------- 1 vmail mail 113529 M?r 16 13:51 m.00000044 >> -rw------- 1 vmail mail 55888 M?r 16 13:51 m.00000045 >> -rw------- 1 vmail mail 673504 M?r 16 13:51 m.00000046 >> -rw------- 1 vmail mail 430738 M?r 16 13:51 m.00000047 >> -rw------- 1 vmail mail 218494 M?r 16 13:51 m.00000048 >> -rw------- 1 vmail mail 96165 M?r 16 13:51 m.00000049 >> -rw------- 1 vmail mail 8370 M?r 16 13:51 m.00000050 >> -rw------- 1 vmail mail 29251 M?r 16 13:51 m.00000051 >> -rw------- 1 vmail mail 394680 M?r 16 13:51 m.00000052 >> -rw------- 1 vmail mail 674892 M?r 16 13:51 m.00000053 >> -rw------- 1 vmail mail 1076919 M?r 16 13:51 m.00000054 >> -rw------- 1 vmail mail 258806 M?r 16 13:51 m.00000055 >> -rw------- 1 vmail mail 60069 M?r 16 13:51 m.00000056 >> -rw------- 1 vmail mail 297891 M?r 16 13:51 m.00000057 >> -rw------- 1 vmail mail 92772 M?r 16 13:51 m.00000058 >> -rw------- 1 vmail mail 129272 M?r 16 13:51 m.00000059 >> -rw------- 1 vmail mail 56073 M?r 16 13:51 m.00000060 >> -rw------- 1 vmail mail 528260 M?r 16 13:51 m.00000061 >> -rw------- 1 vmail mail 29468 M?r 16 13:51 m.00000062 >> -rw------- 1 vmail mail 3250 M?r 16 13:51 m.00000063 >> -rw------- 1 vmail mail 96445 M?r 16 13:51 m.00000064 >> -rw------- 1 vmail mail 337663 M?r 16 13:51 m.00000065 >> -rw------- 1 vmail mail 187505 M?r 16 13:51 m.00000066 >> -rw------- 1 vmail mail 98839 M?r 16 13:51 m.00000067 >> -rw------- 1 vmail mail 5294 M?r 16 13:51 m.00000068 >> -rw------- 1 vmail mail 28276 M?r 16 13:51 m.00000069 >> -rw------- 1 vmail mail 67950 M?r 16 13:52 m.00000070 >> -rw------- 1 vmail mail 704457 M?r 16 13:52 m.00000071 >> -rw------- 1 vmail mail 1410205 M?r 16 13:52 m.00000072 >> -rw------- 1 vmail mail 736330 M?r 16 13:52 m.00000073 >> -rw------- 1 vmail mail 616992 M?r 16 13:52 m.00000074 > -- Jes?s Cea Avi?n _/_/ _/_/_/ _/_/_/ jcea at jcea.es - http://www.jcea.es/ _/_/ _/_/ _/_/ _/_/ _/_/ Twitter: @jcea _/_/ _/_/ _/_/_/_/_/ jabber / xmpp:jcea at jabber.org _/_/ _/_/ _/_/ _/_/ _/_/ "Things are not so easy" _/_/ _/_/ _/_/ _/_/ _/_/ _/_/ "My name is Dump, Core Dump" _/_/_/ _/_/_/ _/_/ _/_/ "El amor es poner tu felicidad en la felicidad de otro" - Leibniz -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 473 bytes Desc: OpenPGP digital signature URL: From asaldanha at infolink.com.br Wed Oct 1 14:48:14 2014 From: asaldanha at infolink.com.br (Alfredo Saldanha) Date: Wed, 1 Oct 2014 11:48:14 -0300 (BRT) Subject: Simply mysql quota check Message-ID: <525400069.43673.1412174894261.JavaMail.zimbra@corp.infolink.com.br> Hi there, I'm setting up a new email server with Dovecot(2.2.9) and MySQL. My Dovecot configuration: #/etc/dovecot/conf.d/90-quota.conf service quota-warning { executable = script /usr/local/bin/quota-warning.sh user = dovecot unix_listener quota-warning { user = vmail } } plugin { quota = maildir:User quota quota_warning = storage=95%% quota-warning 95 %u@%d quota_warning2 = storage=80%% quota-warning 80 %u@%d args = /etc/dovecot/dovecot-sql.conf.ext } #/etc/dovecot/dovecot-sql.conf.ext password_query = \ SELECT username AS user, value AS password \ FROM mailboxes WHERE username = '%n@%d' user_query = \ SELECT username, domain, \ CONCAT('*:storage=', SUBSTRING_INDEX(quota, 'm', 1)*1048576) AS userdb_quota_rule \ FROM mailboxes, domains WHERE mailboxes.username = '%n@%d' \ AND domains.domain = '%d' My idea is when a message is delivered, the dovecot to check quota in the mysql according to the value received in the "user_query" but he does not. It shows a value of 2GB that I don't know where it gets. I execute a manual query in mysql to know the quota my test user and checked that are 5GB, but when I see the dovecot, it shows 2G. SELECT username, domain, CONCAT('*:bytes=', SUBSTRING_INDEX(quota, 'm', 1)*1048576) AS userdb_quota_rule FROM mailboxes, domains WHERE mailboxes.username = 'junix at domain.com' AND domains.domain = 'domain.com' +-------------------+----------------+--------------------+ | username | domain | userdb_quota_rule | +-------------------+----------------+--------------------+ | junix at domain.com | domain.com | *:bytes=5242880000 | +-------------------+----------------+--------------------+ $ sudo doveadm quota get -u junix Quota name Type Value Limit % User quota STORAGE 10 2097152 0 User quota MESSAGE 1 - How would the setting to simply verify the quota of users as userdb_quota_rule this query? BR, Alfredo Jr. From ben at indietorrent.org Wed Oct 1 18:43:57 2014 From: ben at indietorrent.org (Ben Johnson) Date: Wed, 01 Oct 2014 14:43:57 -0400 Subject: Trouble getting listescape plugin to work with "$" separator (as demonstrated in Wiki) in Dovecot 2.2.9 Message-ID: <542C4B6D.8070109@indietorrent.org> Hello, I'm attempting to install the listescape plugin so that IMAP users are able to include periods (.) and forward slashes (/) in IMAP directory names. I'm following the instructions at http://wiki2.dovecot.org/Plugins/Listescape , which imply that this can be accomplished by enabling the listescape plugin and using the dollar sign ($) as the separator. With regard to my dovecot configuration, first, I changed protocol imap { mail_plugins = quota imap_quota antispam } to protocol imap { mail_plugins = quota imap_quota antispam listescape namespace private { separator = $ inbox = yes } } When I start dovecot, I receive the following error: doveconf: Warning: NOTE: You can get a new clean config file with: doveconf -n > dovecot-new.conf doveconf: Warning: Obsolete setting in /etc/dovecot/dovecot.conf:102: namespace private {} has been replaced by namespace { type=private } Pretty straightforward; I made the required change to yield protocol imap { mail_plugins = quota imap_quota antispam listescape namespace { type = private separator = $ inbox = yes } } But now, when I attempt to start dovecot, I receive the following error: doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf line 104: Unknown variable: $ doveconf: Error: managesieve-login: dump-capability process returned 89 doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf line 104: Unknown variable: $ Is it possible that the instructions at the Wiki 2 URL cited above are out-of-date? If I try to escape the $ with any other character (I'm just shooting in the dark regarding possible escape characters, as I cannot find definitive documentation that pertains to escaping $ in the dovecot configuration), I receive yet another error: doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf: Namespace '': Hierarchy separator must be only one character long doveconf: Error: managesieve-login: dump-capability process returned 89 doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf: Namespace '': Hierarchy separator must be only one character long Ultimately, I have two questions: 1.) Is the nesting structure that I've employed correct? The Wiki 2 page is not clear with regard to the nesting; is it correct to put the "namespace" block inside the "protocol imap" block, as I demonstrated above? 2.) Is it possible to escape the dollar sign so that it can be used as the separator? Full "doveconf -n" output is included below. Thanks for any assistance, -Ben # doveconf -n # 2.2.9: /etc/dovecot/dovecot.conf doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf line 104: Unknown variable: $ doveconf: Error: managesieve-login: dump-capability process returned 89 # OS: Linux 3.13.0-34-generic x86_64 Ubuntu 14.04.1 LTS auth_mechanisms = plain login disable_plaintext_auth = no listen = *,[::] log_timestamp = "%Y-%m-%d %H:%M:%S " mail_debug = yes mail_privileged_group = vmail passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } plugin { antispam_backend = pipe antispam_debug_target = syslog antispam_pipe_program = /bin/bash antispam_pipe_program_args = /usr/local/bin/sa-learn-pipe.sh antispam_pipe_program_notspam_arg = --ham antispam_pipe_program_spam_arg = --spam antispam_pipe_tmpdir = /tmp antispam_spam_pattern_ignorecase = SPAM;JUNK antispam_trash_pattern_ignorecase = trash;Deleted * antispam_verbose_debug = 1 quota = dict:user::file:/var/vmail/%d/%n/.quotausage quota_rule2 = Trash:storage=+100M quota_rule3 = Junk:ignore quota_rule4 = INBOX:storage=+100M quota_warning = storage=100%% quota-reached 100 %u %d quota_warning2 = storage=95%% quota-warning 95 %u %d quota_warning3 = storage=80%% quota-warning 80 %u %d quota_warning4 = -storage=100%% quota-below below %u %d sieve = /var/vmail/%d/%n/.sieve } postmaster_address = postmaster at localhost.com protocols = imap pop3 sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0600 user = vmail } user = root } service config { unix_listener config { group = vmail mode = 0600 user = vmail } } service imap-login { client_limit = 1000 process_limit = 500 } service quota-below { executable = script /usr/local/bin/quota-below.sh unix_listener quota-below { group = vmail mode = 0666 user = vmail } user = vmail } service quota-reached { executable = script /usr/local/bin/quota-reached.sh unix_listener quota-reached { group = vmail mode = 0666 user = vmail } user = vmail } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { group = vmail mode = 0666 user = vmail } user = vmail } ssl_cert = I?m receiving the following error(s) messages when trying reloading dovecot (Debian wheezy). doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf line 73: Unknown setting: socket doveconf: Error: managesieve-login: dump-capability process returned 89 Configuration file /etc/dovecot/dovecot.conf : # If you only want to use dovecot-auth, you can set this to "none". protocols = imap sieve log_timestamp = "%Y-%m-%d %H:%M:%S " mail_location = maildir:/var/mail/%d/%n:INDEX=/var/mail/indexes/%d/%n mail_privileged_group = vmail mail_debug = no first_valid_uid = 5000 last_valid_uid = 5000 maildir_copy_with_hardlinks = yes mail_chroot = yes default_login_user = dovecot ssl_cert = /etc/ssl/certs/star_palibrary_org_combined.crt ssl_key = /etc/ssl/private/star_palibrary_org.key protocol imap { # imap_client_workarounds = outlook-idle delay-newmail } protocol pop3 { pop3_uidl_format = %08Xu%08Xv } ## ## MANAGESIEVE specific settings ## protocol sieve { } plugin { sieve_storage = ~/sieve sieve_global_path = /var/vmail/globalsieverc sieve = ~/dovecot.sieve } protocol lda { #log_path = /var/vmail/dovecot-deliver.log auth_socket_path = /var/run/dovecot/auth-master postmaster_address = shortte at mvs.org mail_plugins = sieve } ################################### ## ## LDA specific settings ## auth_default_realm = mvs.org auth_debug = no auth_debug_passwords = no auth_mechanisms = auth_plain auth_login auth_digest-md5 auth_cram-md5 # dovecot-auth only needs to be able to connect to SQL # default_login_user = mail passdb { driver = sql args = /etc/dovecot/dovecot-sql.conf.ext } userdb { driver= sql args = /etc/dovecot/dovecot-sql.conf.ext } socket listen { master { path = /var/run/dovecot/auth-master mode = 0600 user = vmail group = vmail } client { # The client socket is generally safe to export to everyone. Typical use # is to export it to your SMTP server so it can do SMTP AUTH lookups # using it. path = /var/spool/postfix/private/auth mode = 0660 user = postfix group = postfix } } } Packages: ii dovecot-common 1:2.1.7-7+deb7u1 ii dovecot-core 1:2.1.7-7+deb7u1 ii dovecot-gssapi 1:2.1.7-7+deb7u1 ii dovecot-imapd 1:2.1.7-7+deb7u1 ii dovecot-ldap 1:2.1.7-7+deb7u1 ii dovecot-lmtpd 1:2.1.7-7+deb7u1 ii dovecot-managesieved 1:2.1.7-7+deb7u1 ii dovecot-mysql 1:2.1.7-7+deb7u1 ii dovecot-pgsql 1:2.1.7-7+deb7u1 ii dovecot-pop3d 1:2.1.7-7+deb7u1 Any ideas? From h.reindl at thelounge.net Wed Oct 1 18:54:28 2014 From: h.reindl at thelounge.net (Reindl Harald) Date: Wed, 01 Oct 2014 20:54:28 +0200 Subject: Dovecot fails to start - Unknown setting: socket In-Reply-To: References: Message-ID: <542C4DE4.8080802@thelounge.net> Am 01.10.2014 um 20:47 schrieb Max Shortte: > I?m receiving the following error(s) messages when trying reloading dovecot > (Debian wheezy). > > doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf line > 73: Unknown setting: socket > > doveconf: Error: managesieve-login: dump-capability process returned 89 > > Configuration file /etc/dovecot/dovecot.conf honestly it would make more sense if you post line 73 as mentioned in the message followed by the surrounding context -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 181 bytes Desc: OpenPGP digital signature URL: From stephan at rename-it.nl Wed Oct 1 19:21:08 2014 From: stephan at rename-it.nl (Stephan Bosch) Date: Wed, 01 Oct 2014 21:21:08 +0200 Subject: Supporting RFC 5466 (IMAP4 Extension for Named Searches (Filters)) In-Reply-To: <542BF6A1.9080306@jcea.es> References: <542BF6A1.9080306@jcea.es> Message-ID: <542C5424.2070006@rename-it.nl> On 10/1/2014 2:42 PM, Jesus Cea wrote: > I wonder if Dovecot supports RFC 5466 (IMAP4 Extension for Named > Searches (Filters)) or if there is any plan about it. > I have a partial implementation in my patch queue. I haven't worked on it for a few months now due to other projects that took precedence. It still may take quite a while until I can continue that effort. Regards, Stephan. From maxshortte at gmail.com Wed Oct 1 19:39:49 2014 From: maxshortte at gmail.com (Max Shortte) Date: Wed, 1 Oct 2014 15:39:49 -0400 Subject: Dovecot fails to start - Unknown setting: socket In-Reply-To: <542C4DE4.8080802@thelounge.net> References: <542C4DE4.8080802@thelounge.net> Message-ID: Here are the lines in question: socket listen { ####### line 73 ########### master { path = /var/run/dovecot/auth-master mode = 0600 user = vmail group = vmail } client { # The client socket is generally safe to export to everyone. Typical use # is to export it to your SMTP server so it can do SMTP AUTH lookups # using it. path = /var/spool/postfix/private/auth mode = 0660 user = postfix group = postfix } } } On Wed, Oct 1, 2014 at 2:54 PM, Reindl Harald wrote: > > Am 01.10.2014 um 20:47 schrieb Max Shortte: > > I?m receiving the following error(s) messages when trying reloading > dovecot > > (Debian wheezy). > > > > doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf > line > > 73: Unknown setting: socket > > > > doveconf: Error: managesieve-login: dump-capability process returned 89 > > > > Configuration file /etc/dovecot/dovecot.conf > > honestly it would make more sense if you post line 73 > as mentioned in the message followed by the surrounding > context > > From alanm at sics.se Wed Oct 1 20:50:37 2014 From: alanm at sics.se (Alan McGinlay) Date: Wed, 01 Oct 2014 22:50:37 +0200 Subject: Dovecot fails to start - Unknown setting: socket Message-ID: you almost certainly have a missing closing bracket or double quote somewhere. From maxshortte at gmail.com Wed Oct 1 21:46:15 2014 From: maxshortte at gmail.com (Max Shortte) Date: Wed, 1 Oct 2014 17:46:15 -0400 Subject: Dovecot fails to start - Unknown setting: socket In-Reply-To: References: Message-ID: Thanks for responding Alan. I have taken a look at the configuration file and all seems well. Max On Wed, Oct 1, 2014 at 4:50 PM, Alan McGinlay wrote: > you almost certainly have a missing closing bracket or double quote > somewhere. From remko at FreeBSD.org Wed Oct 1 23:40:17 2014 From: remko at FreeBSD.org (Remko Lodder) Date: Thu, 2 Oct 2014 01:40:17 +0200 Subject: Question wrt. dovecot replicator Message-ID: Hi People, I recently setup a replication service within dovecot between two machines in different datacenters, which has the following configuration; (yes it is hashed out, because I needed to) #service replicator { # unix_listener replicator-doveadm { # mode = 0666 # } # process_min_avail = 1 #} # #service aggregator { # fifo_listener replication-notify-fifo { # mode = 0666 # #user = vmail # } # unix_listener replication-notify { # mode = 0666 # #user = vmail # } #} # #service doveadm { # inet_listener { # port = 12346 # } #} # ##doveadm_port = 12346 #doveadm_password = XXXXXXX #replication_max_conns = 30 # and a mail_replica = tcp:host{a,b}:12346 configuration on each host so that they are pointing to eachother; This seems to work fine for most accounts, for example: I never experienced issues with this. However, several other accounts (with a large variety of clients) got duplicated emails. Looking with doveadm I only noticed that the numbers of the messages are closely related to eachother but one number incremented. So they cannot be deleted with the deduplicator function. The replication is provided over TCP only, the connection streams over an OpenVPN tunnel so that the contents are protected, the machines are located in different Datacenters but close to eachother. How can I determine why there are duplicated emails? What kind of messages should I specifically look for? Can I set this up for a few selected accounts instead of all accounts like it was currently? To make sure I do not make things worse for others then needs to be :-) The service had been disabled for the time being to prevent the other users from getting duplicated emails. Thanks for the advice in advance! Cheers Remko -- /"\ Best regards, | remko at FreeBSD.org \ / Remko Lodder | remko at EFnet X http://www.evilcoder.org/ | / \ ASCII Ribbon Campaign | Against HTML Mail and News -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 841 bytes Desc: Message signed with OpenPGP using GPGMail URL: From skdovecot at smail.inf.fh-brs.de Thu Oct 2 06:20:44 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Thu, 2 Oct 2014 08:20:44 +0200 (CEST) Subject: Dovecot fails to start - Unknown setting: socket In-Reply-To: References: <542C4DE4.8080802@thelounge.net> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Wed, 1 Oct 2014, Max Shortte wrote: > Here are the lines in question: > > socket listen { ####### line 73 ########### http://www.dovecot.org/list/dovecot/2012-March/064284.html - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBVCzuvXz1H7kL/d9rAQIMywf/VcSTNKp/C0PjHPl1Kd3bsOB/eYlyGLO2 TX90Z8mKdVNPJHHeVcU/8p4ZKqGHQtxzagnbsmmaEpG8H50umRzYEVnEvvoNyfFH YOhVsJ+KSg7zMowVQ9GV0lxLL6E2Dd70MjwyRZEbK6mWhfqSalMyu16/CFfdWabK mCEN9hMFRNL+N2qMMb7r/P3E4FyJGPyCmCoCgPROb0SOc5q97alc1oOitynjYK8X rn5V840Xqyomc4LH/1P6mYQNo/+omc0vsrIDuboIRyynCn7LXHXtJv9Ze9pCXTbL ytixc77rD35N76sA+eutHga5piujNG6DVM/vwmfrK2TeV9wspJGqFQ== =J+D4 -----END PGP SIGNATURE----- From skdovecot at smail.inf.fh-brs.de Thu Oct 2 06:33:13 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Thu, 2 Oct 2014 08:33:13 +0200 (CEST) Subject: Simply mysql quota check In-Reply-To: <525400069.43673.1412174894261.JavaMail.zimbra@corp.infolink.com.br> References: <525400069.43673.1412174894261.JavaMail.zimbra@corp.infolink.com.br> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Wed, 1 Oct 2014, Alfredo Saldanha wrote: > #/etc/dovecot/dovecot-sql.conf.ext > password_query = \ > SELECT username AS user, value AS password \ > FROM mailboxes WHERE username = '%n@%d' > > user_query = \ > SELECT username, domain, \ > CONCAT('*:storage=', SUBSTRING_INDEX(quota, 'm', 1)*1048576) AS userdb_quota_rule \ > FROM mailboxes, domains WHERE mailboxes.username = '%n@%d' \ > AND domains.domain = '%d' > > My idea is when a message is delivered, the dovecot to check quota in the mysql according to the value received in the "user_query" but he does not. > It shows a value of 2GB that I don't know where it gets. > > I execute a manual query in mysql to know the quota my test user and checked that are 5GB, but when I see the dovecot, it shows 2G. > > SELECT username, domain, CONCAT('*:bytes=', SUBSTRING_INDEX(quota, 'm', 1)*1048576) AS userdb_quota_rule > FROM mailboxes, domains WHERE mailboxes.username = 'junix at domain.com' AND domains.domain = 'domain.com' 1) your manual query uses '*:bytes=', whereas your conf uses '*:storage='. 2) you return the value as userdb_quota_rule, but it must read quota_rule in the user_query. In the password_query fields are prefixed by userdb_ . See http://wiki2.dovecot.org/Quota/Configuration - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBVCzxqnz1H7kL/d9rAQIneAgAukcibxJoQdtwdmrxHbXmKgQsCG22itH5 9VSFGigiPjXg/F1hkj7jHC/xB5uh2M8ayMos+hPxaJkKC4AKYEZu1QEwXAX2qrvN DXt7uPZHLJSMtlWCVb5s6h+v6K3JnbWRrjI4CIfYqB8i8MHKBWei0K02QZcOUOfy KeD7lAIPRuZPnIEiWYREpalRMGeQzZ69SHEmhxDx7VFO5FanlHDxdCwmO7qHoJen ZuNpUWMf5i5czxcDhHjLdtGODv005LFDCXhj48SqI17WzD3mPjJegOCjym6RfKmU RT+PtKieBkzygT1YzvjJbHISFxJSryVg8c48tCb0FgjkNKWXq/KsPg== =wzY8 -----END PGP SIGNATURE----- From teemu.huovila at dovecot.fi Thu Oct 2 08:57:23 2014 From: teemu.huovila at dovecot.fi (Teemu Huovila) Date: Thu, 02 Oct 2014 11:57:23 +0300 Subject: Question wrt. dovecot replicator In-Reply-To: References: Message-ID: <542D1373.9050806@dovecot.fi> On 10/02/2014 02:40 AM, Remko Lodder wrote: > and a mail_replica = tcp:host{a,b}:12346 configuration on each host so that they are pointing to eachother; This seems to work fine for most accounts, for example: I never experienced issues with this. However, several other accounts (with a large variety of clients) got duplicated emails. Looking with doveadm I only noticed that the numbers of the messages are closely related to eachother but one number incremented. So they cannot be deleted with the deduplicator function. > > The replication is provided over TCP only, the connection streams over an OpenVPN tunnel so that the contents are protected, the machines are located in different Datacenters but close to eachother. > > How can I determine why there are duplicated emails? > What kind of messages should I specifically look for? Look for any errors and warnings in the Dovecot log. You could also enable mail_debug (ref. http://wiki2.dovecot.org/Logging#Logging_verbosity) for the accounts being synced. Also, please post your complete configuration. > Can I set this up for a few selected accounts instead of all accounts like it was currently? To make sure I do not make things worse for others then needs to be :-) > The service had been disabled for the time being to prevent the other users from getting duplicated emails. I do not know what kind of userdb you are running, but there is a newish patch that enables per user replication via the mail_replica setting. It is not yet included in the newest (2.2.13) release of Dovecot, but is available via the enterprise version. There are no FreeBSD builds for that, though. ref: http://hg.dovecot.org/dovecot-2.2/rev/c1c67bdc8752 br, Teemu Huovila From asaldanha at infolink.com.br Thu Oct 2 13:48:21 2014 From: asaldanha at infolink.com.br (Alfredo Saldanha) Date: Thu, 2 Oct 2014 10:48:21 -0300 (BRT) Subject: Simply mysql quota check In-Reply-To: <816760435.123879.1412257688933.JavaMail.zimbra@corp.infolink.com.br> References: <525400069.43673.1412174894261.JavaMail.zimbra@corp.infolink.com.br> Message-ID: <973208950.123880.1412257701217.JavaMail.zimbra@corp.infolink.com.br> Steffen, My problem was exactly what you said, the quota field in my query. I fixed it and now is working very well. Thank you very much. Alfredo ----- Mensagem original ----- De: "Steffen Kaiser" Para: "Alfredo Saldanha" Cc: dovecot at dovecot.org Enviadas: Quinta-feira, 2 de outubro de 2014 3:33:13 Assunto: Re: Simply mysql quota check -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Wed, 1 Oct 2014, Alfredo Saldanha wrote: > #/etc/dovecot/dovecot-sql.conf.ext > password_query = \ > SELECT username AS user, value AS password \ > FROM mailboxes WHERE username = '%n@%d' > > user_query = \ > SELECT username, domain, \ > CONCAT('*:storage=', SUBSTRING_INDEX(quota, 'm', 1)*1048576) AS userdb_quota_rule \ > FROM mailboxes, domains WHERE mailboxes.username = '%n@%d' \ > AND domains.domain = '%d' > > My idea is when a message is delivered, the dovecot to check quota in the mysql according to the value received in the "user_query" but he does not. > It shows a value of 2GB that I don't know where it gets. > > I execute a manual query in mysql to know the quota my test user and checked that are 5GB, but when I see the dovecot, it shows 2G. > > SELECT username, domain, CONCAT('*:bytes=', SUBSTRING_INDEX(quota, 'm', 1)*1048576) AS userdb_quota_rule > FROM mailboxes, domains WHERE mailboxes.username = 'junix at domain.com' AND domains.domain = 'domain.com' 1) your manual query uses '*:bytes=', whereas your conf uses '*:storage='. 2) you return the value as userdb_quota_rule, but it must read quota_rule in the user_query. In the password_query fields are prefixed by userdb_ . See http://wiki2.dovecot.org/Quota/Configuration - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBVCzxqnz1H7kL/d9rAQIneAgAukcibxJoQdtwdmrxHbXmKgQsCG22itH5 9VSFGigiPjXg/F1hkj7jHC/xB5uh2M8ayMos+hPxaJkKC4AKYEZu1QEwXAX2qrvN DXt7uPZHLJSMtlWCVb5s6h+v6K3JnbWRrjI4CIfYqB8i8MHKBWei0K02QZcOUOfy KeD7lAIPRuZPnIEiWYREpalRMGeQzZ69SHEmhxDx7VFO5FanlHDxdCwmO7qHoJen ZuNpUWMf5i5czxcDhHjLdtGODv005LFDCXhj48SqI17WzD3mPjJegOCjym6RfKmU RT+PtKieBkzygT1YzvjJbHISFxJSryVg8c48tCb0FgjkNKWXq/KsPg== =wzY8 -----END PGP SIGNATURE----- From teemu.huovila at dovecot.fi Thu Oct 2 13:57:57 2014 From: teemu.huovila at dovecot.fi (Teemu Huovila) Date: Thu, 02 Oct 2014 16:57:57 +0300 Subject: Trouble getting listescape plugin to work with "$" separator (as demonstrated in Wiki) in Dovecot 2.2.9 In-Reply-To: <542C4B6D.8070109@indietorrent.org> References: <542C4B6D.8070109@indietorrent.org> Message-ID: <542D59E5.7030509@dovecot.fi> On 10/01/2014 09:43 PM, Ben Johnson wrote: > Ultimately, I have two questions: > > 1.) Is the nesting structure that I've employed correct? The Wiki 2 page > is not clear with regard to the nesting; is it correct to put the > "namespace" block inside the "protocol imap" block, as I demonstrated above? I think it would be better, if you put the namespace configuration at the top level. See http://master.wiki2.dovecot.org/Namespaces or 10-mail.conf and 15-mailboxes.conf, that are located in the doc/example-config/conf.d/ directory of the Dovecot sources, for more examples. > 2.) Is it possible to escape the dollar sign so that it can be used as > the separator? There was a mistake in the wiki. You should quote the $ like this: "$". br, Teemu Huovila From ben at indietorrent.org Thu Oct 2 14:23:16 2014 From: ben at indietorrent.org (Ben Johnson) Date: Thu, 02 Oct 2014 10:23:16 -0400 Subject: Trouble getting listescape plugin to work with "$" separator (as demonstrated in Wiki) in Dovecot 2.2.9 In-Reply-To: <542D59E5.7030509@dovecot.fi> References: <542C4B6D.8070109@indietorrent.org> <542D59E5.7030509@dovecot.fi> Message-ID: <542D5FD4.4050301@indietorrent.org> On 10/2/2014 9:57 AM, Teemu Huovila wrote: > On 10/01/2014 09:43 PM, Ben Johnson wrote: >> Ultimately, I have two questions: >> >> 1.) Is the nesting structure that I've employed correct? The Wiki 2 page >> is not clear with regard to the nesting; is it correct to put the >> "namespace" block inside the "protocol imap" block, as I demonstrated above? > I think it would be better, if you put the namespace configuration at the top level. See > http://master.wiki2.dovecot.org/Namespaces or 10-mail.conf and 15-mailboxes.conf, that are located in the > doc/example-config/conf.d/ directory of the Dovecot sources, for more examples. > >> 2.) Is it possible to escape the dollar sign so that it can be used as >> the separator? > There was a mistake in the wiki. You should quote the $ like this: "$". > > br, > Teemu Huovila > Teemu, Thank you!!! Quoting the "$" fixed the syntax issue. And I moved the namespace to the root level of the configuration, per your advice. Now, the only problem I see is that when I attempt to create a new folder beneath the Inbox (whether it contains a "." or not), the folder appears at the root-level of the IMAP account, at the same level as the Inbox itself. The folder name is "INBOX.My Folder". Also, if I try to select the folder and view its contents, I receive the error, "Mailbox doesn't exist: INBOX.My Folder". But this may simply be a product of a misconfiguration on my part. For what it's worth, this seems to happen regardless of the separator that I define in the namespace. Do I need to change something else in the Dovecot config for this to work the way that I'm intending? Thanks again for your invaluable assistance, -Ben From jjhoffart at icloud.com Thu Oct 2 15:22:42 2014 From: jjhoffart at icloud.com (jjhoffart) Date: Thu, 02 Oct 2014 09:22:42 -0600 Subject: two dovecot instances Message-ID: Hello, I am currently trying to setup two invocations of dovecot to run on a debian based server. One for director and the other a stock debian instance. The issue I am having is when I go to start the director instance, I receive multiple errors telling me that the listening ports are already in use. I have change these ports in the 10-master.conf file but am still presented with the same errors when starting the second instance. Is this the only file in which the ports need to be changed (10-master.conf) or is there another file in which the ports need to be set? From duihi77 at gmail.com Thu Oct 2 15:51:59 2014 From: duihi77 at gmail.com (Duane Hill) Date: Thu, 2 Oct 2014 10:51:59 -0500 Subject: two dovecot instances In-Reply-To: References: Message-ID: <1761940458.20141002105159@gmail.com> On Thursday, October 2, 2014, 10:22:42 AM, jjhoffart wrote: > Hello, > I am currently trying to setup two invocations of dovecot > to run on a debian based server. One for director and the other a > stock debian instance. The issue I am having is when I go to start > the director instance, I receive multiple errors telling me that the > listening ports are already in use. I have change these ports in the > 10-master.conf file but am still presented with the same errors when > starting the second instance. Is this the only file in which the > ports need to be changed (10-master.conf) or is there another file > in which the ports need to be set? How are you starting the instances? You have two, this would imply you have two different sets of configuration files. Therefore, starting each instance, you should be directing them to their individual set of configuration files. -- Duane Hill duihi77 at gmail.com "If at first you don't succeed, so much for sky diving." From chayes at afo.net Thu Oct 2 20:13:52 2014 From: chayes at afo.net (Cliff Hayes) Date: Thu, 02 Oct 2014 15:13:52 -0500 Subject: auth with entire email addr instead of just username Message-ID: <542DB200.40809@afo.net> I am trying to configure a new IMAP based mail server. I thought I had everything correct. I have dovecot logging turned up and see that dovecot is processing the entire email address as the username like this... Oct 2 14:52:20 servername dovecot: auth: Debug: pam(testuser at domain.com,1.2.3.4): lookup service=dovecot ... and of course pam is reporting that as an invalid user. Moments ago when all was mbox, authentication worked fine. I can see Thunderbird has the username correct (no domain). What is tacking on the domain and how do I fix? Thanks in advance. From h.reindl at thelounge.net Thu Oct 2 20:19:21 2014 From: h.reindl at thelounge.net (Reindl Harald) Date: Thu, 02 Oct 2014 22:19:21 +0200 Subject: auth with entire email addr instead of just username In-Reply-To: <542DB200.40809@afo.net> References: <542DB200.40809@afo.net> Message-ID: <542DB349.4080704@thelounge.net> Am 02.10.2014 um 22:13 schrieb Cliff Hayes: > I am trying to configure a new IMAP based mail server. > I thought I had everything correct. > I have dovecot logging turned up and see that dovecot is processing the entire email address as the username like > this... > Oct 2 14:52:20 servername dovecot: auth: Debug: pam(testuser at domain.com,1.2.3.4): lookup service=dovecot > ... and of course pam is reporting that as an invalid user. > Moments ago when all was mbox, authentication worked fine. > I can see Thunderbird has the username correct (no domain). > What is tacking on the domain and how do I fix? output of "dovecot -n" would be in general a good start * how looks your user database * if you don't use domain as part of the username what do you do in case you get a second domain and names collide * these days the full qualified mail address as username is common and in caes of virtual users you can feed all from the same source instead hanlde the localpart special for login-names -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 181 bytes Desc: OpenPGP digital signature URL: From chayes at afo.net Thu Oct 2 20:24:46 2014 From: chayes at afo.net (Cliff Hayes) Date: Thu, 02 Oct 2014 15:24:46 -0500 Subject: auth with entire email addr instead of just username In-Reply-To: <542DB349.4080704@thelounge.net> References: <542DB200.40809@afo.net> <542DB349.4080704@thelounge.net> Message-ID: <542DB48E.5020605@afo.net> Good point. But when I try to add a user with the "user at domain" format using the useradd command I get error... useradd: invalid user name 'user at domain.com' Here is output you requested: # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-431.29.2.el6.x86_64 x86_64 Scientific Linux release 6.5 (Carbon) auth_debug = yes auth_debug_passwords = yes auth_verbose = yes auth_verbose_passwords = plain mail_access_groups = mail mail_debug = yes mail_location = maildir:~/Maildir mbox_write_locks = fcntl namespace { hidden = no inbox = yes list = yes location = prefix = separator = . subscriptions = yes type = private } passdb { driver = pam } protocols = imap ssl_ca = Am 02.10.2014 um 22:13 schrieb Cliff Hayes: >> I am trying to configure a new IMAP based mail server. >> I thought I had everything correct. >> I have dovecot logging turned up and see that dovecot is processing the entire email address as the username like >> this... >> Oct 2 14:52:20 servername dovecot: auth: Debug: pam(testuser at domain.com,1.2.3.4): lookup service=dovecot >> ... and of course pam is reporting that as an invalid user. >> Moments ago when all was mbox, authentication worked fine. >> I can see Thunderbird has the username correct (no domain). >> What is tacking on the domain and how do I fix? > output of "dovecot -n" would be in general a good start > > * how looks your user database > * if you don't use domain as part of the username what do you do > in case you get a second domain and names collide > * these days the full qualified mail address as username is common > and in caes of virtual users you can feed all from the same > source instead hanlde the localpart special for login-names > > > From h.reindl at thelounge.net Thu Oct 2 20:28:52 2014 From: h.reindl at thelounge.net (Reindl Harald) Date: Thu, 02 Oct 2014 22:28:52 +0200 Subject: auth with entire email addr instead of just username In-Reply-To: <542DB48E.5020605@afo.net> References: <542DB200.40809@afo.net> <542DB349.4080704@thelounge.net> <542DB48E.5020605@afo.net> Message-ID: <542DB584.4050500@thelounge.net> Am 02.10.2014 um 22:24 schrieb Cliff Hayes: > Good point. > But when I try to add a user with the "user at domain" format using the useradd command I get error... > useradd: invalid user name 'user at domain.com' > > Here is output you requested: passdb { driver = pam } userdb { driver = passwd } this are local users - never ever mixed mail and system users here http://wiki2.dovecot.org/VirtualUsers http://wiki2.dovecot.org/Sasl combined both you have a uniqe auth-provider for incoming and outgoing mail independent of system users > # 2.0.9: /etc/dovecot/dovecot.conf > # OS: Linux 2.6.32-431.29.2.el6.x86_64 x86_64 Scientific Linux release 6.5 (Carbon) > auth_debug = yes > auth_debug_passwords = yes > auth_verbose = yes > auth_verbose_passwords = plain > mail_access_groups = mail > mail_debug = yes > mail_location = maildir:~/Maildir > mbox_write_locks = fcntl > namespace { > hidden = no > inbox = yes > list = yes > location = > prefix = > separator = . > subscriptions = yes > type = private > } > passdb { > driver = pam > } > protocols = imap > ssl_ca = ssl_cert = ssl_key = userdb { > driver = passwd > } > verbose_ssl = yes > protocol imap { > imap_id_log = * > } > > > On 10/2/2014 3:19 PM, Reindl Harald wrote: >> Am 02.10.2014 um 22:13 schrieb Cliff Hayes: >>> I am trying to configure a new IMAP based mail server. >>> I thought I had everything correct. >>> I have dovecot logging turned up and see that dovecot is processing the entire email address as the username like >>> this... >>> Oct 2 14:52:20 servername dovecot: auth: Debug: pam(testuser at domain.com,1.2.3.4): lookup service=dovecot >>> ... and of course pam is reporting that as an invalid user. >>> Moments ago when all was mbox, authentication worked fine. >>> I can see Thunderbird has the username correct (no domain). >>> What is tacking on the domain and how do I fix? >> output of "dovecot -n" would be in general a good start >> >> * how looks your user database >> * if you don't use domain as part of the username what do you do >> in case you get a second domain and names collide >> * these days the full qualified mail address as username is common >> and in caes of virtual users you can feed all from the same >> source instead hanlde the localpart special for login-names -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 181 bytes Desc: OpenPGP digital signature URL: From chayes at afo.net Thu Oct 2 21:03:59 2014 From: chayes at afo.net (Cliff Hayes) Date: Thu, 02 Oct 2014 16:03:59 -0500 Subject: Fwd: Re: auth with entire email addr instead of just username In-Reply-To: <542DB349.4080704@thelounge.net> References: <542DB349.4080704@thelounge.net> Message-ID: <542DBDBF.105@afo.net> Good point. But when I try to add a user with the "user at domain" format using the useradd command I get error... useradd: invalid user name 'user at domain.com' Does this mean it's time to switch to database auth? Here is output you requested: # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-431.29.2.el6.x86_64 x86_64 Scientific Linux release 6.5 (Carbon) auth_debug = yes auth_debug_passwords = yes auth_verbose = yes auth_verbose_passwords = plain mail_access_groups = mail mail_debug = yes mail_location = maildir:~/Maildir mbox_write_locks = fcntl namespace { hidden = no inbox = yes list = yes location = prefix = separator = . subscriptions = yes type = private } passdb { driver = pam } protocols = imap ssl_ca = Received: from nitronium05.afomx.net (wsip-66-210-221-15.pn.at.cox.net [66.210.221.15]) by sendmail.afo.net (8.14.7/8.14.7) with ESMTP id s92KJXqO012885 for ; Thu, 2 Oct 2014 15:19:34 -0500 Received: from wursti.dovecot.fi (wursti.dovecot.fi [87.106.245.223]) by nitronium05.afomx.net (8.14.4/8.14.4) with ESMTP id s92KJUjn032312 for ; Thu, 2 Oct 2014 15:19:31 -0500 Received: from wursti.dovecot.fi (localhost.localdomain [127.0.0.1]) by wursti.dovecot.fi (Postfix) with ESMTP id 211FE22373; Thu, 2 Oct 2014 22:19:24 +0200 (CEST) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on wursti.dovecot.fi X-Spam-Level: X-Spam-Status: No, score=-1.1 required=5.0 tests=BAYES_00,RDNS_NONE autolearn=no version=3.3.1 Received: from talvi.dovecot.org (unknown [137.117.229.219]) by wursti.dovecot.fi (Postfix) with ESMTP; Thu, 2 Oct 2014 22:19:24 +0200 (CEST) Received: from [100.90.112.97] (localhost [127.0.0.1]) by talvi.dovecot.org (Postfix) with ESMTP id 44D7D235EA; Thu, 2 Oct 2014 20:19:44 +0000 (UTC) X-Original-To: dovecot at dovecot.org Delivered-To: dovecot at dovecot.org Received: by talvi.dovecot.org (Postfix, from userid 506) id A9CBD235F0; Thu, 2 Oct 2014 20:19:42 +0000 (UTC) Received: from mail.thelounge.net (unknown [91.118.73.15]) by talvi.dovecot.org (Postfix) with ESMTPS id 4DC95234B4 for ; Thu, 2 Oct 2014 20:19:42 +0000 (UTC) Message-ID: <542DB349.4080704 at thelounge.net> Date: Thu, 02 Oct 2014 22:19:21 +0200 From: Reindl Harald Organization: the lounge interactive design User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.1.1 MIME-Version: 1.0 To: dovecot at dovecot.org Subject: Re: auth with entire email addr instead of just username References: <542DB200.40809 at afo.net> In-Reply-To: <542DB200.40809 at afo.net> OpenPGP: id=7F780279; url=http://arrakis.thelounge.net/gpg/h.reindl_thelounge.net.pub.txt Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="EccDjHRFv91hW96jI9NRNb7nA289vHKte" X-BeenThere: dovecot at dovecot.org X-Mailman-Version: 2.1.17 Precedence: list Reply-To: Dovecot Mailing List List-Id: Dovecot Mailing List List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dovecot-bounces at dovecot.org Sender: "dovecot" X-Scanned-By: MIMEDefang 2.73 X-Scanned-By: MIMEDefang 2.75 Am 02.10.2014 um 22:13 schrieb Cliff Hayes: > I am trying to configure a new IMAP based mail server. > I thought I had everything correct. > I have dovecot logging turned up and see that dovecot is processing the entire email address as the username like > this... > Oct 2 14:52:20 servername dovecot: auth: Debug: pam(testuser at domain.com,1.2.3.4): lookup service=dovecot > ... and of course pam is reporting that as an invalid user. > Moments ago when all was mbox, authentication worked fine. > I can see Thunderbird has the username correct (no domain). > What is tacking on the domain and how do I fix? output of "dovecot -n" would be in general a good start * how looks your user database * if you don't use domain as part of the username what do you do in case you get a second domain and names collide * these days the full qualified mail address as username is common and in caes of virtual users you can feed all from the same source instead hanlde the localpart special for login-names -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 189 bytes Desc: not available URL: From teemu.huovila at dovecot.fi Fri Oct 3 07:37:27 2014 From: teemu.huovila at dovecot.fi (Teemu Huovila) Date: Fri, 03 Oct 2014 10:37:27 +0300 Subject: Trouble getting listescape plugin to work with "$" separator (as demonstrated in Wiki) in Dovecot 2.2.9 In-Reply-To: <542D5FD4.4050301@indietorrent.org> References: <542C4B6D.8070109@indietorrent.org> <542D59E5.7030509@dovecot.fi> <542D5FD4.4050301@indietorrent.org> Message-ID: <542E5237.5010702@dovecot.fi> On 10/02/2014 05:23 PM, Ben Johnson wrote: > Now, the only problem I see is that when I attempt to create a new > folder beneath the Inbox (whether it contains a "." or not), the folder > appears at the root-level of the IMAP account, at the same level as the > Inbox itself. The folder name is "INBOX.My Folder". > > Also, if I try to select the folder and view its contents, I receive the > error, "Mailbox doesn't exist: INBOX.My Folder". But this may simply be > a product of a misconfiguration on my part. Namespace configuration can be a bit difficult. I urge you to read the wiki page on namespaces carefully and test which configuration works with your mail clients. It might be as easy, as renaming the namespace you have now to inbox, eg: namespace INBOX { inbox = yes location = prefix = separator = $ type = private } If that is not what you meant, or does not work for your clients, try with several namespaces and setting the "prefix" in them. br, Teemu Huovila From bart.nogas at gmail.com Fri Oct 3 09:06:57 2014 From: bart.nogas at gmail.com (=?UTF-8?B?QmFydMWCb21pZWogTm9nYcWb?=) Date: Fri, 3 Oct 2014 11:06:57 +0200 Subject: [Dovecot] quota using wrong limits in user shared mailboxes Message-ID: Hi, I confirm this bug with LDAP userdb. The temporary workaround is to set quota ignore rule for Shared namespace or specific shared folder. This is obviously not secure workaround. Example: for a shared namespace: namespace ( .... prefix = Shared Folders/%%u/ ... } you have to set quota_rule4 = Shared Folders/*:ignore or quota_rule4 = Shared Folders/username/*:ignore - Bartlomiej Nogas From nick.z.edwards at gmail.com Fri Oct 3 10:48:59 2014 From: nick.z.edwards at gmail.com (Nick Edwards) Date: Fri, 3 Oct 2014 20:48:59 +1000 Subject: [Dovecot] quota using wrong limits in user shared mailboxes In-Reply-To: References: Message-ID: We were supposed to get an update to fix this (and other bugs) over a month or more ago if I remember right, but developer seems to be on extended hiatus On 10/3/14, Bart?omiej Noga? wrote: > Hi, > > I confirm this bug with LDAP userdb. The temporary workaround is to set > quota ignore rule for Shared namespace or specific shared folder. This is > obviously not secure workaround. > > Example: > for a shared namespace: > > namespace > ( > .... > prefix = Shared Folders/%%u/ > ... > } > > you have to set > quota_rule4 = Shared Folders/*:ignore > or > quota_rule4 = Shared Folders/username/*:ignore > > - > Bartlomiej Nogas > From tlx at leuxner.net Fri Oct 3 10:57:28 2014 From: tlx at leuxner.net (Thomas Leuxner) Date: Fri, 3 Oct 2014 12:57:28 +0200 Subject: virtualfolders under mdbox storage backend In-Reply-To: <542BF59A.2030908@jcea.es> References: <542BF59A.2030908@jcea.es> Message-ID: <20141003105728.GA3461@nihlus.leuxner.net> * Jesus Cea 2014.10.01 14:37: > Reading docs in http://wiki2.dovecot.org/Plugins/Virtual I wonder how is > that used if I am using MDBOX as my storage backend. The only references > there are about Maildir. You basically need to configure the path where it stores its indexes e.g. namespace { location = virtual:~/mdbox/virtual prefix = Virtual/ separator = / } Regards Thomas -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 198 bytes Desc: Digital signature URL: From me at rvijay.me Fri Oct 3 11:21:41 2014 From: me at rvijay.me (Vijay Rajah) Date: Fri, 03 Oct 2014 16:51:41 +0530 Subject: home from SQL In-Reply-To: <20140930142908.GB4001@sys4.de> References: <20140930142908.GB4001@sys4.de> Message-ID: <542E86C5.7050005@rvijay.me> The way I do is to have a trigger. Whenever a field changes, there is a trigger associated with that, this trigger populates the appropriate field for that user being modified. I update the field using trigger for both inserts & updates. EX: in MYSQL this is the trigger for new user addition. I just add the email address and password to the db using 'INSERT INTO'..The home directory is updated by this trigger. ( I have a similar trigger for updates) *************************** 1. row *************************** Trigger: TRIG_HOME_INS Event: INSERT Table: user Statement: BEGIN SET new.home=concat('/path/to/mdfiles/',substring_index(new.email,'@',-1),'/',substring_index(new.email,'@',1)); end Timing: BEFORE Created: NULL sql_mode: Definer: mailadmin at localhost character_set_client: utf8 collation_connection: utf8_general_ci Database Collation: latin1_swedish_ci you could have a trigger that updates the appropriate field when the name changes etc... -Vijay On 30/09/14 7:59 PM, Ralf Hildebrandt wrote: > Currently I'm using > user_query = SELECT 1000 AS uid, 1000 AS gid, '/srv/vmail/%2.256Hu/%Lu' AS home, ... > > so I'm hashing based on %u (basically). But in my SQL db I have a > "unique_identifier" field, which never changes, even when the user is > changing his/her email address (due to marriage or the like). > > What I'd really like to do is to use %u to find the value of the > unique_identifier field, hash THAT value and use "AS home". But how? > > That way I can rename users without shuffling directories around the > filesystem. > From tss at iki.fi Fri Oct 3 14:12:29 2014 From: tss at iki.fi (Timo Sirainen) Date: Fri, 3 Oct 2014 17:12:29 +0300 Subject: GETMETADATA UTF8 encoding of folder names instead of UTF7 In-Reply-To: References: Message-ID: <389D17D7-65DC-4DAC-A683-0F2B085E63DF@iki.fi> On 27 Sep 2014, at 14:46, Bart?omiej Noga? wrote: > I have dovecot 2.2.13 instance and I found that (at least for polish > language) folder names in GETMETADATA command response are encoded in UTF8. > Shouldn't it be converted to UTF7? Yes, fixed now: http://hg.dovecot.org/dovecot-2.2/rev/5446d1877c7e From tss at iki.fi Fri Oct 3 14:14:59 2014 From: tss at iki.fi (Timo Sirainen) Date: Fri, 3 Oct 2014 17:14:59 +0300 Subject: LDA randomly failing to write email to disk In-Reply-To: <20140924162424.L6814@shell.xecu.net> References: <20140924162424.L6814@shell.xecu.net> Message-ID: <5D35353F-39BC-4F8A-B4C0-DCE55B782903@iki.fi> On 25 Sep 2014, at 00:11, Andy Dills wrote: > We're using 2.2.13 with pigeonhole 0.4.3, in a clustered environment > (maildir on netapp, dual dovecot instances where each server is both a > proxy and a backend). > > Every now and then (once a month per user, maybe?), users will see a blank > email in their inbox. Investigating further, and we will see that the only > information recorded in the maildir file for the message is the > Return-Path, the Delivered-To, and the first Received line (the one > generated by the local LDA via LMTP). This is fixed in hg. I guess I'll just have to make v2.2.14 release soon. From larryrtx at gmail.com Fri Oct 3 14:20:29 2014 From: larryrtx at gmail.com (Larry Rosenman) Date: Fri, 3 Oct 2014 09:20:29 -0500 Subject: LDA randomly failing to write email to disk In-Reply-To: <5D35353F-39BC-4F8A-B4C0-DCE55B782903@iki.fi> References: <20140924162424.L6814@shell.xecu.net> <5D35353F-39BC-4F8A-B4C0-DCE55B782903@iki.fi> Message-ID: which HG Rev fixes this? On Fri, Oct 3, 2014 at 9:14 AM, Timo Sirainen wrote: > On 25 Sep 2014, at 00:11, Andy Dills wrote: > > > We're using 2.2.13 with pigeonhole 0.4.3, in a clustered environment > > (maildir on netapp, dual dovecot instances where each server is both a > > proxy and a backend). > > > > Every now and then (once a month per user, maybe?), users will see a > blank > > email in their inbox. Investigating further, and we will see that the > only > > information recorded in the maildir file for the message is the > > Return-Path, the Delivered-To, and the first Received line (the one > > generated by the local LDA via LMTP). > > This is fixed in hg. I guess I'll just have to make v2.2.14 release soon. > -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx at gmail.com US Mail: 108 Turvey Cove, Hutto, TX 78634-5688 From andy at xecu.net Fri Oct 3 14:43:24 2014 From: andy at xecu.net (Andy Dills) Date: Fri, 3 Oct 2014 10:43:24 -0400 (EDT) Subject: LDA randomly failing to write email to disk In-Reply-To: <5D35353F-39BC-4F8A-B4C0-DCE55B782903@iki.fi> References: <20140924162424.L6814@shell.xecu.net> <5D35353F-39BC-4F8A-B4C0-DCE55B782903@iki.fi> Message-ID: <20141003103101.F2377@shell.xecu.net> On Fri, 3 Oct 2014, Timo Sirainen wrote: > This is fixed in hg. I guess I'll just have to make v2.2.14 release soon. Thanks Timo, I had given up hope, and was starting to question if maybe I was having hardware issues. Should I feel hesitant about rolling out a fresh build from hg into production? Would I be better off waiting for an official 2.2.14? Thanks, Andy --- Andy Dills Xecunet, Inc. www.xecu.net 301-682-9972 --- From tss at iki.fi Fri Oct 3 15:34:15 2014 From: tss at iki.fi (Timo Sirainen) Date: Fri, 3 Oct 2014 18:34:15 +0300 Subject: v2.2.14.rc1 released Message-ID: <14AA1E83-E354-4EBE-94F6-EF11B446567E@iki.fi> http://dovecot.org/releases/2.2/rc/dovecot-2.2.14.rc1.tar.gz http://dovecot.org/releases/2.2/rc/dovecot-2.2.14.rc1.tar.gz.sig I've wanted to do this release for months now, but I keep being too busy all the time. This release fixes several important bugs and a lot of smaller ones. Because there are such a large number of changes I thought I'd make this release candidate release first and the final v2.2.14 early next week. I usually read through the Dovecot mailing list mails before making a new release to see if there are some (important) bugs reported, but I've been way too busy recently to read through everything. I still have over 250 unread mails and I don't think I'll have time to read them anytime soon. On the positive side the Dovecot company is now hiring more people. Especially having more Dovecot coders would reduce my work load and maybe allow me to go back to reading the Dovecot mailing list daily.. See: http://www.dovecot.fi/dovecot-is-hiring-software-engineer-helsinki/ (you can do this work anywhere - no need to live in Finland) http://www.dovecot.fi/dovecot-is-hiring-operations-and-support-engineer-helsinki/ (this probably requires living in Finland) http://www.dovecot.fi/dovecot-is-hiring-technical-pre-sales-engineer-helsinki/ (probably no need to live in Finland) Here are some of the larger changes since v2.2.13: * lmtp: Delivered-To: header no longer contains <> around the email address. Other MDAs don't have it either. * "Out of disk space" errors are now treated as temporary errors (not the same as "Out of disk quota"). * replication plugin: Use replication only for users who have a non-empty mail_replica setting. + lmtp proxy: Log a line about each mail delivery. + Added login_source_ips setting. This can be used to set the source IP address round-robin from a pool of IPs (in case you run out of TCP ports). + Rawlog settings can use tcp:: as the path. + virtual plugin: Don't keep more than virtual_max_open_mailboxes (default 64) number of backend mailboxes open. + SSL/TLS compression can be disabled with ssl_options=no_compression + acl: Global ACL file now supports "quotes" around patterns. + Added last-login plugin to set user's last-login timestamp on login. + LDAP auth: Allow passdb credentials lookup also with auth_bind=yes - IMAP: MODSEQ was sent in FETCH reply even if CONDSTORE/QRESYNC wasn't enabled. This broke at least old Outlooks. - passdb static treated missing password field the same as an empty password field. - mdbox: Fixed potential infinite looping when scanning a broken mdbox file. - imap-login, pop3-login: Fixed potential crashes when client disconnected unexpectedly. - imap proxy: The connection was hanging in some usage patterns. This mainly affected older Outlooks. - lmtp proxy: The proxy sometimes delivered empty mails in error situations or potentially delivered truncated mails. - fts-lucene: If whitespace_chars was set, we may have ended up indexing some garbage words, growing the index size unnecessarily. - -c and -i parameters for dovecot/doveadm commands were ignored if the config socket was readable. - quota: Quota recalculation didn't include INBOX in some setups. - Mail headers were sometimes added to dovecot.index.cache in wrong order. The main problem this caused was with dsync+imapc incremental syncing when the second sync thought the local mailbox had changed. - doveadm backup didn't notice if emails were missing from the middle of the destination mailbox. Now it deletes and resyncs the mailbox. From rs at sys4.de Fri Oct 3 16:15:46 2014 From: rs at sys4.de (Robert Schetterer) Date: Fri, 03 Oct 2014 18:15:46 +0200 Subject: v2.2.14.rc1 released In-Reply-To: <14AA1E83-E354-4EBE-94F6-EF11B446567E@iki.fi> References: <14AA1E83-E354-4EBE-94F6-EF11B446567E@iki.fi> Message-ID: <542ECBB2.4010904@sys4.de> Am 03.10.2014 um 17:34 schrieb Timo Sirainen: > http://www.dovecot.fi/dovecot-is-hiring-technical-pre-sales-engineer-helsinki/ (probably no need to live in Finland) Hi Timo sounds interesting, any more info about the job... Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From mark at msapiro.net Fri Oct 3 16:27:04 2014 From: mark at msapiro.net (Mark Sapiro) Date: Fri, 03 Oct 2014 09:27:04 -0700 Subject: v2.2.14.rc1 released In-Reply-To: <14AA1E83-E354-4EBE-94F6-EF11B446567E@iki.fi> References: <14AA1E83-E354-4EBE-94F6-EF11B446567E@iki.fi> Message-ID: <542ECE58.4010803@msapiro.net> On 10/03/2014 08:34 AM, Timo Sirainen wrote: > http://dovecot.org/releases/2.2/rc/dovecot-2.2.14.rc1.tar.gz Installed here and working so far. -- Mark Sapiro The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan From petr.bitzan at lf3.cuni.cz Fri Oct 3 17:34:03 2014 From: petr.bitzan at lf3.cuni.cz (ing. Petr Bitzan) Date: Fri, 3 Oct 2014 19:34:03 +0200 Subject: Problem with dovecot-managesieved and sieve scripts in mysql Message-ID: <000001cfdf30$39a7b470$acf71d50$@lf3.cuni.cz> Hello, I would like to ask for advice on the following things: I have sieve scripts stored in mysql, work for LDA and imapd correctly. When I try to connect using the client managesieve (Roungcube plugin managesieve with Thunderbird addon sieve), i receive the following error: Oct 3 19:04:50 mail dovecot: managesieve(11044167): Debug: sieve: include: sieve_global_dir is not set; it is currently not possible to include `:global' scripts. Oct 3 19:04:50 mail dovecot: managesieve(11044167): Error: sieve-storage: Cannot open non-file script location for active script `dict:proxy::sieve;name=active;bindir=/var/vmail/sieve-scripts/11044167' Oct 3 19:04:50 mail dovecot: managesieve(11044167): Fatal: Failed to open Sieve storage. If i change settings sieve to: sieve = ~/.dovecot.sieve sieve_dir = ~/sieve it works fine. can someone please advise configuring dovecot-managesieved with saving scripts in the database. Thank you very much Petr Bitzan ------------- # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.6 ext4 auth_debug = yes auth_mechanisms = plain login auth_verbose = yes dict { acl = mysql:/etc/dovecot/dovecot-acl-shared-dict.conf.ext sieve = mysql:/etc/dovecot/dict-sieve-sql.conf.ext } first_valid_gid = 1002 first_valid_uid = 1002 last_valid_gid = 1002 last_valid_uid = 1002 mail_debug = yes mail_location = maildir:/var/vmail/%n/Maildir mail_plugins = " mail_log notify acl" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { list = children location = maildir:%%h/Maildir:INDEX=~/shared/%%u/ prefix = shared/%%u/ separator = / subscriptions = yes type = shared } namespace inbox { hidden = no inbox = yes list = yes location = mailbox Drafts { special_use = \Drafts } mailbox HAM { auto = subscribe } mailbox Junk { special_use = \Junk } mailbox SPAM { auto = subscribe } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / subscriptions = yes type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile acl_shared_dict = proxy::acl quota = maildir:User quota quota_warning = storage=95%% quota-warning 95 %u sieve = dict:proxy::sieve;name=active;bindir=/var/vmail/sieve-scripts/%u sieve_dir = dict:proxy::sieve;name=active;bindir=~/.sieve-bin } protocols = " imap lmtp sieve pop3" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service dict { unix_listener dict { group = vmail mode = 0600 user = vmail } } service lmtp { inet_listener lmtp { address = 127.0.0.1 port = 24 } user = vmail } service managesieve-login { inet_listener sieve { address = xxxxxxx port = 4190 } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { user = vmail } user = dovecot } ssl_cert = Dear readers we are using Dovecot 2.2.7 and all of our users are using Thunderbird as their mail client. Some of them additionally use their iPad/iPhone and a very few an Android Mail-Client. Now one user noticed that two of his mail folders disappeared. He first believed that he accidentally deleted those folders but then he realized that they are still visible from his iPad. I checked this users maildir and everything looks normal. Deleting the index-files made no difference: New index-files were created but those two folders are still invisable from Thunderbird. My main concern is to find the reason for this behaviour. Maybe folders of other users have disappeared and they have not yet noticed. A fresh installation of Thunderbird will most likely fix this single users problem, but I cannot do this for all of our users. So here's my question: How would I debug such a situation? Kind regards Peter Koch And here's our config file: # Dovecot configuration file default_process_limit = 2048 protocols = imap listen = * base_dir = /var/dovecot/ mail_location = maildir:/mail/%u:LAYOUT=fs ssl_cert = References: Message-ID: <542EE8C5.5010608@integrafin.co.uk> IPad email client shows unsubscribed folders (?) whereas by default TB does not (see server settings->advanced under the account). Just a guess... Alex On 03/10/14 19:03, dovecot.pkoch at dfgh.net wrote: > Dear readers > > we are using Dovecot 2.2.7 and all of our users are using Thunderbird as > their mail client. Some of them additionally use their iPad/iPhone and a > very few an Android Mail-Client. > > Now one user noticed that two of his mail folders disappeared. He first > believed that he accidentally deleted those folders but then he realized > that they are still visible from his iPad. I checked this users maildir and > everything looks normal. Deleting the index-files made no difference: New > index-files were created but those two folders are still invisable from > Thunderbird. > > My main concern is to find the reason for this behaviour. Maybe folders of > other users have disappeared and they have not yet noticed. A fresh > installation of Thunderbird will most likely fix this single users problem, > but I cannot do this for all of our users. > > So here's my question: How would I debug such a situation? > > Kind regards > > Peter Koch > > And here's our config file: > > # Dovecot configuration file > > default_process_limit = 2048 > > protocols = imap > listen = * > base_dir = /var/dovecot/ > > mail_location = maildir:/mail/%u:LAYOUT=fs > > ssl_cert = ssl_key = ssl_ca = ssl_verify_client_cert = yes > ssl_cert_username_field = x500UniqueIdentifier > auth_ssl_username_from_cert = yes > > service imap-login { > inet_listener imap { > port = 0 > } > } > > service auth { > client_limit = 4096 > } > > service anvil { > client_limit = 5000 > } > > passdb { > driver = checkpassword > args = /usr/dovecot/bin/checkpassword > } > > userdb { > driver = passwd > override_fields = home=/mail/%u > } > > protocol imap { > mail_max_userip_connections = 1000 > } > From sven at svenhartge.de Fri Oct 3 18:19:01 2014 From: sven at svenhartge.de (Sven Hartge) Date: Fri, 3 Oct 2014 20:19:01 +0200 Subject: Thunderbird ignores some folders References: Message-ID: <1b1pe2gib3v8@mids.svenhartge.de> dovecot.pkoch at dfgh.net wrote: > we are using Dovecot 2.2.7 and all of our users are using Thunderbird > as their mail client. Some of them additionally use their iPad/iPhone > and a very few an Android Mail-Client. > Now one user noticed that two of his mail folders disappeared. He > first believed that he accidentally deleted those folders but then he > realized that they are still visible from his iPad. I checked this > users maildir and everything looks normal. Deleting the index-files > made no difference: New index-files were created but those two folders > are still invisable from Thunderbird. Have you checked the folder subscription? I had some cases of folder "mysteriously" disappearing from Thunderbird (Linux/Windows/MacOS, doesn't matter) and in all but one case (the one case being the user really had deleted the folders) they were no longer subscribed to. Or at least Thunderbird thought so. Restarting Thunderbird and resubscribing fixed the issue in my cases. Gr??e, Sven. -- Sigmentation fault. Core dumped. From bruno.galindro at gmail.com Fri Oct 3 18:49:06 2014 From: bruno.galindro at gmail.com (Bruno Galindro da Costa) Date: Fri, 3 Oct 2014 15:49:06 -0300 Subject: Configure antispam plugin with private namespaces Message-ID: When I use antispam plugin with a folder that is outside a namespace, the plugin works great. But, if I configure it to watch a folder that is inside a namespace, the mailtrain backend does nothing. Does antispam plugin have support to namespaces? *This is my config:* namespace spam { type = private list = yes location = maildir:/var/mail.spam/%d/%n subscriptions = yes prefix = "SPAM." mailbox Filtrados { auto = subscribe } } plugin { antispam_backend = mailtrain antispam_verbose_debug = 1 antispam_debug_target = syslog # the above NOT works antispam_spam = SPAM.Filtrados # the above works #antispam_spam = Filtrados antispam_signature = X-VERTICAL-IP-Quarantine-ID antispam_mail_sendmail = /usr/local/bin/mail_spam.sh antispam_mail_spam = --spam antispam_mail_notspam = --notspam acl = vfile mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename flag_change save mailbox_create mail_log_fields = uid box msgid from subject size vsize quota = maildir:DefaultQuota quota_exceeded_message = O destinatario desta mensagem esta com a caixa postal cheia. A sua mensagem so pode ser entregue se o destinatario apagar algumas das mensagens. quota_warning = storage=95%% /usr/local/bin/quota-warning.sh 95 %u quota_warning2 = storage=90%% /usr/local/bin/quota-warning.sh 90 %u sieve = /var/mail/sieve_scripts/%d/%n/.dovecot.sieve sieve_dir = /var/mail/sieve_scripts/%d/%n/sieve sieve_global_path = /etc/dovecot/sieve/default.sieve sieve_after = /etc/dovecot/sieve/default.sieve sieve_global_dir = /etc/dovecot/sieve trash = /etc/dovecot/dovecot-trash.conf expire = SPAM.Filtrados expire_dict = proxy::expiredict } protocol imap { mail_fsync = never mail_max_userip_connections = 2048 mail_plugins = quota imap_quota trash zlib mail_log notify imap_acl acl antispam ssl_ca = References: <14AA1E83-E354-4EBE-94F6-EF11B446567E@iki.fi> Message-ID: <542F0FCC.1090008@opencsw.org> On 10/03/14 08:34, Timo Sirainen wrote: > http://dovecot.org/releases/2.2/rc/dovecot-2.2.14.rc1.tar.gz Hi Timo, While testing a build on Solaris 10, compiling stops at: libtool: compile: /opt/SUNWspro/bin/cc -DHAVE_CONFIG_H -I. -I../.. -I../../src/lib -I../../src/lib-ssl-iostream -DMODULE_DIR=\"/opt/csw/lib/dovecot\" -I/opt/csw/include/mysql -I/opt/csw/include/postgresql -I/opt/csw/include -xO3 -m32 -xarch=pentium_pro -xchip=pentium_pro -I/opt/csw/include -c fs-posix.c -KPIC -DPIC -o .libs/fs-posix.o "fs-posix.c", line 533: undefined symbol: file "fs-posix.c", line 533: left operand of "->" must be pointer to struct/union "fs-posix.c", line 556: left operand of "->" must be pointer to struct/union "fs-posix.c", line 563: left operand of "->" must be pointer to struct/union cc: acomp failed for fs-posix.c I'm using the same build environment to create previous OpenCSW packages of dovecot and they have compiled cleanly in the past. So, thought I would let you know about it so it can be fixed before the real relase of 2.2.14 Best regards, -Jake (OpenCSW dovecot maintainer) From stephan at rename-it.nl Fri Oct 3 21:09:59 2014 From: stephan at rename-it.nl (Stephan Bosch) Date: Fri, 03 Oct 2014 23:09:59 +0200 Subject: Problem with dovecot-managesieved and sieve scripts in mysql In-Reply-To: <000001cfdf30$39a7b470$acf71d50$@lf3.cuni.cz> References: <000001cfdf30$39a7b470$acf71d50$@lf3.cuni.cz> Message-ID: <542F10A7.90002@rename-it.nl> On 10/3/2014 7:34 PM, ing. Petr Bitzan wrote: > Hello, > > I would like to ask for advice on the following things: > > > > I have sieve scripts stored in mysql, work for LDA and imapd correctly. > > When I try to connect using the client managesieve (Roungcube plugin managesieve with Thunderbird addon sieve), i receive the following error: > > > > Oct 3 19:04:50 mail dovecot: managesieve(11044167): Debug: sieve: include: sieve_global_dir is not set; it is currently not possible to include `:global' scripts. > > Oct 3 19:04:50 mail dovecot: managesieve(11044167): Error: sieve-storage: Cannot open non-file script location for active script `dict:proxy::sieve;name=active;bindir=/var/vmail/sieve-scripts/11044167' > > Oct 3 19:04:50 mail dovecot: managesieve(11044167): Fatal: Failed to open Sieve storage. Currently, ManageSieve only supports the file storage. The dict storage can only be used to retrieve scripts, not store them. Latest Pigeonhole hg revision provides the infrastructure to implement this, but that will probably not happen soon. Regards, Stephan. From remko at FreeBSD.org Fri Oct 3 21:27:08 2014 From: remko at FreeBSD.org (Remko Lodder) Date: Fri, 3 Oct 2014 23:27:08 +0200 Subject: Question wrt. dovecot replicator In-Reply-To: <542D1373.9050806@dovecot.fi> References: <542D1373.9050806@dovecot.fi> Message-ID: On 02 Oct 2014, at 10:57, Teemu Huovila wrote: > On 10/02/2014 02:40 AM, Remko Lodder wrote: >> and a mail_replica = tcp:host{a,b}:12346 configuration on each host so that they are pointing to eachother; This seems to work fine for most accounts, for example: I never experienced issues with this. However, several other accounts (with a large variety of clients) got duplicated emails. Looking with doveadm I only noticed that the numbers of the messages are closely related to eachother but one number incremented. So they cannot be deleted with the deduplicator function. >> >> The replication is provided over TCP only, the connection streams over an OpenVPN tunnel so that the contents are protected, the machines are located in different Datacenters but close to eachother. >> >> How can I determine why there are duplicated emails? >> What kind of messages should I specifically look for? > Look for any errors and warnings in the Dovecot log. You could also enable mail_debug (ref. > http://wiki2.dovecot.org/Logging#Logging_verbosity) for the accounts being synced. Also, please post your complete configuration. I will set that over the weekend with the replication settings re-enabled. I will also post the configuration with the hopefully gathered debugging information. > >> Can I set this up for a few selected accounts instead of all accounts like it was currently? To make sure I do not make things worse for others then needs to be :-) >> The service had been disabled for the time being to prevent the other users from getting duplicated emails. > I do not know what kind of userdb you are running, but there is a newish patch that enables per user replication via the > mail_replica setting. It is not yet included in the newest (2.2.13) release of Dovecot, but is available via the enterprise > version. There are no FreeBSD builds for that, though. ref: http://hg.dovecot.org/dovecot-2.2/rev/c1c67bdc8752 my userdb consists of local users (Which are fed through LDAP at the backend). perhaps I can setup a mailAttributes setting or something so that the replica can be set, although I prefer that I have control over that in the config itself :-) Thanks! Remko > > br, > Teemu Huovila -- /"\ Best regards, | remko at FreeBSD.org \ / Remko Lodder | remko at EFnet X http://www.evilcoder.org/ | / \ ASCII Ribbon Campaign | Against HTML Mail and News -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 841 bytes Desc: Message signed with OpenPGP using GPGMail URL: From petr.bitzan at lf3.cuni.cz Fri Oct 3 21:29:16 2014 From: petr.bitzan at lf3.cuni.cz (ing. Petr Bitzan) Date: Fri, 3 Oct 2014 23:29:16 +0200 Subject: Problem with dovecot-managesieved and sieve scripts in mysql In-Reply-To: <542F10A7.90002@rename-it.nl> References: <000001cfdf30$39a7b470$acf71d50$@lf3.cuni.cz> <542F10A7.90002@rename-it.nl> Message-ID: <000401cfdf51$15a45530$40ecff90$@lf3.cuni.cz> Thank you very much for your reply. I have to store sieve scripts still think. With best regards Petr Bitzan -----Original Message----- From: dovecot [mailto:dovecot-bounces at dovecot.org] On Behalf Of Stephan Bosch Sent: Friday, October 03, 2014 11:10 PM To: ing. Petr Bitzan; dovecot at dovecot.org Subject: Re: Problem with dovecot-managesieved and sieve scripts in mysql On 10/3/2014 7:34 PM, ing. Petr Bitzan wrote: > Hello, > > I would like to ask for advice on the following things: > > > > I have sieve scripts stored in mysql, work for LDA and imapd correctly. > > When I try to connect using the client managesieve (Roungcube plugin managesieve with Thunderbird addon sieve), i receive the following error: > > > > Oct 3 19:04:50 mail dovecot: managesieve(11044167): Debug: sieve: include: sieve_global_dir is not set; it is currently not possible to include `:global' scripts. > > Oct 3 19:04:50 mail dovecot: managesieve(11044167): Error: sieve-storage: Cannot open non-file script location for active script `dict:proxy::sieve;name=active;bindir=/var/vmail/sieve-scripts/11044167' > > Oct 3 19:04:50 mail dovecot: managesieve(11044167): Fatal: Failed to open Sieve storage. Currently, ManageSieve only supports the file storage. The dict storage can only be used to retrieve scripts, not store them. Latest Pigeonhole hg revision provides the infrastructure to implement this, but that will probably not happen soon. Regards, Stephan. From tss at iki.fi Fri Oct 3 21:30:02 2014 From: tss at iki.fi (Timo Sirainen) Date: Sat, 4 Oct 2014 00:30:02 +0300 Subject: v2.2.14.rc1 released In-Reply-To: <542F0FCC.1090008@opencsw.org> References: <14AA1E83-E354-4EBE-94F6-EF11B446567E@iki.fi> <542F0FCC.1090008@opencsw.org> Message-ID: On 04 Oct 2014, at 00:06, Jake Goerzen wrote: > On 10/03/14 08:34, Timo Sirainen wrote: >> http://dovecot.org/releases/2.2/rc/dovecot-2.2.14.rc1.tar.gz > > Hi Timo, > > While testing a build on Solaris 10, compiling stops at: > > libtool: compile: /opt/SUNWspro/bin/cc -DHAVE_CONFIG_H -I. -I../.. -I../../src/lib -I../../src/lib-ssl-iostream -DMODULE_DIR=\"/opt/csw/lib/dovecot\" -I/opt/csw/include/mysql -I/opt/csw/include/postgresql -I/opt/csw/include -xO3 -m32 -xarch=pentium_pro -xchip=pentium_pro -I/opt/csw/include -c fs-posix.c -KPIC -DPIC -o .libs/fs-posix.o > "fs-posix.c", line 533: undefined symbol: file > "fs-posix.c", line 533: left operand of "->" must be pointer to struct/union > "fs-posix.c", line 556: left operand of "->" must be pointer to struct/union > "fs-posix.c", line 563: left operand of "->" must be pointer to struct/union > cc: acomp failed for fs-posix.c Fixed: http://hg.dovecot.org/dovecot-2.2/rev/dd25099bd633 From remko at FreeBSD.org Fri Oct 3 21:37:40 2014 From: remko at FreeBSD.org (Remko Lodder) Date: Fri, 3 Oct 2014 23:37:40 +0200 Subject: Question wrt. dovecot replicator In-Reply-To: References: <542D1373.9050806@dovecot.fi> Message-ID: <5F20B8B3-0908-41C9-A1C4-1FC08265C503@FreeBSD.org> On 03 Oct 2014, at 23:27, Remko Lodder wrote: > > On 02 Oct 2014, at 10:57, Teemu Huovila wrote: > >> On 10/02/2014 02:40 AM, Remko Lodder wrote: >>> and a mail_replica = tcp:host{a,b}:12346 configuration on each host so that they are pointing to eachother; This seems to work fine for most accounts, for example: I never experienced issues with this. However, several other accounts (with a large variety of clients) got duplicated emails. Looking with doveadm I only noticed that the numbers of the messages are closely related to eachother but one number incremented. So they cannot be deleted with the deduplicator function. >>> >>> The replication is provided over TCP only, the connection streams over an OpenVPN tunnel so that the contents are protected, the machines are located in different Datacenters but close to eachother. >>> >>> How can I determine why there are duplicated emails? >>> What kind of messages should I specifically look for? >> Look for any errors and warnings in the Dovecot log. You could also enable mail_debug (ref. >> http://wiki2.dovecot.org/Logging#Logging_verbosity) for the accounts being synced. Also, please post your complete configuration. > > I will set that over the weekend with the replication settings re-enabled. I will also post the configuration with the hopefully gathered debugging information. > >> >>> Can I set this up for a few selected accounts instead of all accounts like it was currently? To make sure I do not make things worse for others then needs to be :-) >>> The service had been disabled for the time being to prevent the other users from getting duplicated emails. >> I do not know what kind of userdb you are running, but there is a newish patch that enables per user replication via the >> mail_replica setting. It is not yet included in the newest (2.2.13) release of Dovecot, but is available via the enterprise >> version. There are no FreeBSD builds for that, though. ref: http://hg.dovecot.org/dovecot-2.2/rev/c1c67bdc8752 > > my userdb consists of local users (Which are fed through LDAP at the backend). perhaps I can setup a mailAttributes setting or something so that the replica can be > set, although I prefer that I have control over that in the config itself :-) > > Thanks! > Remko For what it?s worth: # 2.2.13: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 10.0-RELEASE-p7 amd64 auth_mechanisms = plain login disable_plaintext_auth = no doveadm_password = XXXXXXXXXX mail_debug = yes mail_location = maildir:~/Maildir mail_plugins = " quota notify" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave duplicate passdb { driver = pam } plugin { antispam_backend = mailtrain antispam_mail_notspam = --ham antispam_mail_sendmail = /usr/local/bin/sa-learn.sh antispam_mail_spam = --spam antispam_spam = Spam antispam_trash = trash;Trash;Deleted Items; Deleted Messages; .Trash mail_replica = tcp:xxxx:12346 sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_global_dir = /usr/local/etc/dovecot/sieve/global/ sieve_global_path = /usr/local/etc/dovecot/sieve/default.sieve } postmaster_address = postmaster at xxxx protocols = imap pop3 lmtp sieve replication_dsync_parameters = -f -d -N -l 30 -U replication_max_conns = 30 service aggregator { fifo_listener replication-notify-fifo { mode = 0666 } unix_listener replication-notify { mode = 0666 } } service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } } service doveadm { inet_listener { port = 12346 } } service imap-login { service_count = 1 } service imap { process_limit = 1024 } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service pop3 { process_limit = 1024 } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0666 } } ssl_ca = < ssl_cert = < ssl_key = < userdb { driver = passwd } protocol lmtp { mail_plugins = quota sieve postmaster_address = postmaster at xxxx } protocol lda { mail_plugins = " quota notify sieve" } protocol imap { mail_max_userip_connections = 20 mail_plugins = " quota notify imap_quota antispam" } [ro > >> >> br, >> Teemu Huovila > > -- > > /"\ Best regards, | remko at FreeBSD.org > \ / Remko Lodder | remko at EFnet > X http://www.evilcoder.org/ | > / \ ASCII Ribbon Campaign | Against HTML Mail and News > -- /"\ Best regards, | remko at FreeBSD.org \ / Remko Lodder | remko at EFnet X http://www.evilcoder.org/ | / \ ASCII Ribbon Campaign | Against HTML Mail and News -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 841 bytes Desc: Message signed with OpenPGP using GPGMail URL: From dovecot at outputservices.com Fri Oct 3 21:48:29 2014 From: dovecot at outputservices.com (dovecot at outputservices.com) Date: Fri, 3 Oct 2014 15:48:29 -0600 (MDT) Subject: v2.2.14.rc1 released Message-ID: <201410032148.s93LmTJ3011963@sunfire.outputservices.com> I get similar results on Solaris 10 x86 using gcc. libtool: compile: gcc -DHAVE_CONFIG_H -I. -I../.. -I../../src/lib -I../../src/lib-ssl-iostream -DMODULE_DIR=\"/tmp/bad/lib/dovecot\" -I/usr/local/openldap/include -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -MT fs-posix.lo -MD -MP -MF .deps/fs-posix.Tpo -c fs-posix.c -fPIC -DPIC -o .libs/fs-posix.o fs-posix.c: In function `fs_posix_lock': fs-posix.c:533: error: `file' undeclared (first use in this function) fs-posix.c:533: error: (Each undeclared identifier is reported only once fs-posix.c:533: error: for each function it appears in.) gmake[3]: *** [fs-posix.lo] Error 1 gmake[3]: Leaving directory `/tmp/dovecot-2.2.14.rc1/src/lib-fs' gmake[2]: *** [all-recursive] Error 1 gmake[2]: Leaving directory `/tmp/dovecot-2.2.14.rc1/src' gmake[1]: *** [all-recursive] Error 1 gmake[1]: Leaving directory `/tmp/dovecot-2.2.14.rc1' gmake: *** [all] Error 2 On 10/03/14 15:06, Jake Goerzen wrote: > On 10/03/14 08:34, Timo Sirainen wrote: >> http://dovecot.org/releases/2.2/rc/dovecot-2.2.14.rc1.tar.gz > > Hi Timo, > > While testing a build on Solaris 10, compiling stops at: > > libtool: compile: /opt/SUNWspro/bin/cc -DHAVE_CONFIG_H -I. -I../.. -I../../src/lib -I../../src/lib-ssl-iostream -DMODULE_DIR=\"/opt/csw/lib/dovecot\" -I/opt/csw/include/mysql -I/opt/csw/include/postgresql -I/opt/csw/include -xO3 -m32 -xarch=pentium_pro -xchip=pentium_pro -I/opt/csw/include -c fs-posix.c -KPIC -DPIC -o .libs/fs-posix.o > "fs-posix.c", line 533: undefined symbol: file > "fs-posix.c", line 533: left operand of "->" must be pointer to struct/union > "fs-posix.c", line 556: left operand of "->" must be pointer to struct/union > "fs-posix.c", line 563: left operand of "->" must be pointer to struct/union > cc: acomp failed for fs-posix.c > > I'm using the same build environment to create previous OpenCSW packages of dovecot and they have compiled cleanly in the past. So, thought I would let you know about it so it can be fixed before the real relase of 2.2.14 > > Best regards, > -Jake (OpenCSW dovecot maintainer) > From bob at computerisms.ca Fri Oct 3 23:57:52 2014 From: bob at computerisms.ca (Bob Miller) Date: Fri, 03 Oct 2014 16:57:52 -0700 Subject: X-sieve-redirected-from Message-ID: <1412380672.25157.26.camel@worklian> Hi, I am chasing a problem with sieve vacation messages. the sieve file looks like this: ## Generated by Roundcube Webmail SieveRules Plugin ## require ["copy","vacation"]; # rule:[computerisms.ca] if anyof (address :contains "To" "bob.miller at ctfn.ca", address :contains "Cc" "bob.miller at ctfn.ca") { redirect :copy "bob at computerisms.ca"; vacation :days 66 :subject "autotest" "hello back"; } The mail is forwarded, but no vacation response is sent, and the mail is not forwarded. I find the lda error like this: _discarding_vacation_response_for_implicitly_delivered_message; _no_known_(envelope)_recipient_address_found_in_message_headers_ (recipient=,_and_no_additional_ `:addresses'_are_specified) I am presuming this is the source of my problem. I am not sure why the domain is being modified to reflect the fqdn of the mail server host. When I look at the delivered mail, I find the following two headers: X-sieve-redirected-from: bob.miller at hostname.domain.tld Delivered-to: bob.miller at domain.tld I have been looking for a while now, and I can't figure out where it is picking up the hostname from. doveconf -a | grep hostname comes up empty. the hostname is not in any of the mta config files. Anyone got a hint? -- Computerisms Bob Miller 867-334-7117 / 867-633-3760 http://computerisms.ca From bourek at thinline.cz Sat Oct 4 06:41:27 2014 From: bourek at thinline.cz (Jiri Bourek) Date: Sat, 04 Oct 2014 08:41:27 +0200 Subject: X-sieve-redirected-from In-Reply-To: <1412380672.25157.26.camel@worklian> References: <1412380672.25157.26.camel@worklian> Message-ID: <542F9697.2030402@thinline.cz> > > The mail is forwarded, but no vacation response is sent, and the mail is > not forwarded. I find the lda error like this: > > _discarding_vacation_response_for_implicitly_delivered_message; > _no_known_(envelope)_recipient_address_found_in_message_headers_ > (recipient=,_and_no_additional_ > `:addresses'_are_specified) Does the message have To: and From: headers? I recall getting the same (or similar) output when those headers were missing during my testing. Adding them fixed the issue. From kiuka at kiuka.hu Sat Oct 4 16:27:31 2014 From: kiuka at kiuka.hu (=?iso-8859-2?Q?Kir=E1ly_Bal=E1zs?=) Date: Sat, 4 Oct 2014 18:27:31 +0200 Subject: Dovecot does not update maildirsize after expunge Message-ID: <000001cfdff0$18cdf690$4a69e3b0$@kiuka.hu> Hello, At the first, sorry for my englishJ I have a problem with dovecot quota since i migrated from courier. Dovecot does not update the Maildirsize after expunge, and the user running out of his quota very quickly. I checked, the file is deleted from the filesystem. If i delete the Maildirsize file, dovecot regenerate it with the correct datas when a new mail arrive. Also tried to set mail_debug=yes, but it doesnt show anything in the log, when delete mails. Im using NFS as homedirs, i tried to turn off the releated options in configuration, but didnt help. Has anyone any idea how to fix this issue? Thank you! Here is the output of dovecot -n: # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.6 nfs auth_mechanisms = plain login default_client_limit = 10000 default_process_limit = 1000 dict { quota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no mail_fsync = always mail_location = maildir:/home/vmail/%d/%n mail_nfs_index = yes mail_nfs_storage = yes mmap_disable = yes namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = INBOX. separator = . type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql }plugin { quota = maildir:User quota sieve = /home/vmail/default.sieve sieve_default = /home/vmail/default.sieve sieve_dir = ~/sieve sieve_extensions = +editheader sieve_global_dir = /var/lib/dovecot/sieve } protocols = " imap pop3" service auth-worker { user = vmail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { mode = 0600 user = vmail } user = $default_internal_user } service dict { unix_listener dict { group = vmail mode = 0600 user = vmail } } ssl_cert = IF('%s'='smtp', 0, -1) user_query = \ SELECT CONCAT('/home/vmail/', '%d', '/', '%n') as home, 5000 as uid, 5000 as gid, CONCAT('*:bytes=', quota) as quota_rule \ FROM email_accounts WHERE email = '%u' # If you wish to avoid two SQL lookups (passdb + userdb), you can use # userdb prefetch instead of userdb sql in dovecot.conf. In that case you'll # also have to return userdb fields in password_query prefixed with "userdb_" # string. For example: #password_query = \ # SELECT userid AS user, password, \ # home AS userdb_home, uid AS userdb_uid, gid AS userdb_gid \ # FROM users WHERE userid = '%u' # Query to get a list of all usernames. #iterate_query = SELECT username AS user FROM users From pixilla at macports.org Sat Oct 4 17:52:22 2014 From: pixilla at macports.org (Bradley Giesbrecht) Date: Sat, 4 Oct 2014 10:52:22 -0700 Subject: v2.2.14.rc1 released In-Reply-To: <14AA1E83-E354-4EBE-94F6-EF11B446567E@iki.fi> References: <14AA1E83-E354-4EBE-94F6-EF11B446567E@iki.fi> Message-ID: <8DFDE286-320B-45DB-AC0A-7C64B62CB3BA@macports.org> On Oct 3, 2014, at 8:34 AM, Timo Sirainen wrote: > http://dovecot.org/releases/2.2/rc/dovecot-2.2.14.rc1.tar.gz Patched with this fix: http://hg.dovecot.org/dovecot-2.2/rev/dd25099bd633 Hi Timo, With Apple OS X Mavericks 10.9 (MacPorts) we stop here: libtool: link: /usr/bin/clang -dynamiclib -o .libs/libdovecot-dsync.0.dylib -Wl,-force_load,./.libs/libdsync.a -L/opt/local/lib ../../lib-storage/.libs/libdovecot-storage.dylib -Os -arch x86_64 -Wl,-headerpad_max_install_names -arch x86_64 -Wl,-dylib_file -Wl,/opt/local/lib/dovecot/libdovecot.0.dylib:/opt/local/var/macports/build/_opt_local_var_macports_sources_svn.macports.org_trunk_dports_mail_dovecot2/dovecot2/work/dovecot-2.2.14.rc1/src/lib-dovecot/.libs/libdovecot.dylib -install_name /opt/local/lib/dovecot/libdovecot-dsync.0.dylib -compatibility_version 1 -current_version 1.0 -Wl,-single_module Undefined symbols for architecture x86_64: "_aqueue_append", referenced from: _sync_tree_sort_and_delete_mailboxes in libdsync.a(dsync-mailbox-tree-sync.o) "_aqueue_count", referenced from: _sync_tree_sort_and_delete_mailboxes in libdsync.a(dsync-mailbox-tree-sync.o) ... Regards, Bradley Giesbrecht (pixilla) -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 455 bytes Desc: Message signed with OpenPGP using GPGMail URL: From jgoerzen at opencsw.org Sat Oct 4 23:49:38 2014 From: jgoerzen at opencsw.org (Jake Goerzen) Date: Sat, 04 Oct 2014 16:49:38 -0700 Subject: v2.2.14.rc1 released In-Reply-To: References: <14AA1E83-E354-4EBE-94F6-EF11B446567E@iki.fi> <542F0FCC.1090008@opencsw.org> Message-ID: <54308792.8080202@opencsw.org> On 10/03/14 14:30, Timo Sirainen wrote: > Fixed: http://hg.dovecot.org/dovecot-2.2/rev/dd25099bd633 Applied the patch and compiling completes but I run into a problem during linking: libtool: link: /opt/SUNWspro/bin/cc -G -z defs -h libdovecot-dsync.so.0 -o .libs/libdovecot-dsync.so.0.0.0 -z allextract ./.libs/libdsync.a -z defaultextract -R/home/jgoerzen/opencsw/dovecot/trunk/work/solaris10-i386/build-isa-pentium_pro/dovecot-2.2.14.rc1/src/lib-storage/.libs -R/opt/csw/lib/dovecot -R/opt/csw/lib -L/opt/csw/lib ../../lib-storage/.libs/libdovecot-storage.so -L/home/jgoerzen/opencsw/dovecot/trunk/work/solaris10-i386/build-isa-pentium_pro/dovecot-2.2.14.rc1/src/lib-dovecot/.libs -lrt -lnsl -lsocket -lsendfile -lc -m32 -xarch=pentium_pro -m32 -xarch=pentium_pro Undefined first referenced symbol in file array_sort_i ./.libs/libdsync.a(dsync-brain-mailbox.o) (symbol belongs to implicit dependency /home/jgoerzen/opencsw/dovecot/trunk/work/solaris10-i386/build-isa-pentium_pro/dovecot-2.2.14.rc1/src/lib-dovecot/.libs/libdovecot.so.0) str_append_tabescaped ./.libs/libdsync.a(dsync-serializer.o) (symbol belongs to implicit dependency /home/jgoerzen/opencsw/dovecot/trunk/work/solaris10-i386/build-isa-pentium_pro/dovecot-2.2.14.rc1/src/lib-dovecot/.libs/libdovecot.so.0) str_c ./.libs/libdsync.a(dsync-brain.o) (symbol belongs to implicit dependency /home/jgoerzen/opencsw/dovecot/trunk/work/solaris10-i386/build-isa-pentium_pro/dovecot-2.2.14.rc1/src/lib-dovecot/.libs/libdovecot.so.0) i_stream_is_eof ./.libs/libdsync.a(dsync-mail.o) (symbol belongs to implicit dependency /home/jgoerzen/opencsw/dovecot/trunk/work/solaris10-i386/build-isa-pentium_pro/dovecot-2.2.14.rc1/src/lib-dovecot/.libs/libdovecot.so.0) str_append_c ./.libs/libdsync.a(dsync-brain.o) (symbol belongs to implicit dependency /home/jgoerzen/opencsw/dovecot/trunk/work/solaris10-i386/build-isa-pentium_pro/dovecot-2.2.14.rc1/src/lib-dovecot/.libs/libdovecot.so.0) str_append_n ./.libs/libdsync.a(dsync-mailbox-tree-sync.o) (symbol belongs to implicit dependency /home/jgoerzen/opencsw/dovecot/trunk/work/solaris10-i386/build-isa-pentium_pro/dovecot-2.2.14.rc1/src/lib-dovecot/.libs/libdovecot.so.0) file_wait_lock ./.libs/libdsync.a(dsync-brain.o) (symbol belongs to implicit dependency /home/jgoerzen/opencsw/dovecot/trunk/work/solaris10-i386/build-isa-pentium_pro/dovecot-2.2.14.rc1/src/lib-dovecot/.libs/libdovecot.so.0) From bob at computerisms.ca Sun Oct 5 02:59:56 2014 From: bob at computerisms.ca (Bob Miller) Date: Sat, 04 Oct 2014 19:59:56 -0700 Subject: X-sieve-redirected-from In-Reply-To: <542F9697.2030402@thinline.cz> References: <1412380672.25157.26.camel@worklian> <542F9697.2030402@thinline.cz> Message-ID: <1412477996.3251.27.camel@worklian> Jiri, Reading my message over I see it was the end of a long day at the end of a long week, thank you for interpreting and replying, > > The mail is forwarded, but no vacation response is sent, and the mail is > > not forwarded. I find the lda error like this: The mail is forwarded. No "not forwarding" going on. the vacation response is not sent. Hopefully that is more clear. > > _discarding_vacation_response_for_implicitly_delivered_message; > > _no_known_(envelope)_recipient_address_found_in_message_headers_ > > (recipient=,_and_no_additional_ > > `:addresses'_are_specified) > > Does the message have To: and From: headers? I recall getting the same > (or similar) output when those headers were missing during my testing. > Adding them fixed the issue. The problem turned out to be my defaultdelivery file in qmail; dovecot-lda was missing the -a argument for the recipient... -- Computerisms Bob Miller 867-334-7117 / 867-633-3760 http://computerisms.ca From tss at iki.fi Sun Oct 5 10:37:19 2014 From: tss at iki.fi (Timo Sirainen) Date: Sun, 5 Oct 2014 13:37:19 +0300 Subject: v2.2.14.rc1 released In-Reply-To: <8DFDE286-320B-45DB-AC0A-7C64B62CB3BA@macports.org> References: <14AA1E83-E354-4EBE-94F6-EF11B446567E@iki.fi> <8DFDE286-320B-45DB-AC0A-7C64B62CB3BA@macports.org> Message-ID: On 04 Oct 2014, at 20:52, Bradley Giesbrecht wrote: > With Apple OS X Mavericks 10.9 (MacPorts) we stop here: > > libtool: link: /usr/bin/clang -dynamiclib -o .libs/libdovecot-dsync.0.dylib -Wl,-force_load,./.libs/libdsync.a -L/opt/local/lib ../../lib-storage/.libs/libdovecot-storage.dylib -Os -arch x86_64 -Wl,-headerpad_max_install_names -arch x86_64 -Wl,-dylib_file -Wl,/opt/local/lib/dovecot/libdovecot.0.dylib:/opt/local/var/macports/build/_opt_local_var_macports_sources_svn.macports.org_trunk_dports_mail_dovecot2/dovecot2/work/dovecot-2.2.14.rc1/src/lib-dovecot/.libs/libdovecot.dylib -install_name /opt/local/lib/dovecot/libdovecot-dsync.0.dylib -compatibility_version 1 -current_version 1.0 -Wl,-single_module > Undefined symbols for architecture x86_64: > "_aqueue_append", referenced from: > _sync_tree_sort_and_delete_mailboxes in libdsync.a(dsync-mailbox-tree-sync.o) > "_aqueue_count", referenced from: > _sync_tree_sort_and_delete_mailboxes in libdsync.a(dsync-mailbox-tree-sync.o) > ... Does the attached patch help? You need to run autogen.sh + configure after patching. -------------- next part -------------- A non-text attachment was scrubbed... Name: diff Type: application/octet-stream Size: 560 bytes Desc: not available URL: From mohsen at pahlevanzadeh.org Sun Oct 5 13:20:32 2014 From: mohsen at pahlevanzadeh.org (Mohsen Pahlevanzadeh) Date: Sun, 05 Oct 2014 16:50:32 +0330 Subject: searching for the special result Message-ID: <1412515232.12807.3.camel@pahlevanzadeh.org> Dear all, Already i installed dovecot (lda) + postfix Now, when i search for dovecot+postfix+mysql+ldap , i don't find any content about LMTP with dovecot+postfix+mysql+ldap Unfortunately, When i find a article, paper or so on, it doesn't complete 100%, it means or doesn't have LMTP, or doesn't have sql, or it has sasl) Question: Is my way wrong? From rs at sys4.de Sun Oct 5 13:51:05 2014 From: rs at sys4.de (Robert Schetterer) Date: Sun, 05 Oct 2014 15:51:05 +0200 Subject: searching for the special result In-Reply-To: <1412515232.12807.3.camel@pahlevanzadeh.org> References: <1412515232.12807.3.camel@pahlevanzadeh.org> Message-ID: <54314CC9.9050805@sys4.de> Am 05.10.2014 um 15:20 schrieb Mohsen Pahlevanzadeh: > Dear all, > > Already i installed dovecot (lda) + postfix > Now, when i search for dovecot+postfix+mysql+ldap , i don't find any > content about LMTP with dovecot+postfix+mysql+ldap > Unfortunately, When i find a article, paper or so on, it doesn't > complete 100%, it means or doesn't have LMTP, or doesn't have sql, or it > has sasl) > Question: > Is my way wrong? > this one is nice https://www.exratione.com/2012/05/a-mailserver-on-ubuntu-1204-postfix-dovecot-mysql/ but its not ldap sorry, search list archive and/or wiki for ldap examples, wait for other to post better links Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From pixilla at macports.org Sun Oct 5 17:22:19 2014 From: pixilla at macports.org (Bradley Giesbrecht) Date: Sun, 5 Oct 2014 10:22:19 -0700 Subject: v2.2.14.rc1 released In-Reply-To: References: <14AA1E83-E354-4EBE-94F6-EF11B446567E@iki.fi> <8DFDE286-320B-45DB-AC0A-7C64B62CB3BA@macports.org> Message-ID: <7FDFD83F-FD6C-43F8-90E6-4D356B4C57C1@macports.org> On Oct 5, 2014, at 3:37 AM, Timo Sirainen wrote: > On 04 Oct 2014, at 20:52, Bradley Giesbrecht wrote: > >> With Apple OS X Mavericks 10.9 (MacPorts) we stop here: >> >> libtool: link: /usr/bin/clang -dynamiclib -o .libs/libdovecot-dsync.0.dylib -Wl,-force_load,./.libs/libdsync.a -L/opt/local/lib ../../lib-storage/.libs/libdovecot-storage.dylib -Os -arch x86_64 -Wl,-headerpad_max_install_names -arch x86_64 -Wl,-dylib_file -Wl,/opt/local/lib/dovecot/libdovecot.0.dylib:/opt/local/var/macports/build/_opt_local_var_macports_sources_svn.macports.org_trunk_dports_mail_dovecot2/dovecot2/work/dovecot-2.2.14.rc1/src/lib-dovecot/.libs/libdovecot.dylib -install_name /opt/local/lib/dovecot/libdovecot-dsync.0.dylib -compatibility_version 1 -current_version 1.0 -Wl,-single_module >> Undefined symbols for architecture x86_64: >> "_aqueue_append", referenced from: >> _sync_tree_sort_and_delete_mailboxes in libdsync.a(dsync-mailbox-tree-sync.o) >> "_aqueue_count", referenced from: >> _sync_tree_sort_and_delete_mailboxes in libdsync.a(dsync-mailbox-tree-sync.o) >> ... > > Does the attached patch help? Yes, with this patch dd25099bd633 compiled and installed to DESTDIR. > You need to run autogen.sh + configure after patching. Autogen.sh required wget and pulled wiki2-export.tar.gz during its operation. Curiously, wget was also used during "make" to pull a unicode file I believe. I need to guard against pulling new files during the build operation. Would these wget fetched files normally be provided in your release packages? Regards, Bradley Giesbrecht (pixilla) -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 455 bytes Desc: Message signed with OpenPGP using GPGMail URL: From odhiambo at gmail.com Sun Oct 5 17:41:19 2014 From: odhiambo at gmail.com (Odhiambo Washington) Date: Sun, 5 Oct 2014 20:41:19 +0300 Subject: v2.2.14.rc1 released In-Reply-To: <14AA1E83-E354-4EBE-94F6-EF11B446567E@iki.fi> References: <14AA1E83-E354-4EBE-94F6-EF11B446567E@iki.fi> Message-ID: On 3 October 2014 18:34, Timo Sirainen wrote: > http://dovecot.org/releases/2.2/rc/dovecot-2.2.14.rc1.tar.gz > http://dovecot.org/releases/2.2/rc/dovecot-2.2.14.rc1.tar.gz.sig > > I've wanted to do this release for months now, but I keep being too busy > all the time. This release fixes several important bugs and a lot of > smaller ones. Because there are such a large number of changes I thought > I'd make this release candidate release first and the final v2.2.14 early > next week. > Installed successfully on my FreeBSD boxes - 8.4-STABLE/9.3-STABLE and so far so good. Even successfully compiled on 10-RELEASE VM just for the fun of it. -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254733744121/+254722743223 "I can't hear you -- I'm using the scrambler." From mohsen at pahlevanzadeh.org Sun Oct 5 23:02:33 2014 From: mohsen at pahlevanzadeh.org (Mohsen Pahlevanzadeh) Date: Mon, 06 Oct 2014 02:32:33 +0330 Subject: searching for the special result In-Reply-To: <54314CC9.9050805@sys4.de> References: <1412515232.12807.3.camel@pahlevanzadeh.org> <54314CC9.9050805@sys4.de> Message-ID: <1412550153.4117.2.camel@pahlevanzadeh.org> On Sun, 2014-10-05 at 15:51 +0200, Robert Schetterer wrote: > Am 05.10.2014 um 15:20 schrieb Mohsen Pahlevanzadeh: > > Dear all, > > > > Already i installed dovecot (lda) + postfix > > Now, when i search for dovecot+postfix+mysql+ldap , i don't find any > > content about LMTP with dovecot+postfix+mysql+ldap > > Unfortunately, When i find a article, paper or so on, it doesn't > > complete 100%, it means or doesn't have LMTP, or doesn't have sql, or it > > has sasl) > > Question: > > Is my way wrong? > > > > this one is nice > > https://www.exratione.com/2012/05/a-mailserver-on-ubuntu-1204-postfix-dovecot-mysql/ > > but its not ldap sorry, search list archive and/or wiki for ldap > examples, wait for other to post better links > > > Best Regards > MfG Robert Schetterer > Dear Robert, Above link doesn't have LMTP, it uses unix socket domain. --mohsen From rs at sys4.de Mon Oct 6 05:21:52 2014 From: rs at sys4.de (Robert Schetterer) Date: Mon, 06 Oct 2014 07:21:52 +0200 Subject: searching for the special result In-Reply-To: <1412550153.4117.2.camel@pahlevanzadeh.org> References: <1412515232.12807.3.camel@pahlevanzadeh.org> <54314CC9.9050805@sys4.de> <1412550153.4117.2.camel@pahlevanzadeh.org> Message-ID: <543226F0.1040900@sys4.de> Am 06.10.2014 um 01:02 schrieb Mohsen Pahlevanzadeh: > On Sun, 2014-10-05 at 15:51 +0200, Robert Schetterer wrote: >> Am 05.10.2014 um 15:20 schrieb Mohsen Pahlevanzadeh: >>> Dear all, >>> >>> Already i installed dovecot (lda) + postfix >>> Now, when i search for dovecot+postfix+mysql+ldap , i don't find any >>> content about LMTP with dovecot+postfix+mysql+ldap >>> Unfortunately, When i find a article, paper or so on, it doesn't >>> complete 100%, it means or doesn't have LMTP, or doesn't have sql, or it >>> has sasl) >>> Question: >>> Is my way wrong? >>> >> >> this one is nice >> >> https://www.exratione.com/2012/05/a-mailserver-on-ubuntu-1204-postfix-dovecot-mysql/ >> >> but its not ldap sorry, search list archive and/or wiki for ldap >> examples, wait for other to post better links >> >> >> Best Regards >> MfG Robert Schetterer >> > Dear Robert, > > Above link doesn't have LMTP, it uses unix socket domain. > > --mohsen > whats the problem with ? http://wiki2.dovecot.org/LMTP ... # add lmtp to protocols, otherwise its listeners are ignored protocols = imap pop3 lmtp service lmtp { inet_listener lmtp { address = 192.168.0.24 127.0.0.1 ::1 port = 24 } unix_listener lmtp { #mode = 0666 } } .... Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From marco.fretz at gmail.com Mon Oct 6 09:01:40 2014 From: marco.fretz at gmail.com (Marco Fretz) Date: Mon, 06 Oct 2014 11:01:40 +0200 Subject: Multiple passwords for a user (SQL) Message-ID: <54325A74.4030507@gmail.com> Hi everyone, I'm not sure if this has been discuessed already as I coun't find anything in the archives - maybe I'm looking for the wrong thing. I want to build something similar to googles "app passwords" where your use a different password (strong, auto generated) for each device / app. In general I think this is pretty easy on the database side as I just need a password table and link say the passwords with an user_id to the corresponding user in the users table - one use has many passwords (1:n). for dovecot this means that it will get multiple rows with passwords back from the "password_query". is there a way to tell dovecot to check all those returned passwords and "pass" the request if one of those passwords match? thank you, best regards Marco From alessio at skye.it Mon Oct 6 10:57:04 2014 From: alessio at skye.it (Alessio Cecchi) Date: Mon, 06 Oct 2014 12:57:04 +0200 Subject: v2.2.14.rc1 released In-Reply-To: <14AA1E83-E354-4EBE-94F6-EF11B446567E@iki.fi> References: <14AA1E83-E354-4EBE-94F6-EF11B446567E@iki.fi> Message-ID: <54327580.7040006@skye.it> Il 03/10/2014 17:34, Timo Sirainen ha scritto: > http://dovecot.org/releases/2.2/rc/dovecot-2.2.14.rc1.tar.gz > http://dovecot.org/releases/2.2/rc/dovecot-2.2.14.rc1.tar.gz.sig Hi Timo, after upgrade from 2.2.13 I found this error/crash in the log: Oct 06 12:00:35 imap(myemail at mydomain.com): Error: Corrupted transaction log file /mystorage/mydomain.com/myemail/Maildir/dovecot.index.log seq 39: Invalid transaction log size (32688 vs 32812): /mystorage/mydomain.com/myemail/Maildir/dovecot.index.log (sync_offset=32688) Oct 06 12:00:35 imap(myemail at mydomain.com): Error: Log synchronization error at seq=0,offset=0 for /mystorage/mydomain.com/myemail/Maildir/dovecot.index: Append with UID 3009, but next_uid = 3010 Oct 06 12:00:35 imap(myemail at mydomain.com): Error: /mystorage/mydomain.com/myemail/Maildir/dovecot.index view syncing failed to apply changes Oct 06 12:00:35 imap(myemail at mydomain.com): Panic: file index-sync.c: line 265 (index_mailbox_sync_next_expunge): assertion failed: (range->seq2 <= ctx->messages_count) Oct 06 12:00:35 imap(myemail at mydomain.com): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x743aa) [0x7f43f1f893aa] -> /usr/lib/dovecot/libdovecot.so.0(+0x74426) [0x7f43f1f89426] -> /usr/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f43f1f3c0ff] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xb159c) [0x7f43f22a359c] -> dovecot/imap(imap_sync_more+0xc3) [0x41fc93] -> dovecot/imap() [0x4203b7] -> dovecot/imap(cmd_sync_delayed+0x209) [0x420879] -> dovecot/imap(client_handle_input+0x1ed) [0x41785d] -> dovecot/imap(client_input+0x6f) [0x417b1f] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x5b) [0x7f43f1f9a57b] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xaf) [0x7f43f1f9b74f] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x9) [0x7f43f1f9a609] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f43f1f9a698] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f43f1f40fd3] -> dovecot/imap(main+0x2b0) [0x421050] -> /lib/libc.so.6(__libc_start_main+0xfd) [0x7f43f1bd1cad] -> dovecot/imap() [0x40be49] Oct 06 12:00:35 imap(myemail at mydomain.com): Fatal: master: service(imap): child 5440 killed with signal 6 (core dumped) (gdb) bt full #0 0x00007f43f1be4ed5 in raise () from /lib/libc.so.6 No symbol table info available. #1 0x00007f43f1be7ce0 in abort () from /lib/libc.so.6 No symbol table info available. #2 0x00007f43f1f893a0 in default_fatal_finish (type=, status=0) at failures.c:193 backtrace = 0x16371d8 "/usr/lib/dovecot/libdovecot.so.0(+0x743aa) [0x7f43f1f893aa] -> /usr/lib/dovecot/libdovecot.so.0(+0x74426) [0x7f43f1f89426] -> /usr/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f43f1f3c0ff] -> /usr/lib/d"... #3 0x00007f43f1f89426 in i_internal_fatal_handler (ctx=0x7fff49a9e420, format=, args=) at failures.c:657 status = 0 #4 0x00007f43f1f3c0ff in i_panic (format=0x1540
) at failures.c:267 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7fff49a9e4f0, reg_save_area = 0x7fff49a9e430}} #5 0x00007f43f22a359c in index_mailbox_sync_next_expunge (ctx=0x166a410, sync_rec_r=) at index-sync.c:265 range = 0x16de140 __FUNCTION__ = "index_mailbox_sync_next_expunge" #6 0x000000000041fc93 in imap_sync_more (ctx=0x16cc9c0) at imap-sync.c:536 str = 0x1637050 ret = __FUNCTION__ = "imap_sync_more" #7 0x00000000004203b7 in cmd_sync_continue (sync_cmd=0x16595f0) at imap-sync.c:658 cmd = prev = client = 0x16589f0 ctx = 0x16cc9c0 ret = __FUNCTION__ = "cmd_sync_continue" #8 0x0000000000420879 in cmd_sync_client (client=) at imap-sync.c:748 ctx = 0x0 flags = client = 0x16589f0 imap_flags = no_newmail = #9 cmd_sync_delayed_real (client=) at imap-sync.c:878 cmd = #10 cmd_sync_delayed (client=) at imap-sync.c:886 _data_stack_cur_id = 3 ret = #11 0x000000000041785d in client_handle_input (client=0x16589f0) at imap-client.c:904 ret = true remove_io = false handled_commands = true __FUNCTION__ = "client_handle_input" #12 0x0000000000417b1f in client_input (client=0x16589f0) at imap-client.c:931 cmd = output = 0x1659430 bytes = __FUNCTION__ = "client_input" #13 0x00007f43f1f9a57b in io_loop_call_io (io=0x16731b0) at ioloop.c:478 ioloop = 0x163f740 t_id = 2 __FUNCTION__ = "io_loop_call_io" #14 0x00007f43f1f9b74f in io_loop_handler_run_internal (ioloop=) at ioloop-epoll.c:220 ctx = 0x16403d0 ---Type to continue, or q to quit--- event = 0x1641240 list = 0x1663690 io = 0x1540 tv = {tv_sec = 1799, tv_usec = 999197} msecs = ret = i = 0 call = false __FUNCTION__ = "io_loop_handler_run_internal" #15 0x00007f43f1f9a609 in io_loop_handler_run (ioloop=0x1540) at ioloop.c:525 No locals. #16 0x00007f43f1f9a698 in io_loop_run (ioloop=0x163f740) at ioloop.c:502 __FUNCTION__ = "io_loop_run" #17 0x00007f43f1f40fd3 in master_service_run (service=0x163f5d0, callback=0x1540) at master-service.c:566 No locals. #18 0x0000000000421050 in main (argc=1, argv=0x163f390) at main.c:412 set_roots = {0x429180, 0x0} login_set = {auth_socket_path = 0x1637050 "\210pc\001", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x421250 , failure_callback = 0x4211f0 , request_auth_token = 1} service_flags = storage_service_flags = MAIL_STORAGE_SERVICE_FLAG_DISALLOW_ROOT username = 0x0 c = From skdovecot at smail.inf.fh-brs.de Mon Oct 6 11:52:07 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Mon, 6 Oct 2014 13:52:07 +0200 (CEST) Subject: Multiple passwords for a user (SQL) In-Reply-To: <54325A74.4030507@gmail.com> References: <54325A74.4030507@gmail.com> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Mon, 6 Oct 2014, Marco Fretz wrote: > corresponding user in the users table - one use has many passwords (1:n). > for dovecot this means that it will get multiple rows with passwords > back from the "password_query". is there a way to tell dovecot to check > all those returned passwords and "pass" the request if one of those > passwords match? I think no, but you could craft a PAM module and use the pam passdb or supply a checkpassword script: http://wiki2.dovecot.org/PasswordDatabase - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBVDKCaHz1H7kL/d9rAQLIAgf/do+D2ZVWBOaAbFB9Vv6SyYQ3mdzI19B7 hGZw3NlVpd1XAtSzb6r2zNardtH0Z/q2LvP71WjSFt5LQL4mye/N1LPsz0n8CoCf 0Vzhudo/WVUZts3W30cr6bfVnjJwfoXbhNjCKjK+evY5C6bt+q5YTGbNkCmgAMGC 2Lc0aFVkA12beSWydtjfUf3tkqXTXr8bJIoaCIuPd9YneZZX+p5b0n99MrToQwC8 WfVwogG6FEXiV7FbAcG+kMzYSB9+gIuMyFPqIr5HNVaGcjkF4PySuDHGMBbyQ8yw 9xPpR/xJ6kf6lnl76db0RJTGua42Szvv9tTu1RE4gDXWq8MepwkoNQ== =24Co -----END PGP SIGNATURE----- From bor400 at gmail.com Mon Oct 6 08:29:37 2014 From: bor400 at gmail.com (bor400) Date: Mon, 6 Oct 2014 01:29:37 -0700 (PDT) Subject: Default file names for sent, trash, etc. Message-ID: <1412584177649-49979.post@n4.nabble.com> Hi, I use dovecot 2.1 with mbox (pop3 imap). For imap I want set dovecot compatibile with my webmail. My webmail use filename for mbox as "sent-mail" , "mail-trash", etc. How I can change from default "Sent" to check (create) "sent-mail" file ? -- View this message in context: http://dovecot.2317879.n4.nabble.com/Default-file-names-for-sent-trash-etc-tp49979.html Sent from the Dovecot mailing list archive at Nabble.com. From gianluca.calloni at jodovit.com Mon Oct 6 12:49:31 2014 From: gianluca.calloni at jodovit.com (Gianluca Calloni) Date: Mon, 6 Oct 2014 14:49:31 +0200 Subject: Help with shared folder Message-ID: <000001cfe163$f9096c70$eb1c4550$@calloni@jodovit.com> Hi dovecot guru.. I need some help configuring shared folder in my server.. This is the situation: DOVECOT 2.0.19 with POSTFIX - CLAMAV - AMAVISD - SPAMASSASSIN This is the production server and sharing folder between user work.. But i need some explanation.. 1) It's possible to share only a subfolder (E.G. => .INBOX.ESTERO) without share the main folder .INBOX? 2) Which is the best way (or best practice) to manage the dovecot-acl and dovecot-acl-list file?? Actually, i modifiy the dovecot-acl by hand (vi editor). but every time i modify it i need to restart the dovecot server to apply the configuration. And i need to reset the /var/run/dovecot/dict owner and group cause with dovecot restart the file go back in root:root owner - group Thank's in advance. Gianluca From skdovecot at smail.inf.fh-brs.de Mon Oct 6 13:48:02 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Mon, 6 Oct 2014 15:48:02 +0200 (CEST) Subject: Default file names for sent, trash, etc. In-Reply-To: <1412584177649-49979.post@n4.nabble.com> References: <1412584177649-49979.post@n4.nabble.com> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Mon, 6 Oct 2014, bor400 wrote: > For imap I want set dovecot compatibile with my webmail. My webmail use > filename for mbox as "sent-mail" , "mail-trash", etc. > How I can change from default "Sent" to check (create) "sent-mail" file ? Dovecot does not care about the useage of the folders, but you can advice your clients with: http://wiki2.dovecot.org/MailboxSettings?highlight=%28special-use%29 - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBVDKdk3z1H7kL/d9rAQJiywgAnJ2WL7K6mWwE09tDlD6hSkl37Wa1ZvlJ igy43Q1bYbGlrzc3orXOu/aEfXxN0+4bLcMVdgAqX/2Jc8CJKlgwXdMIAO0OGMQt 3wpbhbtIwf2lvK1luCwQhdGAbFGKq9RXPX67eMPhKybk8jLSLwyzgtiOTDYVfasF mkB+mHYgoroWjDsjwOEnHz0ReMqvWcAGYbz4I+09zYCti71bShkkYhSHXecOeULc sIKL82HSOQsIlZs7sNxh0nqmYNgdIHOBdR/arur49QZvlxK0V5ztQa8754mHA21g Nd86nBdycK7IQsXcdiPYqtgGr1gsDO3GYqTIx3tShjtJl87GXsvDmA== =pqUt -----END PGP SIGNATURE----- From marco.fretz at gmail.com Mon Oct 6 14:46:21 2014 From: marco.fretz at gmail.com (Marco Fretz) Date: Mon, 06 Oct 2014 16:46:21 +0200 Subject: Multiple passwords for a user (SQL) In-Reply-To: References: <54325A74.4030507@gmail.com> Message-ID: <5432AB3D.8010306@gmail.com> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Thank you Steffen, This sounds like a plan. checkpassword looks quite simple to use and I could still use default userdb with dovecot-sql for userhome, quota, etc. I'll give this a try. thanks Marco Am 06.10.2014 13:52, schrieb Steffen Kaiser: > On Mon, 6 Oct 2014, Marco Fretz wrote: > > > corresponding user in the users table - one use has many passwords (1:n). > > for dovecot this means that it will get multiple rows with passwords > > back from the "password_query". is there a way to tell dovecot to check > > all those returned passwords and "pass" the request if one of those > > passwords match? > > I think no, but you could craft a PAM module and use the pam passdb or supply a checkpassword script: > > http://wiki2.dovecot.org/PasswordDatabase > > -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.22 (MingW32) iQIcBAEBAgAGBQJUMqs9AAoJEKxm7Ju3UATuwIcP/jOLvioR1EsJCkhsHMG2GgoV bvafQznk8KOhTcTW0X3CrPRoV7D7Lmotw+2W3Z/YFR9w48ra/Tlf25PRGg7tv+KE Wx5xTFKZDzoXgW3Nn7Jg0ylBvgYTQQRFEZWBbwn+N/7hMfHagw0H66iaMqw3LV6A d6BnxjHI+Iq1w7EPPpplsMeqLMxSEbv1t7YrqC5n/ydnllRe7j4WFbkMYywAYxR5 WN8SfhuhvxFec3nSOftCVbVvVSFsAPN/n2OYxgVl5LvgLUdI9NUyqpxA/Rj2KVhb +V+/NB/TKEpIBe1Byeb1W8cLeijmgDWXiEQQhG8+3ld21cabqEyQvrRN93FJzHBx n71NTpNul98bZW4BPh4U2uzJMdDzbo8aD5WMJFwczrLwDj/CNhU2W2gh14F4AyhG W9eNRXn9ntdJ2hxhlCb8csLMf9rHd/XgzZkfGEzyvJKPRDONdD7HslP3gFAKo0du xoGe6fw3FJuGg16KkRFWE/dE25fk2y34iliqS1G3j4owMlj79pLV1JsDDI5A1heV f3JNUfMhb1b5lGAI31YoqG5/Ls/0bkMUT6p+BU2ZezYFAUSA2M3EwpsaJkwyu7Ov YTbAG7JOzp7dp/bk6R1PGg11qc9yDHBS4Rm4J+rdLFZ3ibImZ/+0Meb1pRbKLGwV iRaVYK07ag276MQqoLg3 =krqF -----END PGP SIGNATURE----- From joliver at john-oliver.net Mon Oct 6 16:38:47 2014 From: joliver at john-oliver.net (John Oliver) Date: Mon, 6 Oct 2014 09:38:47 -0700 Subject: Dovecot writing to mailbox user@domain Message-ID: <20141006163847.GA18107@ns2.sdsitehosting.net> centOS 6.5, dovecot-2.0.9-7.el6_5.1.x86_64 This is frustrating, because I had it working before... I could deliver an email to a user user at domain, then connect to dovecot IMAP and see the mail, no problem! Then I was told we had to use cyrus, and I was dealing with it for a few weeks. Now we're back to dovecot, and the last backup I had of that config has postfix delivering mail to /var/vmail/username as I want and expect, but dovecot looks for and creates /var/vmail/user at domain which I DON'T want [joliver at test ~]$ dovecot -n # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-431.el6.x86_64 x86_64 CentOS release 6.5 (Final) ext4 auth_username_format = %Lu mail_access_groups = mail mail_location = maildir:/var/vmail/%u/Maildir mail_privileged_group = mail mbox_write_locks = fcntl passdb { driver = pam } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } protocols = imap ssl_cert = Hello! I've posted to the list several times about a strange issue I'm having with dovecot LDA. When dovecot-lda is called in the context of a pipe script that is executed as the "vmail" user via the Dovecot Antispam plugin, dovecot-lda exits prematurely with status code 134. The dovecot deliver manual at http://wiki2.dovecot.org/LDA#logging states very clearly, "If dovecot-lda fails to write to log files it exits with temporary failure." That's a curious note, because I believe that a "temporary failure" exit code may be what I'm dealing with here. When I drag an email from Inbox to SPAM to trigger Antispam, I see only this (and no further output beyond the last line) in syslog, which is the configured logging destination for LDA: imap: antispam: mailbox_is_unsure(Junk): 0 imap: antispam: mailbox_is_trash(INBOX): 0 imap: antispam: mailbox_is_trash(Junk): 0 imap: antispam: mail copy: from trash: 0, to trash: 0 imap: antispam: mailbox_is_spam(INBOX): 0 imap: antispam: mailbox_is_spam(Junk): 1 imap: antispam: mailbox_is_unsure(INBOX): 0 imap: antispam: mail copy: src spam: 0, dst spam: 1, src unsure: 0 imap: antispam: running mailtrain backend program /bin/bash imap: antispam: running mailtrain backend program /bin/bash imap: antispam: running mailtrain backend program parameter 1 /usr/local/bin/sa-learn-pipe.sh imap: antispam: running mailtrain backend program parameter 2 --spam By contrast, if I "su" to the "vmail" user and call the LDA executable with the same arguments that my pipe script does, I see all of the expected output in syslog, AND the message is delivered successfully: /usr/lib/dovecot/deliver -d "sa-training at localhost.com" -m "Training.SPAM" -p "/tmp/sendmail-msg-25169.txt" lda: Debug: Loading modules from directory: /usr/lib/dovecot/modules lda: Debug: Module loaded: /usr/lib/dovecot/modules/lib10_quota_plugin.so lda: Debug: Module loaded: /usr/lib/dovecot/modules/lib90_sieve_plugin.so lda: Debug: auth input: sa-training at localhost.com home=/var/vmail/localhost.com/sa-training mail=maildir:/var/vmail/localhost.com/sa-training/Maildir uid=5000 gid=5000 quota_rule=*:storage=0B sieve=/var/vmail/localhost.com/sa-training/.sieve lda: Debug: Added userdb setting: mail=maildir:/var/vmail/localhost.com/sa-training/Maildir lda: Debug: Added userdb setting: plugin/quota_rule=*:storage=0B lda: Debug: Added userdb setting: plugin/sieve=/var/vmail/localhost.com/sa-training/.sieve lda(sa-training at localhost.com): Debug: Effective uid=5000, gid=5000, home=/var/vmail/localhost.com/sa-training lda(sa-training at localhost.com): Debug: Quota root: name=user backend=dict args=:file:/var/vmail/localhost.com/sa-training/.quotausage lda(sa-training at localhost.com): Debug: Quota rule: root=user mailbox=* bytes=0 messages=0 lda(sa-training at localhost.com): Debug: Quota rule: root=user mailbox=Trash bytes=+104857600 messages=0 lda(sa-training at localhost.com): Debug: Quota rule: root=user mailbox=Junk ignored lda(sa-training at localhost.com): Debug: Quota rule: root=user mailbox=INBOX bytes=+104857600 messages=0 lda(sa-training at localhost.com): Debug: Quota warning: bytes=0 (100%) messages=0 reverse=no command=quota-reached 100 sa-training at localhost.com localhost.com lda(sa-training at localhost.com): Debug: Quota warning: bytes=0 (95%) messages=0 reverse=no command=quota-warning 95 sa-training at localhost.com localhost.com lda(sa-training at localhost.com): Debug: Quota warning: bytes=0 (80%) messages=0 reverse=no command=quota-warning 80 sa-training at localhost.com localhost.com lda(sa-training at localhost.com): Debug: Quota warning: bytes=0 (100%) messages=0 reverse=yes command=quota-below below sa-training at localhost.com localhost.com lda(sa-training at localhost.com): Debug: Quota grace: root=user bytes=0 (10%) lda(sa-training at localhost.com): Debug: dict quota: user=sa-training at localhost.com, uri=file:/var/vmail/localhost.com/sa-training/.quotausage, noenforcing=0 lda(sa-training at localhost.com): Debug: maildir++: root=/var/vmail/localhost.com/sa-training/Maildir, index=, indexpvt=, control=, inbox=/var/vmail/localhost.com/sa-training/Maildir, alt= lda(sa-training at localhost.com): Debug: Quota root: name=user backend=dict args=:file:/var/vmail//raw mail user/.quotausage lda(sa-training at localhost.com): Debug: Quota warning: bytes=0 (100%) messages=0 reverse=no command=quota-reached 100 raw mail user lda(sa-training at localhost.com): Debug: Quota warning: bytes=0 (95%) messages=0 reverse=no command=quota-warning 95 raw mail user lda(sa-training at localhost.com): Debug: Quota warning: bytes=0 (80%) messages=0 reverse=no command=quota-warning 80 raw mail user lda(sa-training at localhost.com): Debug: Quota warning: bytes=0 (100%) messages=0 reverse=yes command=quota-below below raw mail user lda(sa-training at localhost.com): Debug: Quota grace: root=user bytes=0 (10%) lda(sa-training at localhost.com): Debug: dict quota: user=raw mail user, uri=file:/var/vmail//raw mail user/.quotausage, noenforcing=0 lda(sa-training at localhost.com): Debug: none: root=, index=, indexpvt=, control=, inbox=, alt= lda(sa-training at localhost.com): Debug: Destination address: sa-training at localhost.com (source: user at hostname) lda(sa-training at localhost.com): Debug: sieve: Pigeonhole version 0.4.2 initializing lda(sa-training at localhost.com): Debug: sieve: include: sieve_global_dir is not set; it is currently not possible to include `:global' scripts. lda(sa-training at localhost.com): Debug: sieve: using the following location for user's Sieve script: /var/vmail/localhost.com/sa-training/.sieve;name=main script lda(sa-training at localhost.com): Debug: sieve: loading script /var/vmail/localhost.com/sa-training/.sieve;name=main script lda(sa-training at localhost.com): Debug: sieve: script binary /var/vmail/localhost.com/sa-training/.sieve.svbin successfully loaded lda(sa-training at localhost.com): Debug: sieve: binary save: not saving binary /var/vmail/localhost.com/sa-training/.sieve.svbin, because it is already stored lda(sa-training at localhost.com): Debug: sieve: executing script from /var/vmail/localhost.com/sa-training/.sieve.svbin lda(sa-training at localhost.com): sieve: msgid=<20141003110532.045EE6060D at localhost.com>: stored mail into mailbox 'Training.SPAM' I'm trying to make sense of this behavior; the implication seems to be that dovecot-lda is crashes immediately, before it can log anything, when it's triggered via Antispam. Is there some way to determine what's happening? I've posted coredump and trace information previously, and nobody replied. Thanks for any help! -Ben From heupink at merit.unu.edu Mon Oct 6 18:44:14 2014 From: heupink at merit.unu.edu (mourik jan heupink - merit) Date: Mon, 06 Oct 2014 20:44:14 +0200 Subject: Dovecot writing to mailbox user@domain In-Reply-To: <20141006163847.GA18107@ns2.sdsitehosting.net> References: <20141006163847.GA18107@ns2.sdsitehosting.net> Message-ID: <5432E2FE.7050907@merit.unu.edu> Hi John, I'm guessing your problem is: > mail_location = maildir:/var/vmail/%u/Maildir %u means 'username', and perhaps this serves you better: %n: User part in user at domain, same as %u if there's no domain. so: mail_location = maildir:/var/vmail/%n/Maildir I've had this same problem too MJ On 10/06/2014 06:38 PM, John Oliver wrote: > centOS 6.5, dovecot-2.0.9-7.el6_5.1.x86_64 > > This is frustrating, because I had it working before... I could deliver > an email to a user user at domain, then connect to dovecot IMAP and see the > mail, no problem! Then I was told we had to use cyrus, and I was > dealing with it for a few weeks. Now we're back to dovecot, and the > last backup I had of that config has postfix delivering mail to > /var/vmail/username as I want and expect, but dovecot looks for and > creates /var/vmail/user at domain which I DON'T want > > [joliver at test ~]$ dovecot -n > # 2.0.9: /etc/dovecot/dovecot.conf > # OS: Linux 2.6.32-431.el6.x86_64 x86_64 CentOS release 6.5 (Final) ext4 > auth_username_format = %Lu > mail_access_groups = mail > mail_location = maildir:/var/vmail/%u/Maildir > mail_privileged_group = mail > mbox_write_locks = fcntl > passdb { > driver = pam > } > passdb { > args = /etc/dovecot/dovecot-ldap.conf.ext > driver = ldap > } > protocols = imap > ssl_cert = ssl_key = userdb { > driver = passwd > } > userdb { > args = uid=504 gid=505 home=/var/vmail/%u > driver = static > } > [joliver at test ~]$ cat /etc/dovecot/dovecot-ldap.conf.ext > hosts = localhost > auth_bind = no > ldap_version = 3 > debug_level = 0 > default_pass_scheme = SSHA > base = ou=Users,dc=test,dc=com > scope = subtree > pass_filter = (&(objectClass=user)(uid=%u)) > pass_attrs = mail=user,userPassword=password > From tmpdovecot at groyaume.com Tue Oct 7 10:23:52 2014 From: tmpdovecot at groyaume.com (Guillaume) Date: Tue, 07 Oct 2014 12:23:52 +0200 Subject: index problem with only 1 folder of 1 box Message-ID: <5433BF38.3020904@groyaume.com> Hello, First of all, sorry for my poor english level. I pass to solr indexing. All is OK, except for the inbox of one of the mailboxes. For this inbox (other folders of the same mailbox have no problems), when i do text search, there is always no response. Others mailboxes have no problems. If i do a : "doveadm -Dv fts rescan -u mybox at domain.tld", i can do one and only one search with the correct response. It index the folder, take a few seconds and give me the good answer. If i redo the same search, it's extremly quick with no answers. It's like a cache problem but i don't know where and why... Logs are not very verbose... Here is an example of command line search : ---------------------------------------- $ nc 127.0.0.1 143 * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE STARTTLS AUTH=PLAIN AUTH=LOGIN] Bienvenue sur le serveur IMAP de Domain.tld 10 LOGIN "mybox at domain.tld" "MyBigSecret" 10 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE BINARY MOVE SEARCH=FUZZY QUOTA] Logged in 20 SELECT INBOX * FLAGS (\Answered \Flagged \Deleted \Seen \Draft unknown-2 unknown-9 unknown-0 unknown-10 unknown-1 unknown-4 $MDNSent unknown-3 unknown-8 $Forwarded NonJunk) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft unknown-2 unknown-9 unknown-0 unknown-10 unknown-1 unknown-4 $MDNSent unknown-3 unknown-8 $Forwarded NonJunk \*)] Flags permitted. * 8437 EXISTS * 0 RECENT * OK [UIDVALIDITY 1412669180] UIDs valid * OK [UIDNEXT 8439] Predicted next UID * OK [HIGHESTMODSEQ 20] Highest 20 OK [READ-WRITE] Select completed (0.000 secs). 30 SEARCH text "coucou" * OK Indexed 14% of the mailbox, ETA 0:57 * OK Indexed 29% of the mailbox, ETA 0:47 * OK Indexed 72% of the mailbox, ETA 0:11 * OK Mailbox indexing finished * SEARCH 35 108 153 175 176 182 348 357 360 431 472 479 520 574 575 576 577 578 586 949 984 1025 1032 1033 1034 1087 1099 1129 1284 1313 1314 1315 1366 1372 1465 1538 1711 1726 1758 1759 1969 1981 1983 1984 2036 2077 2104 2116 2162 2181 2193 2437 2504 2587 2663 2808 2809 2854 2861 2862 3076 3087 3088 3137 3188 3189 3190 3191 3192 3193 3196 3197 3250 3251 3252 3327 3328 3329 3330 3331 3332 3379 3464 3481 3494 3521 3528 3582 3589 3593 3596 3651 3667 3672 3695 3787 3789 3939 3940 3941 3942 3943 3944 3945 3946 4019 4020 4034 4043 4134 4146 4175 4241 4346 4379 4422 4490 4491 4537 4540 4542 4543 4544 4550 4627 4727 4742 4767 4790 4817 4828 4831 4839 4862 4888 4899 4901 4906 4911 4916 4957 4999 5003 5004 5008 5009 5010 5011 5012 5013 5039 5062 5081 5092 5119 5138 5145 5150 5152 5185 5186 5187 5216 5246 5247 5282 5283 5314 5316 5320 5322 5325 5337 5353 5360 5363 5385 5432 5447 5472 5485 5496 5498 5500 5528 5551 5564 5567 5595 5598 5642 5794 5841 5896 5933 5960 5961 5994 6001 6005 6016 6017 6051 6075 6125 6152 6163 6215 6238 6239 6240 6241 6287 6311 6342 6350 6353 6357 6369 6431 6472 6689 6928 6945 6951 7026 7030 7045 7046 7115 7210 7212 7214 7230 7256 7295 7298 7340 7489 7490 7492 7654 7655 7658 7660 7676 7767 7768 7800 7801 7913 7937 7956 8075 8085 8102 8111 8144 8266 8329 8333 8394 8395 8431 30 OK Search completed (36.029 secs). 40 SEARCH text "coucou" * SEARCH 40 OK Search completed (0.002 secs). 50 SEARCH text "blabla" * SEARCH 50 OK Search completed (0.002 secs). 60 LOGOUT * BYE Logging out 60 OK Logout completed. ---------------------------------------- To close this question, here is dovecot -n: ---------------------------------------- # 2.2.9: /etc/dovecot/dovecot.conf # OS: Linux 3.13.0-36-generic x86_64 Ubuntu 14.04.1 LTS ext4 auth_mechanisms = plain login debug_log_path = /var/log/dovecot-debug.log disable_plaintext_auth = no first_valid_uid = 5000 hostname = mailserver.domain.tld info_log_path = /var/log/dovecot-info.log last_valid_uid = 5000 lda_mailbox_autocreate = yes lda_original_recipient_header = X-Original-To listen = * log_path = /var/log/dovecot-err.log login_greeting = Bienvenue sur le serveur IMAP de Domain.tld mail_debug = yes mail_gid = 5000 mail_location = maildir:/data/mails/%d/%n mail_plugins = " quota fts fts_solr" mail_uid = 5000 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave passdb { driver = pam } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { fts = solr fts_autoindex = yes fts_solr = break-imap-search url=http://localhost:8080/solr/ quota = maildir:User quota sieve = /home/vmail/managesieve/.%n@%d.sieve sieve_dir = /home/vmail/managesieve/%d/%n sieve_global_dir = /home/vmail/sieve/ } postmaster_address = postmaster at domain.tld protocols = " imap sieve pop3" service auth { unix_listener /var/spool/postfix/private/auth { group = root mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0660 user = vmail } } service dict { unix_listener dict { group = vmail mode = 0600 user = vmail } } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } ssl_ca = /proc/sys/vm/drop_caches and a restart of the server, but there is always the same problem... Does anyone have an idea to explore? sincerly yours, Guillaume From eduardo at freedominterface.org Tue Oct 7 11:46:28 2014 From: eduardo at freedominterface.org (Eduardo Ramos) Date: Tue, 07 Oct 2014 08:46:28 -0300 Subject: Help with shared folder In-Reply-To: <000001cfe163$f9096c70$eb1c4550$@calloni@jodovit.com> References: <000001cfe163$f9096c70$eb1c4550$@calloni@jodovit.com> Message-ID: <5433D294.1050307@freedominterface.org> Hi Gianluca, I have roundcubemail as webmail. It has a plugin called 'acl', that allows users create acls easly. My users use to use thunderbird too, and the solution is that add-on: https://addons.mozilla.org/en-US/thunderbird/addon/imap-acl-extension/ On 10/06/2014 09:49 AM, Gianluca Calloni wrote: > Hi dovecot guru.. > > > > I need some help configuring shared folder in my server.. > > This is the situation: > > DOVECOT 2.0.19 > > with POSTFIX - CLAMAV - AMAVISD - SPAMASSASSIN > > > > This is the production server and sharing folder between user work.. > > But i need some explanation.. > > > > 1) It's possible to share only a subfolder (E.G. => .INBOX.ESTERO) without > share the main folder .INBOX? > > 2) Which is the best way (or best practice) to manage the dovecot-acl and > dovecot-acl-list file?? Actually, i modifiy the dovecot-acl by hand (vi > editor). but every time i modify it i need to restart the dovecot server to > apply the configuration. And i need to reset the /var/run/dovecot/dict owner > and group cause with dovecot restart the file go back in root:root owner - > group > > > > > > Thank's in advance. > > > > Gianluca From gianluca.calloni at jodovit.com Tue Oct 7 12:30:05 2014 From: gianluca.calloni at jodovit.com (Gianluca Calloni) Date: Tue, 7 Oct 2014 14:30:05 +0200 Subject: Help with shared folder Message-ID: <008e01cfe22a$6c8ae720$45a0b560$@calloni@jodovit.com> HI Eduardo. Thank you for your replay.. You know if there is a plug-in also for Horde webmail GUI? Unfortunately we use outlook and it seems there is not addon for this. From eduardo at freedominterface.org Tue Oct 7 13:22:13 2014 From: eduardo at freedominterface.org (Eduardo Ramos) Date: Tue, 07 Oct 2014 10:22:13 -0300 Subject: Help with shared folder In-Reply-To: <008e01cfe22a$6c8ae720$45a0b560$@calloni@jodovit.com> References: <008e01cfe22a$6c8ae720$45a0b560$@calloni@jodovit.com> Message-ID: <5433E905.1080307@freedominterface.org> Sorry Gianluca, I know IMP/Horde just by name. Some googling show me that the option: $servers['advanced'] = array(...,'acl' => true,...) could help you, but you can get some issues: https://sys4.de/en/blog/2013/11/06/imap-acl-dovecot-horde-5-imp-6-warning/ On 10/07/2014 09:30 AM, Gianluca Calloni wrote: > HI Eduardo. > > > > Thank you for your replay.. > > > > You know if there is a plug-in also for Horde webmail GUI? > > > > Unfortunately we use outlook and it seems there is not addon for this. From sgerag at gmail.com Tue Oct 7 12:14:54 2014 From: sgerag at gmail.com (Stefanos Gerangelos) Date: Tue, 07 Oct 2014 15:14:54 +0300 Subject: dovecot 2.1 new imap folder permissions Message-ID: <5433D93E.1020701@gmail.com> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi, I hope this is the appropriate place to ask. I am migrating an old mail (postfix/dovecot) server to a new one. Everything works much as expected. I have a small obstacle though. I use mbox format and the setup is pretty much simple. Suppose a user's home directory is the following: # ls -ld /home/foo drwxr-xr-x 3 foo users 4096 Oct 4 13:28 foo and the respective /var/mail: # ls -ld /var/mail/foo - -rw------- 1 foo mail 0 Oct 4 23:45 /var/mail/foo In the old server when the user tried to create a new test imap folder (from an imap client), then the newly created file would be: # ls -l /home/foo/ - -rw------- 1 foo users 0 Oct 2 02:08 test This is the desired behavior. In the new dovecot 2.1 server the following file permissions will apply: # ls -l /home/foo/ - -rw-r--r-- 1 foo users 0 Oct 2 02:08 test I finally noticed that if I chmod the /home/foo to 711, then the new file will have the desired (600) permissions. So, I can make a umask for the new users (login.defs), but that doesn't sound a pretty solution. Do you have anything else to suggest? If you need any .conf file, let me know. Thanks in advance! - --Stefanos -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEcBAEBAgAGBQJUM9k6AAoJEDvFaozEhZub3rwIAKglt/6iAU61rCfWJf6yfMZY HNp3rXz4WDbxhOT+eeuoHNN4QLQFTVmjYoqGpqJEazntdMKJqJ1At3osGtzUMYDe iMuhsbcP+tpMAkeFcYB69cW+HvcmWsPafRJoCgziHapT2VxluWH0rfZIDGmvBI5e kQ31ef9IHZjiBwyKf37e8QraU85HDXgF6AhcJ5I7PlDcJDW/jFGFKOUwDoKJ2BU9 JMUBWDALUZ9Uosd+8P8b11TcjjGdakKBPozvu8aAOKd9jz3G9bvatdHnZkD/OJFl pIrnrQuaBA1bW4UP8nTTSyQVuvLKYpMLbN+NTym8SaEU3BwjirWbRDozHLugXio= =lpy7 -----END PGP SIGNATURE----- From slusarz at curecanti.org Tue Oct 7 16:24:56 2014 From: slusarz at curecanti.org (Michael M Slusarz) Date: Tue, 07 Oct 2014 10:24:56 -0600 Subject: Help with shared folder In-Reply-To: <5433E905.1080307@freedominterface.org> References: <008e01cfe22a$6c8ae720$45a0b560$@calloni@jodovit.com> <5433E905.1080307@freedominterface.org> Message-ID: <20141007102456.Horde.sltLiifKtfXJFqer6YfihQ1@bigworm.curecanti.org> Quoting Eduardo Ramos : > Sorry Gianluca, > > I know IMP/Horde just by name. Some googling show me that the > option: $servers['advanced'] = array(...,'acl' => true,...) could > help you, but you can get some issues: > > https://sys4.de/en/blog/2013/11/06/imap-acl-dovecot-horde-5-imp-6-warning/ We've had native ACL support in Horde/IMP for at least 10 years now. But questions regarding configuration should be asked on one of the Horde mailing lists, not here. michael From r at sys4.de Tue Oct 7 16:56:57 2014 From: r at sys4.de (Ralf Hildebrandt) Date: Tue, 7 Oct 2014 18:56:57 +0200 Subject: Keywords & sync Message-ID: <20141007165657.GD21939@sys4.de> We're using keywords within Thunderbird, and we're syncing those using IMAP. When using more than 5 keywords, we're envcountering problems - they're only partially being synced (between two clients, but not all clients). Any idea why this could be happening? The introduction of tagging in Thunderbird is described here: -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From rs at sys4.de Tue Oct 7 17:03:30 2014 From: rs at sys4.de (Robert Schetterer) Date: Tue, 07 Oct 2014 19:03:30 +0200 Subject: Keywords & sync In-Reply-To: <20141007165657.GD21939@sys4.de> References: <20141007165657.GD21939@sys4.de> Message-ID: <54341CE2.1070109@sys4.de> Am 07.10.2014 um 18:56 schrieb Ralf Hildebrandt: > We're using keywords within Thunderbird, and we're syncing those using > IMAP. When using more than 5 keywords, we're envcountering problems - > they're only partially being synced (between two clients, but not all > clients). > > Any idea why this could be happening? > > The introduction of tagging in Thunderbird is described here: > > guess you mean this http://kb.mozillazine.org/Tags IMAP Thunderbird tries to store tags on the server using IMAP keywords. If the IMAP server doesn't support that it will store lags locally in the .msf file for the folder. That means that another PC can not see the labels. A quick and dirty way to test where tags are stored would be to exit Thunderbird and delete the .msf file, and see if the tags disappeared. A more sophisticated way is to log into the IMAP account and to check whether the PERMANENTFLAGS server response to the SELECT command contains \* (see RFC 3501).This page explains how to manually connect to an IMAP server. Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From skdovecot at smail.inf.fh-brs.de Tue Oct 7 20:08:55 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen) Date: Tue, 07 Oct 2014 22:08:55 +0200 Subject: Keywords & sync In-Reply-To: <54341CE2.1070109@sys4.de> References: <20141007165657.GD21939@sys4.de> <54341CE2.1070109@sys4.de> Message-ID: <54344857.204@smail.inf.fh-brs.de> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Robert Schetterer wrote: > Am 07.10.2014 um 18:56 schrieb Ralf Hildebrandt: >> We're using keywords within Thunderbird, and we're syncing those >> using IMAP. When using more than 5 keywords, we're envcountering >> problems - they're only partially being synced (between two >> clients, but not all clients). >> >> Any idea why this could be happening? >> >> The introduction of tagging in Thunderbird is described here: >> >> > > guess you mean this > > http://kb.mozillazine.org/Tags > > IMAP > > Thunderbird tries to store tags on the server using IMAP keywords. > If the IMAP server doesn't support that it will store lags locally > in the .msf file for the folder. That means that another PC can not > see the labels. > There is another paragraphe to notice: "For sharing tags with another PC (or Thunderbird using a different profile) you need to have defined the same tags to see them. Thunderbird appears to have hard coded support for five tags that mimic the old labels." Did you tested, if all Thunderbirds store the equally named tag with the same IMAP keyword? - -- Steffen -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (Darwin) Comment: Using GnuPG with undefined - http://www.enigmail.net/ iQEVAwUBVDRIV3D1/YhP6VMHAQK/nAf/bgki9hWoDWA+JtoVP4C90lNnsF1AB/q+ +bMi85mkSesLAzJWLEefwAohaDop8X9n1x3Sbo2DgVSMq1zdk8H7KOp6vmCFtRLw 7efdDYc4LlpuNokMGXvbTDctBDfsLaOFj+Eg0OLsutvDtQGFjxmH24vpH7UkbDqc cDnvtmzLksJSbFyE7Ijal5kro7DX9VRmor9/nUAcMHir5VtfoG23OfXEEVQvfluI wZ4GnoykzO++Hr5CTCbdxRYHbMNPL/hejstfMRe+35xokXX/syxSPQ/jz1VLqFkE t1f7tL0IFysqtbhiYaly02Glgc7hsCwjZQtFtd9b8ytJWXWEjtkRvQ== =WzUI -----END PGP SIGNATURE----- From pch at myzel.net Tue Oct 7 21:28:49 2014 From: pch at myzel.net (Peter Chiochetti) Date: Tue, 07 Oct 2014 23:28:49 +0200 Subject: Keywords & sync In-Reply-To: <54344857.204@smail.inf.fh-brs.de> References: <20141007165657.GD21939@sys4.de> <54341CE2.1070109@sys4.de> <54344857.204@smail.inf.fh-brs.de> Message-ID: <54345B11.6090907@myzel.net> Am 2014-10-07 um 22:08 schrieb Steffen: > Robert Schetterer wrote: >> Am 07.10.2014 um 18:56 schrieb Ralf Hildebrandt: >>> We're using keywords within Thunderbird, and we're syncing those >>> using IMAP. When using more than 5 keywords, we're envcountering >>> problems - they're only partially being synced (between two >>> clients, but not all clients). >> >> guess you mean this >> http://kb.mozillazine.org/Tags >> >> IMAP >> Thunderbird tries to store tags on the server using IMAP keywords. >> If the IMAP server doesn't support that it will store lags locally >> in the .msf file for the folder. That means that another PC can not >> see the labels. > > There is another paragraphe to notice: > "For sharing tags with another PC (or Thunderbird using a different > profile) you need to have defined the same tags to see them. > Thunderbird appears to have hard coded support for five tags that > mimic the old labels." Steffen is spot on: only the computer, where you create a tag, will display the new tag. If a tag with the same number but another label exists there, it will show a different label. The tag is stored on the server, but it will not sync labels to other clients! Besides, dovecot is probably limited to 26 tags (letters of the alphabet). PS: I really liked to see a feature to limitlessly tag messages with arbitrary text strings from a synced, easily extensible vocubulary :) But storing them as headers might go against the idea of IMAP, to keep message pristine, storing them extra makes much buro-cracy, oh my! -- peter From skdovecot at smail.inf.fh-brs.de Wed Oct 8 07:36:31 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Wed, 8 Oct 2014 09:36:31 +0200 (CEST) Subject: Keywords & sync In-Reply-To: <54345B11.6090907@myzel.net> References: <20141007165657.GD21939@sys4.de> <54341CE2.1070109@sys4.de> <54344857.204@smail.inf.fh-brs.de> <54345B11.6090907@myzel.net> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Tue, 7 Oct 2014, Peter Chiochetti wrote: > Besides, dovecot is probably limited to 26 tags (letters of the alphabet). Partially, other ones are storred in index files, which are lost, if you need to remove them because of an mailbox corruption. > PS: I really liked to see a feature to limitlessly tag messages with > arbitrary text strings from a synced, easily extensible vocubulary :) But > storing them as headers might go against the idea of IMAP, to keep message > pristine, storing them extra makes much buro-cracy, oh my! See, IMAP ANNOTATE rfc5257: "this can be used to attach comments and other useful information to a message. It is also possible to attach annotations to specific parts of a message, so that, for example, they could be marked as seen, or important, or a comment added. " this seems to be the last post about it: http://www.dovecot.org/list/dovecot/2013-February/140526.html There probably is a working metadata plugin for Dovecot: http://comments.gmane.org/gmane.mail.imap.dovecot/72702 http://hg.dovecot.org/dovecot-metadata-plugin this plugin seems to support annotatemore: http://vman.de/cyrus/draft-daboo-imap-annotatemore-07.html - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBVDTpf3z1H7kL/d9rAQL1RAf+MTv0Tr0caHf0HaLDdRYY4sb45ihs/W4j HM+1/n76hs1aDEr2FyCPjPcgfoQF9q3UGhxNakB5O+XKuZiLbLdZbPBwLfZYg7ly fB+tjitASLIpJjN9F6wdalEgEdsd+HsgLiK1fOFJME2qgSXjfwDy7uKKMh/ZIE/x iWOAGANbYC89f60ELXkG9jGCwAAHD3+y7D8Muk0au6tpvnG9Mp6cYG98fWXtBZ41 n3K5D5xGrI3EH5Erg+Ca2tQ9KPUuN7COJl49a+bccD+PVkmdXGGKu2TwQnckUCum slvMeL+bCDQMYH2yfB4chMCj1TVgz/nfpksk3JPEcqfZ28XbTP+WpQ== =Ha/E -----END PGP SIGNATURE----- From hmoreno at gmv.com Wed Oct 8 08:30:57 2014 From: hmoreno at gmv.com (=?iso-8859-1?Q?H=E9ctor_Moreno_Blanco?=) Date: Wed, 8 Oct 2014 08:30:57 +0000 Subject: mailbox in different filesystem Message-ID: Hello everyone, We have Dovecot 2.1.6 with Maildir. We would like to perform some kind of mail archiving with a mailbox in a different storage, for example a mailbox called ARCHIVED, with different disks (slower...). Is possible to locate this mailbox in other storage (SAS, Fiber...) and how can we do it? Thank you very much in advanced. Kind regards. H?ctor Moreno P Please consider the environment before printing this e-mail. ______________________ This message including any attachments may contain confidential information, according to our Information Security Management System, and intended solely for a specific individual to whom they are addressed. Any unauthorised copy, disclosure or distribution of this message is strictly forbidden. If you have received this transmission in error, please notify the sender immediately and delete it. ______________________ Este mensaje, y en su caso, cualquier fichero anexo al mismo, puede contener informacion clasificada por su emisor como confidencial en el marco de su Sistema de Gestion de Seguridad de la Informacion siendo para uso exclusivo del destinatario, quedando prohibida su divulgacion copia o distribucion a terceros sin la autorizacion expresa del remitente. Si Vd. ha recibido este mensaje erroneamente, se ruega lo notifique al remitente y proceda a su borrado. Gracias por su colaboracion. ______________________ From skdovecot at smail.inf.fh-brs.de Wed Oct 8 10:56:37 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Wed, 8 Oct 2014 12:56:37 +0200 (CEST) Subject: mailbox in different filesystem In-Reply-To: References: Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Wed, 8 Oct 2014, H?ctor Moreno Blanco wrote: > We have Dovecot 2.1.6 with Maildir. > > We would like to perform some kind of mail archiving with a mailbox in a different storage, for example a mailbox called ARCHIVED, with different disks (slower...). > Is possible to locate this mailbox in other storage (SAS, Fiber...) and how can we do it? That depends on what exactly "ARCHIVED" is. 1) is it a "folder" of each user, check out namespaces or symlinks. 2) is it a mailbox with subfolders, check out public namespaces or create an user, where the mail location points somewhere else, e.g. via userdb or symlinks - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBVDUYZXz1H7kL/d9rAQI/fQgAjveccYpN3bc5tRFrIb91sBQe3jLgKCYJ py6D50PlrIvbSqe/eCYJNf4N+LK7QVSxFD6DbnonvtNNg/XK7lst0xWvYls/eaM/ fbWOPj33tojT6TDDfsMPihS1U8C8vfUeBWkHjWG0h3GJ3eK35KgbomKoN2G4FS63 gSk0c6TqPSWjMmlrU5x7CqgOE5dajhqANYot3XXVL+T463bh+olszjbVSRX8FqH+ EoTTeNNeRDMMW8Rq57Khepzd1U8hRgmiEuYDumlUwv25C2+2QdEBgubxdl7Zzo9P t6G2p3pLukncsqn6AFjWu93+l/Euy2HPO2i/Pf5V8dGLOARJMx2txQ== =dfM7 -----END PGP SIGNATURE----- From hmoreno at gmv.com Wed Oct 8 10:59:04 2014 From: hmoreno at gmv.com (=?iso-8859-1?Q?H=E9ctor_Moreno_Blanco?=) Date: Wed, 8 Oct 2014 10:59:04 +0000 Subject: mailbox in different filesystem In-Reply-To: References: Message-ID: Thanks for the quick response Steffen. I mean that every user has its own mailbox to archive mails, in other different storage. Obviously, that namespace/mailbox will have subfolders (months, years, from...). I'll check out how to do it with namespaces/symlinks. Thank you very much. Kind regards. H?ctor Moreno -----Mensaje original----- De: Steffen Kaiser [mailto:skdovecot at smail.inf.fh-brs.de] Enviado el: mi?rcoles, 08 de octubre de 2014 12:57 Para: H?ctor Moreno Blanco CC: dovecot at dovecot.org Asunto: Re: mailbox in different filesystem -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Wed, 8 Oct 2014, H?ctor Moreno Blanco wrote: > We have Dovecot 2.1.6 with Maildir. > > We would like to perform some kind of mail archiving with a mailbox in a different storage, for example a mailbox called ARCHIVED, with different disks (slower...). > Is possible to locate this mailbox in other storage (SAS, Fiber...) and how can we do it? That depends on what exactly "ARCHIVED" is. 1) is it a "folder" of each user, check out namespaces or symlinks. 2) is it a mailbox with subfolders, check out public namespaces or create an user, where the mail location points somewhere else, e.g. via userdb or symlinks - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBVDUYZXz1H7kL/d9rAQI/fQgAjveccYpN3bc5tRFrIb91sBQe3jLgKCYJ py6D50PlrIvbSqe/eCYJNf4N+LK7QVSxFD6DbnonvtNNg/XK7lst0xWvYls/eaM/ fbWOPj33tojT6TDDfsMPihS1U8C8vfUeBWkHjWG0h3GJ3eK35KgbomKoN2G4FS63 gSk0c6TqPSWjMmlrU5x7CqgOE5dajhqANYot3XXVL+T463bh+olszjbVSRX8FqH+ EoTTeNNeRDMMW8Rq57Khepzd1U8hRgmiEuYDumlUwv25C2+2QdEBgubxdl7Zzo9P t6G2p3pLukncsqn6AFjWu93+l/Euy2HPO2i/Pf5V8dGLOARJMx2txQ== =dfM7 -----END PGP SIGNATURE----- P Please consider the environment before printing this e-mail. ______________________ This message including any attachments may contain confidential information, according to our Information Security Management System, and intended solely for a specific individual to whom they are addressed. Any unauthorised copy, disclosure or distribution of this message is strictly forbidden. If you have received this transmission in error, please notify the sender immediately and delete it. ______________________ Este mensaje, y en su caso, cualquier fichero anexo al mismo, puede contener informacion clasificada por su emisor como confidencial en el marco de su Sistema de Gestion de Seguridad de la Informacion siendo para uso exclusivo del destinatario, quedando prohibida su divulgacion copia o distribucion a terceros sin la autorizacion expresa del remitente. Si Vd. ha recibido este mensaje erroneamente, se ruega lo notifique al remitente y proceda a su borrado. Gracias por su colaboracion. ______________________ From andre at rodier.me Thu Oct 9 09:36:52 2014 From: andre at rodier.me (Andre Rodier) Date: Thu, 09 Oct 2014 10:36:52 +0100 Subject: Send an alert on master user login Message-ID: <54365734.1050709@rodier.me> Hello, I want to know if there is an option in Dovecot to send an alert, or run a script when someone is using the master user facility. I can do something myself with fail2ban, but maybe there is an option in Dovecot? Thanks. Andr?. -------------- next part -------------- A non-text attachment was scrubbed... Name: andre.vcf Type: text/x-vcard Size: 235 bytes Desc: not available URL: From martinschmidtii at gmx.de Thu Oct 9 10:35:43 2014 From: martinschmidtii at gmx.de (Martin Schmidt) Date: Thu, 9 Oct 2014 12:35:43 +0200 Subject: dovecot replication (active-active) - server specs Message-ID: Hello, i have some questions about the new dovecot replication and mdbox format. my company has currently 3 old dovecot 2.0.x fileserver/backend with ca. 120k mailboxes and ca. 6 TB data used. They are synchronised per drbd/corosync. Each fileserver/backend have ca. 40k mailboxes im Maildir format. Our MX server is delivering ca. 30 GB new mails per day. Two IMAP proxy server get the connections from the users. Atm. without dovecot director. We've got around 700k connections per day (imap 200k / pop3 500k) The system is getting issues because the fileserver still have old slow HDDs. Users sometime get connection timeouts, because the fileserver can not answer fast enough due to I/O waiting lag. So we want to make a new system. We desire the new system to use mdbox format ( bigger files, less I/O) and replication through dovecot replication (active/active) instead of drbd. Each fileserver should know every mailbox/user and for the time being 2 dovecot proxies for the user connections (IMAP/POP). (later after the migration from the old system to the new, dovecot director instead of proxies, for caching reasons). we've got 2 new fileservers, they have each SSD HDDs for "new-storage" and 7200rpm SATA HDDs on RAID 5 with 10 TB for "alt-storage" 32 GB RAM per Server Do you have some tips for the system? Do you believe 32 GB RAM are enough for one fileserver each and have you experience with the I/O Waiting problem with huge amounts of Data on the alt-storage? Could there be issues with the RAM, if one fileserver has a downtime, so the second one has to take over all mailboxes for a short amount of time? In general are only 2 new fileserver enough or should we think in bigger dimensions, like 4 fileserver Storage expansion in the new servers should not be a problem (bigger HDDs and a few slots free, so we can expand the raid 5). thank you kind regards Martin Schmidt From andre at rodier.me Thu Oct 9 12:04:10 2014 From: andre at rodier.me (Andre Rodier) Date: Thu, 09 Oct 2014 13:04:10 +0100 Subject: Send an alert on master user login In-Reply-To: <54365734.1050709@rodier.me> References: <54365734.1050709@rodier.me> Message-ID: <543679BA.6080507@rodier.me> Hello Again, It's more complex than I thought to do this with fail2ban, especially when using the web mail. So, I am asking again, if anyone knows how to run a custom script every time master user is used, I would be happy. I already have a post login script, but I don't find any variable in the environment that tell me if it's a master user login or not. Thanks. On 09/10/14 10:36, Andre Rodier wrote: > Hello, > > I want to know if there is an option in Dovecot to send an alert, or run > a script when someone is using the master user facility. > > I can do something myself with fail2ban, but maybe there is an option in > Dovecot? > > Thanks. > Andr?. From andre at rodier.me Thu Oct 9 12:07:36 2014 From: andre at rodier.me (Andre Rodier) Date: Thu, 09 Oct 2014 13:07:36 +0100 Subject: Send an alert on master user login In-Reply-To: <543679BA.6080507@rodier.me> References: <54365734.1050709@rodier.me> <543679BA.6080507@rodier.me> Message-ID: <54367A88.10509@rodier.me> On 09/10/14 13:04, Andre Rodier wrote: > Hello Again, > > It's more complex than I thought to do this with fail2ban, especially > when using the web mail. > > So, I am asking again, if anyone knows how to run a custom script every > time master user is used, I would be happy. > > I already have a post login script, but I don't find any variable in the > environment that tell me if it's a master user login or not. > > Thanks. > > On 09/10/14 10:36, Andre Rodier wrote: >> Hello, >> >> I want to know if there is an option in Dovecot to send an alert, or run >> a script when someone is using the master user facility. >> >> I can do something myself with fail2ban, but maybe there is an option in >> Dovecot? >> >> Thanks. >> Andr?. Hi again, I found the variable passed to the script that refers to master user. It's 'MASTER_USER' Thanks. From chuck.peters at gmail.com Thu Oct 9 12:20:14 2014 From: chuck.peters at gmail.com (C Peters) Date: Thu, 9 Oct 2014 08:20:14 -0400 Subject: Dbox and Exim Message-ID: The Dovecot wiki [1] doesn't list either Exim, Postfix or anything else as supporting the dbox. I did some searching in the Exim archives and have found only one message mentioning dbox, sdbox or mdbox. [2] I think an RFC would go a long way towards getting the format supported. Has Timo, or anyone else, considered submitting an RFC to the IETF? My question was how are we going to use it if Exim doesn't support it. It looks like we can filter it and convert it with dovecot-lda. [3] I have generally avoided using Procmail for a few years because of various problems and it's a dead software project that hasn't been developed in what 15 to 20 years. I am thinking about trying it with Exim's built in Maildrop filtering support. Has anybody tried that? What else are people using to enable dbox? The more specific question on the problem I am trying to solve. I have been using mbox for years, and I can't even get Dovecot, IMAP and Thunderbird working on the LAN because it can't handle the GB's of old mail. Mutt works on the local machine, but I want something that works while I am using something other than ssh and mutt. For example I want to try Mailpile and K9. I would like to try dbox, but given it's lack of support in Exim or Postfix, I'll probably convert to maildir. Thanks, Chuck 1. http://wiki2.dovecot.org/MailboxFormat 1. https://lists.exim.org/lurker/message/20110220.014144.87010abd.en.html Thread view: https://lists.exim.org/lurker/thread/20110216.223226.015539ba.en.html#i20110216.223226.015539ba 2. http://ramblings.narrabilis.com/mdboxprocmail From rs at sys4.de Thu Oct 9 13:34:41 2014 From: rs at sys4.de (Robert Schetterer) Date: Thu, 09 Oct 2014 15:34:41 +0200 Subject: Send an alert on master user login In-Reply-To: <54365734.1050709@rodier.me> References: <54365734.1050709@rodier.me> Message-ID: <54368EF1.108@sys4.de> Am 09.10.2014 um 11:36 schrieb Andre Rodier: > Hello, > > I want to know if there is an option in Dovecot to send an alert, or run > a script when someone is using the master user facility. > > I can do something myself with fail2ban, but maybe there is an option in > Dovecot? perhaps you can do it with scripts but you should prefer trigger it out of log however perhaps read http://wiki2.dovecot.org/PostLoginScripting > > Thanks. > Andr?. Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From tss at iki.fi Thu Oct 9 13:43:13 2014 From: tss at iki.fi (Timo Sirainen) Date: Thu, 9 Oct 2014 16:43:13 +0300 Subject: Sieve filter extracting wrong header value on certain mail messages In-Reply-To: References: Message-ID: <1645B5A6-B7D1-4808-B9D4-63D452C690E9@iki.fi> Finally fixed: http://hg.dovecot.org/dovecot-2.2/rev/0e1a3c909a13 On 06 Aug 2014, at 18:56, gowen (dovecot) wrote: > > # 2.2.12: /etc/dovecot/dovecot.conf > # OS: Linux 3.15.4-x86_64-linode45 x86_64 openSUSE 12.3 (x86_64) > > Short version: > > 1) I filter out spam by using a dovecot sieve filter to act based on a header inserted by bogofilter > 2) In some cases, sieve fails to correctly file based on this header > 3) Testing with sieve-test indicates that it's testing the wrong header > 4) Suggestions? Am I doing something wrong? Is there a problem with these headers that bends test-sieve out of shape? > 5) Test files from below are also available via http://www.swynwyr.com/sieve-test/ > > Any help is appreciated!!! > > > Long version with full details: > > Here is the simple sieve filter I'm using to test, and two different variants of an email which triggers this problem. I basically deleted things one by one from an original email (1) to get minimal testcases that triggered (2) or did not trigger (3) the problem. > > The filter: > > === begin test.sieve === > require ["fileinto", "body", "regex"]; > > if header :contains "X-Bogosity" "Spam," { > fileinto "SPAM.SPAM"; > stop; > } elsif header :contains "X-Bogosity" "Unsure," { > fileinto "SPAM.UNSURE"; > stop; > } > > keep; > stop; > === end test.sieve === > > Here is an example email that will cause this filter to not function as expected: > > === begin message.2 === > Return-Path: > Subject: =?utf-8?B?QUhTIEtpdGNoZW4gTWFrZW92ZXIgR2l2ZWF3YXkg?= > Subject: ?HS Kit?hen ?ak??ov??r Giv??away > Subject: =?ISO-8859-1?Q?AHS Kitchen Makeover Giveaway =A0=A0=A0?= > Subject: > Subject: AHS Kitchen Makeover Giveaway > X-Bogosity: Spam, tests=bogofilter, spamicity=1.000000, version=1.2.3 > > > Home Warranty Summer Giveaway > === end message.2 === > > If I run test-sieve on this, we can clearly see in the trace log that when it's supposed to test for header "X-Bogosity" it in fact looks at one of the multiple "Subject" headers. Note that the result is storing in INBOX rather than SPAM.SPAM, and that the "matching value" for "X-Bogosity headers" is actually the contents of the final "Subject" header in the test on line 3. In the second test, on line 6, it uses a different and correct value for the same header! But too late to help as the first test was the one it should have had a match on. > > === begin session === > $ sieve-test -t trace2.log -Tlevel=matching test.sieve message.2 > > Performed actions: > > * store message in folder: INBOX > > Implicit keep: > > (none) > > sieve-test(gowen): Info: final result: success > $ cat trace2.log > > ## Started executing script 'test' > 3: header test > 3: starting `:contains' match with `i;ascii-casemap' comparator: > 3: extracting `X-Bogosity' headers from message > 3: matching value `AHS Kitchen Makeover Giveaway' > 3: with key `Spam,' => 0 > 3: finishing match with result: not matched > 3: jump if result is false > 3: jumping to line 6 > 6: header test > 6: starting `:contains' match with `i;ascii-casemap' comparator: > 6: extracting `X-Bogosity' headers from message > 6: matching value `Spam, tests=bogofilter, spamicity=1.000000, version=1.2.3' > 6: with key `Unsure,' => 0 > 6: finishing match with result: not matched > 6: jump if result is false > 6: jumping to line 11 > 11: keep action; store message in default mailbox > 12: stop command; end all script execution > ## Finished executing script 'test' > > $ > === end session === > > Now lets remove the "Return-Path" from that message. (Of the original 26 headers, all but the 7 shown in message.2 could be removed and still have this message break the filter). This alters thing enough that sieve starts working as expected (in fact, removing any one of the 6 non-X-Bogosity headers will cause this to start working). > > === begin message.3 === > Subject: =?utf-8?B?QUhTIEtpdGNoZW4gTWFrZW92ZXIgR2l2ZWF3YXkg?= > Subject: ?HS Kit?hen ?ak??ov??r Giv??away > Subject: =?ISO-8859-1?Q?AHS Kitchen Makeover Giveaway =A0=A0=A0?= > Subject: > Subject: AHS Kitchen Makeover Giveaway > X-Bogosity: Spam, tests=bogofilter, spamicity=1.000000, version=1.2.3 > > > Home Warranty Summer Giveaway > === end message.3 === > > Now when we run test-sieve it works as expected, filing into SPAM.SPAM and showing the correct matching value for line 3: > > === begin session === > $ sieve-test -t trace3.log -Tlevel=matching test.sieve message.3 > > Performed actions: > > * store message in folder: SPAM.SPAM > > Implicit keep: > > (none) > > sieve-test(gowen): Info: final result: success > $ cat trace3.log > > ## Started executing script 'test' > 3: header test > 3: starting `:contains' match with `i;ascii-casemap' comparator: > 3: extracting `X-Bogosity' headers from message > 3: matching value `Spam, tests=bogofilter, spamicity=1.000000, version=1.2.3' > 3: with key `Spam,' => 1 > 3: finishing match with result: matched > 3: jump if result is false > 3: not jumping > 4: fileinto action > 4: store message in mailbox `SPAM.SPAM' > 5: stop command; end all script execution > ## Finished executing script 'test' > > $ > === end session === From andre at rodier.me Thu Oct 9 14:17:52 2014 From: andre at rodier.me (Andre Rodier) Date: Thu, 09 Oct 2014 15:17:52 +0100 Subject: Send an alert on master user login In-Reply-To: <54365734.1050709@rodier.me> References: <54365734.1050709@rodier.me> Message-ID: <54369910.8000605@rodier.me> On 09/10/14 10:36, Andre Rodier wrote: > Hello, > > I want to know if there is an option in Dovecot to send an alert, or run > a script when someone is using the master user facility. > > I can do something myself with fail2ban, but maybe there is an option in > Dovecot? > > Thanks. > Andr?. I am answering to myself. If anyone is interested, here a custom perl script to report master user login functionality: Regards, Andr?. -------------- next part -------------- [Email] Dest=administrator at example.com From=postmaster at example.com Server=smtp1 Bcc=admin at example2.com -------------- next part -------------- A non-text attachment was scrubbed... Name: master-user-report.pl Type: application/x-perl Size: 1506 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: post-login.sh Type: application/x-shellscript Size: 303 bytes Desc: not available URL: From bytesplit at gmail.com Thu Oct 9 16:03:57 2014 From: bytesplit at gmail.com (Philon) Date: Thu, 9 Oct 2014 18:03:57 +0200 Subject: Dbox and Exim In-Reply-To: References: Message-ID: Hi Chuck, I?m really curious as to if I really understand you correctly. Neither Exim nor Postfix do need to support any mailbox format. They both should hand incoming mail to either LDA or LMTP. You can use sieve and managesieve for filtering and there even is a Thunderbird plugin for managing the filters. So all in all it should be pretty convenient. I don't see why dovecot should not be able to handle multiple GBs of mail, even on a local network. Philon You might want to check here: http://wiki2.dovecot.org/LDA/Exim http://wiki2.dovecot.org/LMTP/Exim 2014-10-09 14:20 GMT+02:00 C Peters : > The Dovecot wiki [1] doesn't list either Exim, Postfix or anything > else as supporting the dbox. I did some searching in the Exim > archives and have found only one message mentioning dbox, sdbox or > mdbox. [2] I think an RFC would go a long way towards getting the > format supported. Has Timo, or anyone else, considered submitting an > RFC to the IETF? > > My question was how are we going to use it if Exim doesn't support it. > It looks like we can filter it and convert it with dovecot-lda. [3] > I have generally avoided using Procmail for a few years because of > various problems and it's a dead software project that hasn't been > developed in what 15 to 20 years. I am thinking about trying it with > Exim's built in Maildrop filtering support. Has anybody tried that? > What else are people using to enable dbox? > > > The more specific question on the problem I am trying to solve. I > have been using mbox for years, and I can't even get Dovecot, IMAP and > Thunderbird working on the LAN because it can't handle the GB's of old > mail. Mutt works on the local machine, but I want something that > works while I am using something other than ssh and mutt. For example > I want to try Mailpile and K9. I would like to try dbox, but given > it's lack of support in Exim or Postfix, I'll probably convert to > maildir. > > Thanks, > Chuck > > > 1. http://wiki2.dovecot.org/MailboxFormat > 1. https://lists.exim.org/lurker/message/20110220.014144.87010abd.en.html > Thread view: > https://lists.exim.org/lurker/thread/20110216.223226.015539ba.en.html#i20110216.223226.015539ba > 2. http://ramblings.narrabilis.com/mdboxprocmail > From me at junc.eu Thu Oct 9 16:07:50 2014 From: me at junc.eu (Benny Pedersen) Date: Thu, 09 Oct 2014 18:07:50 +0200 Subject: Dbox and Exim In-Reply-To: References: Message-ID: <148f5aa9008.280b.d475fad7b14312f5d8424e35e39f7512@junc.eu> On October 9, 2014 2:20:14 PM C Peters wrote: > it's lack of support in Exim or Postfix, I'll probably convert to > maildir. Why not use dovecot lmtp or dovecot lda ?, postfix or exim dont need to store mails in sql like dbmail does, but dbmail have a lda or lmtp aswell, problem solved no ? From bluewind at xinu.at Thu Oct 9 17:24:06 2014 From: bluewind at xinu.at (Florian Pritz) Date: Thu, 09 Oct 2014 19:24:06 +0200 Subject: dovecot replication (active-active) - server specs In-Reply-To: References: Message-ID: <5436C4B6.4070303@xinu.at> On 09.10.2014 12:35, Martin Schmidt wrote: > So we want to make a new system. We desire the new system to use > mdbox format ( bigger files, less I/O) Be sure to enable compression when do do that move (you'd have to do pretty much the same migration again if you enable it later) as per http://wiki2.dovecot.org/Plugins/Zlib Just in case: You'll probably also want to increase mdbox_rotate_size from the default 2m to something along the lines of 10m to 100m (This also only affects new files so should be done early) -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 819 bytes Desc: OpenPGP digital signature URL: From bind at enas.net Thu Oct 9 18:41:06 2014 From: bind at enas.net (Urban Loesch) Date: Thu, 09 Oct 2014 20:41:06 +0200 Subject: dovecot replication (active-active) - server specs In-Reply-To: References: Message-ID: <5436D6C2.3060303@enas.net> Hi, Am 09.10.2014 12:35, schrieb Martin Schmidt: > Our MX server is delivering ca. 30 GB new mails per day. > Two IMAP proxy server get the connections from the users. Atm. without dovecot director. > We've got around 700k connections per day (imap 200k / pop3 500k) Are this the hole connections per day? How many concurrend connections do you have at the same time on each server? > So we want to make a new system. > We desire the new system to use mdbox format ( bigger files, less I/O) > and replication through dovecot replication (active/active) instead of drbd. I have no experience with dovecot replication (Still on our roadmap). We are currently using drbd on a 10Gbit dedicated link. Works very well for us. > Each fileserver should know every mailbox/user and for the time being 2 dovecot proxies for the user connections (IMAP/POP). > (later after the migration from the old system to the new, dovecot director instead of proxies, for caching reasons). As Florian said, enable zlib. This also decreases I/O, but needs a bit more of CPU. But not that much. > > we've got 2 new fileservers, they have each SSD HDDs for "new-storage" > and 7200rpm SATA HDDs on RAID 5 with 10 TB for "alt-storage" > 32 GB RAM per Server You also could move the INDEX files from mdbox to different SSDs. We are doing so with 40k accounts and 2TB user data. Index partition has only 22GB used and is increasing not very fast. > > Do you have some tips for the system? > Do you believe 32 GB RAM are enough for one fileserver each and have you experience with the I/O Waiting problem with huge amounts of Data on the alt-storage? > Could there be issues with the RAM, if one fileserver has a downtime, so the second one has to take over all mailboxes for a short amount of time? I think memory is not the problem. On IMAP/POP3 servers the main problem is I/O. But with dovecot mdbox and index files on SSD's we have no problem at the moment. > > In general are only 2 new fileserver enough or should we think in bigger dimensions, like 4 fileserver > Storage expansion in the new servers should not be a problem (bigger HDDs and a few slots free, so we can expand the raid 5). We are using raid 10 hardware raid controller with cache and sata 7200rpm disks. OK, raid 10 needs more disks, but is much faster than raid 5. Raid 5 is not very fast in my eyes. > > > thank you > kind regards > > Martin Schmidt > Regards Urban From tss at iki.fi Thu Oct 9 22:06:12 2014 From: tss at iki.fi (Timo Sirainen) Date: Fri, 10 Oct 2014 01:06:12 +0300 Subject: Dbox and Exim In-Reply-To: References: Message-ID: <64621E0A-9DFB-4AC8-A732-0B1C02C84388@iki.fi> On 09 Oct 2014, at 15:20, C Peters wrote: > The Dovecot wiki [1] doesn't list either Exim, Postfix or anything > else as supporting the dbox. I did some searching in the Exim > archives and have found only one message mentioning dbox, sdbox or > mdbox. [2] I think an RFC would go a long way towards getting the > format supported. Has Timo, or anyone else, considered submitting an > RFC to the IETF? No, and I don't want it to happen anytime in near future. The dbox format is highly Dovecot-specific, because it relies on Dovecot's index files. These index files are still changing and I'm not sure if they will ever be fully finished. I don't want any other software to even attempt to implement the same functionality. > My question was how are we going to use it if Exim doesn't support it. As others said, use LMTP or dovecot-lda with Sieve filtering. From tss at iki.fi Thu Oct 9 22:14:25 2014 From: tss at iki.fi (Timo Sirainen) Date: Fri, 10 Oct 2014 01:14:25 +0300 Subject: Keywords & sync In-Reply-To: References: <20141007165657.GD21939@sys4.de> <54341CE2.1070109@sys4.de> <54344857.204@smail.inf.fh-brs.de> <54345B11.6090907@myzel.net> Message-ID: <329DF0D9-08C3-4770-BA67-D1EE862B9AFF@iki.fi> On 08 Oct 2014, at 10:36, Steffen Kaiser wrote: >> PS: I really liked to see a feature to limitlessly tag messages with arbitrary text strings from a synced, easily extensible vocubulary :) But storing them as headers might go against the idea of IMAP, to keep message pristine, storing them extra makes much buro-cracy, oh my! > > See, IMAP ANNOTATE rfc5257: > > "this can be used to attach comments and other useful > information to a message. It is also possible to attach annotations > to specific parts of a message, so that, for example, they could be > marked as seen, or important, or a comment added. > " > > this seems to be the last post about it: > http://www.dovecot.org/list/dovecot/2013-February/140526.html > > There probably is a working metadata plugin for Dovecot: > > http://comments.gmane.org/gmane.mail.imap.dovecot/72702 > http://hg.dovecot.org/dovecot-metadata-plugin Newer v2.2.x supports METADATA internally, no need for external plugins. It also supports dsync, ACLs and IMAP commands as mentioned in the first mail. What is still missing is some kind of a quota support, but if you're not too worried about that you can already enable it. Anyway, RFC 5257 is ANNOTATE which is different from METADATA. That is still not implemented by any plugin and its core functionality is also still missing from Dovecot's lib-storage. If you really want to implement it in a quick and dirty way you could use the mailbox METADATA entries to do it by using the IMAP UIDs as part of the mailbox METADATA entry names. Those don't get automatically deleted when mails are expunged, and could have some other problems, but basically it would work.. From vivien at w3.org Wed Oct 8 12:13:43 2014 From: vivien at w3.org (Vivien Lacourba) Date: Wed, 08 Oct 2014 14:13:43 +0200 Subject: [Pigeonhole Sieve interpreter] :create argument and lda_mailbox_autosubscribe setting Message-ID: <1412770423.8665.0.camel@han-solo> Hi, I am using dovecot and dovecot-sieve packages from Debian Wheezy (2.1.7-7+deb7u1). I noticed that while using ":create" (from the mailbox extension) in my Sieve filter and "lda_mailbox_autosubscribe = yes" in Dovecot's LDA config it automatically subscribes to the destination mailbox even if that mailbox already existed. Reading Dovecot's documentation and the mailbox extension RFC it seems subscription should happen only if it is a newly created mailbox and should not happen if the mailbox already existed. http://tools.ietf.org/html/rfc5490#section-3.2 [[ 3.2. ":create" Argument to "fileinto" Command (...) If the mailbox already exists, this argument is ignored. (...) ]] /etc/dovecot/conf.d/15-lda.conf [[ # Should automatically created mailboxes be also automatically subscribed? lda_mailbox_autosubscribe = yes ]] Also I noticed that if I don't use ":create" in my filters and instead set "lda_mailbox_autocreate = yes" in Dovecot's LDA config, then this time the behavior looks correct as the automatic subscription will only happen for a newly created mailbox. Thanks, Vivien -- Vivien Lacourba World Wide Web Consortium Systems & Network Engineer http://www.w3.org vivien at w3.org Tel: +33.4.92.38.78.89 http://www.w3.org/People/Vivien Fax: +33.4.92.38.78.22 -- Vivien Lacourba World Wide Web Consortium Systems & Network Engineer http://www.w3.org vivien at w3.org Tel: +33.4.92.38.78.89 http://www.w3.org/People/Vivien Fax: +33.4.92.38.78.22 From dovecot.org at veggiechinese.net Thu Oct 9 22:52:52 2014 From: dovecot.org at veggiechinese.net (Will Yardley) Date: Thu, 9 Oct 2014 15:52:52 -0700 Subject: Dbox and Exim In-Reply-To: References: Message-ID: <20141009225251.GA9540@aura.veggiechinese.net> On Thu, Oct 09, 2014 at 06:03:57PM +0200, Philon wrote: > > I?m really curious as to if I really understand you correctly. Neither Exim > nor Postfix do need to support any mailbox format. They both should hand > incoming mail to either LDA or LMTP. Postfix has an LDA (local(8)). I believe Exim also has a builtin LDA. local(8) - Postfix local mail delivery Postfix's LDA can write to both Maildir and mbox mailboxes. Of course, both MTAs let you specify an external LDA, but both do have builtin ones. w From andre at rodier.me Fri Oct 10 07:53:35 2014 From: andre at rodier.me (Andre Rodier) Date: Fri, 10 Oct 2014 08:53:35 +0100 Subject: Dbox and Exim In-Reply-To: <64621E0A-9DFB-4AC8-A732-0B1C02C84388@iki.fi> References: <64621E0A-9DFB-4AC8-A732-0B1C02C84388@iki.fi> Message-ID: <5437907F.3070204@rodier.me> On 09/10/14 23:06, Timo Sirainen wrote: > On 09 Oct 2014, at 15:20, C Peters wrote: > >> The Dovecot wiki [1] doesn't list either Exim, Postfix or anything >> else as supporting the dbox. I did some searching in the Exim >> archives and have found only one message mentioning dbox, sdbox or >> mdbox. [2] I think an RFC would go a long way towards getting the >> format supported. Has Timo, or anyone else, considered submitting an >> RFC to the IETF? > > No, and I don't want it to happen anytime in near future. The dbox format is highly Dovecot-specific, because it relies on Dovecot's index files. These index files are still changing and I'm not sure if they will ever be fully finished. I don't want any other software to even attempt to implement the same functionality. > >> My question was how are we going to use it if Exim doesn't support it. > > As others said, use LMTP or dovecot-lda with Sieve filtering. > Hi, I am sorry if I am presumptuous or out of topic, but it seems to me that the mail storage should be standardised. I am still using Maildir myself, simply because I like the simplicity, one file is one email, one directory is one email folder, for backup or restore. The only thing I don't like is the naming convention, but I don't know if a file system exists today to store such information in label or tags associated to each file. Regarding the optimisation, I think it's the file system's role, albeit I appreciate Dovecot's efforts to optimise the storage by taking in consideration file system's specificities. A feature I would like, is dovecot being able to store emails in databases, SQL or NoSQL. I would use this for archiving and queries purposes. MariaDB / Drizzle, or MongoDB, CouchDB, etc. There is plenty of choice. Maybe this storage scheme would be slower, but IMHO, this is not a problem when people just want to archive their emails on a remote computer. Maybe I could start this if I had some template or example to start. Kind regards, Andr?. From apm at one.com Fri Oct 10 08:05:33 2014 From: apm at one.com (Peter Mogensen) Date: Fri, 10 Oct 2014 10:05:33 +0200 Subject: 2.2.14rc1 - dsync in backup mode still changes source permissions Message-ID: <5437934D.6070903@one.com> Hi, It seems we are still able to reproduce this: http://www.dovecot.org/list/dovecot/2014-May/096367.html However... there's no longer any error-messages. It just silently changes permissions on some dovecot files in the source maildir. (most often dovecot-uidlist) We're running dsync as root, with hardwired userdb values for other reasons. So it has the OS permissions to change source. But still, running in "backup" shouldn't change source ever, should it? The command line is of this format - running on destination-host: # dsync -R -o mail_home=/users/user/maildir backup ssh -c arcfour -o StrictHostKeyChecking=no -i /root/.ssh/id-rsa-dsync source-host "dsync -o mail_home=/users/user/maildir" /Peter From rs at sys4.de Fri Oct 10 08:10:55 2014 From: rs at sys4.de (Robert Schetterer) Date: Fri, 10 Oct 2014 10:10:55 +0200 Subject: Dbox and Exim In-Reply-To: <5437907F.3070204@rodier.me> References: <64621E0A-9DFB-4AC8-A732-0B1C02C84388@iki.fi> <5437907F.3070204@rodier.me> Message-ID: <5437948F.1040205@sys4.de> Am 10.10.2014 um 09:53 schrieb Andre Rodier: > On 09/10/14 23:06, Timo Sirainen wrote: >> On 09 Oct 2014, at 15:20, C Peters wrote: >> >>> The Dovecot wiki [1] doesn't list either Exim, Postfix or anything >>> else as supporting the dbox. I did some searching in the Exim >>> archives and have found only one message mentioning dbox, sdbox or >>> mdbox. [2] I think an RFC would go a long way towards getting the >>> format supported. Has Timo, or anyone else, considered submitting an >>> RFC to the IETF? >> >> No, and I don't want it to happen anytime in near future. The dbox >> format is highly Dovecot-specific, because it relies on Dovecot's >> index files. These index files are still changing and I'm not sure if >> they will ever be fully finished. I don't want any other software to >> even attempt to implement the same functionality. >> >>> My question was how are we going to use it if Exim doesn't support it. >> >> As others said, use LMTP or dovecot-lda with Sieve filtering. >> > > Hi, > > I am sorry if I am presumptuous or out of topic, but it seems to me that > the mail storage should be standardised. Not really, its good to have many options > > I am still using Maildir myself, simply because I like the simplicity, > one file is one email, one directory is one email folder, for backup or > restore. > > The only thing I don't like is the naming convention, but I don't know > if a file system exists today to store such information in label or tags > associated to each file. > > Regarding the optimisation, I think it's the file system's role, albeit > I appreciate Dovecot's efforts to optimise the storage by taking in > consideration file system's specificities. > > A feature I would like, is dovecot being able to store emails in > databases, SQL or NoSQL. I would use this for archiving and queries > purposes. MariaDB / Drizzle, or MongoDB, CouchDB, etc. There is plenty > of choice. agreed, its good to have more options > > Maybe this storage scheme would be slower, but IMHO, this is not a > problem when people just want to archive their emails on a remote computer. why not using bcc stuff with i.e postfix perhaps see https://sys4.de/de/blog/2013/02/07/mailarchiv-mit-dovecot-und-postfix-sortiert-nach-datum-mailadressen-und-ein-ausgehend-unterordnern/ sorry german > > Maybe I could start this if I had some template or example to start. > > Kind regards, > Andr?. Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From marcel.cochem at googlemail.com Fri Oct 10 08:17:27 2014 From: marcel.cochem at googlemail.com (marcel.cochem) Date: Fri, 10 Oct 2014 10:17:27 +0200 Subject: question: dovecot lda running as special user (vmail) or normal user (marcel)? In-Reply-To: References: Message-ID: Dear Mailing List, (version and dovecot -n at the bottom) (Sorry for the bad English in this mail :) ) I'm new to dovecot and wanted to build my own mailserver using dovecot+postfix. I currently have a Problem with Permissions with my mailfolder. I could solve it easily if i set it with chmod to 777. but thats no real solution. While reading my log files i see a lot messages like: Oct 10 05:19:52 lda(owncloud): Error: user owncloud: Initialization failed: Initializing mail storage from mail_location setting failed: stat(/home/vmail/example.com/owncloud/mail) failed: Permission denied (euid=100(owncloud) egid=1004(owncloud) missing +x perm: /home/vmail, dir owned by 5000:5000 mode=0700) Oct 10 05:19:52 lda(owncloud): Fatal: Invalid user settings. Refer to server log for more information. So Currently two Users need to acces the mail-folder: 1. The user itself (here: owncloud) 2. The vmail user I want to use dovecot with virtual users. Now the question is: shouldn't the directory be accessed only by the vmail user? and not by the owncloud user? Second Quest: If it's correct that the access is made by 2 users: what rights do they need? I Cant add all users to the group vmail and set g+rwx Permissions (every user could read mails from other users, and even edit them!) Thanks a Lot. Kind Regards, Marcel ------------------------------ ------------------------------------------------------------------------------------ dovecot --version 2.2.13 dovecot -n # 2.2.13: /etc/dovecot/dovecot.conf # OS: Linux 3.13.0-37-generic x86_64 Ubuntu 14.04.1 LTS ext4 auth_mechanisms = plain login auth_verbose = yes info_log_path = /var/log/dovecot-info.log log_path = /var/log/dovecot.log mail_home = /home/vmail/example.com/%n mail_location = maildir:/home/vmail/example.com/%n/mail:LAYOUT=fs managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave duplicate namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = } passdb { args = username_format=%u scheme=ssha512 /etc/dovecot/passwd.db driver = passwd-file } plugin { sieve = ~/.dovecot.sieve sieve_after = /home/vmail/sieve-after sieve_before = /home/vmail/sieve-before sieve_dir = ~/sieve } protocols = imap sieve service auth { unix_listener /var/spool/postfix/private/dovecot-auth { group = postfix mode = 0660 user = postfix } } ssl_cert = was automatically rejected:%n%r } On Fri, Oct 10, 2014 at 10:13 AM, marcel.cochem < marcel.cochem at googlemail.com> wrote: > Dear Mailing List, > > (version and dovecot -n at the bottom) > (Sorry for the bad English in this mail :) ) > > I'm new to dovecot and wanted to build my own mailserver using > dovecot+postfix. > I currently have a Problem with Permissions with my mailfolder. > I could solve it easily if i set it with chmod to 777. but thats no real > solution. > > While reading my log files i see a lot messages like: > Oct 10 05:19:52 lda(owncloud): Error: user owncloud: Initialization > failed: Initializing mail storage from mail_location setting failed: > stat(/home/vmail/example.com/owncloud/mail) failed: Permission denied > (euid=100(owncloud) egid=1004(owncloud) missing +x perm: /home/vmail, dir > owned by 5000:5000 mode=0700) > Oct 10 05:19:52 lda(owncloud): Fatal: Invalid user settings. Refer to > server log for more information. > > So Currently two Users need to acces the mail-folder: > 1. The user itself (here: owncloud) > 2. The vmail user > > I want to use dovecot with virtual users. Now the question is: shouldn't > the directory be accessed only by the vmail user? and not by the owncloud > user? > > Second Quest: > If it's correct that the access is made by 2 users: what rights do they > need? > I Cant add all users to the group vmail and set g+rwx Permissions (every > user could read mails from other users, and even edit them!) > > Thanks a Lot. > Kind Regards, > > Marcel > > ------------------------------------------------------------------------------------------------------------------ > > dovecot --version > 2.2.13 > > dovecot -n > # 2.2.13: /etc/dovecot/dovecot.conf > # OS: Linux 3.13.0-37-generic x86_64 Ubuntu 14.04.1 LTS ext4 > auth_mechanisms = plain login > auth_verbose = yes > info_log_path = /var/log/dovecot-info.log > log_path = /var/log/dovecot.log > mail_home = /home/vmail/example.com/%n > mail_location = maildir:/home/vmail/example.com/%n/mail:LAYOUT=fs > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope encoded-character > vacation subaddress comparator-i;ascii-numeric relational regex imap4flags > copy include variables body enotify environment mailbox date ihave duplicate > namespace inbox { > inbox = yes > location = > mailbox Drafts { > auto = subscribe > special_use = \Drafts > } > mailbox Junk { > auto = subscribe > special_use = \Junk > } > mailbox Sent { > auto = subscribe > special_use = \Sent > } > mailbox "Sent Messages" { > auto = subscribe > special_use = \Sent > } > mailbox Trash { > auto = subscribe > special_use = \Trash > } > prefix = > } > passdb { > args = username_format=%u scheme=ssha512 /etc/dovecot/passwd.db > driver = passwd-file > } > plugin { > sieve = ~/.dovecot.sieve > sieve_after = /home/vmail/sieve-after > sieve_before = /home/vmail/sieve-before > sieve_dir = ~/sieve > } > protocols = imap sieve > service auth { > unix_listener /var/spool/postfix/private/dovecot-auth { > group = postfix > mode = 0660 > user = postfix > } > } > ssl_cert = ssl_cipher_list = > ECDH+AESGCM:DH+AESGCM:ECDH+AES256:DH+AES256:ECDH+AES128:DH+AES:ECDH+3DES:DH+3DES:RSA+AES:RSA+3DES:!ADH:!AECDH:!MD5:!DSS > ssl_client_ca_dir = /etc/ssl/certs > ssl_key = userdb { > args = uid=5000 gid=5000 home=/home/vmail/example.com/%n > driver = static > } > protocol imap { > imap_client_workarounds = delay-newmail tb-extra-mailbox-sep > mail_max_userip_connections = 10 > } > protocol lda { > deliver_log_format = msgid=%m: %$ > mail_plugins = sieve > postmaster_address = postmaster at example.com > quota_full_tempfail = yes > rejection_reason = Your message to <%t> was automatically rejected:%n%r > } > > From marcel.cochem at googlemail.com Fri Oct 10 08:21:32 2014 From: marcel.cochem at googlemail.com (marcel.cochem) Date: Fri, 10 Oct 2014 10:21:32 +0200 Subject: question: dovecot lda running as special user (vmail) or normal user (marcel)? Message-ID: Dear Mailing List, (version and dovecot -n at the bottom) (Sorry for the bad English in this mail :) ) I'm new to dovecot and wanted to build my own mailserver using dovecot+postfix. I currently have a Problem with Permissions with my mailfolder. I could solve it easily if i set it with chmod to 777. but thats no real solution. While reading my log files i see a lot messages like: Oct 10 05:19:52 lda(owncloud): Error: user owncloud: Initialization failed: Initializing mail storage from mail_location setting failed: stat(/home/vmail/example.com/owncloud/mail) failed: Permission denied (euid=100(owncloud) egid=1004(owncloud) missing +x perm: /home/vmail, dir owned by 5000:5000 mode=0700) Oct 10 05:19:52 lda(owncloud): Fatal: Invalid user settings. Refer to server log for more information. So Currently two Users need to acces the mail-folder: 1. The user itself (here: owncloud) 2. The vmail user I want to use dovecot with virtual users. Now the question is: shouldn't the directory be accessed only by the vmail user? and not by the owncloud user? Second Quest: If it's correct that the access is made by 2 users: what rights do they need? I Cant add all users to the group vmail and set g+rwx Permissions (every user could read mails from other users, and even edit them!) Thanks a Lot. Kind Regards, Marcel ------------------------------ ------------------------------------------------------------------------------------ dovecot --version 2.2.13 dovecot -n # 2.2.13: /etc/dovecot/dovecot.conf # OS: Linux 3.13.0-37-generic x86_64 Ubuntu 14.04.1 LTS ext4 auth_mechanisms = plain login auth_verbose = yes info_log_path = /var/log/dovecot-info.log log_path = /var/log/dovecot.log mail_home = /home/vmail/example.com/%n mail_location = maildir:/home/vmail/example.com/%n/mail:LAYOUT=fs managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave duplicate namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = } passdb { args = username_format=%u scheme=ssha512 /etc/dovecot/passwd.db driver = passwd-file } plugin { sieve = ~/.dovecot.sieve sieve_after = /home/vmail/sieve-after sieve_before = /home/vmail/sieve-before sieve_dir = ~/sieve } protocols = imap sieve service auth { unix_listener /var/spool/postfix/private/dovecot-auth { group = postfix mode = 0660 user = postfix } } ssl_cert = was automatically rejected:%n%r } From philipp at devh.de Fri Oct 10 08:47:46 2014 From: philipp at devh.de (Philipp Resch) Date: Fri, 10 Oct 2014 10:47:46 +0200 Subject: Migrating to Dovecot EE Message-ID: <54379D32.50809@devh.de> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hello everyone! I am currently running dovecot 2.2.9 on my Debian Wheezy system. As this version is a bit outdated and I'm not too keen on compiling Dovecot myself I was thinking about moving to the Dovecot EE repository. I already have access to the repository, and now before I starting "apt-getting" all kinds of packages: What would be the best way on moving to the Dovecot EE repository? Just doing an apt-get install dovecot-ee? Will it replace the current version? Or should the old version be removed before installing the new one? Has anyone ever done this and has some advice for me? Thanks in advance, Philipp -----BEGIN PGP SIGNATURE----- iQEcBAEBAgAGBQJUN50yAAoJEC6sCbYfpzg9ilcH/iREEyhyygKEVrCyLRjutcLm iLa63KHCFGFjU3b5igZFD+Jv1uZmHfyLh+ZFz0ditHmS1jbNE49WKGawAuoBb3lv VqMCex3qsOA9OVdAbPYUCecs7K18Oo8DjwFpI4Sn70flsaFpo3JS32I/dZ9OMF7d p9O/G1PfJ4mw4zWC0HGgE7kluYytPBJTw2rqqAyjHXypQhcpiF+HHtFm/pX9SF4U b4K5YqfFJE/Bk7YYEdnQFyribcDxkllIzeAt09EhpEwZHK8MTWi92PwnHDcTX3M4 P7JnmSO3YtfSphbqDOFZgAYz2otEAPgysXu3v4asLkcoiPQb/H7hUlcNZyzLeIo= =fu6j -----END PGP SIGNATURE----- From sven at svenhartge.de Fri Oct 10 09:09:56 2014 From: sven at svenhartge.de (Sven Hartge) Date: Fri, 10 Oct 2014 11:09:56 +0200 Subject: Migrating to Dovecot EE References: <54379D32.50809@devh.de> Message-ID: <0b2asa4qarv8@mids.svenhartge.de> Philipp Resch wrote: > I am currently running dovecot 2.2.9 on my Debian Wheezy system. As > this version is a bit outdated and I'm not too keen on compiling > Dovecot myself I was thinking about moving to the Dovecot EE > repository. I already have access to the repository, and now before I > starting "apt-getting" all kinds of packages: What would be the best > way on moving to the Dovecot EE repository? Just doing an apt-get > install dovecot-ee? Will it replace the current version? Or should the > old version be removed before installing the new one? Has anyone ever > done this and has some advice for me? I've done it like this: 1) backup /etc/dovecot 2) purge old dovecot packages This removes all dovecot internal users, but do not worry, they will be recreated by the dovecot-ee packages. This also deletes all config files, but you have a backup from step 1. 3) install dovecot-ee packages 4) put config files from backup back to /etc/dovecot Beware: the pacakge system allows you to replace the old dovecot packages with the dovecot-ee packages, but due to the way the Debian package system works, this will wreck your dovecot-configuration once you finally purge the old packages, because then this also purges the old config files and deletes the dovecot-internal users (like dovenull). This is why it is very important to _first_ delete _and_ purge the old packages before installation of the dovecot-ee packages. Gr??e, Sven. -- Sigmentation fault. Core dumped. From skdovecot at smail.inf.fh-brs.de Fri Oct 10 09:27:33 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Fri, 10 Oct 2014 11:27:33 +0200 (CEST) Subject: question: dovecot lda running as special user (vmail) or normal user (marcel)? In-Reply-To: References: Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Fri, 10 Oct 2014, marcel.cochem wrote: > I'm new to dovecot and wanted to build my own mailserver using > dovecot+postfix. > I currently have a Problem with Permissions with my mailfolder. > I could solve it easily if i set it with chmod to 777. but thats no real > solution. > > While reading my log files i see a lot messages like: > Oct 10 05:19:52 lda(owncloud): Error: user owncloud: Initialization failed: > Initializing mail storage from mail_location setting failed: > stat(/home/vmail/example.com/owncloud/mail) failed: Permission denied > (euid=100(owncloud) egid=1004(owncloud) missing +x perm: /home/vmail, dir > owned by 5000:5000 mode=0700) > Oct 10 05:19:52 lda(owncloud): Fatal: Invalid user settings. Refer to > server log for more information. > > So Currently two Users need to acces the mail-folder: > 1. The user itself (here: owncloud) > 2. The vmail user > I want to use dovecot with virtual users. Now the question is: shouldn't > the directory be accessed only by the vmail user? and not by the owncloud > user? postfix starts the LDA as owncloud user, looks like you set postfix up to use system users. Either make it use the vmail user or use LMTP. >> userdb { >> args = uid=5000 gid=5000 home=/home/vmail/example.com/%n >> driver = static >> } Via IMAP/POP3 and LMTP all users will use these settings. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBVDemh3z1H7kL/d9rAQIMxwf/cLh7M/VVUzweg5Vg1hQZx5rneCh/Lj6l 7NK1HSwEaXz/4u6kVQOpqXXRUhjHz9DXgAh6blQDifXOVHY3V1MpDleg8DKzHeah wmhnfw3jWNuAGWd7z96Iys8mjuopPz35hy6nhVVwQtmv3wbFdqqch4PrCa2pOnvc gnWUaht2wSdHhAP4ZCyNY5zWPPEQtIigpXqcYpfIRXVg/wO9TiYH0Uww6BBZvNUl W/LRlS2E0jlQeacAueyRcdjoMuKC0ki/2ao12GWBffGW+2EJTD8U6dSTu4Ogviyr g8SsPqUIG4NpQAvB2T5XwjECmsiR2gkxYaEJ8tLki0vUj4iQDGFgOA== =aeeT -----END PGP SIGNATURE----- From martinschmidtii at gmx.de Fri Oct 10 11:31:11 2014 From: martinschmidtii at gmx.de (Martin Schmidt) Date: Fri, 10 Oct 2014 13:31:11 +0200 Subject: dovecot replication (active-active) - server specs In-Reply-To: <5436D6C2.3060303@enas.net> References: <5436D6C2.3060303@enas.net> Message-ID: <5437C37F.20206@gmx.de> Hello Am 09.10.2014 um 20:41 schrieb Urban Loesch: > Hi, > > Am 09.10.2014 12:35, schrieb Martin Schmidt: > >> Our MX server is delivering ca. 30 GB new mails per day. >> Two IMAP proxy server get the connections from the users. Atm. >> without dovecot director. >> We've got around 700k connections per day (imap 200k / pop3 500k) > > Are this the hole connections per day? How many concurrend connections > do you have at the same time on each server? we've got 3 Fileserver with ca. 1200 concurrend IMAP connections and ca. 50 concurrend POP3 connections on each server. > >> So we want to make a new system. >> We desire the new system to use mdbox format ( bigger files, less I/O) >> and replication through dovecot replication (active/active) instead >> of drbd. > > I have no experience with dovecot replication (Still on our roadmap). > We are currently using drbd on a 10Gbit dedicated link. Works very > well for us. > >> Each fileserver should know every mailbox/user and for the time being >> 2 dovecot proxies for the user connections (IMAP/POP). >> (later after the migration from the old system to the new, dovecot >> director instead of proxies, for caching reasons). > > As Florian said, enable zlib. This also decreases I/O, but needs a bit > more of CPU. But not that much. Yes we have enabled it, estimated space saving is up to 40% > >> >> we've got 2 new fileservers, they have each SSD HDDs for "new-storage" >> and 7200rpm SATA HDDs on RAID 5 with 10 TB for "alt-storage" >> 32 GB RAM per Server > > You also could move the INDEX files from mdbox to different SSDs. We > are doing so with 40k accounts and 2TB user data. Index partition has > only 22GB used and is increasing not very fast. On our testsystem we've got it also on a raid 1 SSD, only alt-storage is on raid 5. Looks good. > >> >> Do you have some tips for the system? >> Do you believe 32 GB RAM are enough for one fileserver each and have >> you experience with the I/O Waiting problem with huge amounts of Data >> on the alt-storage? >> Could there be issues with the RAM, if one fileserver has a downtime, >> so the second one has to take over all mailboxes for a short amount >> of time? > > I think memory is not the problem. On IMAP/POP3 servers the main > problem is I/O. But with dovecot mdbox and index files on SSD's we > have no problem at the moment. On each of our 3 Fileserver we've got 16 GB RAM, 5-7 GB is used and rest is cached. You might be right, the i/o is always the bottleneck. >> >> In general are only 2 new fileserver enough or should we think in >> bigger dimensions, like 4 fileserver >> Storage expansion in the new servers should not be a problem (bigger >> HDDs and a few slots free, so we can expand the raid 5). > We are using raid 10 hardware raid controller with cache and sata > 7200rpm disks. OK, raid 10 needs more disks, but is much faster than > raid 5. Raid 5 is not very fast in my eyes. We've made tests with raid 10 and raid 5, on 4 sata 7200rpm disks, of course raid 10 was faster, but overall not very much. And you can expand raid 5 easier. Can you tell me, if you have a high "Waiting" on your alt-storage? > >> >> >> thank you >> kind regards >> >> Martin Schmidt >> > > Regards > Urban Thank you for your impressions. kr Martin Schmidt From tmpdovecot at groyaume.com Fri Oct 10 11:50:49 2014 From: tmpdovecot at groyaume.com (Guillaume) Date: Fri, 10 Oct 2014 13:50:49 +0200 Subject: index problem with only 1 folder of 1 box In-Reply-To: <5433BF38.3020904@groyaume.com> References: <5433BF38.3020904@groyaume.com> Message-ID: <5437C819.6080005@groyaume.com> Hello, I retry. Nobody does have an idea about my index problem? The biggest trouble for me is : Is it a solr problem or a dovecot problem? In my opinion, it's more a dovecot problem because the first research after a solr reindex give the good answer. Can someone explains to me how dovecot creates and uses cache please? Once again, sorry for my poor english level. Thank you in advance Guillaume Le 07/10/2014 12:23, Guillaume a ?crit : > Hello, > > First of all, sorry for my poor english level. > > I pass to solr indexing. > > All is OK, except for the inbox of one of the mailboxes. For this inbox > (other folders of the same mailbox have no problems), when i do text > search, there is always no response. > Others mailboxes have no problems. > > If i do a : "doveadm -Dv fts rescan -u mybox at domain.tld", i can do one > and only one search with the correct response. It index the folder, take > a few seconds and give me the good answer. > > If i redo the same search, it's extremly quick with no answers. It's > like a cache problem but i don't know where and why... > Logs are not very verbose... > > Here is an example of command line search : > ---------------------------------------- > > $ nc 127.0.0.1 143 > * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE > IDLE STARTTLS AUTH=PLAIN AUTH=LOGIN] Bienvenue sur le serveur IMAP de > Domain.tld > 10 LOGIN "mybox at domain.tld" "MyBigSecret" > 10 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE > IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS > THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN > NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH > ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE BINARY > MOVE SEARCH=FUZZY QUOTA] Logged in > 20 SELECT INBOX > * FLAGS (\Answered \Flagged \Deleted \Seen \Draft unknown-2 unknown-9 > unknown-0 unknown-10 unknown-1 unknown-4 $MDNSent unknown-3 unknown-8 > $Forwarded NonJunk) > * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft unknown-2 > unknown-9 unknown-0 unknown-10 unknown-1 unknown-4 $MDNSent unknown-3 > unknown-8 $Forwarded NonJunk \*)] Flags permitted. > * 8437 EXISTS > * 0 RECENT > * OK [UIDVALIDITY 1412669180] UIDs valid > * OK [UIDNEXT 8439] Predicted next UID > * OK [HIGHESTMODSEQ 20] Highest > 20 OK [READ-WRITE] Select completed (0.000 secs). > 30 SEARCH text "coucou" > * OK Indexed 14% of the mailbox, ETA 0:57 > * OK Indexed 29% of the mailbox, ETA 0:47 > * OK Indexed 72% of the mailbox, ETA 0:11 > * OK Mailbox indexing finished > * SEARCH 35 108 153 175 176 182 348 357 360 431 472 479 520 574 575 576 > 577 578 586 949 984 1025 1032 1033 1034 1087 1099 1129 1284 1313 1314 > 1315 1366 1372 1465 1538 1711 1726 1758 1759 1969 1981 1983 1984 2036 > 2077 2104 2116 2162 2181 2193 2437 2504 2587 2663 2808 2809 2854 2861 > 2862 3076 3087 3088 3137 3188 3189 3190 3191 3192 3193 3196 3197 3250 > 3251 3252 3327 3328 3329 3330 3331 3332 3379 3464 3481 3494 3521 3528 > 3582 3589 3593 3596 3651 3667 3672 3695 3787 3789 3939 3940 3941 3942 > 3943 3944 3945 3946 4019 4020 4034 4043 4134 4146 4175 4241 4346 4379 > 4422 4490 4491 4537 4540 4542 4543 4544 4550 4627 4727 4742 4767 4790 > 4817 4828 4831 4839 4862 4888 4899 4901 4906 4911 4916 4957 4999 5003 > 5004 5008 5009 5010 5011 5012 5013 5039 5062 5081 5092 5119 5138 5145 > 5150 5152 5185 5186 5187 5216 5246 5247 5282 5283 5314 5316 5320 5322 > 5325 5337 5353 5360 5363 5385 5432 5447 5472 5485 5496 5498 5500 5528 > 5551 5564 5567 5595 5598 5642 5794 5841 5896 5933 5960 5961 5994 6001 > 6005 6016 6017 6051 6075 6125 6152 6163 6215 6238 6239 6240 6241 6287 > 6311 6342 6350 6353 6357 6369 6431 6472 6689 6928 6945 6951 7026 7030 > 7045 7046 7115 7210 7212 7214 7230 7256 7295 7298 7340 7489 7490 7492 > 7654 7655 7658 7660 7676 7767 7768 7800 7801 7913 7937 7956 8075 8085 > 8102 8111 8144 8266 8329 8333 8394 8395 8431 > 30 OK Search completed (36.029 secs). > 40 SEARCH text "coucou" > * SEARCH > 40 OK Search completed (0.002 secs). > 50 SEARCH text "blabla" > * SEARCH > 50 OK Search completed (0.002 secs). > 60 LOGOUT > * BYE Logging out > 60 OK Logout completed. > > ---------------------------------------- > > To close this question, here is dovecot -n: > ---------------------------------------- > # 2.2.9: /etc/dovecot/dovecot.conf > # OS: Linux 3.13.0-36-generic x86_64 Ubuntu 14.04.1 LTS ext4 > auth_mechanisms = plain login > debug_log_path = /var/log/dovecot-debug.log > disable_plaintext_auth = no > first_valid_uid = 5000 > hostname = mailserver.domain.tld > info_log_path = /var/log/dovecot-info.log > last_valid_uid = 5000 > lda_mailbox_autocreate = yes > lda_original_recipient_header = X-Original-To > listen = * > log_path = /var/log/dovecot-err.log > login_greeting = Bienvenue sur le serveur IMAP de Domain.tld > mail_debug = yes > mail_gid = 5000 > mail_location = maildir:/data/mails/%d/%n > mail_plugins = " quota fts fts_solr" > mail_uid = 5000 > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope > encoded-character vacation subaddress comparator-i;ascii-numeric > relational regex imap4flags copy include variables body enotify > environment mailbox date ihave > passdb { > driver = pam > } > passdb { > args = /etc/dovecot/dovecot-sql.conf.ext > driver = sql > } > plugin { > fts = solr > fts_autoindex = yes > fts_solr = break-imap-search url=http://localhost:8080/solr/ > quota = maildir:User quota > sieve = /home/vmail/managesieve/.%n@%d.sieve > sieve_dir = /home/vmail/managesieve/%d/%n > sieve_global_dir = /home/vmail/sieve/ > } > postmaster_address = postmaster at domain.tld > protocols = " imap sieve pop3" > service auth { > unix_listener /var/spool/postfix/private/auth { > group = root > mode = 0660 > user = postfix > } > unix_listener auth-userdb { > group = vmail > mode = 0660 > user = vmail > } > } > service dict { > unix_listener dict { > group = vmail > mode = 0600 > user = vmail > } > } > service managesieve-login { > inet_listener sieve { > port = 4190 > } > inet_listener sieve_deprecated { > port = 2000 > } > } > ssl_ca = ssl_cert = ssl_key = userdb { > driver = passwd > } > userdb { > args = /etc/dovecot/dovecot-sql.conf.ext > driver = sql > } > verbose_proctitle = yes > protocol lmtp { > mail_plugins = " sieve" > } > protocol lda { > mail_plugins = " quota fts fts_solr sieve" > } > protocol imap { > mail_plugins = " quota fts fts_solr imap_quota" > } > ------------------------------- > > By the way, i try to clean solr cache with an : > echo 1 > /proc/sys/vm/drop_caches > > and a restart of the server, but there is always the same problem... > > Does anyone have an idea to explore? > > sincerly yours, > > Guillaume -- Guillaume Buiret-F?dit 22, avenue de la Gare B?t. C1 91570 Bi?vres T?l : 06.61.33.65.75 From teemu.huovila at dovecot.fi Fri Oct 10 12:15:32 2014 From: teemu.huovila at dovecot.fi (Teemu Huovila) Date: Fri, 10 Oct 2014 15:15:32 +0300 Subject: index problem with only 1 folder of 1 box In-Reply-To: <5437C819.6080005@groyaume.com> References: <5433BF38.3020904@groyaume.com> <5437C819.6080005@groyaume.com> Message-ID: <5437CDE4.40408@dovecot.fi> Hello On 10/10/2014 02:50 PM, Guillaume wrote: > The biggest trouble for me is : > Is it a solr problem or a dovecot problem? > > In my opinion, it's more a dovecot problem because the first research after a solr reindex give the good answer. If at all possible, you should try a newer version of Dovecot. There have been quite a few changes to FTS and the SOLR backend since version 2.2.9. See attached log for HG log of changes. Hope this helps. br, Teemu Huovila -------------- next part -------------- A non-text attachment was scrubbed... Name: fts-solr.log Type: text/x-log Size: 38068 bytes Desc: not available URL: From jbehrend at mpifr-bonn.mpg.de Fri Oct 10 12:45:43 2014 From: jbehrend at mpifr-bonn.mpg.de (Jan Behrend) Date: Fri, 10 Oct 2014 14:45:43 +0200 Subject: Question wrt. dovecot replicator In-Reply-To: <5F20B8B3-0908-41C9-A1C4-1FC08265C503@FreeBSD.org> References: <542D1373.9050806@dovecot.fi> <5F20B8B3-0908-41C9-A1C4-1FC08265C503@FreeBSD.org> Message-ID: <1412945143.452.33.camel@jb1.mpifr-bonn.mpg.de> On Fri, 2014-10-03 at 23:37 +0200, Remko Lodder wrote: > >>> How can I determine why there are duplicated emails? Same problem here! > >>> What kind of messages should I specifically look for? > >> Look for any errors and warnings in the Dovecot log. You could also enable mail_debug (ref. > >>> Can I set this up for a few selected accounts instead of all accounts like it was currently? To make sure I do not make things worse for others then needs to be :-) > >>> The service had been disabled for the time being to prevent the other users from getting duplicated emails. > >> I do not know what kind of userdb you are running, but there is a newish patch that enables per user replication via the > >> mail_replica setting. It is not yet included in the newest (2.2.13) release of Dovecot, but is available via the enterprise > >> version. There are no FreeBSD builds for that, though. ref: http://hg.dovecot.org/dovecot-2.2/rev/c1c67bdc8752 > > > > my userdb consists of local users (Which are fed through LDAP at the backend). perhaps I can setup a mailAttributes setting or something so that the replica can be > > set, although I prefer that I have control over that in the config itself :-) With the latest Debian jessie version 1:2.2.13-5 you can actually have a per user mail_replica setting taken from a (LDAP) directory. This keeps the duplicate mail issue away from other users but a few willing to test ... > For what it?s worth: > > replication_dsync_parameters = -f -d -N -l 30 -U I read in Peer Heinlein's Dovecot book http://www.opensourcepress.de/de/produkte/Dovecot/13560/978-3-95539-074-7 that replicating a public namespace gives you trouble :-(. So keep the "-N" option away for now. However I would like examples for the "-n" and "-x" options, which are neither given in the wiki nor in the nonexistant man page. I think the replication feature is very, very cool, but right now it gives me a hard time to implement flawlessly ;-) Thanks for any help or light shed on this issue ... Cheers Jan -- MAX-PLANCK-INSTITUT fuer Radioastronomie Jan Behrend - Rechenzentrum ---------------------------------------- Auf dem Huegel 69, D-53121 Bonn Tel: +49 (228) 525 359, Fax: +49 (228) 525 229 jbehrend at mpifr-bonn.mpg.de http://www.mpifr-bonn.mpg.de -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 198 bytes Desc: This is a digitally signed message part URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/x-pkcs7-signature Size: 6019 bytes Desc: not available URL: From tmpdovecot at groyaume.com Fri Oct 10 12:46:08 2014 From: tmpdovecot at groyaume.com (Guillaume) Date: Fri, 10 Oct 2014 14:46:08 +0200 Subject: index problem with only 1 folder of 1 box In-Reply-To: <5437CDE4.40408@dovecot.fi> References: <5433BF38.3020904@groyaume.com> <5437C819.6080005@groyaume.com> <5437CDE4.40408@dovecot.fi> Message-ID: <5437D510.30801@groyaume.com> Thank you for your answer. I will try to upgrade dovecot. By the way, I erase cache of solr ( *:* ) and the problem is always here... When I will can upgrade dovecot, i will write back to say if its good or not. Sincerely yours, Guillaume Le 10/10/2014 14:15, Teemu Huovila a ?crit : > Hello > > On 10/10/2014 02:50 PM, Guillaume wrote: >> The biggest trouble for me is : >> Is it a solr problem or a dovecot problem? >> >> In my opinion, it's more a dovecot problem because the first research after a solr reindex give the good answer. > If at all possible, you should try a newer version of Dovecot. There have been quite a few changes to FTS and the SOLR backend > since version 2.2.9. See attached log for HG log of changes. Hope this helps. > > br, > Teemu Huovila > From me at junc.eu Fri Oct 10 13:38:34 2014 From: me at junc.eu (Benny Pedersen) Date: Fri, 10 Oct 2014 15:38:34 +0200 Subject: Dbox and Exim In-Reply-To: <5437948F.1040205@sys4.de> References: <64621E0A-9DFB-4AC8-A732-0B1C02C84388@iki.fi> <5437907F.3070204@rodier.me> <5437948F.1040205@sys4.de> Message-ID: <148fa4843a8.280b.d475fad7b14312f5d8424e35e39f7512@junc.eu> On October 10, 2014 10:10:55 AM Robert Schetterer wrote: > sorry german Why sorry ?, its more sad to see it repeated Men m?ske skulle jeg bare skrive bl?b?rgr?d ? :) From tk at giga.or.at Fri Oct 10 15:07:38 2014 From: tk at giga.or.at (Thomas Klausner) Date: Fri, 10 Oct 2014 17:07:38 +0200 Subject: fixes for quota support on NetBSD Message-ID: <20141010150738.GB997@danbala.tuwien.ac.at> Hi! dovecot-2.2.13 already has quota support for NetBSD, but it's buggy. The attached patches by Manuel Bouyer fix the issues. There is one thing that's not nice in them: one include is now for "/usr/include/quota.h" since dovecot comes with its own file "quota.h" which is earlier in the search path. Perhaps dovecot's copy can be renamed to dovecot-quota.h or to some other non-conflicting name? Cheers, Thomas -------------- next part -------------- $NetBSD: patch-src_plugins_quota_quota-fs.c,v 1.4 2013/08/05 23:12:42 bouyer Exp $ fix support for NetBSD's libquota --- src/plugins/quota/quota-fs.c.orig 2013-02-26 09:42:04.000000000 +0100 +++ src/plugins/quota/quota-fs.c 2013-08-06 01:00:32.000000000 +0200 @@ -672,34 +672,38 @@ { struct quotakey qk; struct quotaval qv; + struct quotahandle *qh; + int ret; - if (root->qh == NULL) { - if ((root->qh = quota_open(root->mount->mount_path)) == NULL) { - i_error("cannot open quota for %s: %m", - root->mount->mount_path); - fs_quota_root_disable(root, group); - return 0; - } - } + if ((qh = quota_open(root->mount->mount_path)) == NULL) { + i_error("cannot open quota for %s: %m", + root->mount->mount_path); + fs_quota_root_disable(root, group); + return 0; + } qk.qk_idtype = group ? QUOTA_IDTYPE_GROUP : QUOTA_IDTYPE_USER; qk.qk_id = group ? root->gid : root->uid; qk.qk_objtype = bytes ? QUOTA_OBJTYPE_BLOCKS : QUOTA_OBJTYPE_FILES; - if (quota_get(root->qh, &qk, &qv) != 0) { + if (quota_get(qh, &qk, &qv) != 0) { if (errno == ESRCH) { fs_quota_root_disable(root, group); return 0; } i_error("quotactl(Q_GETQUOTA, %s) failed: %m", root->mount->mount_path); - return -1; + ret = -1; + goto end; } *value_r = qv.qv_usage * DEV_BSIZE; *limit_r = qv.qv_softlimit * DEV_BSIZE; - return 1; + ret = 1; +end: + quota_close(qh); + return ret; } #endif -------------- next part -------------- $NetBSD: patch-src_plugins_quota_quota-fs.h,v 1.4 2013/08/05 23:12:42 bouyer Exp $ fix support for NetBSD's libquota --- src/plugins/quota/quota-fs.h.orig 2013-08-06 00:53:34.000000000 +0200 +++ src/plugins/quota/quota-fs.h 2013-08-06 00:54:29.000000000 +0200 @@ -7,7 +7,8 @@ #endif #ifdef HAVE_QUOTA_OPEN -# include /* NetBSD with libquota */ +/* absolute path to avoid confusion with ./quota.h */ +# include "/usr/include/quota.h" /* NetBSD with libquota */ #endif #ifdef HAVE_SYS_QUOTA_H From rs at sys4.de Fri Oct 10 15:20:16 2014 From: rs at sys4.de (Robert Schetterer) Date: Fri, 10 Oct 2014 17:20:16 +0200 Subject: Dbox and Exim In-Reply-To: <148fa4843a8.280b.d475fad7b14312f5d8424e35e39f7512@junc.eu> References: <64621E0A-9DFB-4AC8-A732-0B1C02C84388@iki.fi> <5437907F.3070204@rodier.me> <5437948F.1040205@sys4.de> <148fa4843a8.280b.d475fad7b14312f5d8424e35e39f7512@junc.eu> Message-ID: <5437F930.8060509@sys4.de> Am 10.10.2014 um 15:38 schrieb Benny Pedersen: > On October 10, 2014 10:10:55 AM Robert Schetterer wrote: > >> sorry german > > Why sorry ?, its more sad to see it repeated > > Men m?ske skulle jeg bare skrive bl?b?rgr?d ? :) jIyajbe' Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From mark at msapiro.net Fri Oct 10 16:14:31 2014 From: mark at msapiro.net (Mark Sapiro) Date: Fri, 10 Oct 2014 09:14:31 -0700 Subject: Error with dovecot 2.2.14rc1 Message-ID: <543805E7.9010000@msapiro.net> I don't know if this is significant or not, but it is at least unusual here. First we see this: > Oct 9 10:10:03 sbh16 dovecot: imap(mark): Error: Sync failed for mbox file /var/spool/mail/mark: seq=393 uid=201517 uid_broken=0 originally needed 0 bytes, now needs 66 bytes which has apparently added 66 bytes to UID 201517 Then, later we see: > Oct 9 11:26:19 sbh16 dovecot: imap(mark): Error: Cached message size larger than expected (32353 > 32287) > Oct 9 11:26:19 sbh16 dovecot: imap(mark): Error: Corrupted index cache file /home/mark/Mail/.imap/INBOX/dovecot.index.cache: Broken physical size for mail UID 201517 > Oct 9 11:26:19 sbh16 dovecot: imap(mark): Error: read(/var/spool/mail/mark) failed: Cached message size larger than expected (32353 > 32287) (FETCH BODY[] for mailbox INBOX UID 201517) > Oct 9 11:26:19 sbh16 dovecot: imap(mark): Disconnected: FETCH read() failed in=10948 out=1206206 As of now (almost 22 hours later) these are the only dovecot Error messages in the log. Going back a full month, we see this under dovecot 2.2.13 > Sep 9 10:18:01 sbh16 dovecot: imap(mark): Error: Sync failed for mbox file /var/spool/mail/mark: seq=198 uid=198968 uid_broken=0 originally needed 0 bytes, now needs 66 bytes but no subsequent errors like yesterday. -- Mark Sapiro The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan From tss at iki.fi Fri Oct 10 21:52:43 2014 From: tss at iki.fi (Timo Sirainen) Date: Sat, 11 Oct 2014 00:52:43 +0300 Subject: 2.2.14rc1 - dsync in backup mode still changes source permissions In-Reply-To: <5437934D.6070903@one.com> References: <5437934D.6070903@one.com> Message-ID: On 10 Oct 2014, at 11:05, Peter Mogensen wrote: > It seems we are still able to reproduce this: > http://www.dovecot.org/list/dovecot/2014-May/096367.html > > However... there's no longer any error-messages. It just silently changes permissions on some dovecot files in the source maildir. (most often dovecot-uidlist) > > We're running dsync as root, with hardwired userdb values for other reasons. So it has the OS permissions to change source. But still, running in "backup" shouldn't change source ever, should it? It's not doing any changes to mailbox contents, but it's still updating the index/uidlist files as part of its normal operation. > The command line is of this format - running on destination-host: > > > # dsync -R -o mail_home=/users/user/maildir backup ssh -c arcfour -o StrictHostKeyChecking=no -i /root/.ssh/id-rsa-dsync source-host "dsync -o mail_home=/users/user/maildir" You should use -u user at domain parameter in both sides so it drops root privileges. From tss at iki.fi Fri Oct 10 22:22:58 2014 From: tss at iki.fi (Timo Sirainen) Date: Sat, 11 Oct 2014 01:22:58 +0300 Subject: 2.2.14rc1 - dsync in backup mode still changes source permissions In-Reply-To: References: <5437934D.6070903@one.com> Message-ID: On 11 Oct 2014, at 00:52, Timo Sirainen wrote: > On 10 Oct 2014, at 11:05, Peter Mogensen wrote: > >> It seems we are still able to reproduce this: >> http://www.dovecot.org/list/dovecot/2014-May/096367.html >> >> However... there's no longer any error-messages. It just silently changes permissions on some dovecot files in the source maildir. (most often dovecot-uidlist) >> >> We're running dsync as root, with hardwired userdb values for other reasons. So it has the OS permissions to change source. But still, running in "backup" shouldn't change source ever, should it? > > It's not doing any changes to mailbox contents, but it's still updating the index/uidlist files as part of its normal operation. > >> The command line is of this format - running on destination-host: >> >> >> # dsync -R -o mail_home=/users/user/maildir backup ssh -c arcfour -o StrictHostKeyChecking=no -i /root/.ssh/id-rsa-dsync source-host "dsync -o mail_home=/users/user/maildir" > > You should use -u user at domain parameter in both sides so it drops root privileges. Oh, and reading the linked mail more closely, if the maildir S=sizes have problems then Dovecot attempts to fix them. It's the same as if you attempted to read the mails via any method. doveadm backup doesn't attempt to read the whole source maildir without any modifications, although it could, but that could cause performance problems. Anyway, if you have broken S=sizes, you could try setting maildir_broken_filename_sizes=yes. From apm at one.com Sat Oct 11 06:51:41 2014 From: apm at one.com (Peter Mogensen) Date: Sat, 11 Oct 2014 08:51:41 +0200 Subject: 2.2.14rc1 - dsync in backup mode still changes source permissions In-Reply-To: References: <5437934D.6070903@one.com> Message-ID: <5438D37D.8030208@one.com> On 2014-10-10 23:52, Timo Sirainen wrote: > It's not doing any changes to mailbox contents, but it's still updating the index/uidlist files as part of its normal operation. I doesn't actually seem to change content of the files. Only permissoins. But given that the docs says (or rather "said") explicitly: "No changes are ever done to the source location." I would expect operations on the "source" to be strictly read only - including permissions. Is the documentation intentionally changed to not make that promise anymore? >> # dsync -R -o mail_home=/users/user/maildir backup ssh -c arcfour -o StrictHostKeyChecking=no -i /root/.ssh/id-rsa-dsync source-host "dsync -o mail_home=/users/user/maildir" > > You should use -u user at domain parameter in both sides so it drops root privileges. Yes... but the problem here is that the current userdb has accounts which can be activated/de-activated and de-activating an account makes the userdb act as it doesn't exist. ... which makes dsync skip it. I realize that's a broken userdb, but the possible work-around was to not do userdb lookups with dsync. /Peter From marcel.cochem at googlemail.com Sat Oct 11 12:52:56 2014 From: marcel.cochem at googlemail.com (marcel.cochem) Date: Sat, 11 Oct 2014 14:52:56 +0200 Subject: question: dovecot lda running as special user (vmail) or normal user (marcel)? In-Reply-To: References: Message-ID: Thank you for that information, unfortunately i didn't figure out how to force postfix to use vmail user. I know that the line in main.cf (postfix) is executed as the user that recieves the mail and not by the vmail user (whole mail.cf file at pastebin : http://pastebin.com/0DsfuwJi): mailbox_command = /usr/lib/dovecot/deliver -c /etc/dovecot/conf.d/01-mail-stack-delivery.conf -m "${EXTENSION}" And the following lines in master.cf (pastebin: http://pastebin.com/G7HKGJtz) looks like it is executed with user vmail: dovecot unix - n n - - pipe flags=DRhu user=vmail:vmail argv=/usr/lib/dovecot/deliver -f ${sender} -d ${recipient} i also tried to add the mailbox_command in the master.cf file dovecot unix - n n - - pipe flags=DRhu user=vmail:vmail argv=/usr/lib/dovecot/deliver -c /etc/dovecot/conf.d/01-mail-stack-delivery.conf -m "${EXTENSION}" -f ${sender} -d ${recipient} but that didn't seem to solve the Problem... To set up the server, i used this tutorial: http://arstechnica.com/information-technology/2014/02/how-to-run-your-own-e-mail-server-with-your-own-domain-part-1/ Can you say what i have to change, or show me another good tutorial which uses postfix+dovecot with virtual users & maildir ? Regards, Marcel On Fri, Oct 10, 2014 at 11:27 AM, Steffen Kaiser < skdovecot at smail.inf.fh-brs.de> wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > On Fri, 10 Oct 2014, marcel.cochem wrote: > > I'm new to dovecot and wanted to build my own mailserver using >> dovecot+postfix. >> I currently have a Problem with Permissions with my mailfolder. >> I could solve it easily if i set it with chmod to 777. but thats no real >> solution. >> >> While reading my log files i see a lot messages like: >> Oct 10 05:19:52 lda(owncloud): Error: user owncloud: Initialization >> failed: >> Initializing mail storage from mail_location setting failed: >> stat(/home/vmail/example.com/owncloud/mail) failed: Permission denied >> (euid=100(owncloud) egid=1004(owncloud) missing +x perm: /home/vmail, dir >> owned by 5000:5000 mode=0700) >> Oct 10 05:19:52 lda(owncloud): Fatal: Invalid user settings. Refer to >> server log for more information. >> >> So Currently two Users need to acces the mail-folder: >> 1. The user itself (here: owncloud) >> 2. The vmail user >> > > I want to use dovecot with virtual users. Now the question is: shouldn't >> the directory be accessed only by the vmail user? and not by the owncloud >> user? >> > > postfix starts the LDA as owncloud user, looks like you set postfix up to > use system users. Either make it use the vmail user or use LMTP. > > userdb { >>> args = uid=5000 gid=5000 home=/home/vmail/example.com/%n >>> driver = static >>> } >>> >> > Via IMAP/POP3 and LMTP all users will use these settings. > > - -- Steffen Kaiser > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1.4.11 (GNU/Linux) > > iQEVAwUBVDemh3z1H7kL/d9rAQIMxwf/cLh7M/VVUzweg5Vg1hQZx5rneCh/Lj6l > 7NK1HSwEaXz/4u6kVQOpqXXRUhjHz9DXgAh6blQDifXOVHY3V1MpDleg8DKzHeah > wmhnfw3jWNuAGWd7z96Iys8mjuopPz35hy6nhVVwQtmv3wbFdqqch4PrCa2pOnvc > gnWUaht2wSdHhAP4ZCyNY5zWPPEQtIigpXqcYpfIRXVg/wO9TiYH0Uww6BBZvNUl > W/LRlS2E0jlQeacAueyRcdjoMuKC0ki/2ao12GWBffGW+2EJTD8U6dSTu4Ogviyr > g8SsPqUIG4NpQAvB2T5XwjECmsiR2gkxYaEJ8tLki0vUj4iQDGFgOA== > =aeeT > -----END PGP SIGNATURE----- > From lists at wildgooses.com Sat Oct 11 17:09:52 2014 From: lists at wildgooses.com (Ed W) Date: Sat, 11 Oct 2014 18:09:52 +0100 Subject: dovecot replication (active-active) - server specs In-Reply-To: References: Message-ID: <54396460.2010404@wildgooses.com> > we've got 2 new fileservers, they have each SSD HDDs for "new-storage" > and 7200rpm SATA HDDs on RAID 5 with 10 TB for "alt-storage" > Friends don't let friends use Raid5... http://www.baarf.com/ (Use Raid6 or something else...) Note, a common counter argument is that someone has "full backups and can survive a rebuild, so the RAID5 is really just to increase uptime". I suggest you do the sums on silent corruption and compare with your data size. Bit rot seems to be an observable problem now. Scrub your arrays regularly and where possible use data integrity checks at higher levels (not much for linux, but ZFS offers this for other OSs) Good luck Ed W From mysql.jorge at decimal.pt Sat Oct 11 21:36:07 2014 From: mysql.jorge at decimal.pt (Jorge Bastos) Date: Sat, 11 Oct 2014 22:36:07 +0100 Subject: New to list / SQL AUTH Message-ID: <003801cfe59b$5e2f1830$1a8d4890$@jorge@decimal.pt> Hi, I'm new to dovecot, and I was reading the manual, to use SQL auth along with virtual domains. So far, it's perfect and does what I need, except for one thing. For each new user, does the directories on the filesystem will be auto-created on 1st login? Thanks in advanced, From malucosfe at gmail.com Sat Oct 11 22:50:21 2014 From: malucosfe at gmail.com (Luciano Gabriel Andino) Date: Sat, 11 Oct 2014 19:50:21 -0300 Subject: courier-imap to dovecot Message-ID: Hello! I am here since my boxes (40000 emails in folders) are not usable with roundcube and courier-imap. Server is core 2 quad, 4GB RAM and 1TB HD. Which are steps for migration for about 40 Maildir boxes to dovecot? -- Saludos!! Luciano Andino GNU/Linux user #185103 Santa Fe - Argentina ----------------------------------------------- From gedalya at gedalya.net Sat Oct 11 22:56:37 2014 From: gedalya at gedalya.net (Gedalya) Date: Sat, 11 Oct 2014 18:56:37 -0400 Subject: New to list / SQL AUTH In-Reply-To: <003801cfe59b$5e2f1830$1a8d4890$@jorge@decimal.pt> References: <003801cfe59b$5e2f1830$1a8d4890$@jorge@decimal.pt> Message-ID: <5439B5A5.8000504@gedalya.net> On 10/11/2014 05:36 PM, Jorge Bastos wrote: > For each new user, does the directories on the filesystem will be > auto-created on 1st login? Yes, as far as permissions on parent directories allow. From tim at bastelfreak.de Sun Oct 12 01:38:15 2014 From: tim at bastelfreak.de (Tim) Date: Sun, 12 Oct 2014 03:38:15 +0200 Subject: Corrupted index cache after migrating from maildir to mdbox In-Reply-To: <542AB304.8030208@bastelfreak.de> References: <54275AD9.2080900@bastelfreak.de> <542A5626.9090001@bastelfreak.de> <542A76BD.7010409@solu.fi> <542AB304.8030208@bastelfreak.de> Message-ID: <5439DB87.7060206@bastelfreak.de> On 30.09.2014 15:41, Tim wrote: > On 30.09.2014 11:24, Toni Mattila wrote: >> Hi, >> >> You have broken maildir files with wrong S= in them. Usually produced >> by maildrop or courier imap's tools. You can fix them with >> http://www.dovecot.org/tools/maildir-size-fix.pl >> > I migrated from maildir to mdbox. Seems like the tool only fixes maildir > format? possible to fix my mdbox? Also I never noticed any error > messages while using maildir. Hey guys, any further thoughts here? >> If you compare ls -la and S= in the files you will see the difference. >> >> Cheers, >> Toni >> >> On 30.9.2014 10:05, Tim wrote: >>> Hi guys, >>> >>> does nobody has any thoughts on this error? >>> >>> >>> On 28.09.2014 02:48, Tim wrote: >>>> Hi guys, >>>> >>>> I'm running dovecot/postfix on my Debian Jessie maschine: >>>> >>>> # dovecot --version >>>> 2.2.13 >>>> doveconf -n output: http://p.bastelfreak.de/HsVwS/ >>>> >>>> today I migrated from maildir(located at /var/vmail) to mdbox with >>>> these >>>> commands: >>>> rsync -av -f"+ */" -f"- *" /var/vmail/ /home/vmail/ >>>> rm /home/vmail/*/*/Maildir -rf >>>> for i in $(doveadm user \*); do u=$(echo $i | cut -d@ -f1); d=$(echo $i >>>> |cut -d@ -f2); dsync -v -u $i mirror mdbox:/home/vmail/$d/$u/mdbox; >>>> done >>>> >>>> Then I changed the mail_location to mdbox:/home/vmail/%d/%n/mdbox and >>>> did the following commands: >>>> >>>> service dovecot restart >>>> for i in $(doveadm user \*); do u=$(echo $i | cut -d@ -f1); d=$(echo $i >>>> |cut -d@ -f2); dsync -v -u $i mirror maildir:/var/vmail/$d/$u/Mail; >>>> done >>>> doveadm index -A all INBOX >>>> for i in $(doveadm user \*); do doveadm -Dv fts rescan -u $i;done >>>> >>>> unfortunately I'm getting the following two kinds of error messages for >>>> all mail boxes in my mail.log: >>>> >>>> Error: Corrupted index cache file >>>> /home/vmail/%domain/%user/mdbox/mailboxes/%maildir/dbox-Mails/dovecot.index.cache: >>>> >>>> Broken virtual size for mail UID 2564 >>>> >>>> and: >>>> >>>> Error: read(/home/vmail/%domain/%user/mdbox/storage/m.108 >>>> ): FETCH BODY[] for mailbox %maildir UID 2564 got too little data: 2417 >>>> vs 6319 >>>> >>>> please let me know if you have any suggestions for fixing this issue or >>>> if you need more information. >>>> >>>> kind regards, Tim From mart at e-positive.ee Sun Oct 12 07:01:32 2014 From: mart at e-positive.ee (Mart Pirita) Date: Sun, 12 Oct 2014 10:01:32 +0300 Subject: CentOS x64 compilation fails. Message-ID: <543A274C.4070702@e-positive.ee> Hello. I have problems to compile Dovecot2.2.13 with rpmbuild using options: ./configure \ --prefix=/usr \ --with-ssl=openssl \ --with-ssldir=/etc/ssl \ --sysconfdir=/etc \ --without-vpopmail \ --with-pam \ --without-bsdauth \ --without-sql \ --without-nss \ --without-ldap \ --without-pgsql \ --without-mysql \ --without-sqlite \ --with-rundir=/var/run/dovecot \ --without-deliver \ --without-gssapi make Using CentOS 5.11, option - rpmbuild -ba dovecot2.2.spec fails with error: /bin/mkdir -p '/var/tmp/dovecot-2.2.13-mp-root/usr/lib64/dovecot' /bin/sh ../../libtool --mode=install /usr/bin/install -c libdovecot-storage.la '/var/tmp/dovecot-2.2.13-mp-root/usr/lib64/dovecot' libtool: install: error: cannot install `libdovecot-storage.la' to a directory not ending in /usr/lib/dovecot make[4]: *** [install-pkglibLTLIBRARIES] Error 1 make[4]: Leaving directory `/usr/src/redhat/BUILD/dovecot-2.2.13/src/lib-storage' make[3]: *** [install-am] Error 2 make[3]: Leaving directory `/usr/src/redhat/BUILD/dovecot-2.2.13/src/lib-storage' make[2]: *** [install-recursive] Error 1 make[2]: Leaving directory `/usr/src/redhat/BUILD/dovecot-2.2.13/src/lib-storage' make[1]: *** [install-recursive] Error 1 make[1]: Leaving directory `/usr/src/redhat/BUILD/dovecot-2.2.13/src' make: *** [install-recursive] Error 1 error: Bad exit status from /var/tmp/rpm-tmp.14076 (%install) RPM build errors: Bad exit status from /var/tmp/rpm-tmp.14076 (%install) But using CentOS 5.11with option- rpmbuild --target=i686 -ba dovecot2.2.spec works fine. However, using CentOS 6.5, with option - rpmbuild -ba dovecot2.2.spec fails with error: /bin/mkdir -p '/root/rpmbuild/BUILDROOT/dovecot-2.2.13-mp.x86_64/usr/lib64/dovecot' /bin/sh ../../libtool --mode=install /usr/bin/install -c libdovecot-storage.la '/root/rpmbuild/BUILDROOT/dovecot-2.2.13-mp.x86_64/usr/lib64/dovecot' libtool: install: error: cannot install `libdovecot-storage.la' to a directory not ending in /usr/lib/dovecot make[4]: *** [install-pkglibLTLIBRARIES] Error 1 make[4]: Leaving directory `/root/rpmbuild/BUILD/dovecot-2.2.13/src/lib-storage' make[3]: *** [install-am] Error 2 make[3]: Leaving directory `/root/rpmbuild/BUILD/dovecot-2.2.13/src/lib-storage' make[2]: *** [install-recursive] Error 1 make[2]: Leaving directory `/root/rpmbuild/BUILD/dovecot-2.2.13/src/lib-storage' make[1]: *** [install-recursive] Error 1 make[1]: Leaving directory `/root/rpmbuild/BUILD/dovecot-2.2.13/src' make: *** [install-recursive] Error 1 error: Bad exit status from /var/tmp/rpm-tmp.HP3meN (%install) RPM build errors: Bad exit status from /var/tmp/rpm-tmp.HP3meN (%install) But when CentOS 5.11with option rpmbuild --target=i686 -ba dovecot2.2.spec suceeds, CentOS 6.5still fails: cpio: dovecot-2.2.13/src/lib-compression/abspath.c: Cannot stat: No such file or directory cpio: dovecot-2.2.13/src/lib-compression/compat.h: Cannot stat: No such file or directory cpio: dovecot-2.2.13/src/lib-compression/lib.h: Cannot stat: No such file or directory 18096 blocks + /usr/lib/rpm/check-buildroot /root/rpmbuild/BUILDROOT/dovecot-2.2.13-mp.i386/usr/lib/dovecot/dovecot-config:LIBDOVECOT='-L/root/rpmbuild/BUILDROOT/dovecot-2.2.13-mp.i386/usr/lib/dovecot -ldovecot' /root/rpmbuild/BUILDROOT/dovecot-2.2.13-mp.i386/usr/lib/dovecot/dovecot-config:LIBDOVECOT_INCLUDE=-I/root/rpmbuild/BUILDROOT/dovecot-2.2.13-mp.i386/usr/include/dovecot Found '/root/rpmbuild/BUILDROOT/dovecot-2.2.13-mp.i386' in installed files; aborting error: Bad exit status from /var/tmp/rpm-tmp.69mGY0 (%install) RPM build errors: Bad exit status from /var/tmp/rpm-tmp.69mGY0 (%install) How to fix these errors? -- Mart From pada at posteo.de Sun Oct 12 12:54:59 2014 From: pada at posteo.de (Daniel Parthey) Date: Sun, 12 Oct 2014 14:54:59 +0200 Subject: Corrupted index cache after migrating from maildir to mdbox In-Reply-To: <5439DB87.7060206@bastelfreak.de> References: <54275AD9.2080900@bastelfreak.de> <542A5626.9090001@bastelfreak.de> <542A76BD.7010409@solu.fi> <542AB304.8030208@bastelfreak.de> <5439DB87.7060206@bastelfreak.de> Message-ID: <40C363C8-FADD-4A89-95C7-C39EA2300FAD@posteo.de> I think you could try to simply delete dovecot.index.cache file and have dovecot automatically recreate it on the next delivery or login. And then see if the error messages go away for this mailbox. With mdbox the dovecot.index file must not be deleted however, you would otherwise lose "seen" flags. Anyway, better have a backup prepared, before deleting any files ;) Regards Daniel From filbar at centrum.cz Sun Oct 12 17:28:06 2014 From: filbar at centrum.cz (=?utf-8?q?Filip_Bartmann?=) Date: Sun, 12 Oct 2014 19:28:06 +0200 Subject: =?utf-8?q?Dovecot_domain_quota?= Message-ID: <20141012192806.6F97F9E9@centrum.cz> I have dovecot version 2.1.7 and I have quota configured as: ----------------------------------- dict { quota_domain = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } mail_plugins = quota protocol imap { mail_plugins = quota quota imap_quota } plugin { quota = dict:domain:%d:proxy::quota_domain quota_rule = *:storage=1M quota_rule2 = Trash:storage=+100M } ----------------------------------- /etc/dovecot/dovecot-dict-sql.conf.ext: ----------------------------------- map { pattern = priv/quota/storage table = quota_dict username_field = domain value_field = bytes } map { pattern = priv/quota/messages table = quota_dict username_field = domain value_field = messages } map { pattern = shared/expire/$user/$mailbox table = expires value_field = expire_stamp fields { username = $user mailbox = $mailbox } } ----------------------------------- But the problem is that quota table created as: ----------------------------------- CREATE TABLE `quota_dict` ( `domain` varchar(255) NOT NULL, `bytes` bigint(20) NOT NULL DEFAULT '0', `messages` int(5) NOT NULL DEFAULT '0', PRIMARY KEY (`domain`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 ----------------------------------- counts quota only for last user as defined /etc/dovecot/users or in database table. So if I have in /etc/dovecot/users (the contents is from testing VPS): ----------------------------------- test at debian.jd:{plain}radegast:8:8::/srv/mail/debian.jd/::userdb_quota_rule=*:storage=500k bartmann at debian.jd:{plain}radegast:8:8::/srv/mail/debian.jd/::userdb_quota_rule=*:storage=500k ----------------------------------- After running `doveadm quota recalc -A` I have in my db: ----------------------------------- +-----------+--------+----------+ | domain | bytes | messages | +-----------+--------+----------+ | debian.jd | 505758 | 81 | +-----------+--------+----------+ ----------------------------------- whith is from account bartmann at debian.jd not both accounts at testing VPS domain debian.jd. The same is with quota enforcing - quota if enforced on the latter of the accounts in /etc/dovecot/users on testing machine or database in production machine. What I do wrong? Thanks Filip Bartmann From rs at sys4.de Sun Oct 12 19:35:15 2014 From: rs at sys4.de (Robert Schetterer) Date: Sun, 12 Oct 2014 21:35:15 +0200 Subject: Dovecot domain quota In-Reply-To: <20141012192806.6F97F9E9@centrum.cz> References: <20141012192806.6F97F9E9@centrum.cz> Message-ID: <543AD7F3.2060801@sys4.de> Am 12.10.2014 um 19:28 schrieb Filip Bartmann: > I have dovecot version 2.1.7 and I have quota configured as: > ----------------------------------- > dict { > quota_domain = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext > } > mail_plugins = quota > protocol imap { > mail_plugins = quota quota imap_quota > } > plugin { > quota = dict:domain:%d:proxy::quota_domain > quota_rule = *:storage=1M > quota_rule2 = Trash:storage=+100M > } > ----------------------------------- > /etc/dovecot/dovecot-dict-sql.conf.ext: > ----------------------------------- > map { > pattern = priv/quota/storage > table = quota_dict > username_field = domain > value_field = bytes > } > map { > pattern = priv/quota/messages > table = quota_dict > username_field = domain > value_field = messages > } > map { > pattern = shared/expire/$user/$mailbox > table = expires > value_field = expire_stamp > fields { > username = $user > mailbox = $mailbox > } > } > ----------------------------------- > But the problem is that quota table created as: > ----------------------------------- > CREATE TABLE `quota_dict` ( > `domain` varchar(255) NOT NULL, > `bytes` bigint(20) NOT NULL DEFAULT '0', > `messages` int(5) NOT NULL DEFAULT '0', > PRIMARY KEY (`domain`) > ) ENGINE=InnoDB DEFAULT CHARSET=latin1 > ----------------------------------- > counts quota only for last user as defined /etc/dovecot/users or in database table. > So if I have in /etc/dovecot/users (the contents is from testing VPS): > ----------------------------------- > test at debian.jd:{plain}radegast:8:8::/srv/mail/debian.jd/::userdb_quota_rule=*:storage=500k > bartmann at debian.jd:{plain}radegast:8:8::/srv/mail/debian.jd/::userdb_quota_rule=*:storage=500k > ----------------------------------- > After running `doveadm quota recalc -A` I have in my db: > ----------------------------------- > +-----------+--------+----------+ > | domain | bytes | messages | > +-----------+--------+----------+ > | debian.jd | 505758 | 81 | > +-----------+--------+----------+ > ----------------------------------- > whith is from account bartmann at debian.jd not both accounts at testing VPS domain debian.jd. The same is with quota enforcing - quota if enforced on the latter of the accounts in /etc/dovecot/users on testing machine or database in production machine. > > What I do wrong? > Thanks > Filip Bartmann > domain quota may be tricky never tested but perhaps reread http://serverstutorial.wordpress.com/2012/12/28/configuring-domain-user-mailbox-quotas-in-dovecot-via-postfixadmin-on-ubuntu-12-04lts/ http://wiki2.dovecot.org/Quota/Configuration Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From tim at bastelfreak.de Sun Oct 12 22:52:32 2014 From: tim at bastelfreak.de (Tim) Date: Mon, 13 Oct 2014 00:52:32 +0200 Subject: Corrupted index cache after migrating from maildir to mdbox In-Reply-To: <40C363C8-FADD-4A89-95C7-C39EA2300FAD@posteo.de> References: <54275AD9.2080900@bastelfreak.de> <542A5626.9090001@bastelfreak.de> <542A76BD.7010409@solu.fi> <542AB304.8030208@bastelfreak.de> <5439DB87.7060206@bastelfreak.de> <40C363C8-FADD-4A89-95C7-C39EA2300FAD@posteo.de> Message-ID: <543B0630.3010203@bastelfreak.de> Hi, I mv'ed all dovecot.index.cache files for one mailbox away but I still get error messages: Oct 12 22:47:12 mail01 dovecot: imap(foobar at example.com): Error: read(/home/vmail/example.com/foobar/mdbox/storage/m.1): FETCH BODY[] for mailbox INBOX UID 3 got too little data: 738 vs 1543 Oct 12 22:47:12 mail01 dovecot: imap(foobar at example.com): Error: Corrupted index cache file /home/vmail/example.com/foobar/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: Broken virtual size for mail UID 3 So dovecot recreates the cache file but they are instant broken again? Any thoughts here? On 12.10.2014 14:54, Daniel Parthey wrote: > I think you could try to simply delete dovecot.index.cache file and have dovecot automatically recreate it on the next delivery or login. And then see if the error messages go away for this mailbox. > > With mdbox the dovecot.index file must not be deleted however, you would otherwise lose "seen" flags. > > Anyway, better have a backup prepared, before deleting any files ;) > > Regards > Daniel > From gedalya at gedalya.net Sun Oct 12 22:08:03 2014 From: gedalya at gedalya.net (Gedalya) Date: Sun, 12 Oct 2014 18:08:03 -0400 Subject: Dovecot domain quota In-Reply-To: <20141012192806.6F97F9E9@centrum.cz> References: <20141012192806.6F97F9E9@centrum.cz> Message-ID: <543AFBC3.1040801@gedalya.net> On 10/12/2014 01:28 PM, Filip Bartmann wrote: > After running `doveadm quota recalc -A` I have in my db: > ----------------------------------- > +-----------+--------+----------+ > | domain | bytes | messages | > +-----------+--------+----------+ > | debian.jd | 505758 | 81 | > +-----------+--------+----------+ > ----------------------------------- > whith is from accountbartmann at debian.jd not both accounts at testing VPS domain debian.jd. The same is with quota enforcing - quota if enforced on the latter of the accounts in /etc/dovecot/users on testing machine or database in production machine. > > What I do wrong? As I remember from previous conversations here, this is a limitation of the current design. The comment in example-config/conf.d/90-quota.conf says: # Multiple quota roots are also possible, for example this gives each user # their own 100MB quota and one shared 1GB quota within the domain It doesn't really support accounting for the *sum* of *multiple storage quotas* within a domain. As a hack: you can just not run quota recalc ;-) or more realistically, separately track user quotas individually (you really should!), and post recalc immediately update the domain by running something like update domain_quota set bytes=(select sum(bytes) from user_quota where username like '%@debian.jd') where domain='debian.jd'; From aleskandrox at gmail.com Sun Oct 12 22:58:51 2014 From: aleskandrox at gmail.com (aleskandro) Date: Mon, 13 Oct 2014 00:58:51 +0200 Subject: [Dovecot/VirtualUsers/VirtualMailBoxes] No mails into mua Message-ID: <1990311.LQMChl5UHK@panagulis> Hi all, I've configured postfix with multiple host and virtual mailboxes (main.cf is here: http://pastebin.com/798VVxbv). So I can receive email to vuser at mydomain.tld into /var/mail/vhosts/mydomain.tld/vuser file. Now I'm configuring dovecot 2.2.13-r1; this is my dovecot -n and /etc/dovecot/passwddir/mydomain.tld/passwd: http://pastebin.com/b4xcjj7t - The auth and server subscribe from a mua is ok and in the vuser file there are some mails but I can't see them in my mua. mail.log doesn't report any error. Where I'm wrong? Aleskandro From pada at posteo.de Mon Oct 13 00:37:57 2014 From: pada at posteo.de (Daniel Parthey) Date: Mon, 13 Oct 2014 02:37:57 +0200 Subject: Corrupted index cache after migrating from maildir to mdbox In-Reply-To: <543B0630.3010203@bastelfreak.de> References: <54275AD9.2080900@bastelfreak.de> <542A5626.9090001@bastelfreak.de> <542A76BD.7010409@solu.fi> <542AB304.8030208@bastelfreak.de> <5439DB87.7060206@bastelfreak.de> <40C363C8-FADD-4A89-95C7-C39EA2300FAD@posteo.de> <543B0630.3010203@bastelfreak.de> Message-ID: <04A36D03-B15E-425E-9DDD-C3E04844519D@posteo.de> Maybe the index is corrupted too and the index.cache is a cached version of the corrupted index? Are you using NFS with mdbox and accessing one nfs mailbox directory concurrently from several dovecot hosts? From apm at one.com Mon Oct 13 05:36:43 2014 From: apm at one.com (Peter Mogensen) Date: Mon, 13 Oct 2014 07:36:43 +0200 Subject: 2.2.14rc1 - dsync in backup mode still changes source permissions In-Reply-To: <5438D37D.8030208@one.com> References: <5437934D.6070903@one.com> <5438D37D.8030208@one.com> Message-ID: <543B64EB.7090900@one.com> On 2014-10-11 08:51, Peter Mogensen wrote: > ....the docs says (or rather "said") explicitly: > > "No changes are ever done to the source location." ... > > Is the documentation intentionally changed to not make that promise > anymore? I also notice that the "-o" for overriding userdb settings has been removed from the documentation. Is that intentionally? /Peter From tim at bastelfreak.de Mon Oct 13 08:20:36 2014 From: tim at bastelfreak.de (Tim) Date: Mon, 13 Oct 2014 10:20:36 +0200 Subject: Corrupted index cache after migrating from maildir to mdbox In-Reply-To: <04A36D03-B15E-425E-9DDD-C3E04844519D@posteo.de> References: <54275AD9.2080900@bastelfreak.de> <542A5626.9090001@bastelfreak.de> <542A76BD.7010409@solu.fi> <542AB304.8030208@bastelfreak.de> <5439DB87.7060206@bastelfreak.de> <40C363C8-FADD-4A89-95C7-C39EA2300FAD@posteo.de> <543B0630.3010203@bastelfreak.de> <04A36D03-B15E-425E-9DDD-C3E04844519D@posteo.de> Message-ID: <543B8B54.8060707@bastelfreak.de> all mails are stored on an xfs filesystem and only the local dovecot accesses it. Possible to fix the index.cache files? I havn't found anything suitable in the docs. The doveadm-index commands are only for the fts plugin I think. On 13.10.2014 02:37, Daniel Parthey wrote: > Maybe the index is corrupted too and the index.cache is a cached version of the corrupted index? > > Are you using NFS with mdbox and accessing one nfs mailbox directory concurrently from several dovecot hosts? > From bourek at thinline.cz Mon Oct 13 08:47:56 2014 From: bourek at thinline.cz (Jiri Bourek) Date: Mon, 13 Oct 2014 10:47:56 +0200 Subject: Dovecot domain quota In-Reply-To: <543AFBC3.1040801@gedalya.net> References: <20141012192806.6F97F9E9@centrum.cz> <543AFBC3.1040801@gedalya.net> Message-ID: <543B91BC.1060001@thinline.cz> On 13.10.2014 00:08, Gedalya wrote: > On 10/12/2014 01:28 PM, Filip Bartmann wrote: >> After running `doveadm quota recalc -A` I have in my db: >> ----------------------------------- >> +-----------+--------+----------+ >> | domain | bytes | messages | >> +-----------+--------+----------+ >> | debian.jd | 505758 | 81 | >> +-----------+--------+----------+ >> ----------------------------------- >> whith is from accountbartmann at debian.jd not both accounts at testing >> VPS domain debian.jd. The same is with quota enforcing - quota if >> enforced on the latter of the accounts in /etc/dovecot/users on >> testing machine or database in production machine. >> >> What I do wrong? > As I remember from previous conversations here, this is a limitation of > the current design. I remember the same thing. > As a hack: you can just not run quota recalc ;-) or more realistically, > separately track user quotas individually (you really should!), and post > recalc immediately update the domain by running something like > update domain_quota set bytes=(select sum(bytes) from user_quota where > username like '%@debian.jd') where domain='debian.jd'; This won't accout for changes made during the recalc - although to my knowledge it's still the best solution in this type of configuration. When I was trying to make both user and domain quotas work properly, the only way I figured out was to track domain quota as group quota in the filesystem. Forcing users/domains to have separate system user and group of course. From gedalya at gedalya.net Mon Oct 13 09:11:03 2014 From: gedalya at gedalya.net (Gedalya) Date: Mon, 13 Oct 2014 05:11:03 -0400 Subject: Dovecot domain quota In-Reply-To: <543B91BC.1060001@thinline.cz> References: <20141012192806.6F97F9E9@centrum.cz> <543AFBC3.1040801@gedalya.net> <543B91BC.1060001@thinline.cz> Message-ID: <543B9727.9010306@gedalya.net> On 10/13/2014 04:47 AM, Jiri Bourek wrote: >> As a hack: you can just not run quota recalc ;-) or more realistically, >> separately track user quotas individually (you really should!), and post >> recalc immediately update the domain by running something like >> update domain_quota set bytes=(select sum(bytes) from user_quota where >> username like '%@debian.jd') where domain='debian.jd'; > > This won't accout for changes made during the recalc - although to my > knowledge it's still the best solution in this type of configuration. We're talking about making the domain quota equal to the sum of the user quotas, using a single SQL statement. After execution of this statement, the domain quota will be correct, assuming that the user quotas are correct. If recalc doesn't account for changes done during the recalc, then that's a bug. From sottilette at rfx.it Mon Oct 13 11:42:23 2014 From: sottilette at rfx.it (sottilette at rfx.it) Date: Mon, 13 Oct 2014 13:42:23 +0200 (CEST) Subject: delete/archive old mail Message-ID: Hi everybody, I store user's mail in the old mbox format. I have many scripts to manage users that works fine with mbox. I use the very old Expire_mail.pl script to delete mail older than NN days for selected users (nightly cron job). Still works fine with my CentOS dovecot-2.0.16. Now I want move the mail to a sort of archive folder instead of simply deleting it from the inbox for some users. Is there a similar script or some simple triks? Thanks, F. From rs at sys4.de Mon Oct 13 11:46:56 2014 From: rs at sys4.de (Robert Schetterer) Date: Mon, 13 Oct 2014 13:46:56 +0200 Subject: delete/archive old mail In-Reply-To: References: Message-ID: <543BBBB0.7010105@sys4.de> Am 13.10.2014 um 13:42 schrieb sottilette at rfx.it: > > Hi everybody, > I store user's mail in the old mbox format. > I have many scripts to manage users that works fine with mbox. > I use the very old Expire_mail.pl script to delete mail older than NN > days for selected users (nightly cron job). Still works fine with my > CentOS dovecot-2.0.16. > Now I want move the mail to a sort of archive folder instead of simply > deleting it from the inbox for some users. > Is there a similar script or some simple triks? > > Thanks, F. perhaps you will find some ideas here https://sys4.de/de/blog/2013/02/07/mailarchiv-mit-dovecot-und-postfix-sortiert-nach-datum-mailadressen-und-ein-ausgehend-unterordnern/ ... #/bin/bash YEAR=`/bin/date +%Y` /usr/bin/doveadm expunge -d -u *@backup.server.org mailbox user-backup\*$YEAR*\* savedbefore 10d ... Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From bourek at thinline.cz Mon Oct 13 11:49:00 2014 From: bourek at thinline.cz (Jiri Bourek) Date: Mon, 13 Oct 2014 13:49:00 +0200 Subject: Dovecot domain quota In-Reply-To: <543B9727.9010306@gedalya.net> References: <20141012192806.6F97F9E9@centrum.cz> <543AFBC3.1040801@gedalya.net> <543B91BC.1060001@thinline.cz> <543B9727.9010306@gedalya.net> Message-ID: <543BBC2C.9000800@thinline.cz> On 13.10.2014 11:11, Gedalya wrote: > On 10/13/2014 04:47 AM, Jiri Bourek wrote: >>> As a hack: you can just not run quota recalc ;-) or more realistically, >>> separately track user quotas individually (you really should!), and post >>> recalc immediately update the domain by running something like >>> update domain_quota set bytes=(select sum(bytes) from user_quota where >>> username like '%@debian.jd') where domain='debian.jd'; >> >> This won't accout for changes made during the recalc - although to my >> knowledge it's still the best solution in this type of configuration. > We're talking about making the domain quota equal to the sum of the user > quotas, using a single SQL statement. After execution of this statement, > the domain quota will be correct, assuming that the user quotas are > correct. If recalc doesn't account for changes done during the recalc, > then that's a bug. Well if I understand OP's configuration correctly, his Dovecot is not using per-user quotas, which means that when recalc finishes for a mailbox, nothing is updating information about that mailbox. I don't think that's a bug in recalc, just defficiency in OP's setup. Although after reading your post again I now understood you suggested to add per-user quotas into his Dovecot's config too. My bad, that could work. From JEDC at ramboll.com Mon Oct 13 12:30:32 2014 From: JEDC at ramboll.com (Jens Dueholm Christensen) Date: Mon, 13 Oct 2014 12:30:32 +0000 Subject: To dovecot-ee or not to dovecot-ee Message-ID: Hi At the moment I'm running an ageing 2.0.13 install that need to be upgraded and moved to new HW. I was looking around, and saw that dovecot-ee is listed as a "free" (ie. 0$) product on dovecot.fi. Apart from the need to register an account in order to "purchase" an -ee license, are there any cavats by switching to the -ee version compared to compiling and running the regular releases? I've got no problems with downloading, building and installing the normal releases and I have no need for object storage, so will the -ee version give me anything else but access to a YUM repo and RPM packages? Regards, Jens Dueholm Christensen Survey IT From h.reindl at thelounge.net Mon Oct 13 12:35:30 2014 From: h.reindl at thelounge.net (Reindl Harald) Date: Mon, 13 Oct 2014 14:35:30 +0200 Subject: To dovecot-ee or not to dovecot-ee In-Reply-To: References: Message-ID: <543BC712.801@thelounge.net> Am 13.10.2014 um 14:30 schrieb Jens Dueholm Christensen: > I've got no problems with downloading, building and installing the normal releases and I have no need for object storage, so will the -ee version give me anything else but access to a YUM repo and RPM packages? upstream support -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 181 bytes Desc: OpenPGP digital signature URL: From deano-dovecot at areyes.com Mon Oct 13 13:54:34 2014 From: deano-dovecot at areyes.com (deano-dovecot at areyes.com) Date: Mon, 13 Oct 2014 09:54:34 -0400 Subject: To dovecot-ee or not to dovecot-ee In-Reply-To: References: Message-ID: On 2014-10-13 08:30, Jens Dueholm Christensen wrote: > Apart from the need to register an account in order to "purchase" an > -ee license, are there any cavats by switching to the -ee version > compared to compiling and running the regular releases? > > I've got no problems with downloading, building and installing the > normal releases and I have no need for object storage, so will the -ee > version give me anything else but access to a YUM repo and RPM > packages? If you're planning on an Ubuntu platform, right now it only supports 12.04. 14.04 is in the works as I recall, but no idea when. Personally I run 2.2.9-1ubuntu2.1 on Ubuntu 14.04 from stock repo. -- Dean From mysql.jorge at decimal.pt Mon Oct 13 19:10:58 2014 From: mysql.jorge at decimal.pt (Jorge Bastos) Date: Mon, 13 Oct 2014 20:10:58 +0100 Subject: Compile dovecot with sieve/managesieve support Message-ID: <000001cfe719$6c1a8630$444f9290$@jorge@decimal.pt> Hi guys, I'd like to have dovecot with sieve support, but can't find any information on how to enable the sieve/managesieve support. Does anyone can light me up on this? Thanks, From user+dovecot at localhost.localdomain.org Mon Oct 13 19:43:00 2014 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Mon, 13 Oct 2014 19:43:00 +0000 Subject: Compile dovecot with sieve/managesieve support In-Reply-To: <000001cfe719$6c1a8630$444f9290$@jorge@decimal.pt> References: <000001cfe719$6c1a8630$444f9290$@jorge@decimal.pt> Message-ID: <543C2B44.5020005@localhost.localdomain.org> On 10/13/2014 07:10 PM, Jorge Bastos wrote: > Hi guys, > > > > I'd like to have dovecot with sieve support, but can't find any information > on how to enable the sieve/managesieve support. > > Does anyone can light me up on this? http://wiki2.dovecot.org/Pigeonhole should provide all the information you need. Regards, Pascal -- The trapper recommends today: defaced.1428621 at localdomain.org From mysql.jorge at decimal.pt Mon Oct 13 20:03:16 2014 From: mysql.jorge at decimal.pt (Jorge Bastos) Date: Mon, 13 Oct 2014 21:03:16 +0100 Subject: Compile dovecot with sieve/managesieve support In-Reply-To: References: <543c23d0.43b5700a.54f7.39e7SMTPIN_ADDED_BROKEN@mx.google.com> Message-ID: <003501cfe720$ba511740$2ef345c0$@jorge@decimal.pt> Larry & Pascal, Thanks for the reply. Ok this is the lib for sieve, and the sieved, I see in debian packages that there is a dovecot-managesieved, the daemon, does this pigeonhole is the daemon also? > -----Original Message----- > From: Larry Rosenman [mailto:larryrtx at gmail.com] > Sent: segunda-feira, 13 de Outubro de 2014 20:12 > To: Jorge Bastos > Subject: Re: Compile dovecot with sieve/managesieve support > > look at pigeonhole. That's the Sieve implementation for Dovecot 2.x > > On 10/13/14, Jorge Bastos wrote: > > Hi guys, > > > > > > > > I'd like to have dovecot with sieve support, but can't find any > > information on how to enable the sieve/managesieve support. > > > > Does anyone can light me up on this? > > > > > > > > Thanks, > > > > > > > > > -- > Larry Rosenman http://www.lerctr.org/~ler > Phone: +1 214-642-9640 (c) E-Mail: larryrtx at gmail.com > US Mail: 108 Turvey Cove, Hutto, TX 78634-5688 From dovecot-bugs at daniel.thecshore.com Sat Oct 11 06:14:35 2014 From: dovecot-bugs at daniel.thecshore.com (Daniel Dickinson) Date: Sat, 11 Oct 2014 02:14:35 -0400 Subject: ]UG] Dovecot 2.2.9 SSL client cert verification fails: openssl verify: OK Message-ID: <5438CACB.3040004@daniel.thecshore.com> Greetings all, I have verified a bug that has long been attributed to lack of knowledge on the part of the user. Dovecot rejects StartSSL client certificates due to reject StartSSL root CA when doing client verification even though the appropriately constructed ca-bundle.pem has been created and applied vi ssl_ca = ca-bundle.pem cat class1-client-crl.pem >>ca-bundle.pem openssl x509 -in startcom-root-ca.pem -subject -issuer >>ca-bundle.pem cat startcom-root-ca-crl.pem >>ca-bundle.pem Furthermore exim, Thunderbird, and Firefox are all perfectly happy with the certificates (and exim has no problem verifying the client certificates). Further, there are many more messages regarding issues with users of dovecot having issues with StartCom client certificates who have reported following all the steps than with Cyrus or Courier. Oh, and client verification of server-side certificate works fine with server-side certificate bundle (cat server.pem startcom-intermediate.pem startcom-root-ca.pem >dovecot.pem) Relevant dovecot -n included below: auth_debug = yes auth_mechanisms = plain login digest-md5 cram-md5 otp auth_ssl_require_client_cert = yes auth_verbose = yes ssl = required ssl_ca = From damien at desfontain.es Sun Oct 12 08:50:24 2014 From: damien at desfontain.es (Damien Desfontaines) Date: Sun, 12 Oct 2014 10:50:24 +0200 Subject: Permissions for shared mail don't work Message-ID: <20141012085024.GH19675@K3PO.thurnes.local> Good morning, I'm using dovecot v.2.1.7 on Debian Sid, and the output of dovecot -n is available here: http://paste.fulltxt.net/C-O I'm trying to make the mailbox of (system) user "spam" available to user "ted". I followed these instructions: http://wiki2.dovecot.org/SharedMailboxes/Permissions and it doesn't seem to work. To be more precise: - I manually (and recursively) changed the permissions of all files in ~spam/Mail to 660 (and 770 for the directories); - I manually (and recursively) changed the group owner of everything in ~spam/Mail to "mailperso", where "mailperso" is a group whose users are spam and ted; - I added ??mail_access_groups=mailperso?? into my dovecot config; - and I restarted dovecot. But still, when I send a new email to spam, it appears as being owned by group "spam" and having permissions set to 600, so I can't access it with user "ted". I also tried to set the setgid bit for ~spam/Mail, it didn't change anything, and when I recursively set the setgid for all subdirectories of ~spam/Mail, it gives new mails the correct group (mailperso) but not the correct permissions. Have I missed something, or is this a bug? Thanks in advance and best regards, Damien -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 213 bytes Desc: Digital signature URL: From tim.meusel at online-mail.biz Mon Oct 13 08:14:04 2014 From: tim.meusel at online-mail.biz (Tim Meusel) Date: Mon, 13 Oct 2014 10:14:04 +0200 Subject: Corrupted index cache after migrating from maildir to mdbox In-Reply-To: <04A36D03-B15E-425E-9DDD-C3E04844519D@posteo.de> References: <54275AD9.2080900@bastelfreak.de> <542A5626.9090001@bastelfreak.de> <542A76BD.7010409@solu.fi> <542AB304.8030208@bastelfreak.de> <5439DB87.7060206@bastelfreak.de> <40C363C8-FADD-4A89-95C7-C39EA2300FAD@posteo.de> <543B0630.3010203@bastelfreak.de> <04A36D03-B15E-425E-9DDD-C3E04844519D@posteo.de> Message-ID: <543B89CC.5020709@online-mail.biz> On 13.10.2014 02:37, Daniel Parthey wrote: > Maybe the index is corrupted too and the index.cache is a cached version of the corrupted index? > > Are you using NFS with mdbox and accessing one nfs mailbox directory concurrently from several dovecot hosts? > all mails are stored on an xfs filesystem and only the local dovecot accesses it. Possible to fix the index.cache files? I havn't found anything suitable in the docs. The doveadm-index commands are only for the fts plugin I think. From mysql.jorge at decimal.pt Mon Oct 13 20:35:17 2014 From: mysql.jorge at decimal.pt (Jorge Bastos) Date: Mon, 13 Oct 2014 21:35:17 +0100 Subject: Compile dovecot with sieve/managesieve support In-Reply-To: References: <543c23d0.43b5700a.54f7.39e7SMTPIN_ADDED_BROKEN@mx.google.com> <543c3019.43c5980a.759b.ffff92ebSMTPIN_ADDED_BROKEN@mx.google.com> Message-ID: <006d01cfe725$333f5af0$99be10d0$@jorge@decimal.pt> I see, If i need anything else i'll post, Thanks, > -----Original Message----- > From: Larry Rosenman [mailto:larryrtx at gmail.com] > Sent: segunda-feira, 13 de Outubro de 2014 21:05 > To: Jorge Bastos > Subject: Re: Compile dovecot with sieve/managesieve support > > Pigeonhole does ManageSieve as well...... > > On 10/13/14, Jorge Bastos wrote: > > Larry & Pascal, > > > > Thanks for the reply. > > > > Ok this is the lib for sieve, and the sieved, I see in debian > packages > > that there is a dovecot-managesieved, the daemon, does this > pigeonhole > > is the daemon also? > > > >> -----Original Message----- > >> From: Larry Rosenman [mailto:larryrtx at gmail.com] > >> Sent: segunda-feira, 13 de Outubro de 2014 20:12 > >> To: Jorge Bastos > >> Subject: Re: Compile dovecot with sieve/managesieve support > >> > >> look at pigeonhole. That's the Sieve implementation for Dovecot 2.x > >> > >> On 10/13/14, Jorge Bastos wrote: > >> > Hi guys, > >> > > >> > > >> > > >> > I'd like to have dovecot with sieve support, but can't find any > >> > information on how to enable the sieve/managesieve support. > >> > > >> > Does anyone can light me up on this? > >> > > >> > > >> > > >> > Thanks, > >> > > >> > > >> > > >> > >> > >> -- > >> Larry Rosenman http://www.lerctr.org/~ler > >> Phone: +1 214-642-9640 (c) E-Mail: larryrtx at gmail.com > >> US Mail: 108 Turvey Cove, Hutto, TX 78634-5688 > > > > > -- > Larry Rosenman http://www.lerctr.org/~ler > Phone: +1 214-642-9640 (c) E-Mail: larryrtx at gmail.com > US Mail: 108 Turvey Cove, Hutto, TX 78634-5688 From mysql.jorge at decimal.pt Mon Oct 13 21:29:42 2014 From: mysql.jorge at decimal.pt (Jorge Bastos) Date: Mon, 13 Oct 2014 22:29:42 +0100 Subject: Mailbox format (was: RE: Compile dovecot with sieve/managesieve support) In-Reply-To: <006d01cfe725$333f5af0$99be10d0$@jorge@decimal.pt> References: <543c23d0.43b5700a.54f7.39e7SMTPIN_ADDED_BROKEN@mx.google.com> <543c3019.43c5980a.759b.ffff92ebSMTPIN_ADDED_BROKEN@mx.google.com> <006d01cfe725$333f5af0$99be10d0$@jorge@decimal.pt> Message-ID: <007601cfe72c$cd630670$68291350$@jorge@decimal.pt> Guys, Whats the best mailbox format: - dbox - mbox - maildir - ?!? Pros and cons? > -----Original Message----- > From: dovecot [mailto:dovecot-bounces at dovecot.org] On Behalf Of Jorge > Bastos > Sent: segunda-feira, 13 de Outubro de 2014 21:35 > To: dovecot at dovecot.org > Subject: RE: Compile dovecot with sieve/managesieve support > > I see, > > If i need anything else i'll post, > > Thanks, > > > -----Original Message----- > > From: Larry Rosenman [mailto:larryrtx at gmail.com] > > Sent: segunda-feira, 13 de Outubro de 2014 21:05 > > To: Jorge Bastos > > Subject: Re: Compile dovecot with sieve/managesieve support > > > > Pigeonhole does ManageSieve as well...... > > > > On 10/13/14, Jorge Bastos wrote: > > > Larry & Pascal, > > > > > > Thanks for the reply. > > > > > > Ok this is the lib for sieve, and the sieved, I see in debian > > packages > > > that there is a dovecot-managesieved, the daemon, does this > > pigeonhole > > > is the daemon also? > > > > > >> -----Original Message----- > > >> From: Larry Rosenman [mailto:larryrtx at gmail.com] > > >> Sent: segunda-feira, 13 de Outubro de 2014 20:12 > > >> To: Jorge Bastos > > >> Subject: Re: Compile dovecot with sieve/managesieve support > > >> > > >> look at pigeonhole. That's the Sieve implementation for Dovecot > > >> 2.x > > >> > > >> On 10/13/14, Jorge Bastos wrote: > > >> > Hi guys, > > >> > > > >> > > > >> > > > >> > I'd like to have dovecot with sieve support, but can't find any > > >> > information on how to enable the sieve/managesieve support. > > >> > > > >> > Does anyone can light me up on this? > > >> > > > >> > > > >> > > > >> > Thanks, > > >> > > > >> > > > >> > > > >> > > >> > > >> -- > > >> Larry Rosenman http://www.lerctr.org/~ler > > >> Phone: +1 214-642-9640 (c) E-Mail: larryrtx at gmail.com > > >> US Mail: 108 Turvey Cove, Hutto, TX 78634-5688 > > > > > > > > > -- > > Larry Rosenman http://www.lerctr.org/~ler > > Phone: +1 214-642-9640 (c) E-Mail: larryrtx at gmail.com > > US Mail: 108 Turvey Cove, Hutto, TX 78634-5688 From pada at posteo.de Mon Oct 13 22:43:04 2014 From: pada at posteo.de (Daniel Parthey) Date: Tue, 14 Oct 2014 00:43:04 +0200 Subject: Compile dovecot with sieve/managesieve support In-Reply-To: <000001cfe719$6c1a8630$444f9290$@jorge@decimal.pt> References: <000001cfe719$6c1a8630$444f9290$@jorge@decimal.pt> Message-ID: Hi, please have a look at http://wiki2.dovecot.org/Pigeonhole/Installation Kind regards Daniel From gedalya at gedalya.net Mon Oct 13 23:55:14 2014 From: gedalya at gedalya.net (Gedalya) Date: Mon, 13 Oct 2014 19:55:14 -0400 Subject: Mailbox format In-Reply-To: <007601cfe72c$cd630670$68291350$@jorge@decimal.pt> References: <543c23d0.43b5700a.54f7.39e7SMTPIN_ADDED_BROKEN@mx.google.com> <543c3019.43c5980a.759b.ffff92ebSMTPIN_ADDED_BROKEN@mx.google.com> <006d01cfe725$333f5af0$99be10d0$@jorge@decimal.pt> <007601cfe72c$cd630670$68291350$@jorge@decimal.pt> Message-ID: <543C6662.40508@gedalya.net> On 10/13/2014 05:29 PM, Jorge Bastos wrote: > Guys, > > Whats the best mailbox format: > - dbox Dovecot-specific. Higher performance, saves I/O. > - mbox Don't bother. > - maildir Simple, compatible, resilient. > - ?!? > > Pros and cons? > No short answer is the right answer. Try to thoroughly read http://wiki2.dovecot.org/MailboxFormat and child pages. From stephan at rename-it.nl Tue Oct 14 01:20:40 2014 From: stephan at rename-it.nl (Stephan Bosch) Date: Tue, 14 Oct 2014 03:20:40 +0200 Subject: [Pigeonhole Sieve interpreter] :create argument and lda_mailbox_autosubscribe setting In-Reply-To: <1412770423.8665.0.camel@han-solo> References: <1412770423.8665.0.camel@han-solo> Message-ID: <543C7A68.1040102@rename-it.nl> On 10/8/2014 2:13 PM, Vivien Lacourba wrote: > Hi, > > I am using dovecot and dovecot-sieve packages from Debian Wheezy > (2.1.7-7+deb7u1). > > I noticed that while using ":create" (from the mailbox extension) in my > Sieve filter and "lda_mailbox_autosubscribe = yes" in Dovecot's LDA > config it automatically subscribes to the destination mailbox even if > that mailbox already existed. > > Reading Dovecot's documentation and the mailbox extension RFC it seems > subscription should happen only if it is a newly created mailbox and > should not happen if the mailbox already existed. > > http://tools.ietf.org/html/rfc5490#section-3.2 > [[ > 3.2. ":create" Argument to "fileinto" Command > (...) > If the mailbox already exists, this argument is ignored. > (...) > ]] > > /etc/dovecot/conf.d/15-lda.conf > [[ > # Should automatically created mailboxes be also automatically > subscribed? > lda_mailbox_autosubscribe = yes > ]] > > Also I noticed that if I don't use ":create" in my filters and instead > set "lda_mailbox_autocreate = yes" in Dovecot's LDA config, then this > time the behavior looks correct as the automatic subscription will only > happen for a newly created mailbox. You are right. This one should fix it: http://hg.rename-it.nl/dovecot-2.2-pigeonhole/rev/a0a5f61eea69 Regards, Stephan. From rs at sys4.de Tue Oct 14 08:01:53 2014 From: rs at sys4.de (Robert Schetterer) Date: Tue, 14 Oct 2014 10:01:53 +0200 Subject: Mailbox format In-Reply-To: <007601cfe72c$cd630670$68291350$@jorge@decimal.pt> References: <543c23d0.43b5700a.54f7.39e7SMTPIN_ADDED_BROKEN@mx.google.com> <543c3019.43c5980a.759b.ffff92ebSMTPIN_ADDED_BROKEN@mx.google.com> <006d01cfe725$333f5af0$99be10d0$@jorge@decimal.pt> <007601cfe72c$cd630670$68291350$@jorge@decimal.pt> Message-ID: <543CD871.7020207@sys4.de> Am 13.10.2014 um 23:29 schrieb Jorge Bastos: > Guys, > > Whats the best mailbox format: > - dbox > - mbox > - maildir > - ?!? there is no universal answer to this a minimum answer might be, maildir is ok in a small non cluster setup ever, please study wiki and archive for more info Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From mysql.jorge at decimal.pt Tue Oct 14 08:27:32 2014 From: mysql.jorge at decimal.pt (Jorge Bastos) Date: Tue, 14 Oct 2014 09:27:32 +0100 Subject: Mailbox format In-Reply-To: <543CD871.7020207@sys4.de> References: <543c23d0.43b5700a.54f7.39e7SMTPIN_ADDED_BROKEN@mx.google.com> <543c3019.43c5980a.759b.ffff92ebSMTPIN_ADDED_BROKEN@mx.google.com> <006d01cfe725$333f5af0$99be10d0$@jorge@decimal.pt> <007601cfe72c$cd630670$68291350$@jorge@decimal.pt> <543CD871.7020207@sys4.de> Message-ID: <002501cfe788$b3522f70$19f68e50$@jorge@decimal.pt> Hi all, Ya, I've read the wiki and the best choice I believe it's MailDir format. Simple and direct information on the wiki, thanks! > -----Original Message----- > From: dovecot [mailto:dovecot-bounces at dovecot.org] On Behalf Of Robert > Schetterer > Sent: ter?a-feira, 14 de Outubro de 2014 09:02 > To: dovecot at dovecot.org > Subject: Re: Mailbox format > > Am 13.10.2014 um 23:29 schrieb Jorge Bastos: > > Guys, > > > > Whats the best mailbox format: > > - dbox > > - mbox > > - maildir > > - ?!? > > there is no universal answer to this > a minimum answer might be, maildir is ok in a small non cluster setup > ever, please study wiki and archive for more info > > > Best Regards > MfG Robert Schetterer > > -- > [*] sys4 AG > > http://sys4.de, +49 (89) 30 90 46 64 > Franziskanerstra?e 15, 81669 M?nchen > > Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 > Vorstand: Patrick Ben Koetter, Marc Schiffbauer > Aufsichtsratsvorsitzender: Florian Kirstein From mysql.jorge at decimal.pt Tue Oct 14 08:28:44 2014 From: mysql.jorge at decimal.pt (Jorge Bastos) Date: Tue, 14 Oct 2014 09:28:44 +0100 Subject: Request to list owner Message-ID: Hi list owner, Sorry for this. Is it possible to change the reply-to in mailman to be the list, and not the person who replied? Also the [Dovecot] on the subject would be handy. Just two things to get better. Thanks, From h.reindl at thelounge.net Tue Oct 14 08:32:06 2014 From: h.reindl at thelounge.net (Reindl Harald) Date: Tue, 14 Oct 2014 10:32:06 +0200 Subject: Request to list owner In-Reply-To: References: Message-ID: <543CDF86.8070606@thelounge.net> Am 14.10.2014 um 10:28 schrieb Jorge Bastos: > Sorry for this. > > Is it possible to change the reply-to in mailman to be the list, and not the > person who replied? just use "reply to list" > Also the [Dovecot] on the subject would be handy no - type "yahoo lists DMARC" in Google as well as the subject header my be DKIM signed -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 181 bytes Desc: OpenPGP digital signature URL: From ml+dovecot at moritz.augsburger.name Tue Oct 14 08:33:55 2014 From: ml+dovecot at moritz.augsburger.name (Moritz Augsburger) Date: Tue, 14 Oct 2014 10:33:55 +0200 Subject: Request to list owner In-Reply-To: References: Message-ID: <543CDFF3.9080907@moritz.augsburger.name> On 2014-10-14 10:28, Jorge Bastos wrote: > Is it possible to change the reply-to in mailman to be the list, and not the > person who replied? Every good MUA has a possibility for replying to the list. Also read http://www.unicom.com/pw/reply-to-harmful.html > Also the [Dovecot] on the subject would be handy. Nope, I disagree. If you need to filter, there is a header for this: List-Id: Dovecot Mailing List Moritz From rs at sys4.de Tue Oct 14 08:41:28 2014 From: rs at sys4.de (Robert Schetterer) Date: Tue, 14 Oct 2014 10:41:28 +0200 Subject: Request to list owner In-Reply-To: References: Message-ID: <543CE1B8.3000108@sys4.de> Am 14.10.2014 um 10:28 schrieb Jorge Bastos: > Hi list owner, > > > > Sorry for this. > > Is it possible to change the reply-to in mailman to be the list, and not the > person who replied? > > Also the [Dovecot] on the subject would be handy. > > > > Just two things to get better. > > > > Thanks, > might brake dkim and dmarc, filter with list-id Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From professa at dementianati.com Tue Oct 14 09:02:31 2014 From: professa at dementianati.com (Professa Dementia) Date: Tue, 14 Oct 2014 02:02:31 -0700 Subject: Request to list owner In-Reply-To: References: Message-ID: <543CE6A7.2090602@dementianati.com> On 10/14/2014 1:28 AM, Jorge Bastos wrote: > Also the [Dovecot] on the subject would be handy. The list used to do this. I agree with you, and the matter was debated, but the list is not a democracy and Timo, as the owner, changed the list unilaterally. The problem is that changing the subject conflicts with DKIM. DKIM is a broken standard for several reasons; it does not have allowances for mailing lists to add their name to the subject - a very common and useful practice - and these days spam filters do a far superior job than DKIM, making it too little, too late. I do not use DKIM and get no spam. That last spam I got was about 4 months ago, then another 2 months before that. 2 spams over the course of 6 months is pretty good, and that is without DKIM. Depending on your mail client, you can set up a filter that detects the mailing-list headers and adds the name back to the subject line. I do something similar and it adds back the lost functionality. :-) Best of luck. Dem From h.reindl at thelounge.net Tue Oct 14 09:37:22 2014 From: h.reindl at thelounge.net (Reindl Harald) Date: Tue, 14 Oct 2014 11:37:22 +0200 Subject: Request to list owner In-Reply-To: <543CE6A7.2090602@dementianati.com> References: <543CE6A7.2090602@dementianati.com> Message-ID: <543CEED2.5040700@thelounge.net> Am 14.10.2014 um 11:02 schrieb Professa Dementia: > On 10/14/2014 1:28 AM, Jorge Bastos wrote: > >> Also the [Dovecot] on the subject would be handy. > > The list used to do this. I agree with you, and the matter was debated, > but the list is not a democracy and Timo, as the owner, changed the list > unilaterally. > > The problem is that changing the subject conflicts with DKIM. DKIM is a > broken standard for several reasons; it does not have allowances for > mailing lists to add their name to the subject - a very common and > useful practice - and these days spam filters do a far superior job than > DKIM, making it too little, too late nonsense because that spamfilters use DKIM and SPF *too* for their scoring cat maillog | grep "spamd: result" | grep DKIM | wc -l 12782 /var/lib/spamassassin/3.004000/updates_spamassassin_org score USER_IN_DKIM_WHITELIST -100.000 score USER_IN_DEF_DKIM_WL -7.500 score DKIM_SIGNED 0.1 score DKIM_VALID -0.1 score DKIM_VALID_AU -0.1 score DKIM_VERIFIED 0 score DKIM_POLICY_SIGNALL 0 score DKIM_POLICY_SIGNSOME 0 score DKIM_POLICY_TESTING 0 score DKIM_ADSP_CUSTOM_LOW 0.001 score DKIM_ADSP_CUSTOM_MED 0.001 score DKIM_ADSP_CUSTOM_HIGH 0.001 score DKIM_ADSP_ALL 0 1.1 0 0.8 score DKIM_ADSP_DISCARD 0 1.8 0 1.8 score DKIM_ADSP_NXDOMAIN 0 0.8 0 0.9 score DKIMDOMAIN_IN_DWL 0 -3.5 0 -3.5 score DKIMDOMAIN_IN_DWL_UNKNOWN 0 -0.01 0 -0.01 -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 181 bytes Desc: OpenPGP digital signature URL: From ml+dovecot at moritz.augsburger.name Tue Oct 14 09:40:32 2014 From: ml+dovecot at moritz.augsburger.name (Moritz Augsburger) Date: Tue, 14 Oct 2014 11:40:32 +0200 Subject: Request to list owner In-Reply-To: <543CEED2.5040700@thelounge.net> References: <543CE6A7.2090602@dementianati.com> <543CEED2.5040700@thelounge.net> Message-ID: <543CEF90.9060200@moritz.augsburger.name> On 2014-10-14 11:37, Reindl Harald wrote: > nonsense because that spamfilters use DKIM and SPF > *too* for their scoring Sorry, didn't know that spamasassin is the only available spam filter on the market. From h.reindl at thelounge.net Tue Oct 14 09:49:55 2014 From: h.reindl at thelounge.net (Reindl Harald) Date: Tue, 14 Oct 2014 11:49:55 +0200 Subject: Request to list owner In-Reply-To: <543CEF90.9060200@moritz.augsburger.name> References: <543CE6A7.2090602@dementianati.com> <543CEED2.5040700@thelounge.net> <543CEF90.9060200@moritz.augsburger.name> Message-ID: <543CF1C3.1020701@thelounge.net> Am 14.10.2014 um 11:40 schrieb Moritz Augsburger: > On 2014-10-14 11:37, Reindl Harald wrote: >> nonsense because that spamfilters use DKIM and SPF >> *too* for their scoring > > Sorry, didn't know that spamasassin is the only available > spam filter on the market no, but most others work similar and SA works behind the scenes even in most commercial boxes as one of many filters - the point was that many people using DKIM for their filtering without even aware -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 181 bytes Desc: OpenPGP digital signature URL: From per at computer.org Tue Oct 14 10:45:54 2014 From: per at computer.org (Per Jessen) Date: Tue, 14 Oct 2014 12:45:54 +0200 Subject: Request to list owner References: <543CE6A7.2090602@dementianati.com> Message-ID: Professa Dementia wrote: > On 10/14/2014 1:28 AM, Jorge Bastos wrote: > >> Also the [Dovecot] on the subject would be handy. > > The list used to do this. I agree with you, and the matter was > debated, but the list is not a democracy and Timo, as the owner, > changed the list unilaterally. > > The problem is that changing the subject conflicts with DKIM. DKIM is > a broken standard for several reasons; it does not have allowances for > mailing lists to add their name to the subject - a very common and > useful practice And superfluous too - for list identification, use the List-* headers instead. > - and these days spam filters do a far superior job than DKIM, making > it too little, too late. I do not use DKIM and get no > spam. I don't use DKIM, and I get loads of spam :-) As always, YMMV. -- Per Jessen, Z?rich (0.0?C) http://www.dns24.ch/ - your free DNS host, made in Switzerland. From sottilette at rfx.it Tue Oct 14 11:17:43 2014 From: sottilette at rfx.it (F.) Date: Tue, 14 Oct 2014 13:17:43 +0200 (CEST) Subject: delete/archive old mail In-Reply-To: <543CD658.80204@sys4.de> References: <543BBBB0.7010105@sys4.de> <543CD658.80204@sys4.de> Message-ID: >>>> Hi everybody, >>>> I store user's mail in the old mbox format. >>>> I have many scripts to manage users that works fine with mbox. >>>> I use the very old Expire_mail.pl script to delete mail older than NN >>>> days for selected users (nightly cron job). Still works fine with my >>>> CentOS dovecot-2.0.16. >>>> Now I want move the mail to a sort of archive folder instead of simply >>>> deleting it from the inbox for some users. >>>> Is there a similar script or some simple triks? >>>> >>>> Thanks, F. >>> >>> perhaps you will find some ideas here >>> >>> https://sys4.de/de/blog/2013/02/07/mailarchiv-mit-dovecot-und-postfix-sortiert-nach-datum-mailadressen-und-ein-ausgehend-unterordnern/ >>> >>> >>> ... >>> #/bin/bash >>> YEAR=`/bin/date +%Y` >>> /usr/bin/doveadm expunge -d -u *@backup.server.org mailbox >>> user-backup\*$YEAR*\* savedbefore 10d >>> ... >> >> Thanks for replay. >> My German is really poor, but from a quick look of the example above and >> man doveadm[-expunge], seems that it can be used to replace the old >> Expire_mail.pl (I need to study the right syntax ...) >> >> But still there is the move/archive old mail activity not solved. > > i use the bc feature of postfix to move a copy of all mail per > maildomain into a backup maildomain archive folder, as this is done via lmtp > i am able to sort mails via sieve per user and date folder, depending > on how you like to setup you may use imap acl to give seen rights to the > orig user, so the may restore their own mail whenever they want and/or > their domain postmaster can do it for them. > > But thats only one chance you can do it, you have to decide what fits > best to your needs. > > >> >> doveadm-altmove seems interesting, but in the man page it is reported >> only work with dbox (dbox-only), and my inboxes are in mbox format. >> >> Any other advice? Sorry for the replay to sender instead of the list. As I originally wrote, my need is script or a command like the old Expire_mail.pl that parse a local mbox folder and move/copy mail older than NN days to another local mbox folder. Probably for a Perl programmer is only matter of modify this script or something similar. I searched in docs, wiki, ... but not noticied something that can simply be inserted in a cron job to do the work. Only migration tools or complex (for me), library that can be used to manipulate folders :-) Thanks, F. From r.vandenhof at tiw.nl Tue Oct 14 13:38:42 2014 From: r.vandenhof at tiw.nl (Rick van den Hof) Date: Tue, 14 Oct 2014 15:38:42 +0200 Subject: Doveadm quota recalc sets quota for wrong quota root Message-ID: <20141014133842.GC3528@Rick-pc> Hi, In our setup, we use two quota roots. One for user quota and one for domain quota. If a user has no quota, then the domain quota is applied. For a user with user quota this is how it looks: # doveadm quota get -u test at shellz.nl Quota name Type Value Limit % Domain quota STORAGE 1439155 2560000 56 Domain quota MESSAGE 21257 - 0 User quota STORAGE 0 102400 0 User quota MESSAGE 0 - 0 In this case, the whole domain contains 21257 messages but the account itself contains 0. For a user with only domain quota, this is how it looks: # doveadm quota get -u rick at shellz.nl Quota name Type Value Limit % Domain quota STORAGE 1439155 2560000 56 Domain quota MESSAGE 21257 - 0 User quota STORAGE 693299 - 0 User quota MESSAGE 12876 - 0 So far so good. My account contains 12876 messages. Now I've sent a message containing a 1mb.bin as attachment to test at shellz.nl: # doveadm quota get -u test at shellz.nl Quota name Type Value Limit % Domain quota STORAGE 1440540 2560000 56 Domain quota MESSAGE 21258 - 0 User quota STORAGE 1384 102400 1 User quota MESSAGE 1 - 0 Seems to be fine, the message on disk is indeed 1.4MB and this has been added to both domain and user quota. Now see what happens when I run the following command: # doveadm quota recalc -u test at shellz.nl # doveadm quota get -u test at shellz.nl Quota name Type Value Limit % Domain quota STORAGE 1384 2560000 0 Domain quota MESSAGE 1 - 0 User quota STORAGE 1384 102400 1 User quota MESSAGE 1 - 0 The recalc action has updated the domain usage to reflect the specific user's usage (my 12876 messages are no longer counted). We log domain usage (usage_domain) in a seperate table from mailbox usage (usage_mailbox). These are the queries that set the usage: 256 Query BEGIN 256 Query DELETE FROM usage_domain WHERE domain = 'shellz.nl' 256 Query DELETE FROM usage_domain WHERE domain = 'shellz.nl' 256 Query INSERT INTO usage_domain (bytes,domain) VALUES ('1418118','shellz.nl') ON DUPLICATE KEY UPDATE bytes='1418118' 256 Query INSERT INTO usage_domain (messages,domain) VALUES ('1','shellz.nl') ON DUPLICATE KEY UPDATE messages='1' 256 Query COMMIT 257 Query BEGIN 257 Query DELETE FROM usage_mailbox WHERE userdomain = 'test at shellz.nl' 257 Query DELETE FROM usage_mailbox WHERE userdomain = 'test at shellz.nl' 257 Query INSERT INTO usage_mailbox (bytes,userdomain) VALUES ('1418118','test at shellz.nl') ON DUPLICATE KEY UPDATE bytes='1418118' 257 Query INSERT INTO usage_mailbox (messages,userdomain) VALUES ('1','test at shellz.nl') ON DUPLICATE KEY UPDATE messages='1' 257 Query COMMIT How do I prevent this from happening? It should only update the usage_mailbox table when I run the recalc command. Could this be because we use seperate tables for domain and user usage? dovecot -n: # 2.2.9: /etc/dovecot/dovecot.conf # OS: Linux 3.13.0-37-generic x86_64 Ubuntu 14.04.1 LTS auth_mechanisms = plain login auth_username_chars = abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890+=_.-@& dict { expire = mysql:/etc/dovecot/dovecot-sql-expire.conf quotadomaindict = mysql:/etc/dovecot/dovecot-sql-quota-domain.conf quotauserdict = mysql:/etc/dovecot/dovecot-sql-quota-user.conf } disable_plaintext_auth = no listen = *,[::] mail_fsync = never mail_location = maildir:~/Maildir mail_plugins = quota expire managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave passdb { args = /etc/dovecot/dovecot-sql-user.conf driver = sql } plugin { expire = Trash expire2 = Spam expire_dict = proxy::expire mail_log_events = delete copy save expunge mailbox_delete mailbox_rename mail_log_fields = uid box msgid size quota = dict:Domain quota:%d:proxy::quotadomaindict quota_rule2 = Trash:ignore quota_warning = storage=99%% doquotawarning 99 %u quota_warning2 = storage=95%% doquotawarning 95 %u quota_warning3 = storage=75%% doquotawarning 75 %u quota2 = dict:User quota::proxy::quotauserdict quota2_rule2 = Trash:ignore quota2_warning = storage=99%% doquotawarning 99 %u quota2_warning2 = storage=95%% doquotawarning 95 %u quota2_warning3 = storage=75%% doquotawarning 75 %u } protocols = imap pop3 service auth-worker { unix_listener auth-worker { mode = 0600 user = vmail } } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { mode = 0600 user = vmail } unix_listener auth-userdb { mode = 0600 user = vmail } user = vmail } service dict { unix_listener dict { mode = 0600 user = vmail } } service doquotawarning { executable = script /usr/bin/doquotawarning.py unix_listener doquotawarning { user = vmail } user = vmail } service imap-login { chroot = process_limit = 200 process_min_avail = 2 } service imap { executable = imap postlogin } service managesieve-login { chroot = } service pop3-login { chroot = process_limit = 50 process_min_avail = 2 } service pop3 { executable = pop3 postlogin } service postlogin { executable = script-login /usr/local/postfixint/dolastlogin.py user = $default_internal_user } ssl_cert = ' was automatically rejected:%n%r } dovecot-sql-quota-domain.conf: connect = xxx map { pattern = priv/quota/storage table = usage_domain username_field = domain value_field = bytes } map { pattern = priv/quota/messages table = usage_domain username_field = domain value_field = messages } dovecot-sql-quota-user.conf: connect = xxx map { pattern = priv/quota/storage table = usage_mailbox username_field = userdomain value_field = bytes } map { pattern = priv/quota/messages table = usage_mailbox username_field = userdomain value_field = messages } Thanks in advance to anyone who might be able to shed some light in this situation :). Kind regards, Rick van den Hof -- Manager Engineering Totaalnet Internet Works B.V. IJsselburcht 4e 6825 BP Arnhem +31(0)26-3844944 | r.vandenhof at tiw.eu (PGP Key: 0x5A66E935) -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 473 bytes Desc: Digital signature URL: From bourek at thinline.cz Tue Oct 14 13:47:07 2014 From: bourek at thinline.cz (Jiri Bourek) Date: Tue, 14 Oct 2014 15:47:07 +0200 Subject: Doveadm quota recalc sets quota for wrong quota root In-Reply-To: <20141014133842.GC3528@Rick-pc> References: <20141014133842.GC3528@Rick-pc> Message-ID: <543D295B.6040301@thinline.cz> On 14.10.2014 15:38, Rick van den Hof wrote: > Hi, > > In our setup, we use two quota roots. One for user quota and one for > domain quota. If a user has no quota, then the domain quota is applied. > > The recalc action has updated the domain usage to reflect the specific > user's usage (my 12876 messages are no longer counted). See thread with subject "Dovecot domain quota" from yesterday. Although this kind of usage is (or at least was) mentioned in example configuration, it doesn't work properly. From slitt at troubleshooters.com Tue Oct 14 14:35:08 2014 From: slitt at troubleshooters.com (Steve Litt) Date: Tue, 14 Oct 2014 10:35:08 -0400 Subject: Request to list owner In-Reply-To: <543CDFF3.9080907@moritz.augsburger.name> References: <543CDFF3.9080907@moritz.augsburger.name> Message-ID: <20141014103508.4dfbc651@mydesq2.domain.cxm> On Tue, 14 Oct 2014 10:33:55 +0200 Moritz Augsburger wrote: > On 2014-10-14 10:28, Jorge Bastos wrote: > > Is it possible to change the reply-to in mailman to be the list, > > and not the person who replied? > > Every good MUA has a possibility for replying to the list. Also read > http://www.unicom.com/pw/reply-to-harmful.html The preceding link is the opinion of one guy, and is no discussion ender. He makes up an ugly sounding characterization "munge", and I counter with the better sounding characterization "discussionize". A mailing list is meant to produce a whole greater than the sum of the parts, not a bunch of people whispering privately in each others' ear, and therefore the default should go back to the mailing list. I'm soooo tired of seeing Chip Rosenthal's tired rant about reply-to redirection quoted as if it's something more than one guy's opinion. For me, personally, the point is moot, because from my Claws-Mail on Debian Wheezy Linux, both Reply to List and Reply send it back to the list, and I must use Reply to Sender to send to the sender, which is the exact behavior I find best for a mailing list. The original poster (OP) was using MS Outlook. Does anyone know how to "reply to list" in Outlook? If not, does Thunderbird have a "reply to list"? If so, the OP could switch to Thunderbird. > > > Also the [Dovecot] on the subject would be handy. > > Nope, I disagree. If you need to filter, there is a header for this: > List-Id: Dovecot Mailing List I've been very pleased with the results ever since I started filtering mailing lists by List-Id instead of a marker in the subject line. It keeps everything going to the right mailboxes, even when crossposts are involved. I use the very versatile procmail for filtering; I'm not sure the OP's MS Outlook can do that. But, of course, Outlook has much more serious issues than any of this: I'd recommend the OP use a different mail client, for the security of his computer. SteveT Steve Litt * http://www.troubleshooters.com/ Troubleshooting Training * Human Performance From h.reindl at thelounge.net Tue Oct 14 14:47:14 2014 From: h.reindl at thelounge.net (Reindl Harald) Date: Tue, 14 Oct 2014 16:47:14 +0200 Subject: Request to list owner In-Reply-To: <20141014103508.4dfbc651@mydesq2.domain.cxm> References: <543CDFF3.9080907@moritz.augsburger.name> <20141014103508.4dfbc651@mydesq2.domain.cxm> Message-ID: <543D3772.90405@thelounge.net> Am 14.10.2014 um 16:35 schrieb Steve Litt: > On Tue, 14 Oct 2014 10:33:55 +0200 > Moritz Augsburger wrote: > >> On 2014-10-14 10:28, Jorge Bastos wrote: >>> Is it possible to change the reply-to in mailman to be the list, >>> and not the person who replied? >> >> Every good MUA has a possibility for replying to the list. Also read >> http://www.unicom.com/pw/reply-to-harmful.html > > The preceding link is the opinion of one guy, and is no discussion > ender. He makes up an ugly sounding characterization "munge", and I > counter with the better sounding characterization "discussionize". which happens currently > A mailing list is meant to produce a whole greater than the sum of the > parts, not a bunch of people whispering privately in each others' ear, > and therefore the default should go back to the mailing list. I'm soooo > tired of seeing Chip Rosenthal's tired rant about reply-to redirection > quoted as if it's something more than one guy's opinion. not only one guy, you get on many lists a complaint for "reply all", reply private and so on - to quote another owner of a list about mailserver software "fix your mailclient" > For me, personally, the point is moot, because from my Claws-Mail on > Debian Wheezy Linux, both Reply to List and Reply send it back to the > list, and I must use Reply to Sender to send to the sender, which is > the exact behavior I find best for a mailing list. > > The original poster (OP) was using MS Outlook. Does anyone know how to > "reply to list" in Outlook? If not, does Thunderbird have a "reply to > list"? If so, the OP could switch to Thunderbird. surely - and that's why i hate "reply all" because depending on which copy is faster i get the button enabled or not >>> Also the [Dovecot] on the subject would be handy. >> >> Nope, I disagree. If you need to filter, there is a header for this: >> List-Id: Dovecot Mailing List > > I've been very pleased with the results ever since I started filtering > mailing lists by List-Id instead of a marker in the subject line. It > keeps everything going to the right mailboxes, even when crossposts are > involved. I use the very versatile procmail for filtering; I'm not sure > the OP's MS Outlook can do that. But, of course, Outlook has much more > serious issues than any of this: I'd recommend the OP use a different > mail client, for the security of his computer we are on a *mailserver list* and the server supports sieve -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 181 bytes Desc: OpenPGP digital signature URL: From James.Shewey at panasonic.aero Tue Oct 14 15:53:02 2014 From: James.Shewey at panasonic.aero (James Shewey) Date: Tue, 14 Oct 2014 15:53:02 +0000 Subject: pop3-login segfaulting Message-ID: <34009FB6A0D66E47AA133778D6DEA40E59F305@Mail-sna05.mascorp.com> I upgraded dovecot from v1 to v2 as part of a CentOS upgrade (5.6->6.5) and am now running on 2.0.9. Any time I connect to the pop or imap ports however I get "master: Error: service(imap-login): child 2860 killed with signal 11 (core not dumped - add -D parameter to service imap-login { executable }" after following the core dump instructions at http://www.dovecot.org/bugreport.html. The problem is that I'm not sure how these processes are spawned in order to add the switch. Can I spawn them directly? If so, I ought to be able to do an strace to track down the issue as well. Regards, James Shewey NOC Systems Administrator I Product Support Engineering [Description: Panasonic Avionics] Panasonic Avionics Corporation Phone: +1 (949) 672-2000 Direct: +1 (949) 595-5187 -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 3421 bytes Desc: image001.png URL: From rs at sys4.de Tue Oct 14 16:03:26 2014 From: rs at sys4.de (Robert Schetterer) Date: Tue, 14 Oct 2014 18:03:26 +0200 Subject: pop3-login segfaulting In-Reply-To: <34009FB6A0D66E47AA133778D6DEA40E59F305@Mail-sna05.mascorp.com> References: <34009FB6A0D66E47AA133778D6DEA40E59F305@Mail-sna05.mascorp.com> Message-ID: <543D494E.2000400@sys4.de> Am 14.10.2014 um 17:53 schrieb James Shewey: > I upgraded dovecot from v1 to v2 as part of a CentOS upgrade (5.6->6.5) and am now running on 2.0.9. Any time I connect to the pop or imap ports however I get "master: Error: service(imap-login): child 2860 killed with signal 11 (core not dumped - add -D parameter to service imap-login { executable }" after following the core dump instructions at http://www.dovecot.org/bugreport.html. > > The problem is that I'm not sure how these processes are spawned in order to add the switch. Can I spawn them directly? If so, I ought to be able to do an strace to track down the issue as well. > > Regards, > > James Shewey > NOC Systems Administrator I > Product Support Engineering > > [Description: Panasonic Avionics] > Panasonic Avionics Corporation > Phone: +1 (949) 672-2000 > Direct: +1 (949) 595-5187 > > You should upgrade to a more recent version, debugging 2.0.9 makes less sense Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From przemek.orzechowski at makolab.pl Tue Oct 14 16:43:49 2014 From: przemek.orzechowski at makolab.pl (=?UTF-8?B?UHJ6ZW15c8WCYXcgT3J6ZWNob3dza2k=?=) Date: Tue, 14 Oct 2014 18:43:49 +0200 Subject: Request to list owner In-Reply-To: <20141014103508.4dfbc651@mydesq2.domain.cxm> References: <543CDFF3.9080907@moritz.augsburger.name> <20141014103508.4dfbc651@mydesq2.domain.cxm> Message-ID: <543D52C5.1090108@makolab.pl> On 14.10.2014 16:35, Steve Litt wrote: > On Tue, 14 Oct 2014 10:33:55 +0200 > Moritz Augsburger wrote: > >> On 2014-10-14 10:28, Jorge Bastos wrote: >>> Is it possible to change the reply-to in mailman to be the list, >>> and not the person who replied? >> Every good MUA has a possibility for replying to the list. Also read >> http://www.unicom.com/pw/reply-to-harmful.html > The preceding link is the opinion of one guy, and is no discussion > ender. He makes up an ugly sounding characterization "munge", and I > counter with the better sounding characterization "discussionize". > > A mailing list is meant to produce a whole greater than the sum of the > parts, not a bunch of people whispering privately in each others' ear, > and therefore the default should go back to the mailing list. I'm soooo > tired of seeing Chip Rosenthal's tired rant about reply-to redirection > quoted as if it's something more than one guy's opinion. > > For me, personally, the point is moot, because from my Claws-Mail on > Debian Wheezy Linux, both Reply to List and Reply send it back to the > list, and I must use Reply to Sender to send to the sender, which is > the exact behavior I find best for a mailing list. > > The original poster (OP) was using MS Outlook. Does anyone know how to > "reply to list" in Outlook? If not, does Thunderbird have a "reply to > list"? If so, the OP could switch to Thunderbird. Of course Thunderbird has reply to list option >>> Also the [Dovecot] on the subject would be handy. >> Nope, I disagree. If you need to filter, there is a header for this: >> List-Id: Dovecot Mailing List > I've been very pleased with the results ever since I started filtering > mailing lists by List-Id instead of a marker in the subject line. It > keeps everything going to the right mailboxes, even when crossposts are > involved. I use the very versatile procmail for filtering; I'm not sure > the OP's MS Outlook can do that. But, of course, Outlook has much more > serious issues than any of this: I'd recommend the OP use a different > mail client, for the security of his computer. > > SteveT > > Steve Litt * http://www.troubleshooters.com/ > Troubleshooting Training * Human Performance > From tss at iki.fi Tue Oct 14 16:53:43 2014 From: tss at iki.fi (Timo Sirainen) Date: Tue, 14 Oct 2014 09:53:43 -0700 Subject: v2.2.14 released Message-ID: http://dovecot.org/releases/2.2/dovecot-2.2.14.tar.gz http://dovecot.org/releases/2.2/dovecot-2.2.14.tar.gz.sig Looks like it took a bit longer to make this release after RC1 than I thought. I'm now in San Jose area for a few months and still jumping between apartments and trying to adjust to the new timezone. Some of the more important fixes since RC1: - Fixed several race conditions with dovecot.index.cache handling that may have caused unnecessary "cache is corrupted" errors. - auth: If auth client listed userdb and disconnected before finishing, the auth worker process got stuck (and eventually all workers could get used up and requests would start failing). Some of the larger changes since v2.2.13: * lmtp: Delivered-To: header no longer contains <> around the email address. Other MDAs don't have it either. * "Out of disk space" errors are now treated as temporary errors (not the same as "Out of disk quota"). * replication plugin: Use replication only for users who have a non-empty mail_replica setting. + lmtp proxy: Log a line about each mail delivery. + Added login_source_ips setting. This can be used to set the source IP address round-robin from a pool of IPs (in case you run out of TCP ports). + Rawlog settings can use tcp:: as the path. + virtual plugin: Don't keep more than virtual_max_open_mailboxes (default 64) number of backend mailboxes open. + SSL/TLS compression can be disabled with ssl_options=no_compression + acl: Global ACL file now supports "quotes" around patterns. + Added last-login plugin to set user's last-login timestamp on login. + LDAP auth: Allow passdb credentials lookup also with auth_bind=yes - IMAP: MODSEQ was sent in FETCH reply even if CONDSTORE/QRESYNC wasn't enabled. This broke at least old Outlooks. - passdb static treated missing password field the same as an empty password field. - mdbox: Fixed potential infinite looping when scanning a broken mdbox file. - imap-login, pop3-login: Fixed potential crashes when client disconnected unexpectedly. - imap proxy: The connection was hanging in some usage patterns. This mainly affected older Outlooks. - lmtp proxy: The proxy sometimes delivered empty mails in error situations or potentially delivered truncated mails. - fts-lucene: If whitespace_chars was set, we may have ended up indexing some garbage words, growing the index size unnecessarily. - -c and -i parameters for dovecot/doveadm commands were ignored if the config socket was readable. - quota: Quota recalculation didn't include INBOX in some setups. - Mail headers were sometimes added to dovecot.index.cache in wrong order. The main problem this caused was with dsync+imapc incremental syncing when the second sync thought the local mailbox had changed. - doveadm backup didn't notice if emails were missing from the middle of the destination mailbox. Now it deletes and resyncs the mailbox. From Kind at adm.uib.no Tue Oct 14 16:56:12 2014 From: Kind at adm.uib.no (Hans Morten Kind) Date: Tue, 14 Oct 2014 18:56:12 +0200 Subject: auth-worker goes wild Message-ID: dovecot-2.2.13 running on Solaris-10, app 5000 concurrent connections, and a pretty standard config where passdb is set up with driver = pam. We have had some situations where an auth-worker gets into a loop, the load on the server rises and the auth-master seems blocked untill finally no new imap nor pop session are accepted. A 'doveadm reload' restores normal operations. With debug logging enabled we are observing this: auth: Debug: pam(,10.10.30.33,<7WMu3UkEGQCBsR4h>): cache miss auth-worker(24556): Debug: pam(,10.10.30.33): lookup service=dovecot auth-worker(24556): Debug: pam(,10.10.30.33): #1/1 style=2 msg=Please enter user name: ... auth-worker(24556): Debug: pam(,10.10.30.33): #1/1 style=2 msg=Please enter user name: etc etc After some time dovecot only logs Warning: Auth process not responding, delayed sending initial response (greeting) Disconnected: Auth process broken (disconnected before auth was ready, waited 26 secs) 'truss -wall -aep PID' on the looping auth-worker shows the loop: 0.0757 write(2, 0x080AE0C0, 71) = 71 0101 2 4 5 5 6 p a m ( , 1 0 . 1 0 . 3 0 . 3 3 ) : # 1 / 1 s t y l e = 2 m s g = P l e a s e e n t e r u s e r n a m e : \n 0.0826 write(2, 0x080AE0C0, 71) = 71 0101 2 4 5 5 6 p a m ( , 1 0 . 1 0 . 3 0 . 3 3 ) : # 1 / 1 s t y l e = 2 m s g = P l e a s e e n t e r u s e r n a m e : \n The host at 10.10.30.33 is running RoundCube for app 1000 concurrent users. This problem started after we provided our users RoundCube, and every time we end up in this stuck situation, it is the RoundCube-server making the connections where the username has zero length. I am unable to reproduce how RoundCube puts dovecot into this mess. With the enclosed patch installed, the loop terminates and normal operation are restored immediately: auth: Debug: pam(,10.10.30.33,): cache miss auth-worker(18658): Debug: pam(,10.10.30.33): lookup service=dovecot auth-worker(18658): Debug: pam(,10.10.30.33): #1/1 style=2 msg=Please enter user name: auth-worker(18658): Fatal: NO USER? auth-worker(18658): Error: Raw backtrace: 0xfef0798c -> 0xfef06d3b -> 0x807ca6e -> 0xfecc460e -> 0xfecc1d1e -> 0xfe3c0af4 -> 0xfecc2608 -> 0xfecc27f1 -> 0x807cc5e -> 0x807d162 -> 0x807d310 -> 0x8069ca1 -> 0x806ab72 -> 0x806aeec -> 0xfef1e866 -> 0xfef2001c -> 0xfef1e9ff -> 0xfef1e956 -> 0xfeeb0172 -> 0x8071bf2 -> 0x805a650 auth: Error: auth worker: Aborted PASSV request for : Worker process died unexpectedly I think however, that the pam driver should not have been initiated when the username has zero length, definitely there is nobody around to answer the prompt for a username ... hmk -------------- next part -------------- Common subdirectories: orig/auth and src/auth diff -ru orig/auth/passdb-pam.c src/auth/passdb-pam.c --- orig/auth/passdb-pam.c ti. okt. 14 12:04:16 2014 +++ src/auth/passdb-pam.c ti. okt. 14 12:02:28 2014 @@ -85,6 +85,8 @@ string = strdup(ctx->request->user); if (string == NULL) i_fatal_status(FATAL_OUTOFMEM, "Out of memory"); + if (strlen(string) == 0) + i_fatal_status(FATAL_OUTOFMEM, "NO USER?"); break; case PAM_PROMPT_ECHO_OFF: /* Assume we're asking for password */ From tss at iki.fi Tue Oct 14 17:08:11 2014 From: tss at iki.fi (Timo Sirainen) Date: Tue, 14 Oct 2014 10:08:11 -0700 Subject: Request to list owner In-Reply-To: References: Message-ID: On 14 Oct 2014, at 01:28, Jorge Bastos wrote: > Is it possible to change the reply-to in mailman to be the list, and not the > person who replied? I've a patched mailman that allows you to set the reply-to headers to your mails, indicating that you want replies only to list. See the "edit options" in http://dovecot.org/cgi-bin/mailman/listinfo/dovecot I sometimes (well, nowadays probably too often) reply to mails very late, and I always do reply-to-all then, because there's a good chance that the person who originally sent the mail isn't actively reading Dovecot list and would miss the reply otherwise. Also when I'm in other mailing lists I prefer people to Cc me, because I'm not actively reading any of those lists and I could easily miss the reply. But people are different and want different things. I don't know if there's any good solution to this. Except maybe if everybody always did reply-to-all and people could start configuring their mail clients in a way to hide the private replies if they don't want to see them. > Also the [Dovecot] on the subject would be handy. As mentioned, this breaks DKIM. You could create a local Sieve script to add the [Dovecot] subject. From mysql.jorge at decimal.pt Tue Oct 14 17:30:50 2014 From: mysql.jorge at decimal.pt (Jorge Bastos) Date: Tue, 14 Oct 2014 18:30:50 +0100 Subject: Request to list owner In-Reply-To: References: Message-ID: <021001cfe7d4$992efc30$cb8cf490$@jorge@decimal.pt> Perfect :) > -----Original Message----- > From: dovecot [mailto:dovecot-bounces at dovecot.org] On Behalf Of Timo > Sirainen > Sent: ter?a-feira, 14 de Outubro de 2014 18:08 > To: Dovecot Mailing List > Subject: Re: Request to list owner > > On 14 Oct 2014, at 01:28, Jorge Bastos wrote: > > > Is it possible to change the reply-to in mailman to be the list, and > > not the person who replied? > > I've a patched mailman that allows you to set the reply-to headers to > your mails, indicating that you want replies only to list. See the > "edit options" in http://dovecot.org/cgi-bin/mailman/listinfo/dovecot > > I sometimes (well, nowadays probably too often) reply to mails very > late, and I always do reply-to-all then, because there's a good chance > that the person who originally sent the mail isn't actively reading > Dovecot list and would miss the reply otherwise. Also when I'm in other > mailing lists I prefer people to Cc me, because I'm not actively > reading any of those lists and I could easily miss the reply. > > But people are different and want different things. I don't know if > there's any good solution to this. Except maybe if everybody always did > reply-to-all and people could start configuring their mail clients in a > way to hide the private replies if they don't want to see them. > > > Also the [Dovecot] on the subject would be handy. > > As mentioned, this breaks DKIM. You could create a local Sieve script > to add the [Dovecot] subject. From rs at sys4.de Tue Oct 14 17:37:57 2014 From: rs at sys4.de (Robert Schetterer) Date: Tue, 14 Oct 2014 19:37:57 +0200 Subject: Request to list owner In-Reply-To: <543D52C5.1090108@makolab.pl> References: <543CDFF3.9080907@moritz.augsburger.name> <20141014103508.4dfbc651@mydesq2.domain.cxm> <543D52C5.1090108@makolab.pl> Message-ID: <543D5F75.7060506@sys4.de> Am 14.10.2014 um 18:43 schrieb Przemys?aw Orzechowski: > Of course Thunderbird has reply to list option and if there is no sieve on the server you may define a filter in Thunderbird, guees its the same with outlook see pics in https://sys4.de/de/blog/2014/04/12/thunderbird-filter-list-id/ Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From Kind at adm.uib.no Tue Oct 14 17:44:20 2014 From: Kind at adm.uib.no (Hans Morten Kind) Date: Tue, 14 Oct 2014 19:44:20 +0200 Subject: auth-worker goes wild In-Reply-To: References: Message-ID: <20141014174420.GA12974@alf.uib.no> Seems like Timo had a fix for this already! http://hg.dovecot.org/dovecot-2.2/rev/4dc3f6103c48 It will do the trick right - we love dovecot! hmk From h.reindl at thelounge.net Tue Oct 14 17:52:29 2014 From: h.reindl at thelounge.net (Reindl Harald) Date: Tue, 14 Oct 2014 19:52:29 +0200 Subject: auth-worker goes wild In-Reply-To: <20141014174420.GA12974@alf.uib.no> References: <20141014174420.GA12974@alf.uib.no> Message-ID: <543D62DD.2030104@thelounge.net> Am 14.10.2014 um 19:44 schrieb Hans Morten Kind: > Seems like Timo had a fix for this already! > > http://hg.dovecot.org/dovecot-2.2/rev/4dc3f6103c48 > > It will do the trick right - we love dovecot! go back shortly before your first message there was a announcement for a new stable release! -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 181 bytes Desc: OpenPGP digital signature URL: From alan at ufies.org Tue Oct 14 18:25:00 2014 From: alan at ufies.org (Alan Bailward) Date: Tue, 14 Oct 2014 11:25:00 -0700 Subject: bandwidth shaping Message-ID: <09C1C4BA-100D-450F-831C-1CB21ABC8B66@ufies.org> Hey all, sorry if this has been asked before, but I haven?t really found a good solution. I have a mac at home and randomly, maybe once a week or once a month, Mail.app will go crazy and use as much bandwidth as I have to pull down mail. I?m not home so I can?t tell what it?s done or why, and sometimes it stops after an hour, sometimes it goes all night, leaving me with a potentially big bandwidth bill for my colo?d server which hosts my mail (dovecot 1.2.9, postfix 2.7.0 on Ubuntu LTS 10.04). I?m wondering if there?s a way to restrict bandwidth that?s the ?accepted? and proper way with dovecot? There isn?t anything (AFAICT) built into dovecot, and the alternative seems to be setting up bandwidth shaping with ?ip?, but that is a pretty horrible nest of ugliness. Is there a fairly simple setup to set it so imap/pop traffic can only ever use 1mb/s (or some arbitrary number)? I?m not looking for a one liner, but each time this happens I say ?I?m going to figure this out and fix this?, then get lost in ip and shaping queues and give up in frustration until the next time it happens, when I say ?I?m *really* going to figure this out this time??. Anyone have any pointers? TIA Alan From rs at sys4.de Tue Oct 14 18:32:59 2014 From: rs at sys4.de (Robert Schetterer) Date: Tue, 14 Oct 2014 20:32:59 +0200 Subject: bandwidth shaping In-Reply-To: <09C1C4BA-100D-450F-831C-1CB21ABC8B66@ufies.org> References: <09C1C4BA-100D-450F-831C-1CB21ABC8B66@ufies.org> Message-ID: <543D6C5B.3080202@sys4.de> Am 14.10.2014 um 20:25 schrieb Alan Bailward: > Hey all, sorry if this has been asked before, but I haven?t really found a good solution. I have a mac at home and randomly, maybe once a week or once a month, Mail.app will go crazy and use as much bandwidth as I have to pull down mail. I?m not home so I can?t tell what it?s done or why, and sometimes it stops after an hour, sometimes it goes all night, leaving me with a potentially big bandwidth bill for my colo?d server which hosts my mail (dovecot 1.2.9, postfix 2.7.0 on Ubuntu LTS 10.04). > > I?m wondering if there?s a way to restrict bandwidth that?s the ?accepted? and proper way with dovecot? There isn?t anything (AFAICT) built into dovecot, and the alternative seems to be setting up bandwidth shaping with ?ip?, but that is a pretty horrible nest of ugliness. > > Is there a fairly simple setup to set it so imap/pop traffic can only ever use 1mb/s (or some arbitrary number)? I?m not looking for a one liner, but each time this happens I say ?I?m going to figure this out and fix this?, then get lost in ip and shaping queues and give up in frustration until the next time it happens, when I say ?I?m *really* going to figure this out this time??. > > Anyone have any pointers? not really, you should do more analyse what happens exactly meanwhile switch to thunderbird... Ubuntu LTS 10.04 runs out of support go update to trusty which will have more recent software versions dovecot and postfix > > TIA > > Alan > Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From doctor at doctor.nl2k.ab.ca Tue Oct 14 18:53:46 2014 From: doctor at doctor.nl2k.ab.ca (The Doctor) Date: Tue, 14 Oct 2014 12:53:46 -0600 Subject: v2.2.14 released In-Reply-To: References: Message-ID: <20141014185346.GA20897@doctor.nl2k.ab.ca> Timo can you help me with this error? dovecot-2.2.14$ make make all-recursive Making all in . /bin/bash ./update-version.sh . . Making all in src Making all in lib-test Making all in lib make all-am Making all in lib-settings Making all in lib-auth Making all in lib-master Making all in lib-charset Making all in lib-dns Making all in lib-dict Making all in lib-sasl Making all in lib-ssl-iostream Making all in lib-http Making all in lib-fs Making all in lib-mail Making all in lib-imap Making all in lib-imap-storage Making all in lib-imap-client Making all in lib-imap-urlauth Making all in lib-compression Making all in lib-dovecot Making all in lib-index Making all in lib-storage Making all in list /bin/bash ../../../libtool --tag=CC --mode=compile gcc -DHAVE_CONFIG_H -I. -I../../.. -I../../../src/lib -I../../../src/lib-mail -I../../../src/lib-index -I../../../src/lib-imap -I../../../src/lib-storage -I../../../src/lib-storage/index -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -I/usr/contrib/include -MT mailbox-list-index-iter.lo -MD -MP -MF .deps/mailbox-list-index-iter.Tpo -c -o mailbox-list-index-iter.lo mailbox-list-index-iter.c libtool: compile: gcc -DHAVE_CONFIG_H -I. -I../../.. -I../../../src/lib -I../../../src/lib-mail -I../../../src/lib-index -I../../../src/lib-imap -I../../../src/lib-storage -I../../../src/lib-storage/index -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -I/usr/contrib/include -MT mailbox-list-index-iter.lo -MD -MP -MF .deps/mailbox-list-index-iter.Tpo -c mailbox-list-index-iter.c -fPIC -DPIC -o .libs/mailbox-list-index-iter.o In file included from mailbox-list-index-iter.c:8: mailbox-list-index.h:89: field `last_refresh_timeval' has incomplete type mailbox-list-index.h:112: confused by earlier errors, bailing out *** Error code 1 Stop. *** Error code 1 Stop. *** Error code 1 Stop. *** Error code 1 Stop. *** Error code 1 Stop. -- Member - Liberal International This is doctor@@nl2k.ab.ca Ici doctor@@nl2k.ab.ca God,Queen and country!Never Satan President Republic!Beware AntiChrist rising! http://www.fullyfollow.me/rootnl2k Look at Psalms 14 and 53 on Atheism Danger comes when our feelings outweigh reality. -unknown From tss at iki.fi Tue Oct 14 19:14:33 2014 From: tss at iki.fi (Timo Sirainen) Date: Tue, 14 Oct 2014 12:14:33 -0700 Subject: v2.2.14 released In-Reply-To: <20141014185346.GA20897@doctor.nl2k.ab.ca> References: <20141014185346.GA20897@doctor.nl2k.ab.ca> Message-ID: <2F3A5C77-14B8-46C5-ADE8-8E9A6E4364EF@iki.fi> On 14 Oct 2014, at 11:53, The Doctor wrote: > In file included from mailbox-list-index-iter.c:8: > mailbox-list-index.h:89: field `last_refresh_timeval' has incomplete type http://hg.dovecot.org/dovecot-2.2/rev/93a3335ec0d5 should help. From tss at iki.fi Tue Oct 14 19:25:32 2014 From: tss at iki.fi (Timo Sirainen) Date: Tue, 14 Oct 2014 12:25:32 -0700 Subject: Disabling SSLv3 protocol Message-ID: <35F49C5B-94AD-43C2-88B5-ECA68D216254@iki.fi> Since people are now talking about the SSLv3 security hole and how to disable it, here's a thread where you can talk about that. In Dovecot v2.1+ you can disable SSLv3 by setting: ssl_protocols = !SSLv2 !SSLv3 In older versions you'd have to patch the source code. Attached a patch against v2.0. I don't know if there are any clients that would break by disabling SSLv3. I'd expect all the clients to use the system (or otherwise generic) SSL libraries, which would automatically choose the TLS protocol over SSL. So my guess is that unless somebody is using over a 10 year old client there wouldn't be any problems. Maybe some old mobile phones might be using SSL.. If you find out about any clients that require SSLv3 I'd like to know about it. For Dovecot v2.3 I could maybe disable SSLv3 by default if there's no real need for it. (Also: Don't be confused by SSL/TLS protocols vs. SSL port/STARTTLS, as described in http://wiki2.dovecot.org/SSL. For example https://en.wikipedia.org/wiki/Comparison_of_email_clients#SSL_and_TLS_support is irrelevant here.) -------------- next part -------------- A non-text attachment was scrubbed... Name: dovecot-sslv3-disable.diff Type: application/octet-stream Size: 533 bytes Desc: not available URL: -------------- next part -------------- From r at sys4.de Tue Oct 14 22:24:18 2014 From: r at sys4.de (Ralf Hildebrandt) Date: Wed, 15 Oct 2014 00:24:18 +0200 Subject: Proxy problem: "[COMPRESSIONACTIVE] TLS compression already enabled" Message-ID: <20141014222418.GF775@sys4.de> We're proxying using 2.2.14~rc1 (on our IMAP Proxy) to two dovecot backend servers running dovecot-2.2.13-r1 When we're using Thundebird to connect to the dovecot proxy, we're getting the message "The mail server for account ACCOUNTNAME responded: [COMPRESSIONACTIVE] TLS compression already enabled" But why? Capabilities reported by the proxy: . OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE BINARY MOVE SEARCH=FUZZY COMPRESS=DEFLATE QUOTA] Logged in Capabilities of the backend servers when connecting directly: . OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE BINARY MOVE SEARCH=FUZZY COMPRESS=DEFLATE QUOTA] Logged in -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From tss at iki.fi Tue Oct 14 22:57:12 2014 From: tss at iki.fi (Timo Sirainen) Date: Tue, 14 Oct 2014 15:57:12 -0700 Subject: Proxy problem: "[COMPRESSIONACTIVE] TLS compression already enabled" In-Reply-To: <20141014222418.GF775@sys4.de> References: <20141014222418.GF775@sys4.de> Message-ID: On 14 Oct 2014, at 15:24, Ralf Hildebrandt wrote: > We're proxying using 2.2.14~rc1 (on our IMAP Proxy) to two dovecot > backend servers running dovecot-2.2.13-r1 > > When we're using Thundebird to connect to the dovecot proxy, we're > getting the message "The mail server for account ACCOUNTNAME > responded: [COMPRESSIONACTIVE] TLS compression already enabled" > > But why? Is the connection from proxy to backend using SSL? Did this work in earlier Dovecot version? From m at sys4.de Tue Oct 14 23:10:23 2014 From: m at sys4.de (Marc Schiffbauer) Date: Wed, 15 Oct 2014 01:10:23 +0200 Subject: Proxy problem: "[COMPRESSIONACTIVE] TLS compression already enabled" In-Reply-To: References: <20141014222418.GF775@sys4.de> Message-ID: <20141014231023.GZ13398@schiffbauer.net> * Timo Sirainen schrieb am 15.10.14 um 00:57 Uhr: >On 14 Oct 2014, at 15:24, Ralf Hildebrandt wrote: > >> We're proxying using 2.2.14~rc1 (on our IMAP Proxy) to two dovecot >> backend servers running dovecot-2.2.13-r1 >> >> When we're using Thundebird to connect to the dovecot proxy, we're >> getting the message "The mail server for account ACCOUNTNAME >> responded: [COMPRESSIONACTIVE] TLS compression already enabled" >> >> But why? > >Is the connection from proxy to backend using SSL? Did this work in earlier Dovecot version? I talked to Ralf about this issue today. Yes, proxy to backend is using ssl. And yes when proxy is talking to a 2.1.17 backend there is no issue. -Marc -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From tss at iki.fi Tue Oct 14 23:28:46 2014 From: tss at iki.fi (Timo Sirainen) Date: Tue, 14 Oct 2014 16:28:46 -0700 Subject: Disabling SSLv3 protocol In-Reply-To: <35F49C5B-94AD-43C2-88B5-ECA68D216254@iki.fi> References: <35F49C5B-94AD-43C2-88B5-ECA68D216254@iki.fi> Message-ID: <737345E4-85D0-4D9D-B2A2-A2C692B1FDE4@iki.fi> On 14 Oct 2014, at 12:25, Timo Sirainen wrote: > Since people are now talking about the SSLv3 security hole and how to disable it, here's a thread where you can talk about that. In Dovecot v2.1+ you can disable SSLv3 by setting: > > ssl_protocols = !SSLv2 !SSLv3 > > In older versions you'd have to patch the source code. Attached a patch against v2.0. It might be possible in older versions to also modify ssl_cipher_list to disable the SSLv3 ciphers. But I'm not sure if that actually works (especially without breaking TLSv1 as well). Anyway, reading https://www.openssl.org/~bodo/ssl-poodle.pdf it describes how to use the problem against web services using a similar attack as with BEAST. My understanding is that this kind of an attack is difficult or impossible to use against IMAP/POP3 protocols, because the clients always send the same pre-login data and there's nothing the attacker can do about that. Would be a good time anyway now to get rid of the SSLv3 protocol just in case there is a way to attack it. From tss at iki.fi Tue Oct 14 23:39:22 2014 From: tss at iki.fi (Timo Sirainen) Date: Tue, 14 Oct 2014 16:39:22 -0700 Subject: Proxy problem: "[COMPRESSIONACTIVE] TLS compression already enabled" In-Reply-To: <20141014231023.GZ13398@schiffbauer.net> References: <20141014222418.GF775@sys4.de> <20141014231023.GZ13398@schiffbauer.net> Message-ID: <39A52157-ADC8-4976-BCCC-ACC533441D3A@iki.fi> On 14 Oct 2014, at 16:10, Marc Schiffbauer wrote: > * Timo Sirainen schrieb am 15.10.14 um 00:57 Uhr: >> On 14 Oct 2014, at 15:24, Ralf Hildebrandt wrote: >> >>> We're proxying using 2.2.14~rc1 (on our IMAP Proxy) to two dovecot >>> backend servers running dovecot-2.2.13-r1 >>> >>> When we're using Thundebird to connect to the dovecot proxy, we're >>> getting the message "The mail server for account ACCOUNTNAME >>> responded: [COMPRESSIONACTIVE] TLS compression already enabled" >>> >>> But why? >> >> Is the connection from proxy to backend using SSL? Did this work in earlier Dovecot version? > > I talked to Ralf about this issue today. Yes, proxy to backend is using ssl. And yes when proxy is talking to a 2.1.17 backend there is no issue. Right .. If the TLS connection already has compression enabled, Dovecot will refuse COMPRESS command. But it should be checking this against the original client's TLS connection and not the proxy's. As a workaround you could set in Dovecot backends "ssl_options = no_compression". I'll try to figure out how this should be fixed properly. From tss at iki.fi Tue Oct 14 23:58:39 2014 From: tss at iki.fi (Timo Sirainen) Date: Tue, 14 Oct 2014 16:58:39 -0700 Subject: Proxy problem: "[COMPRESSIONACTIVE] TLS compression already enabled" In-Reply-To: <39A52157-ADC8-4976-BCCC-ACC533441D3A@iki.fi> References: <20141014222418.GF775@sys4.de> <20141014231023.GZ13398@schiffbauer.net> <39A52157-ADC8-4976-BCCC-ACC533441D3A@iki.fi> Message-ID: <68D88E80-5EE6-4C84-B0B2-5563B9F4F0F2@iki.fi> On 14 Oct 2014, at 16:39, Timo Sirainen wrote: > On 14 Oct 2014, at 16:10, Marc Schiffbauer wrote: > >> * Timo Sirainen schrieb am 15.10.14 um 00:57 Uhr: >>> On 14 Oct 2014, at 15:24, Ralf Hildebrandt wrote: >>> >>>> We're proxying using 2.2.14~rc1 (on our IMAP Proxy) to two dovecot >>>> backend servers running dovecot-2.2.13-r1 >>>> >>>> When we're using Thundebird to connect to the dovecot proxy, we're >>>> getting the message "The mail server for account ACCOUNTNAME >>>> responded: [COMPRESSIONACTIVE] TLS compression already enabled" >>>> >>>> But why? >>> >>> Is the connection from proxy to backend using SSL? Did this work in earlier Dovecot version? >> >> I talked to Ralf about this issue today. Yes, proxy to backend is using ssl. And yes when proxy is talking to a 2.1.17 backend there is no issue. > > Right .. If the TLS connection already has compression enabled, Dovecot will refuse COMPRESS command. But it should be checking this against the original client's TLS connection and not the proxy's. As a workaround you could set in Dovecot backends "ssl_options = no_compression". I'll try to figure out how this should be fixed properly. After thinking about this for a while, I decided to simply remove the check: http://hg.dovecot.org/dovecot-2.2/rev/e3b9cd19c33d Annoyingly it now leaves a bunch of unused code for setting the tls_compression flag. But it's a bit annoying to remove that code also. From jtam.home at gmail.com Wed Oct 15 00:09:13 2014 From: jtam.home at gmail.com (Joseph Tam) Date: Tue, 14 Oct 2014 17:09:13 -0700 (PDT) Subject: delete/archive old mail In-Reply-To: References: Message-ID: "F." writes: >>> doveadm-altmove seems interesting, but in the man page it is reported >>> only work with dbox (dbox-only), and my inboxes are in mbox format. >>> >>> Any other advice? > > As I originally wrote, my need is script or a command like the old > Expire_mail.pl that parse a local mbox folder and move/copy mail older > than NN days to another local mbox folder. > Probably for a Perl programmer is only matter of modify this script or > something similar. > I searched in docs, wiki, ... but not noticied something that can simply > be inserted in a cron job to do the work. > > Only migration tools or complex (for me), library that can be used to > manipulate folders :-) I don't understand how you could have found doveadm-altmove, but miss doveadm-move -- doesn't this dovecot command do exactly what you want? $ man doveadm-move NAME doveadm-move - Move messages matching the given search query into another mailbox ... EXAMPLE Move janes messages - received in September 2011 - from her INBOX into her archive. doveadm move -u jane Archive/2011/09 mailbox 2011-10-01 SINCE 01-Sep-2011 [Is this a typo: "2011-10-01" should be "INBOX"?] The example is fairly close to what you want. Apart from the obvious change to user and mailbox name, the condition would be "savedbefore ${NN}d". You might have to follow this up with an expunge if this operation does not do that. Joseph Tam From m at sys4.de Wed Oct 15 02:06:49 2014 From: m at sys4.de (Marc Schiffbauer) Date: Wed, 15 Oct 2014 04:06:49 +0200 Subject: Proxy problem: "[COMPRESSIONACTIVE] TLS compression already enabled" In-Reply-To: <39A52157-ADC8-4976-BCCC-ACC533441D3A@iki.fi> References: <20141014222418.GF775@sys4.de> <20141014231023.GZ13398@schiffbauer.net> <39A52157-ADC8-4976-BCCC-ACC533441D3A@iki.fi> Message-ID: <20141015020649.GC13398@schiffbauer.net> * Timo Sirainen schrieb am 15.10.14 um 01:39 Uhr: >On 14 Oct 2014, at 16:10, Marc Schiffbauer wrote: > >> * Timo Sirainen schrieb am 15.10.14 um 00:57 Uhr: >>> On 14 Oct 2014, at 15:24, Ralf Hildebrandt wrote: >>> >>>> We're proxying using 2.2.14~rc1 (on our IMAP Proxy) to two dovecot >>>> backend servers running dovecot-2.2.13-r1 >>>> >>>> When we're using Thundebird to connect to the dovecot proxy, we're >>>> getting the message "The mail server for account ACCOUNTNAME >>>> responded: [COMPRESSIONACTIVE] TLS compression already enabled" >>>> >>>> But why? >>> >>> Is the connection from proxy to backend using SSL? Did this work in earlier Dovecot version? >> >> I talked to Ralf about this issue today. Yes, proxy to backend is using ssl. And yes when proxy is talking to a 2.1.17 backend there is no issue. > >Right .. If the TLS connection already has compression enabled, Dovecot will refuse COMPRESS command. But it should be checking this against the original client's TLS connection and not the proxy's. As a workaround you could set in Dovecot backends "ssl_options = no_compression". I'll try to figure out how this should be fixed properly. Timo, thanks for the workaround. After finding out that this requires 2.2.14 too (had 2.2.13 before) it works like a charme now. -Marc -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From tss at iki.fi Wed Oct 15 03:05:57 2014 From: tss at iki.fi (Timo Sirainen) Date: Tue, 14 Oct 2014 20:05:57 -0700 Subject: Corrupted index cache after migrating from maildir to mdbox In-Reply-To: <54275AD9.2080900@bastelfreak.de> References: <54275AD9.2080900@bastelfreak.de> Message-ID: <408E7528-3DA5-4469-ADB8-0278679DC3A7@iki.fi> On 27 Sep 2014, at 17:48, Tim wrote: > unfortunately I'm getting the following two kinds of error messages for > all mail boxes in my mail.log: > > Error: Corrupted index cache file > /home/vmail/%domain/%user/mdbox/mailboxes/%maildir/dbox-Mails/dovecot.index.cache: > Broken virtual size for mail UID 2564 > > and: > > Error: read(/home/vmail/%domain/%user/mdbox/storage/m.108 > ): FETCH BODY[] for mailbox %maildir UID 2564 got too little data: 2417 > vs 6319 If that happens to all the mails, something went wrong. Did you maybe use zlib plugin while writing the messages (compressed), but now you're trying to read the mails without zlib plugin? The error messages may be somewhat confusing. The problem isn't dovecot.index.cache file, but that the message sizes in the m.* files don't match the contents. There's no easy way to fix those, because they should just about never be wrong. From tss at iki.fi Wed Oct 15 03:18:57 2014 From: tss at iki.fi (Timo Sirainen) Date: Tue, 14 Oct 2014 20:18:57 -0700 Subject: Dbox and Exim In-Reply-To: <5437907F.3070204@rodier.me> References: <64621E0A-9DFB-4AC8-A732-0B1C02C84388@iki.fi> <5437907F.3070204@rodier.me> Message-ID: <994EDBEC-CC8B-4B0D-BB31-FAC7C27962CF@iki.fi> On 10 Oct 2014, at 00:53, Andre Rodier wrote: > On 09/10/14 23:06, Timo Sirainen wrote: >> On 09 Oct 2014, at 15:20, C Peters wrote: >> >>> The Dovecot wiki [1] doesn't list either Exim, Postfix or anything >>> else as supporting the dbox. I did some searching in the Exim >>> archives and have found only one message mentioning dbox, sdbox or >>> mdbox. [2] I think an RFC would go a long way towards getting the >>> format supported. Has Timo, or anyone else, considered submitting an >>> RFC to the IETF? >> >> No, and I don't want it to happen anytime in near future. The dbox format is highly Dovecot-specific, because it relies on Dovecot's index files. These index files are still changing and I'm not sure if they will ever be fully finished. I don't want any other software to even attempt to implement the same functionality. > > I am sorry if I am presumptuous or out of topic, but it seems to me that the mail storage should be standardised. > > I am still using Maildir myself, simply because I like the simplicity, one file is one email, one directory is one email folder, for backup or restore. Sure, mbox and Maildir are pretty standard. And Maildir is especially good if you care about reliability more than performance. But dbox was especially designed for performance - trying to standardize it in any way would limit the ability to improve its performance in future. So dbox isn't really meant for people who want to use any kind of a standard, it's for people who want as good performance from Dovecot as possible. > A feature I would like, is dovecot being able to store emails in databases, SQL or NoSQL. I would use this for archiving and queries purposes. MariaDB / Drizzle, or MongoDB, CouchDB, etc. There is plenty of choice. Dovecot's (commercial) object storage plugin could probably be used with NoSQL servers. We've been looking into Cassandra support at least. > Maybe this storage scheme would be slower, but IMHO, this is not a problem when people just want to archive their emails on a remote computer. > > Maybe I could start this if I had some template or example to start. There's a very old SQL storage plugin for Dovecot. It would require a lot of work though: http://dovecot.org/patches/mail-sql.patch http://dovecot.org/patches/mail-sql.tar.gz There is actually also a working read-only SQL storage plugin that supports only INBOX. I could send the sources for that as well. From leo at strike.wu.ac.at Wed Oct 15 08:14:44 2014 From: leo at strike.wu.ac.at (Alexander 'Leo' Bergolth) Date: Wed, 15 Oct 2014 10:14:44 +0200 Subject: permissions when moving mails Message-ID: <543E2CF4.6020103@strike.wu.ac.at> Hi! I am using Unix groups to control access to shared mailboxes. This works fine as long as files are not moved between mailboxes that are owned by different groups. The move operation doesn't change group ownership of the mail. Is there a way to force dovecot to e.g. inherit the ownership from the parent folder, not only for new messages bot also for messages moved from one folder to another? The wiki says: http://wiki2.dovecot.org/SharedMailboxes/Permissions -------------------- 8< -------------------- When mails are copied between Maildirs, it's usually done by hard linking. If the source and destination directory permissions are different, Dovecot create a new file and copies data the slow way so that it can assign the wanted destination permissions. The source and destination permission lookups are done only by looking at the mailbox root directories' permissions, not individual mail files. This may become a problem if the mail files' permissions aren't as Dovecot expects. -------------------- 8< -------------------- Does dovecot only look at the permissions or does it also take user/group ownership into account? The behavior I experience is that even though the mailbox directories are owned by different groups, dovecot doesn't copy the mails. (See my example below.) Setting maildir_copy_with_hardlinks = no seems to fix the problem but maybe this behavior should be considered as a bug? I am using dovecot 2.2.14 and maildir mailboxes. Cheers, --leo P.S.: Here is an example of the current behavior: before the move from PAS to GSD: -------------------- 8< -------------------- GSD/.Eingang/cur/: total 0 drwxrws--- 2 nobody gsd 6 Oct 13 13:46 . drwxrws--- 5 nobody gsd 81 Oct 15 09:41 .. PAS/.Eingang/cur/: total 4 drwxrws--- 2 nobody pas 89 Oct 15 09:39 . drwxrws--- 5 nobody pas 79 Oct 15 09:39 .. -rw-rw-r-- 1 nobody pas 4073 Jul 8 08:14 1404967500.M656935P20690.samba.intern.rk-klosterneuburg.at,S=4073,W=4213:2,S -------------------- 8< -------------------- after the move: -------------------- 8< -------------------- GSD/.Eingang/cur/: total 4 drwxrws--- 2 nobody gsd 87 Oct 15 09:42 . drwxrws--- 5 nobody gsd 81 Oct 15 09:42 .. -rw-rw-r-- 1 nobody pas 4073 Jul 8 08:14 1413358925.M22574P3008.samba.intern.rk-klosterneuburg.at,S=4073,W=4213:2,S PAS/.Eingang/cur/: total 0 drwxrws--- 2 nobody pas 6 Oct 15 09:42 . drwxrws--- 5 nobody pas 79 Oct 15 09:42 .. -------------------- 8< -------------------- Mailbox directories are: -------------------- 8< -------------------- drwxrws--- 4 nobody pas 143 Nov 25 2013 PAS drwxrws--- 5 nobody pas 79 Oct 15 09:57 PAS/.Eingang drwxrws--- 10 nobody gsd 4096 Dec 11 2013 GSD drwxrws--- 5 nobody gsd 81 Oct 15 09:42 GSD/.Eingang -------------------- 8< -------------------- (In my own litte world, the mail should now be owned by the gsd group.. :-)) -- e-mail ::: Leo.Bergolth (at) wu.ac.at fax ::: +43-1-31336-906050 location ::: IT-Services | Vienna University of Economics | Austria From bernd at petrovitsch.priv.at Wed Oct 15 09:00:10 2014 From: bernd at petrovitsch.priv.at (Bernd Petrovitsch) Date: Wed, 15 Oct 2014 11:00:10 +0200 Subject: Request to list owner In-Reply-To: References: Message-ID: <1413363611.9236.3.camel@thorin> On Die, 2014-10-14 at 09:28 +0100, Jorge Bastos wrote: [...] > Sorry for this. Than don't write it. > Is it possible to change the reply-to in mailman to be the list, and not the > person who replied? Alas, it is possible but not good: http://www.unicom.com/pw/reply-to-harmful.html https://woozle.org/~neale/papers/reply-to-still-harmful.html > Also the [Dovecot] on the subject would be handy. That wastes screen space and mail filtering is - in the 21st century - better done on List-Id and similar headers. > Just two things to get better. No, much much worse. Bernd -- "I dislike type abstraction if it has no real reason. And saving on typing is not a good reason - if your typing speed is the main issue when you're coding, you're doing something seriously wrong." - Linus Torvalds From pbopbo at freemail.hu Wed Oct 15 15:24:41 2014 From: pbopbo at freemail.hu (Peter Benko) Date: Wed, 15 Oct 2014 17:24:41 +0200 (CEST) Subject: mmap_disable=yes not honored always Message-ID: Hi all, I'm experimenting with having the mail store on a 9p file system that lacks mmap() functionality. So I disabled it in dovecot: mmap_disable = yes However, I keep getting the following error messages in my log: Oct 15 16:55:00 computer-name dovecot: imap user at domain.com[192.168.1.3] Error: mmap() failed with file /mail/mailboxes/domain.com/user/indexpvt-accounts/other-user/mailboxes/INBOX/dovecot.index.pvt.log: Invalid argument I only get those messages for the shared folder's private indexes. This setup works perfectly on an ext2/3/4 fs. Any opinions, is this a bug? Is mmap_disable not mandatory for all operations? Best regards, Peter From pbopbo at freemail.hu Wed Oct 15 15:31:48 2014 From: pbopbo at freemail.hu (Peter Benko) Date: Wed, 15 Oct 2014 17:31:48 +0200 (CEST) Subject: mmap_disable=yes not honored always Message-ID: Hi all, I'm experimenting with having the mail store on a 9p file system that lacks mmap() functionality. So I disabled it in dovecot: mmap_disable = yes However, I keep getting the following error messages in my log: Oct 15 16:55:00 computer-name dovecot: imap user at domain.com[192.168.1.3] Error: mmap() failed with file /mail/mailboxes/domain.com/user/indexpvt-accounts/other-user/mailboxes/INBOX/dovecot.index.pvt.log: Invalid argument I only get those messages for the shared folder's private indexes. This setup works perfectly on an ext2/3/4 fs. Any opinions, is this a bug? Is mmap_disable not mandatory for all operations? Best regards, Peter From chayes at afo.net Wed Oct 15 19:10:01 2014 From: chayes at afo.net (Cliff Hayes) Date: Wed, 15 Oct 2014 14:10:01 -0500 Subject: Permissions problem on new installation Message-ID: <543EC689.1000104@afo.net> I am setting up a new mail server using imap only on Scientific Linux 6.5 and dovecot 2.0.9. How do I fix this problem? I keep getting these errors regardless of permissions ... even up to 777. Oct 15 13:56:01 avalon dovecot: imap(chayes at domain.tld): Error: opendir(/var/email/chayes at domain.tld/Maildir) failed: Permission denied (euid=497(chayes) egid=12(mail) missing +r perm: /var/email/chayes at domain.tld/Maildir, euid is not dir owner) Oct 15 13:56:01 avalon dovecot: imap(chayes at domain.tld): Error: opendir(/var/email/chayes at domain.tld/Maildir) failed: Permission denied (euid=497(chayes) egid=12(mail) missing +r perm: /var/email/chayes at domain.tld/Maildir, euid is not dir owner) Oct 15 13:56:01 avalon dovecot: imap(chayes at domain.tld): Error: opendir(/var/email/chayes at domain.tld/Maildir/new) failed: Permission denied (euid=497(chayes) egid=12(mail) missing +r perm: /var/email/chayes at domain.tld/Maildir/new, euid is not dir owner) Oct 15 13:56:07 avalon dovecot: imap(chayes at domain.tld): Error: opendir(/var/email/chayes at domain.tld/Maildir/new) failed: Permission denied (euid=497(chayes) egid=12(mail) missing +r perm: /var/email/chayes at domain.tld/Maildir/new, euid is not dir owner) Yet when i check, chayes is directory owner as follows (currently showing 760 but I've tried everything): drwx------. 3 chayes mail 4096 Oct 15 12:56 chayes at domain.tld drwxrwx---. 6 chayes mail 4096 Oct 15 13:55 Maildir drwxrw----. 2 chayes mail 4096 Oct 15 12:56 cur -rw-------. 1 chayes mail 104 Oct 15 12:56 dovecot.index.log -rw-------. 1 chayes mail 0 Oct 15 12:56 dovecot.mailbox.log -rw-------. 1 chayes mail 51 Oct 15 12:56 dovecot-uidlist drwxrw----. 2 chayes mail 4096 Oct 15 12:56 new -rw-------. 1 chayes mail 6 Oct 15 12:56 subscriptions drwxrw----. 2 chayes mail 4096 Oct 15 12:56 tmp dovecot config: protocols = imap mail_access_groups=mail mail_location = maildir:~/Maildir Thanks in advance. From user+dovecot at localhost.localdomain.org Wed Oct 15 19:37:04 2014 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Wed, 15 Oct 2014 19:37:04 +0000 Subject: doveadm-move(1) [was: Re: delete/archive old mail] In-Reply-To: References: Message-ID: <543ECCE0.1000005@localhost.localdomain.org> On 10/15/2014 12:09 AM, Joseph Tam wrote: > ... > > EXAMPLE > Move janes messages - received in September 2011 - from her > INBOX into her archive. > > doveadm move -u jane Archive/2011/09 mailbox > 2011-10-01 SINCE 01-Sep-2011 > > [Is this a typo: "2011-10-01" should be "INBOX"?] > ? Where did you find this example? ,--[ doveadm-move(1) 2013-11-23 ]-- | EXAMPLE | Move jane's messages - received in September 2011 - from her INBOX into | her archive. | | doveadm move -u jane Archive/2011/09 mailbox INBOX BEFORE \ | 2011-10-01 SINCE 01-Sep-2011 `-- Also http://wiki2.dovecot.org/Tools/Doveadm/Move#section_example shows the correct example. Regards, Pascal -- The trapper recommends today: cafefeed.1428821 at localdomain.org From chayes at afo.net Wed Oct 15 20:25:38 2014 From: chayes at afo.net (Cliff Hayes) Date: Wed, 15 Oct 2014 15:25:38 -0500 Subject: Permissions problem on new installation In-Reply-To: <543EC689.1000104@afo.net> References: <543EC689.1000104@afo.net> Message-ID: <543ED842.8010009@afo.net> Please disregard. selinux was blocking. On 10/15/2014 2:10 PM, Cliff Hayes wrote: > I am setting up a new mail server using imap only on Scientific Linux > 6.5 and dovecot 2.0.9. How do I fix this problem? > > I keep getting these errors regardless of permissions ... even up to 777. > > Oct 15 13:56:01 avalon dovecot: imap(chayes at domain.tld): Error: > opendir(/var/email/chayes at domain.tld/Maildir) failed: Permission denied > (euid=497(chayes) egid=12(mail) missing +r perm: > /var/email/chayes at domain.tld/Maildir, euid is not dir owner) > > Oct 15 13:56:01 avalon dovecot: imap(chayes at domain.tld): Error: > opendir(/var/email/chayes at domain.tld/Maildir) failed: Permission denied > (euid=497(chayes) egid=12(mail) missing +r perm: > /var/email/chayes at domain.tld/Maildir, euid is not dir owner) > > Oct 15 13:56:01 avalon dovecot: imap(chayes at domain.tld): Error: > opendir(/var/email/chayes at domain.tld/Maildir/new) failed: Permission > denied (euid=497(chayes) egid=12(mail) missing +r perm: > /var/email/chayes at domain.tld/Maildir/new, euid is not dir owner) > > Oct 15 13:56:07 avalon dovecot: imap(chayes at domain.tld): Error: > opendir(/var/email/chayes at domain.tld/Maildir/new) failed: Permission > denied (euid=497(chayes) egid=12(mail) missing +r perm: > /var/email/chayes at domain.tld/Maildir/new, euid is not dir owner) > > Yet when i check, chayes is directory owner as follows (currently > showing 760 but I've tried everything): > > drwx------. 3 chayes mail 4096 Oct 15 12:56 chayes at domain.tld > > drwxrwx---. 6 chayes mail 4096 Oct 15 13:55 Maildir > > drwxrw----. 2 chayes mail 4096 Oct 15 12:56 cur > -rw-------. 1 chayes mail 104 Oct 15 12:56 dovecot.index.log > -rw-------. 1 chayes mail 0 Oct 15 12:56 dovecot.mailbox.log > -rw-------. 1 chayes mail 51 Oct 15 12:56 dovecot-uidlist > drwxrw----. 2 chayes mail 4096 Oct 15 12:56 new > -rw-------. 1 chayes mail 6 Oct 15 12:56 subscriptions > drwxrw----. 2 chayes mail 4096 Oct 15 12:56 tmp > > dovecot config: > > protocols = imap > mail_access_groups=mail > mail_location = maildir:~/Maildir > > Thanks in advance. > From James.Shewey at panasonic.aero Wed Oct 15 21:17:22 2014 From: James.Shewey at panasonic.aero (James Shewey) Date: Wed, 15 Oct 2014 21:17:22 +0000 Subject: pop3-login segfaulting In-Reply-To: <543D494E.2000400@sys4.de> References: <34009FB6A0D66E47AA133778D6DEA40E59F305@Mail-sna05.mascorp.com> <543D494E.2000400@sys4.de> Message-ID: <34009FB6A0D66E47AA133778D6DEA40E5A1589@Mail-sna05.mascorp.com> This was solved by upgrading my config file using "doveconf -n -c /etc/dovecot/dovecot.conf > dovecot-2.conf" The other problem I was running into was my dovecot.conf file was getting changed to a symlink to itself and I was getting an error " Fatal: Error reading configuration: read(/opt/dovecot/config) failed: Connection reset by peer. This was resolved by changing the base_dir = to an empty directory that did not contain dovecot.conf. Regards, James Shewey NOC Systems Administrator I Product Support Engineering Panasonic Avionics Corporation Phone: +1 (949) 672-2000 Direct: +1 (949) 595-5187 -----Original Message----- From: dovecot [mailto:dovecot-bounces at dovecot.org] On Behalf Of Robert Schetterer Sent: Tuesday, October 14, 2014 9:03 AM To: dovecot at dovecot.org Subject: Re: pop3-login segfaulting Am 14.10.2014 um 17:53 schrieb James Shewey: > I upgraded dovecot from v1 to v2 as part of a CentOS upgrade (5.6->6.5) and am now running on 2.0.9. Any time I connect to the pop or imap ports however I get "master: Error: service(imap-login): child 2860 killed with signal 11 (core not dumped - add -D parameter to service imap-login { executable }" after following the core dump instructions at http://www.dovecot.org/bugreport.html. > > The problem is that I'm not sure how these processes are spawned in order to add the switch. Can I spawn them directly? If so, I ought to be able to do an strace to track down the issue as well. > > Regards, > > James Shewey > NOC Systems Administrator I > Product Support Engineering > > [Description: Panasonic Avionics] > Panasonic Avionics Corporation > Phone: +1 (949) 672-2000 > Direct: +1 (949) 595-5187 > > You should upgrade to a more recent version, debugging 2.0.9 makes less sense Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From jtam.home at gmail.com Wed Oct 15 23:16:37 2014 From: jtam.home at gmail.com (Joseph Tam) Date: Wed, 15 Oct 2014 16:16:37 -0700 (PDT) Subject: doveadm-move(1) In-Reply-To: References: Message-ID: Pascal Volk writes: >> EXAMPLE >> Move janes messages - received in September 2011 - from her >> INBOX into her archive. >> >> doveadm move -u jane Archive/2011/09 mailbox >> 2011-10-01 SINCE 01-Sep-2011 >> >> [Is this a typo: "2011-10-01" should be "INBOX"?] >> ? > > Where did you find this example? Cut&pasted off the terminal man page output. Looking into man1/doveadm-move.1, I see .B doveadm move \-u jane Archive/2011/09 mailbox INBOX BEFORE \(rs .B 2011-10-01 SINCE 01-Sep-2011 so it's a problem with my nroff, not dovecot's man pages. (Hmm, it happens with groff too -- it appears to be some sort of line length bug.) > Also http://wiki2.dovecot.org/Tools/Doveadm/Move#section_example > shows the correct example. Yes, this makes much more sense. Joseph Tam From user+dovecot at localhost.localdomain.org Wed Oct 15 23:27:15 2014 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Wed, 15 Oct 2014 23:27:15 +0000 Subject: doveadm-move(1) In-Reply-To: References: Message-ID: <543F02D3.6010404@localhost.localdomain.org> On 10/15/2014 11:16 PM, Joseph Tam wrote: > Pascal Volk writes: >> Where did you find this example? > > Cut&pasted off the terminal man page output. Looking into > man1/doveadm-move.1, I see > > .B doveadm move \-u jane Archive/2011/09 mailbox INBOX BEFORE \(rs > .B 2011-10-01 SINCE 01-Sep-2011 > > so it's a problem with my nroff, not dovecot's man pages. (Hmm, it > happens with groff too -- it appears to be some sort of line length bug.) Well, there was a problem with non-escaped dashes. But that was fixed 10 months ago: http://hg.dovecot.org/dovecot-2.2/diff/8a3d0426f514/doc/man/doveadm-move.1.in I'm not sure, if that is the reason for the problem. Which OS, *roff are you using? Maybe I'm able to reproduce the problem. :-) Regards, Pascal -- The trapper recommends today: c01dcafe.1428901 at localdomain.org From chayes at afo.net Thu Oct 16 05:29:55 2014 From: chayes at afo.net (Cliff Hayes) Date: Thu, 16 Oct 2014 00:29:55 -0500 Subject: Unable to get virtual users set up with database auth Message-ID: <543F57D3.5060806@afo.net> I can't seem to get imap virtual users to work with database authentication on new Scientific Linux 6.5 server with Sendmail 8.14.4 & Dovecot 2.0.9 Apparently I have to also create system users because sendmail/procmail/dovecot want to check directory ownership. So I created a database, made entry for the user, created the user chayes on the system. But %u always contains just chayes instead of chayes at domain.tld even though I tried different select statements to put the entire username in the username field. This causes the following errors: Oct 16 00:10:26 avalon sendmail[2536]: s9G5APo9002535: forward /var/spool/mail/chayes at domain.tld/chayes/.forward.avalon: Group writable directory Oct 16 00:10:26 avalon sendmail[2536]: s9G5APo9002535: forward /var/spool/mail/chayes at domain.tld/chayes/.forward: Group writable directory Oct 16 00:10:26 avalon dovecot: lda(chayes): Debug: Effective uid=497, gid=497, home=/var/spool/mail/chayes at domain.tld/chayes Oct 16 00:10:26 avalon dovecot: lda(chayes): Debug: Home dir not found: /var/spool/mail/chayes at domain.tld/chayes Oct 16 00:10:26 avalon dovecot: lda(chayes): Debug: Namespace : type=private, prefix=, sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=mbox:/var/spool/mail/chayes:INBOX=/var/spool/mail/chayes Oct 16 00:10:26 avalon dovecot: lda(chayes): Debug: fs: root=/var/spool/mail/chayes, index=, control=, inbox=/var/spool/mail/chayes Oct 16 00:10:26 avalon dovecot: lda(chayes): Error: user chayes: Initialization failed: Namespace '': mbox: mbox root directory can't be a file: /var/spool/mail/chayes (http://wiki.dovecot.org/MailLocation/Mbox) Oct 16 00:10:26 avalon dovecot: lda(chayes): Fatal: Invalid user settings. Refer to server log for more information. protocols = imap mail_location = mbox:/var/spool/mail/%u:INBOX=/var/spool/mail/%u password_query = SELECT uNameDomain as username, uDomain as domain, uPass as password FROM users WHERE uName = '%n' AND uDomain = '%d' also tried password_query = SELECT uName as username, uDomain as domain, uPass as password FROM users WHERE uName = '%n' AND uDomain = '%d' # file: /etc/procmailrc # system-wide settings for procmail SHELL="/bin/bash" SENDMAIL="/usr/sbin/sendmail -oi -t" LOGFILE="/var/log/procmail.log" DROPPRIVS=yes DELIVER="/usr/libexec/dovecot/deliver" #MAILDIR=$HOME/ #DEFAULT=$HOME/ :0 w * ^X-Spam-Status: Yes | $DELIVER -m spam :0 w | $DELIVER Thanks in advance From lists at luigirosa.com Thu Oct 16 07:09:50 2014 From: lists at luigirosa.com (Luigi Rosa) Date: Thu, 16 Oct 2014 09:09:50 +0200 Subject: LastLogin In-Reply-To: References: Message-ID: <543F6F3E.30709@luigirosa.com> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Timo Sirainen wrote on 14/10/2014 18:53: > + Added last-login plugin to set user's last-login timestamp on login. According to http://wiki2.dovecot.org/Plugins/LastLogin the plugin uses redis, but can use other dictionaries If I have MySQL as userbase backend what field(s) should be created to have this information recordered in the database? Ciao, luigi - -- / +--[Luigi Rosa]-- \ Afternoon: that part of the day we spend worrying about how we wasted the morning. -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQIcBAEBAgAGBQJUP285AAoJEO5WT/qgw4yKPngQAKYkmLQuVf3/ViWfWOkwah52 vYv6uXYcWWRa76NNIVGLw4I9LMWv1Nw0DWNAJotPkHBggbBzkc396Etb+6qrj0uT zNz/uHfsv4CJquxRFyGtGal+j9ZeG2T60PtZXkh+sHAnShSmbvsr+RzLgJOzfYVh o5RAW//bLiRdyVun32ZRwHLwueI14ppQxnAQOMuvTZNUxYg3nxUnkOObx2/5pGmq bv61gg+AFK74/QoMZrK9UdS3Pg7gQU8PXd2j4tv08iuJ4MjBlHx14aye0hdc1T6p 1VlM8kd/nh62B7hQEBPxRB0G2jVA/LM58ENO7MmbsX3E5+p1hgg++aw7prmsZvw8 mpM5MazHzj78jdclNVa94TqOnXOJ/3D5+0bEAILu20QchjP4aFcmAHf3xZW6lA1t ZcCYb2n/UOEL2+9vaR8ngAqpi/14mmgQQL1r9rqNDqx8uZGzfRq1LKD2RyQ+Vt0e ui7eMnL4dNMhpW+IU3eGH8+/V7gf2Aj5MRFDZ8r+nzi6PdjSRBwRz5/arrc87r2P XmYebH6bRYMpVYHoWk76HrOkOSrYmYYRYijqfMivLoF1Fa25XDu4wqN55D+VZgEa 5Ad8/BSvhV0Yhg9yVoqXGREbxPLlQAQ8RA2fMhm5I1pqr3YYxoh5ayFiAGPBhnD1 aBFenPPnc6DnN+luxFWj =5H+W -----END PGP SIGNATURE----- From leo at strike.wu.ac.at Thu Oct 16 07:45:42 2014 From: leo at strike.wu.ac.at (Alexander 'Leo' Bergolth) Date: Thu, 16 Oct 2014 09:45:42 +0200 Subject: v2.2.14 released In-Reply-To: References: Message-ID: <543F77A6.2000902@strike.wu.ac.at> On 10/14/2014 06:53 PM, Timo Sirainen wrote: > - Fixed several race conditions with dovecot.index.cache handling that > may have caused unnecessary "cache is corrupted" errors. Rejoyed too soon! :-( Unfortunately it doesn't fix my (maybe mbox related) index.cache errors reported back in May: http://markmail.org/message/xhxorbutl3encr2d I know that Timo suggests to switch away from mbox but unfortunately this is rather challenging for me. Switching to maildir results in millions of files and this overwhelmes my backup system. mdbox also does not qualify since AFAIK there is no python or perl library support for manipulating mdbox mailboxes. :-( -------------------- 8< -------------------- Oct 15 15:08:34 samba dovecot: imap(USER1): Error: Corrupted index cache file /home/USER1/mail/.imap/INBOX/dovecot.index.cache: Broken physical size for mail UID 75144 Oct 15 15:08:34 samba dovecot: imap(USER1): Error: copy: i_stream_read() failed: Invalid argument Oct 15 15:08:34 samba dovecot: imap(USER1): Error: read(/var/mail/USER1) failed: Cached message size smaller than expected (55337 < 55338) (uid=51556, box=Trash) Oct 15 15:20:02 samba dovecot: imap(USER2): Error: Cached message size smaller than expected (282553 < 282554) Oct 15 15:20:02 samba dovecot: imap(USER2): Error: Corrupted index cache file /home/USER2/mail/.imap/INBOX/dovecot.index.cache: Broken physical size for mail UID 12364 Oct 15 15:20:02 samba dovecot: imap(USER2): Error: read(/var/mail/USER2) failed: Cached message size smaller than expected (282553 < 282554) (FETCH BODY[2] for mailbox INBOX UID 12364) Oct 15 15:50:30 samba dovecot: imap(USER3): Error: Cached message size smaller than expected (58902 < 58903) Oct 15 15:50:30 samba dovecot: imap(USER3): Error: Corrupted index cache file /home/USER3/mail/.imap/INBOX/dovecot.index.cache: Broken physical size for mail UID 19810 Oct 15 15:50:30 samba dovecot: imap(USER3): Error: read(/var/mail/USER3) failed: Cached message size smaller than expected (58902 < 58903) (FETCH BODY[] for mailbox INBOX UID 19810) Oct 15 16:02:56 samba dovecot: imap(USER4): Error: Cached message size smaller than expected (181831 < 181832) Oct 15 16:02:56 samba dovecot: imap(USER4): Error: Corrupted index cache file /home/USER4/mail/.imap/INBOX/dovecot.index.cache: Broken physical size for mail UID 2178 Oct 15 16:02:56 samba dovecot: imap(USER4): Error: read(/var/mail/USER4) failed: Cached message size smaller than expected (181831 < 181832) (FETCH BODY[] for mailbox INBOX UID 2178) Oct 15 16:18:24 samba dovecot: imap(USER1): Error: Cached message size smaller than expected (55339 < 55340) Oct 15 16:18:24 samba dovecot: imap(USER1): Error: Corrupted index cache file /home/USER1/mail/.imap/INBOX/dovecot.index.cache: Broken physical size for mail UID 75144 Oct 15 16:18:24 samba dovecot: imap(USER1): Error: copy: i_stream_read() failed: Invalid argument Oct 15 16:18:24 samba dovecot: imap(USER1): Error: read(/var/mail/USER1) failed: Cached message size smaller than expected (55339 < 55340) (uid=51559, box=Trash) Oct 15 16:44:15 samba dovecot: imap(USER5): Error: Cached message size smaller than expected (6951359 < 6951360) Oct 15 16:44:15 samba dovecot: imap(USER5): Error: Corrupted index cache file /home/USER5/mail/.imap/INBOX/dovecot.index.cache: Broken physical size for mail UID 5023 Oct 15 16:44:15 samba dovecot: imap(USER5): Error: read(/var/mail/USER5) failed: Cached message size smaller than expected (6951359 < 6951360) (FETCH BODY[3] for mailbox INBOX UID 5023) Oct 15 21:27:45 samba dovecot: imap(USER1): Error: Cached message size smaller than expected (45743 < 45744) Oct 15 21:27:45 samba dovecot: imap(USER1): Error: Corrupted index cache file /home/USER1/mail/.imap/INBOX/dovecot.index.cache: Broken physical size for mail UID 75059 Oct 15 21:27:45 samba dovecot: imap(USER1): Error: copy: i_stream_read() failed: Invalid argument Oct 15 21:27:45 samba dovecot: imap(USER1): Error: read(/var/mail/USER1) failed: Cached message size smaller than expected (45743 < 45744) (uid=51565, box=Trash) Oct 16 05:10:41 samba dovecot: imap(USER1): Error: Cached message size smaller than expected (98120 < 98121) Oct 16 05:10:41 samba dovecot: imap(USER1): Error: Corrupted index cache file /home/USER1/mail/.imap/INBOX/dovecot.index.cache: Broken physical size for mail UID 75158 Oct 16 05:10:41 samba dovecot: imap(USER1): Error: copy: i_stream_read() failed: Invalid argument Oct 16 05:10:41 samba dovecot: imap(USER1): Error: read(/var/mail/USER1) failed: Cached message size smaller than expected (98120 < 98121) (uid=51566, box=Trash) Oct 16 07:11:12 samba dovecot: imap(USER6): Error: Cached message size smaller than expected (7991 < 7992) Oct 16 07:11:12 samba dovecot: imap(USER6): Error: Corrupted index cache file /home/USER6/mail/.imap/INBOX/dovecot.index.cache: Broken physical size for mail UID 925 Oct 16 07:11:12 samba dovecot: imap(USER6): Error: read(/var/mail/USER6) failed: Invalid argument Oct 16 08:49:30 samba dovecot: imap(USER1): Error: Cached message size smaller than expected (68834 < 68835) Oct 16 08:49:30 samba dovecot: imap(USER1): Error: Corrupted index cache file /home/USER1/mail/.imap/INBOX/dovecot.index.cache: Broken physical size for mail UID 75168 Oct 16 08:49:30 samba dovecot: imap(USER1): Error: copy: i_stream_read() failed: Invalid argument Oct 16 08:49:30 samba dovecot: imap(USER1): Error: read(/var/mail/USER1) failed: Cached message size smaller than expected (68834 < 68835) (uid=1198, box=A_Leitung) Oct 16 09:07:56 samba dovecot: imap(USER7): Error: Cached message size smaller than expected (367995 < 367997) Oct 16 09:07:56 samba dovecot: imap(USER7): Error: Corrupted index cache file /home/USER7/mail/.imap/INBOX/dovecot.index.cache: Broken physical size for mail UID 25775 Oct 16 09:07:56 samba dovecot: imap(USER7): Error: read(/var/mail/USER7) failed: Cached message size smaller than expected (367995 < 367997) (FETCH BODY[] for mailbox INBOX UID 25775) -------------------- 8< -------------------- Cheers, --leo -- e-mail ::: Leo.Bergolth (at) wu.ac.at fax ::: +43-1-31336-906050 location ::: IT-Services | Vienna University of Economics | Austria From tmpdovecot at groyaume.com Thu Oct 16 07:46:27 2014 From: tmpdovecot at groyaume.com (Guillaume) Date: Thu, 16 Oct 2014 09:46:27 +0200 Subject: index problem with only 1 folder of 1 box In-Reply-To: <5437D510.30801@groyaume.com> References: <5433BF38.3020904@groyaume.com> <5437C819.6080005@groyaume.com> <5437CDE4.40408@dovecot.fi> <5437D510.30801@groyaume.com> Message-ID: <543F77D3.8050800@groyaume.com> Hello, Once again, sorry for my poor english skills... I upgrade dovecot to 2.2.13, and... the problem is always here. :-( So i purge (once again) solr entirely and reinstall it. But I forget to install the schema.xml in solr. I have only the original schema which is given with the package. ==> All is OK (but a bit slow : 5s against less than a second) I reinstall the schema.xml of dovecot, it's very fast but... I have the problem again... Now i know the source of the problem! ;) But i'm not able to configure correctly the schema at this moment... :-( So i will preserve the original schema for the moment. Good bye Guillaume Le 10/10/2014 14:46, Guillaume a ?crit : > > Thank you for your answer. I will try to upgrade dovecot. > By the way, I erase cache of solr ( *:* > ) and the problem is always here... > > When I will can upgrade dovecot, i will write back to say if its good or > not. > > Sincerely yours, > > Guillaume > > > Le 10/10/2014 14:15, Teemu Huovila a ?crit : >> Hello >> >> On 10/10/2014 02:50 PM, Guillaume wrote: >>> The biggest trouble for me is : >>> Is it a solr problem or a dovecot problem? >>> >>> In my opinion, it's more a dovecot problem because the first research >>> after a solr reindex give the good answer. >> If at all possible, you should try a newer version of Dovecot. There >> have been quite a few changes to FTS and the SOLR backend >> since version 2.2.9. See attached log for HG log of changes. Hope this >> helps. >> >> br, >> Teemu Huovila >> From jtam.home at gmail.com Thu Oct 16 09:01:16 2014 From: jtam.home at gmail.com (Joseph Tam) Date: Thu, 16 Oct 2014 02:01:16 -0700 (PDT) Subject: doveadm-move(1) In-Reply-To: References: Message-ID: Pascal Volk writes: >> Cut&pasted off the terminal man page output. Looking into >> man1/doveadm-move.1, I see >> >> .B doveadm move \-u jane Archive/2011/09 mailbox INBOX BEFORE \(rs >> .B 2011-10-01 SINCE 01-Sep-2011 >> >> so it's a problem with my nroff, not dovecot's man pages. (Hmm, it >> happens with groff too -- it appears to be some sort of line length bug.) > > Well, there was a problem with non-escaped dashes. But that was fixed 10 > months ago: > http://hg.dovecot.org/dovecot-2.2/diff/8a3d0426f514/doc/man/doveadm-move.1.in Nope, that didn't fix it. > I'm not sure, if that is the reason for the problem. > > Which OS, *roff are you using? Maybe I'm able to reproduce the problem. :-) It's Solaris10 nroff, and GNU groff 1.19.1. Ancient stuff so I wouldn't spend too much time looking at it. It's weird that two independent software implementations would do the same thing. Joseph Tam From andy at xecu.net Thu Oct 16 12:28:24 2014 From: andy at xecu.net (Andy Dills) Date: Thu, 16 Oct 2014 08:28:24 -0400 Subject: v2.2.14 released In-Reply-To: References: Message-ID: 2.2.14 is working great in production for us. No more strange errors with indexes[1] (which was a constant thing in 2.2.13), and I'm happy that the clustered LDA issues are resolved. Well done Timo, and congratulations on your relocation to the US! Andy [1] Panic: file mail-index-transaction-export.c: line 203 (log_append_ext_hdr_update): assertion failed: (u32.offset + u32.size <= ext_hdr_size) --- ----------------------------------------------------- ANDY DILLS - XECUNET, LLC 5744-R Industry Lane Frederick MD 21704 www.xecu.net [1] P: 301-682-9972 P: 1-877-XECUNET F: 240-215-0351 Twitter [2] Facebook [3] ----------------------------------------------------- Links: ------ [1] http://www.xecu.net/ [2] https://twitter.com/Xecunet [3] http://www.facebook.com/xecunet From gordon.grubert+lists at uni-greifswald.de Thu Oct 16 13:04:47 2014 From: gordon.grubert+lists at uni-greifswald.de (Gordon Grubert) Date: Thu, 16 Oct 2014 15:04:47 +0200 Subject: Strange quota warning behavior Message-ID: <543FC26F.5060209@uni-greifswald.de> Hi, we are using dovecot 2.2.14. So far, we used the following quota warning configuration quota_rule = *:storage=10G quota_warning = storage=90%% quota-warning 90 %n quota_warning2 = storage=80%% quota-warning 80 %n quota_warning3 = storage=70%% quota-warning 70 %n This works fine. Now, we wanted to add the all clear feature for the quota warning by adding this line: quota_warning4 = -storage=70%% quota-warning 70 %n below The result is really strange. Test 1: 70% exceeded: warning3 executed => OK fall below 70%: quota_warning2 executed => NOT OK quota_warning4 executed => OK Test 2: 70% exceeded: warning3 executed => OK 80% exceeded: warning2 executed => OK fall below 80% (but still more than 70%): quota_warning executed => NOT OK fall below 70%: quota_warning2 executed => NOT OK quota_warning4 executed => OK At the moment, we are running the minimal configuration quota_warning = storage=70%% quota-warning 70 %n quota_warning2 = -storage=70%% quota-warning 70 %n below working like expected (warning when exceeding 70% and all clear when falling below 70%). Does anybody know if there is an error in our configuration or maybe, could this be a bug in dovecot? Best regards, Gordon -- Technischer Leiter & stellv. Direktor Universit?tsrechenzentrum (URZ) E.-M.-Arndt-Universit?t Greifswald Felix-Hausdorff-Str. 12 17489 Greifswald Germany Tel. +49 3834 86 1456 Fax. +49 3834 86 1401 From r at sys4.de Thu Oct 16 13:26:12 2014 From: r at sys4.de (Ralf Hildebrandt) Date: Thu, 16 Oct 2014 15:26:12 +0200 Subject: Proxy problem: "imap-login: Error: proxy(USERNAME): connect(10.x.x.178, 993) failed: Cannot assign requested address (after 0 secs, local=10.x.x.104)" Message-ID: <20141016132612.GA16495@sys4.de> After fixing the "duplicate compression" problem, we're now encountering "imap-login: Error: proxy(USERNAME): connect(10.x.x.178, 993) failed: Cannot assign requested address (after 0 secs, local=10.x.x.100)" in the logs. We already tried raising the ulimit, the max number of open files. Once we reach about 25k connections, we're getting the error above... for all local addresses. It seems as if the system cannot create any more outgoing connections. We already optimized: ---- snip ---- net.ipv4.tcp_fin_timeout=5 # down from 30s net.ipv4.tcp_tw_reuse=1 net.ipv4.tcp_tw_recycle=1 # http://redis4you.com/articles.php?id=012&name=Redis+high+traffic+connection+issue net.ipv4.ip_local_port_range=10000 65000 # http://www.fromdual.com/huge-amount-of-time-wait-connections net.ipv4.netfilter.ip_conntrack_max=524288 ---- snip ---- But still we get (once the load is rising beyond some point): # fgrep "Cannot assign requested address" /var/log/dovecot/dovecot.log |awk '{print $NF}' | sort | uniq -c | sort -n 142 local=10.x.x.100) 147 local=10.x.x.107) 148 local=10.x.x.106) 151 local=10.x.x.104) 151 local=10.x.x.109) 152 local=10.x.x.105) 156 local=10.x.x.110) 162 local=10.x.x.102) 165 local=10.x.x.101) 178 local=10.x.x.103) 189 local=10.x.x.108) We're using multiple local addresses when proxying to the backends -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From bviaris at lescentaures.fr Thu Oct 16 15:43:42 2014 From: bviaris at lescentaures.fr (Bruno Viaris) Date: Thu, 16 Oct 2014 17:43:42 +0200 Subject: dsync duplicating identical messages Message-ID: <543FE7AE.4050603@lescentaures.fr> Dear list, I?m trying to setup dovecot/postfix/getmail for a single user application: I have 3 email accounts and 2 main computers (home and work). I want to have an imap server on each machine with sync/replication so that read/reply/delete status and sorting into folders are identical. This part is achieved via dsync and seems to work. Messages are fetched from my ISPs with getmail on both machines. The problem I have is that dsync does not see that a message already fetched on both sides is identical, and duplicates it. I use sdbox (because I like the compression option and the separate storage of attachments). The content of the messages (headers and body) are identical, but the sdbox files have differences in the header and/or trailer. In fact, for each incoming message, I get 4 slightly different files (2 on each machine). Do you know where I could find documentation on how dsync compares messages, and also on sdbox file format ? If you explain me that there is no way to prevent this duplication and that anyway dsync does the right thing, I will probably use getmail only on one machine and let dsync propagate the messages to the other site, but I will miss the redundancy (and some speed) of my wished setup... Thanks -- Bruno P.S. : Background: Home has DSL with 10 MBit/s down and 1 MBit/s up, and full control over NAT / firewall Work internet access is limited by the 100 MBit LAN and has strict firewall and complicated VPN. So it is not easy for my home email client to access the imap server of my work machine, and it is slow for my work email client to access my home imap server. I don?t trust any company for archiving my emails. From skdovecot at smail.inf.fh-brs.de Thu Oct 16 15:45:26 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Thu, 16 Oct 2014 17:45:26 +0200 (CEST) Subject: Unable to get virtual users set up with database auth In-Reply-To: <543F57D3.5060806@afo.net> References: <543F57D3.5060806@afo.net> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Thu, 16 Oct 2014, Cliff Hayes wrote: > But %u always contains just chayes instead of chayes at domain.tld even though I > tried different select statements to put the entire username in the username > field. > mail_location = mbox:/var/spool/mail/%u:INBOX=/var/spool/mail/%u > > password_query = SELECT uNameDomain as username, uDomain as domain, uPass as ^^^^^^ From http://wiki2.dovecot.org/PasswordDatabase username should read just user. Whereas: "username: Like user, but doesn't drop existing domain name (e.g. "username=foo" for "user at domain" gives "foo at domain"). " > password FROM users WHERE uName = '%n' AND uDomain = '%d' - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBVD/oFnz1H7kL/d9rAQIawQgAuDCC8VpNDffq8n3tNvHD81YuAVdHO3Xf Tv1xUftwta3g5c51AxWercHrV+Td79Od4sqfNAElEJOkZGpCHje+R8u74xdidpq3 RhDJaFzxFprJfnPa5SX2meoI98E0HMZRY/18kutK6JytMYzRZ10EV3wN0GuIjh+/ a7bvxFaxQEWZYDlagDEvv2IULHVW5HROU5yacFDDxElnFPIvcUHLrbMCVnh9qUyg H7dtuySEooZVqPymoYUWTISaQ4mjv4mRI7jTxYYjSIxhWBkxoxUyqZGWds01/eGZ gzKLcx+PqjAmnpNV/ee/i8fA82UNmlPl4K6E2GWLnKfLiD8kzYIqTQ== =hVsF -----END PGP SIGNATURE----- From skdovecot at smail.inf.fh-brs.de Thu Oct 16 15:51:24 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Thu, 16 Oct 2014 17:51:24 +0200 (CEST) Subject: [Dovecot/VirtualUsers/VirtualMailBoxes] No mails into mua In-Reply-To: <1990311.LQMChl5UHK@panagulis> References: <1990311.LQMChl5UHK@panagulis> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Mon, 13 Oct 2014, aleskandro wrote: > Hi all, I've configured postfix with multiple host and virtual mailboxes > (main.cf is here: http://pastebin.com/798VVxbv). > > So I can receive email to vuser at mydomain.tld into > /var/mail/vhosts/mydomain.tld/vuser file. Now I'm configuring dovecot 2.2.13-r1; > this is my dovecot -n and /etc/dovecot/passwddir/mydomain.tld/passwd: > http://pastebin.com/b4xcjj7t - > > The auth and server subscribe from a mua is ok and in the vuser file there are > some mails but I can't see them in my mua. mail.log doesn't report any error. > > Where I'm wrong? verify with mail_debug=true what Dovecot thinks the location is and post the log here and not on pastebin. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBVD/pfHz1H7kL/d9rAQIGswf/UbFq3q/2qkFBWiEPEuzxFSolGkLe1Um2 BiTNik6Yo1kkNVybZ4iQtZIQk6PUrEXy0FZeoP3OWRSiu+2BxFEjTZ0UYYjA9+sZ OJPf5UsZTU4qzXkDorpp4Q865lYtSiCyKd9Z2h6PS60bCcIVamYdZrCIQ0OrIX0O G8KW940vpOMd4zoBRHzNnq5ZguiWVAb/WSFTMLmDr5vDNAtj+olVuwOCaCO6Hfw8 3B513tKJWP8vHWrlB+5ArPF09B5VKUIBcJWsbYnBwlbtBhx3XRdBNsoI71WW2lMo c/P8ceSE9aISpleZ90wdW/QsI+SRvcBYTDI47YrcbXq4FqgEgk9hYA== =hhzk -----END PGP SIGNATURE----- From chayes at afo.net Thu Oct 16 16:02:53 2014 From: chayes at afo.net (Cliff Hayes) Date: Thu, 16 Oct 2014 11:02:53 -0500 Subject: Unable to get virtual users set up with database auth Message-ID: <543FEC2D.3030005@afo.net> I can't seem to get imap virtual users to work with database authentication on new Scientific Linux 6.5 server with Sendmail 8.14.4 & Dovecot 2.0.9 Apparently I have to also create system users because sendmail/procmail/dovecot want to check directory ownership. So I created a database, made entry for the user, created the user chayes on the system. But %u always contains just chayes instead of chayes at domain.tld even though I tried different select statements to put the entire username in the username field. This causes the following errors: Oct 16 00:10:26 avalon sendmail[2536]: s9G5APo9002535: forward /var/spool/mail/chayes at domain.tld/chayes/.forward.avalon: Group writable directory Oct 16 00:10:26 avalon sendmail[2536]: s9G5APo9002535: forward /var/spool/mail/chayes at domain.tld/chayes/.forward: Group writable directory Oct 16 00:10:26 avalon dovecot: lda(chayes): Debug: Effective uid=497, gid=497, home=/var/spool/mail/chayes at domain.tld/chayes Oct 16 00:10:26 avalon dovecot: lda(chayes): Debug: Home dir not found: /var/spool/mail/chayes at domain.tld/chayes Oct 16 00:10:26 avalon dovecot: lda(chayes): Debug: Namespace : type=private, prefix=, sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=mbox:/var/spool/mail/chayes:INBOX=/var/spool/mail/chayes Oct 16 00:10:26 avalon dovecot: lda(chayes): Debug: fs: root=/var/spool/mail/chayes, index=, control=, inbox=/var/spool/mail/chayes Oct 16 00:10:26 avalon dovecot: lda(chayes): Error: user chayes: Initialization failed: Namespace '': mbox: mbox root directory can't be a file: /var/spool/mail/chayes (http://wiki.dovecot.org/MailLocation/Mbox) Oct 16 00:10:26 avalon dovecot: lda(chayes): Fatal: Invalid user settings. Refer to server log for more information. protocols = imap mail_location = mbox:/var/spool/mail/%u:INBOX=/var/spool/mail/%u password_query = SELECT uNameDomain as username, uDomain as domain, uPass as password FROM users WHERE uName = '%n' AND uDomain = '%d' also tried password_query = SELECT uName as username, uDomain as domain, uPass as password FROM users WHERE uName = '%n' AND uDomain = '%d' # file: /etc/procmailrc # system-wide settings for procmail SHELL="/bin/bash" SENDMAIL="/usr/sbin/sendmail -oi -t" LOGFILE="/var/log/procmail.log" DROPPRIVS=yes DELIVER="/usr/libexec/dovecot/deliver" #MAILDIR=$HOME/ #DEFAULT=$HOME/ :0 w * ^X-Spam-Status: Yes | $DELIVER -m spam :0 w | $DELIVER Thanks in advance From chayes at afo.net Thu Oct 16 16:06:30 2014 From: chayes at afo.net (Cliff Hayes) Date: Thu, 16 Oct 2014 11:06:30 -0500 Subject: Unable to get virtual users set up with database auth In-Reply-To: References: <543F57D3.5060806@afo.net> Message-ID: <543FED06.5030306@afo.net> I tried both ways with same result. I tried just returning the username as well. On 10/16/2014 10:45 AM, Steffen Kaiser wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > On Thu, 16 Oct 2014, Cliff Hayes wrote: > >> But %u always contains just chayes instead of chayes at domain.tld even >> though I tried different select statements to put the entire username >> in the username field. >> mail_location = mbox:/var/spool/mail/%u:INBOX=/var/spool/mail/%u >> >> password_query = SELECT uNameDomain as username, uDomain as domain, >> uPass as > ^^^^^^ From > http://wiki2.dovecot.org/PasswordDatabase username should read just > user. Whereas: "username: Like user, but doesn't drop existing domain > name (e.g. "username=foo" for "user at domain" gives "foo at domain"). " > >> password FROM users WHERE uName = '%n' AND uDomain = '%d' > > - -- Steffen Kaiser > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1.4.11 (GNU/Linux) > > iQEVAwUBVD/oFnz1H7kL/d9rAQIawQgAuDCC8VpNDffq8n3tNvHD81YuAVdHO3Xf > Tv1xUftwta3g5c51AxWercHrV+Td79Od4sqfNAElEJOkZGpCHje+R8u74xdidpq3 > RhDJaFzxFprJfnPa5SX2meoI98E0HMZRY/18kutK6JytMYzRZ10EV3wN0GuIjh+/ > a7bvxFaxQEWZYDlagDEvv2IULHVW5HROU5yacFDDxElnFPIvcUHLrbMCVnh9qUyg > H7dtuySEooZVqPymoYUWTISaQ4mjv4mRI7jTxYYjSIxhWBkxoxUyqZGWds01/eGZ > gzKLcx+PqjAmnpNV/ee/i8fA82UNmlPl4K6E2GWLnKfLiD8kzYIqTQ== > =hVsF > -----END PGP SIGNATURE----- > From chayes at afo.net Thu Oct 16 16:12:22 2014 From: chayes at afo.net (Cliff Hayes) Date: Thu, 16 Oct 2014 11:12:22 -0500 Subject: Unable to get virtual users set up with database auth In-Reply-To: References: <543F57D3.5060806@afo.net> Message-ID: <543FEE66.1010806@afo.net> ok I tried this as the query: password_query = SELECT uName as user, uNameDomain as username, uDomain as domain, uPass as password FROM users WHERE uName = '%n' AND uDomain = '%d' and it is still putting mail /var/spool/mail/chayes and erroring trying to look in chayes at domain.tld/chayes instead of /var/spool/mail/chayes at domain.tld Oct 16 11:09:22 avalon sendmail[5047]: s9GG9KVV005046: forward /var/spool/mail/chayes at domain.tld/chayes/.forward.avalon: Group writable directory Oct 16 11:09:22 avalon sendmail[5047]: s9GG9KVV005046: forward /var/spool/mail/chayes at domain.tld/chayes/.forward: Group writable directory Oct 16 11:09:22 avalon dovecot: lda(chayes): Debug: Effective uid=497, gid=497, home=/var/spool/mail/chayes at domain.tld/chayes Oct 16 11:09:22 avalon dovecot: lda(chayes): Debug: Home dir not found: /var/spool/mail/chayes at domain.tld/chayes Oct 16 11:09:22 avalon dovecot: lda(chayes): Debug: Namespace : type=private, prefix=, sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=mbox:/var/spool/mail/chayes:INBOX=/var/spool/mail/chayes Oct 16 11:09:22 avalon dovecot: lda(chayes): Debug: fs: root=/var/spool/mail/chayes, index=, control=, inbox=/var/spool/mail/chayes Oct 16 11:09:22 avalon dovecot: lda(chayes): Error: user chayes: Initialization failed: Namespace '': mbox: mbox root directory can't be a file: /var/spool/mail/chayes (http://wiki.dovecot.org/MailLocation/Mbox) Oct 16 11:09:22 avalon dovecot: lda(chayes): Fatal: Invalid user settings. Refer to server log for more information. On 10/16/2014 10:45 AM, Steffen Kaiser wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > On Thu, 16 Oct 2014, Cliff Hayes wrote: > >> But %u always contains just chayes instead of chayes at domain.tld even >> though I tried different select statements to put the entire username >> in the username field. >> mail_location = mbox:/var/spool/mail/%u:INBOX=/var/spool/mail/%u >> >> password_query = SELECT uNameDomain as username, uDomain as domain, >> uPass as > ^^^^^^ From > http://wiki2.dovecot.org/PasswordDatabase username should read just > user. Whereas: "username: Like user, but doesn't drop existing domain > name (e.g. "username=foo" for "user at domain" gives "foo at domain"). " > >> password FROM users WHERE uName = '%n' AND uDomain = '%d' > > - -- Steffen Kaiser > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1.4.11 (GNU/Linux) > > iQEVAwUBVD/oFnz1H7kL/d9rAQIawQgAuDCC8VpNDffq8n3tNvHD81YuAVdHO3Xf > Tv1xUftwta3g5c51AxWercHrV+Td79Od4sqfNAElEJOkZGpCHje+R8u74xdidpq3 > RhDJaFzxFprJfnPa5SX2meoI98E0HMZRY/18kutK6JytMYzRZ10EV3wN0GuIjh+/ > a7bvxFaxQEWZYDlagDEvv2IULHVW5HROU5yacFDDxElnFPIvcUHLrbMCVnh9qUyg > H7dtuySEooZVqPymoYUWTISaQ4mjv4mRI7jTxYYjSIxhWBkxoxUyqZGWds01/eGZ > gzKLcx+PqjAmnpNV/ee/i8fA82UNmlPl4K6E2GWLnKfLiD8kzYIqTQ== > =hVsF > -----END PGP SIGNATURE----- > From gedalya at gedalya.net Thu Oct 16 16:12:59 2014 From: gedalya at gedalya.net (Gedalya) Date: Thu, 16 Oct 2014 12:12:59 -0400 Subject: Unable to get virtual users set up with database auth In-Reply-To: <543FED06.5030306@afo.net> References: <543F57D3.5060806@afo.net> <543FED06.5030306@afo.net> Message-ID: <543FEE8B.7090906@gedalya.net> Since you have to use system users, why don't you just use that? Why use SQL? On 10/16/2014 12:06 PM, Cliff Hayes wrote: > I tried both ways with same result. > I tried just returning the username as well. > > On 10/16/2014 10:45 AM, Steffen Kaiser wrote: >> -----BEGIN PGP SIGNED MESSAGE----- >> Hash: SHA1 >> >> On Thu, 16 Oct 2014, Cliff Hayes wrote: >> >>> But %u always contains just chayes instead of chayes at domain.tld even >>> though I tried different select statements to put the entire username >>> in the username field. >>> mail_location = mbox:/var/spool/mail/%u:INBOX=/var/spool/mail/%u >>> >>> password_query = SELECT uNameDomain as username, uDomain as domain, >>> uPass as >> ^^^^^^ From >> http://wiki2.dovecot.org/PasswordDatabase username should read just >> user. Whereas: "username: Like user, but doesn't drop existing domain >> name (e.g. "username=foo" for "user at domain" gives "foo at domain"). " >> >>> password FROM users WHERE uName = '%n' AND uDomain = '%d' >> >> - -- Steffen Kaiser >> -----BEGIN PGP SIGNATURE----- >> Version: GnuPG v1.4.11 (GNU/Linux) >> >> iQEVAwUBVD/oFnz1H7kL/d9rAQIawQgAuDCC8VpNDffq8n3tNvHD81YuAVdHO3Xf >> Tv1xUftwta3g5c51AxWercHrV+Td79Od4sqfNAElEJOkZGpCHje+R8u74xdidpq3 >> RhDJaFzxFprJfnPa5SX2meoI98E0HMZRY/18kutK6JytMYzRZ10EV3wN0GuIjh+/ >> a7bvxFaxQEWZYDlagDEvv2IULHVW5HROU5yacFDDxElnFPIvcUHLrbMCVnh9qUyg >> H7dtuySEooZVqPymoYUWTISaQ4mjv4mRI7jTxYYjSIxhWBkxoxUyqZGWds01/eGZ >> gzKLcx+PqjAmnpNV/ee/i8fA82UNmlPl4K6E2GWLnKfLiD8kzYIqTQ== >> =hVsF >> -----END PGP SIGNATURE----- >> From gedalya at gedalya.net Thu Oct 16 16:24:18 2014 From: gedalya at gedalya.net (Gedalya) Date: Thu, 16 Oct 2014 12:24:18 -0400 Subject: Unable to get virtual users set up with database auth In-Reply-To: <543FF002.4060306@afo.net> References: <543F57D3.5060806@afo.net> <543FED06.5030306@afo.net> <543FEE8B.7090906@gedalya.net> <543FF002.4060306@afo.net> Message-ID: <543FF132.8090504@gedalya.net> On 10/16/2014 12:19 PM, Cliff Hayes wrote: > well i don't want to use system users. but how do I assign a UID and > GID to virtual users to eliminate the permissions errors? > For dovecot, it is like this: http://wiki2.dovecot.org/AuthDatabase/SQL#User_database_lookups I don't know if this would be OK with your sendmail side. You should really post your complete dovecot config (dovecot -n output + any ".ext" files) so that we can get a better picture. From malucosfe at gmail.com Thu Oct 16 16:24:18 2014 From: malucosfe at gmail.com (Luciano Gabriel Andino) Date: Thu, 16 Oct 2014 13:24:18 -0300 Subject: ssd for /home Message-ID: Hi, I am thinking to change sata disk for /home and I want to know if change to a SSD hd, is a good option. I have 30-40 accounts with 30-50K email in boxes. -- Saludos!! Luciano Andino GNU/Linux user #185103 Santa Fe - Argentina ----------------------------------------------- From gheskett at wdtv.com Thu Oct 16 16:27:15 2014 From: gheskett at wdtv.com (Gene Heskett) Date: Thu, 16 Oct 2014 12:27:15 -0400 Subject: v2.2.14 released In-Reply-To: <543F77A6.2000902@strike.wu.ac.at> References: <543F77A6.2000902@strike.wu.ac.at> Message-ID: <201410161227.15665.gheskett@wdtv.com> On Thursday 16 October 2014 03:45:42 Alexander 'Leo' Bergolth did opine And Gene did reply: > On 10/14/2014 06:53 PM, Timo Sirainen wrote: > > - Fixed several race conditions with dovecot.index.cache handling > > that > > > > may have caused unnecessary "cache is corrupted" errors. > > Rejoyed too soon! :-( > Unfortunately it doesn't fix my (maybe mbox related) index.cache errors > reported back in May: http://markmail.org/message/xhxorbutl3encr2d > > I know that Timo suggests to switch away from mbox but unfortunately > this is rather challenging for me. Switching to maildir results in > millions of files and this overwhelmes my backup system. I reset kmail 1.13.5 to use maildir (mdir) format message storage several years ago. My email corpus is north of 20Gb, and amanda has no problems backing it up. Its been doing it well enough I can do a bare metal recovery and have. Sounds like you need a better backup proggy. Amanda, FWIW, is a wrapper, most commonly using the current version of tar, can also use dump, but I consider tars file at a time granularity a huge advantage since it can also recover something you accidentally deleted without overwriting everything. > mdbox also > does not qualify since AFAIK there is no python or perl library > support for manipulating mdbox mailboxes. > > :-( > > -------------------- 8< -------------------- > Oct 15 15:08:34 samba dovecot: imap(USER1): Error: Corrupted index > cache file /home/USER1/mail/.imap/INBOX/dovecot.index.cache: Broken > physical size for mail UID 75144 Oct 15 15:08:34 samba dovecot: > imap(USER1): Error: copy: i_stream_read() failed: Invalid argument Oct > 15 15:08:34 samba dovecot: imap(USER1): Error: read(/var/mail/USER1) > failed: Cached message size smaller than expected (55337 < 55338) > (uid=51556, box=Trash) Oct 15 15:20:02 samba dovecot: imap(USER2): > Error: Cached message size smaller than expected (282553 < 282554) Oct > 15 15:20:02 samba dovecot: imap(USER2): Error: Corrupted index cache > file /home/USER2/mail/.imap/INBOX/dovecot.index.cache: Broken physical > size for mail UID 12364 Oct 15 15:20:02 samba dovecot: imap(USER2): > Error: read(/var/mail/USER2) failed: Cached message size smaller than > expected (282553 < 282554) (FETCH BODY[2] for mailbox INBOX UID 12364) > Oct 15 15:50:30 samba dovecot: imap(USER3): Error: Cached message size > smaller than expected (58902 < 58903) Oct 15 15:50:30 samba dovecot: > imap(USER3): Error: Corrupted index cache file > /home/USER3/mail/.imap/INBOX/dovecot.index.cache: Broken physical size > for mail UID 19810 Oct 15 15:50:30 samba dovecot: imap(USER3): Error: > read(/var/mail/USER3) failed: Cached message size smaller than > expected (58902 < 58903) (FETCH BODY[] for mailbox INBOX UID 19810) > Oct 15 16:02:56 samba dovecot: imap(USER4): Error: Cached message size > smaller than expected (181831 < 181832) Oct 15 16:02:56 samba dovecot: > imap(USER4): Error: Corrupted index cache file > /home/USER4/mail/.imap/INBOX/dovecot.index.cache: Broken physical size > for mail UID 2178 Oct 15 16:02:56 samba dovecot: imap(USER4): Error: > read(/var/mail/USER4) failed: Cached message size smaller than > expected (181831 < 181832) (FETCH BODY[] for mailbox INBOX UID 2178) > Oct 15 16:18:24 samba dovecot: imap(USER1): Error: Cached message size > smaller than expected (55339 < 55340) Oct 15 16:18:24 samba dovecot: > imap(USER1): Error: Corrupted index cache file > /home/USER1/mail/.imap/INBOX/dovecot.index.cache: Broken physical size > for mail UID 75144 Oct 15 16:18:24 samba dovecot: imap(USER1): Error: > copy: i_stream_read() failed: Invalid argument Oct 15 16:18:24 samba > dovecot: imap(USER1): Error: read(/var/mail/USER1) failed: Cached > message size smaller than expected (55339 < 55340) (uid=51559, > box=Trash) Oct 15 16:44:15 samba dovecot: imap(USER5): Error: Cached > message size smaller than expected (6951359 < 6951360) Oct 15 16:44:15 > samba dovecot: imap(USER5): Error: Corrupted index cache file > /home/USER5/mail/.imap/INBOX/dovecot.index.cache: Broken physical size > for mail UID 5023 Oct 15 16:44:15 samba dovecot: imap(USER5): Error: > read(/var/mail/USER5) failed: Cached message size smaller than > expected (6951359 < 6951360) (FETCH BODY[3] for mailbox INBOX UID > 5023) Oct 15 21:27:45 samba dovecot: imap(USER1): Error: Cached > message size smaller than expected (45743 < 45744) Oct 15 21:27:45 > samba dovecot: imap(USER1): Error: Corrupted index cache file > /home/USER1/mail/.imap/INBOX/dovecot.index.cache: Broken physical size > for mail UID 75059 Oct 15 21:27:45 samba dovecot: imap(USER1): Error: > copy: i_stream_read() failed: Invalid argument Oct 15 21:27:45 samba > dovecot: imap(USER1): Error: read(/var/mail/USER1) failed: Cached > message size smaller than expected (45743 < 45744) (uid=51565, > box=Trash) Oct 16 05:10:41 samba dovecot: imap(USER1): Error: Cached > message size smaller than expected (98120 < 98121) Oct 16 05:10:41 > samba dovecot: imap(USER1): Error: Corrupted index cache file > /home/USER1/mail/.imap/INBOX/dovecot.index.cache: Broken physical size > for mail UID 75158 Oct 16 05:10:41 samba dovecot: imap(USER1): Error: > copy: i_stream_read() failed: Invalid argument Oct 16 05:10:41 samba > dovecot: imap(USER1): Error: read(/var/mail/USER1) failed: Cached > message size smaller than expected (98120 < 98121) (uid=51566, > box=Trash) Oct 16 07:11:12 samba dovecot: imap(USER6): Error: Cached > message size smaller than expected (7991 < 7992) Oct 16 07:11:12 samba > dovecot: imap(USER6): Error: Corrupted index cache file > /home/USER6/mail/.imap/INBOX/dovecot.index.cache: Broken physical size > for mail UID 925 Oct 16 07:11:12 samba dovecot: imap(USER6): Error: > read(/var/mail/USER6) failed: Invalid argument Oct 16 08:49:30 samba > dovecot: imap(USER1): Error: Cached message size smaller than expected > (68834 < 68835) Oct 16 08:49:30 samba dovecot: imap(USER1): Error: > Corrupted index cache file > /home/USER1/mail/.imap/INBOX/dovecot.index.cache: Broken physical size > for mail UID 75168 Oct 16 08:49:30 samba dovecot: imap(USER1): Error: > copy: i_stream_read() failed: Invalid argument Oct 16 08:49:30 samba > dovecot: imap(USER1): Error: read(/var/mail/USER1) failed: Cached > message size smaller than expected (68834 < 68835) (uid=1198, > box=A_Leitung) Oct 16 09:07:56 samba dovecot: imap(USER7): Error: > Cached message size smaller than expected (367995 < 367997) Oct 16 > 09:07:56 samba dovecot: imap(USER7): Error: Corrupted index cache file > /home/USER7/mail/.imap/INBOX/dovecot.index.cache: Broken physical size > for mail UID 25775 Oct 16 09:07:56 samba dovecot: imap(USER7): Error: > read(/var/mail/USER7) failed: Cached message size smaller than > expected (367995 < 367997) (FETCH BODY[] for mailbox INBOX UID 25775) > -------------------- 8< -------------------- > > Cheers, > --leo Cheers, Gene Heskett -- "There are four boxes to be used in defense of liberty: soap, ballot, jury, and ammo. Please use in that order." -Ed Howdershelt (Author) Genes Web page US V Castleman, SCOTUS, Mar 2014 is grounds for Impeaching SCOTUS From przemek.orzechowski at makolab.pl Thu Oct 16 17:45:44 2014 From: przemek.orzechowski at makolab.pl (=?UTF-8?B?UHJ6ZW15c8WCYXcgT3J6ZWNob3dza2k=?=) Date: Thu, 16 Oct 2014 19:45:44 +0200 Subject: ssd for /home In-Reply-To: References: Message-ID: <54400448.5080505@makolab.pl> On 16.10.2014 18:24, Luciano Gabriel Andino wrote: > Hi, I am thinking to change sata disk for /home and I want to know if > change to a SSD hd, is a good option. I have 30-40 accounts with 30-50K > email in boxes. > Hi SSD's give you fast read and (degrading with time) fast write performance but at a cost. Even server grade SSD's are prone to sudden failures. Mostly due to exeeded max write count. And when they fail you lose whole data stored on them (this happened fiew times in my work) So we are using SSD's as fast storage ie as cache, but always have a persistent copy somwhere else or store data that can be easily reconstructed in case of SSD's fail. You can read SSD disks all the time but writing to them causes fast wear. Most SSD's have a specific limit of numer of writes (more specific erase cycles for memory blocks) and when they reach that limit they just stop working. In mirror raid both drives will fail almost at the same time, couse of identical workloads. Thats what my experiences with SSD storage is. The other factor is the price. In my laptop (not so heavily used - fiew VM's and ubuntu desktop (30% of the drive left unpartitioned) an intel consumer grade SSD died in a year (no files recoverable). So my advice is either store dovecot indexes on SSD (should improve performance) or have a mirror (dsync ?) of Your /home on some other (magnetic) storage unless You are ok with the loss of /home contents From gedalya at gedalya.net Thu Oct 16 17:46:19 2014 From: gedalya at gedalya.net (Gedalya) Date: Thu, 16 Oct 2014 13:46:19 -0400 Subject: Unable to get virtual users set up with database auth In-Reply-To: <543FF790.8040905@afo.net> References: <543F57D3.5060806@afo.net> <543FED06.5030306@afo.net> <543FEE8B.7090906@gedalya.net> <543FF002.4060306@afo.net> <543FF132.8090504@gedalya.net> <543FF790.8040905@afo.net> Message-ID: <5440046B.4040308@gedalya.net> When you reply, try to make sure you reply to the list (dovecot at dovecot.org), in Thunderbird you should have a Reply List button, or just use reply to all. btw I meant: the output of the 'dovecot -n' command, sorry :D OK so, first of all, lda doesn't do any passdb lookup at all, only userdb. It doesn't have any password to check. Just as a comment, your password query could just as well be: password_query = SELECT uPass as password FROM users WHERE uName = '%n' AND uDomain = '%d' auth_username_format = %Lu -- which I believe is set by default, would lowercase the username for you on the way in from the client, so if all your usernames are meant to be purely lowercase, there is no need to return these fields from the database. Set it explicitly just to be sure. You're using a somewhat old version, I'm not sure how it was back then. Either way, this shouldn't be affecting lda. Now, this seems to be wrong. mail_location = mbox:/var/spool/mail/%u:INBOX=/var/spool/mail/%u You probably want it more like: mbox:~/mail:INBOX=/var/spool/mail/%u The first value, ~/mail, will be a /mail directory under the 'home' directory set in your static userdb, and that's where mailboxes (folders) other than INBOX will be stored. It must be a directory, not a file! I'm a little confused about some of the other details in your log. Let's try to correct your mail_location first and see where that takes us. Also, under namespace, you might as well comment out the 'location = ' and 'prefix = ' lines, though I'm not sure it matters. On 10/16/2014 12:51 PM, Cliff Hayes wrote: > Here it is: > > [root at avalon dovecot]# dovecot -n output > # 2.0.9: /etc/dovecot/dovecot.conf > # OS: Linux 2.6.32-431.29.2.el6.x86_64 x86_64 Scientific Linux release > 6.5 (Carbon) ext4 > auth_debug = yes > auth_debug_passwords = yes > auth_verbose = yes > auth_verbose_passwords = plain > first_valid_uid = 496 > mail_access_groups = mail > mail_debug = yes > mail_location = mbox:/var/spool/mail/%u:INBOX=/var/spool/mail/%u > mbox_write_locks = fcntl > namespace { > hidden = no > inbox = yes > list = yes > location = > prefix = > separator = . > subscriptions = yes > type = private > } > passdb { > args = /etc/dovecot/dovecot-sql.conf.ext > driver = sql > } > protocols = imap > ssl_ca = ssl_cert = ssl_key = userdb { > args = uid=497 gid=12 home=/var/email/%u > driver = static > } > verbose_ssl = yes > protocol imap { > imap_id_log = * > } > > [root at avalon dovecot]# cat dovecot-sql.conf.ext > > driver = mysql > > default_pass_scheme = PLAIN > > connect = host=localhost dbname=email user=blah password=blah > > password_query = SELECT uName as user, uNameDomain as username, > uDomain as domain, uPass as password FROM users WHERE uName = '%n' AND > uDomain = '%d' > > > > > On 10/16/2014 11:24 AM, Gedalya wrote: >> On 10/16/2014 12:19 PM, Cliff Hayes wrote: >>> well i don't want to use system users. but how do I assign a UID and >>> GID to virtual users to eliminate the permissions errors? >>> >> For dovecot, it is like this: >> http://wiki2.dovecot.org/AuthDatabase/SQL#User_database_lookups >> >> I don't know if this would be OK with your sendmail side. >> >> You should really post your complete dovecot config (dovecot -n output + >> any ".ext" files) so that we can get a better picture. >> From THerrmann at ADwin.de Thu Oct 16 18:25:26 2014 From: THerrmann at ADwin.de (Thomas Herrmann) Date: Thu, 16 Oct 2014 20:25:26 +0200 Subject: ssd for /home In-Reply-To: <54400448.5080505@makolab.pl> References: <54400448.5080505@makolab.pl> Message-ID: <54400D96.8060909@ADwin.de> On 10/16/2014 07:45 PM, Przemys?aw Orzechowski wrote: > On 16.10.2014 18:24, Luciano Gabriel Andino wrote: >> Hi, I am thinking to change sata disk for /home and I want to know if >> change to a SSD hd, is a good option. I have 30-40 accounts with 30-50K >> email in boxes. For such a small amount of mail an HDD would work as well if you use a smart operating system and filesystem, because almost all mails will fit into RAM. Regards, Thomas -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4246 bytes Desc: S/MIME Cryptographic Signature URL: From tss at iki.fi Thu Oct 16 19:11:15 2014 From: tss at iki.fi (Timo Sirainen) Date: Thu, 16 Oct 2014 12:11:15 -0700 Subject: v2.2.14 released In-Reply-To: <543F77A6.2000902@strike.wu.ac.at> References: <543F77A6.2000902@strike.wu.ac.at> Message-ID: <9D12599E-8BBB-44C8-B6CE-662BBB0DD12B@iki.fi> On 16 Oct 2014, at 00:45, Alexander 'Leo' Bergolth wrote: > On 10/14/2014 06:53 PM, Timo Sirainen wrote: >> - Fixed several race conditions with dovecot.index.cache handling that >> may have caused unnecessary "cache is corrupted" errors. > > Rejoyed too soon! :-( > Unfortunately it doesn't fix my (maybe mbox related) index.cache errors reported back in May: http://markmail.org/message/xhxorbutl3encr2d These aren't actually cache related problems. These are mbox bugs. > I know that Timo suggests to switch away from mbox but unfortunately this is rather challenging for me. Switching to maildir results in millions of files and this overwhelmes my backup system. mdbox also does not qualify since AFAIK there is no python or perl library support for manipulating mdbox mailboxes. > :-( You shouldn't need to manipulate mdboxes directly. You can manipulate them via doveadm binary or doveadm protocol. That way you could also later on switch between any mailbox formats without changing your manipulation tools. From tss at iki.fi Thu Oct 16 19:15:08 2014 From: tss at iki.fi (Timo Sirainen) Date: Thu, 16 Oct 2014 12:15:08 -0700 Subject: Proxy problem: "imap-login: Error: proxy(USERNAME): connect(10.x.x.178, 993) failed: Cannot assign requested address (after 0 secs, local=10.x.x.104)" In-Reply-To: <20141016132612.GA16495@sys4.de> References: <20141016132612.GA16495@sys4.de> Message-ID: <95247B98-13B5-42C0-A8A4-10B8F9F6B77E@iki.fi> On 16 Oct 2014, at 06:26, Ralf Hildebrandt wrote: > After fixing the "duplicate compression" problem, we're now > encountering > > "imap-login: Error: proxy(USERNAME): connect(10.x.x.178, 993) failed: Cannot assign requested address (after 0 secs, local=10.x.x.100)" > > in the logs. We already tried raising the ulimit, the max number of > open files. Once we reach about 25k connections, we're getting the > error above... for all local addresses. It seems as if the system > cannot create any more outgoing connections. I'd guess you're running out of TCP ports. > We're using multiple local addresses when proxying to the backends How are you doing the multiple local addresses? In v2.2.14 there's login_source_ips setting intended to solve this problem. http://wiki2.dovecot.org/PasswordDatabase/ExtraFields/Proxy From tss at iki.fi Thu Oct 16 19:21:54 2014 From: tss at iki.fi (Timo Sirainen) Date: Thu, 16 Oct 2014 12:21:54 -0700 Subject: dsync duplicating identical messages In-Reply-To: <543FE7AE.4050603@lescentaures.fr> References: <543FE7AE.4050603@lescentaures.fr> Message-ID: On 16 Oct 2014, at 08:43, Bruno Viaris wrote: > I?m trying to setup dovecot/postfix/getmail for a single user > application: I have 3 email accounts and 2 main computers (home and > work). I want to have an imap server on each machine with > sync/replication so that read/reply/delete status and sorting into > folders are identical. This part is achieved via dsync and seems to work. > > Messages are fetched from my ISPs with getmail on both machines. The > problem I have is that dsync does not see that a message already fetched > on both sides is identical, and duplicates it. dsync isn't supposed to work with this kind of setup. It doesn't try to compare if message contents are identical. It works with GUIDs that Dovecot generates internally when writing the mails to disk. > If you explain me that there is no way to prevent this duplication and > that anyway dsync does the right thing, I will probably use getmail only > on one machine and let dsync propagate the messages to the other site, > but I will miss the redundancy (and some speed) of my wished setup... I think that's how it needs to be done. From rnowotny at rotek.at Thu Oct 16 19:50:53 2014 From: rnowotny at rotek.at (Robert Nowotny) Date: Thu, 16 Oct 2014 21:50:53 +0200 Subject: ssd for /home In-Reply-To: <54400448.5080505@makolab.pl> References: <54400448.5080505@makolab.pl> Message-ID: <5440219D.7010100@rotek.at> |> ...to change sata disk for /home why only for /home ? since the email data is the biggest part, i would not care for the remaining (system, dovecot, etc) and put everything on the SSD > Even server grade SSD's are prone to sudden failures. Mostly due to exeeded max write count. this is only true for old SSD Drives und bad installation. Modern drives - for instance Intel - the warranty is a MINIMUM lifetime of 5 years @ 20GB wite volume per day.|*|/ here some data fromMtron (one of the few SSD oems who do quote endurance in a way that non specialists can understand). In thedata sheet for their 32G product - which incidentally has 5 million cycles write endurance - they quote the write endurance for the disk as "greater than 85 years assuming 100G / day erase/write cycles" - which involves overwriting the disk 3 times a day. /|*|so - properly used (trim, 10% overprovisioning, mount with noatime, tmp on virtualfs) a modern SSD is for sure much much more reliable then any magnetic plattern drive.|*|/ Over-provisioningextends the SSD life - because all cells in a chip do not have the same endurance. There's a distribution curve of endurance within chip blocks which is a proprietary secret which can be characterized by the SSD controller designer for the chips they support. Most blocks are significantly better than the floor level in the same memory chip. SLC : about 100.000 write Cycles / Cell eMLC : about 10.000 write Cycles / Cell MLC : about 3000 write Cycles / Cell > In mirror raid both drives will fail almost at the same time, couse of identical workloads. Au contraire:- not only can an SSD RAID array offer a multiple of a single SSD's throughput, and IOPs, just as with hard disks but depending on the array configuration theoperating life can be multipliedas well - because not all the disks will operate at 100% duty cycle. That means that MTBF and not write endurance will be the limiting factors. And although oem publishedMTBF data for hard disks has been discredited recently - the MTBF data for flash SSDs has been verified for over a decade in more discriminating applications in high reliability embedded systems. /|*|therefore |*|/I use for my very heavvy loaded servers : LSI SAS9270i or similar Raid Controller - LSI Service is really good, the controllers are performing very good 6 x SSD Drives Samsung Pro Series, using Raid 1+0 (never use Raid5 ...) - 10 Years Warranty @ 150TB written for each Drive. /|*|S|*|/o I end up with (a minimum of) 450TB /|*|written|*|/- well thats a lot isnt it. and >10% overprovisioning will extend that value a lot. 1 magnetic Drive for Nightly Backup with rsync PCBackup Server to make a backup of the Nightly Backup during the Day ... use mdbox format use xz compression (uses /*LOTS*/ of ram, but reduce datavolume (and therefore write volume), compression is faster then the data write rates ..., also cache is used more efficiently) Never had ANY problems until now, and speed is amazing. /|*|> The other factor is the price. my time - and uptime - is priceless. Hardware is cheap. I happily throw $3000 in the ring to sleep well. 1 Day data recovery and no mail for 40 users is fore sure much much more expansive ... You can find much more information here : http://www.storagesearch.com/ssdmyths-endurance.html |*|/ /|*| | |Am 2014-10-16 um 19:45 schrieb Przemys?aw Orzechowski: | > |On 16.10.2014 18:24, Luciano Gabriel Andino wrote: > | >> |Hi, I am thinking to change sata disk for /home and I want to know if >> change to a SSD hd, is a good option. I have 30-40 accounts with 30-50K >> email in boxes. >> >> | > |Hi > > SSD's give you fast read and (degrading with time) fast write > performance but at a cost. > > Even server grade SSD's are prone to sudden failures. Mostly due to > exeeded max write count. And when they fail you lose whole data stored > on them (this happened fiew times in my work) So we are using SSD's as > fast storage ie as cache, but always have a persistent copy somwhere > else or store data that can be easily reconstructed in case of SSD's > fail. > > You can read SSD disks all the time but writing to them causes fast > wear. Most SSD's have a specific limit of numer of writes (more > specific erase cycles for memory blocks) and when they reach that > limit they just stop working. > In mirror raid both drives will fail almost at the same time, couse of > identical workloads. > > Thats what my experiences with SSD storage is. > The other factor is the price. > > In my laptop (not so heavily used - fiew VM's and ubuntu desktop (30% > of the drive left unpartitioned) an intel consumer grade SSD died in a > year (no files recoverable). > > So my advice is either store dovecot indexes on SSD (should improve > performance) or have a mirror (dsync ?) of Your /home on some other > (magnetic) storage unless You are ok with the loss of /home contents > | ||*|/ /|* From damien at desfontain.es Thu Oct 16 22:33:05 2014 From: damien at desfontain.es (Damien Desfontaines) Date: Fri, 17 Oct 2014 00:33:05 +0200 Subject: Permissions for shared mail don't work Message-ID: <20141016223305.GC17848@K3PO.thurnes.local> Hello, (Sorry if you already received this mail. I sent it without having subscribed to the list, but I never got any confirmation; so I assumed it has been filtered by the anti-spam or something.) I'm using dovecot v.2.1.7 on Debian Sid, and the output of dovecot -n is available here: http://paste.fulltxt.net/C-O I'm trying to make the mailbox of (system) user "spam" available to user "ted". I followed these instructions: http://wiki2.dovecot.org/SharedMailboxes/Permissions and it doesn't seem to work. To be more precise: - I manually (and recursively) changed the permissions of all files in ~spam/Mail to 660 (and 770 for the directories); - I manually (and recursively) changed the group owner of everything in ~spam/Mail to "mailperso", where "mailperso" is a group whose users are spam and ted; - I added ? mail_access_groups=mailperso ? into my dovecot config; - and I restarted dovecot. But still, when I send a new email to spam, it appears as being owned by group "spam" and having permissions set to 600, so I can't access it with user "ted". I also tried to set the setgid bit for ~spam/Mail, it didn't change anything, and when I recursively set the setgid for all subdirectories of ~spam/Mail, it gives new mails the correct group (mailperso) but not the correct permissions. Have I missed something, or is this a bug? Thanks in advance and best regards, Damien -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 213 bytes Desc: Digital signature URL: From skdovecot at smail.inf.fh-brs.de Fri Oct 17 06:26:10 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Fri, 17 Oct 2014 08:26:10 +0200 (CEST) Subject: Permissions for shared mail don't work In-Reply-To: <20141016223305.GC17848@K3PO.thurnes.local> References: <20141016223305.GC17848@K3PO.thurnes.local> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Fri, 17 Oct 2014, Damien Desfontaines wrote: > I'm trying to make the mailbox of (system) user "spam" available to > user "ted". I followed these instructions: > http://wiki2.dovecot.org/SharedMailboxes/Permissions > and it doesn't seem to work. To be more precise: > - I manually (and recursively) changed the permissions of all > files in ~spam/Mail to 660 (and 770 for the directories); > - I manually (and recursively) changed the group owner of everything > in ~spam/Mail to "mailperso", where "mailperso" is a group whose > users are spam and ted; > - I added ? mail_access_groups=mailperso ? into my dovecot config; > - and I restarted dovecot. > > But still, when I send a new email to spam, it appears as being owned > by group "spam" and having permissions set to 600, so I can't access > it with user "ted". I also tried to set the setgid bit for ~spam/Mail, > it didn't change anything, and when I recursively set the setgid for > all subdirectories of ~spam/Mail, it gives new mails the correct group > (mailperso) but not the correct permissions. Please post (here in the list) ls -al ~spam/Mail ~spam/Mail/{new,cur} - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBVEC2gnz1H7kL/d9rAQKEIAf/b0xU5NqG1UqMy0umd+5PAmuLDf6I/IWU zD7hN/l8X2XPP2sGi5r8SkfIKZCVR/H+KLuZVJoNM5xeGlfg9c51Pd8UPrVlAlsE DnWDdJYY0+TXyqrY+chfK6rqH6+AF5EKIRioKfZmdlaK+jrQc4hHTRJIfCLpx2Ok 7MBHsCcAlPUrhpFAjmek8ylHHRlTZFvDfQei80PBRs7g7ULS+sVPgr1oSggQ1NbY o0j04LMtgcUZwrYNvOj2fr4jzUZkpoohvX2AgDbnEzzrilAYKmVfYUcjBj4Gn3+n T9CyWQCRVf1NKCAkqeH5HXaw6VcDGFUPtJVpNaZKn/ItbhfZHgqu1w== =dUq7 -----END PGP SIGNATURE----- From skdovecot at smail.inf.fh-brs.de Fri Oct 17 07:09:14 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Fri, 17 Oct 2014 09:09:14 +0200 (CEST) Subject: Unable to get virtual users set up with database auth In-Reply-To: <5440046B.4040308@gedalya.net> References: <543F57D3.5060806@afo.net> <543FED06.5030306@afo.net> <543FEE8B.7090906@gedalya.net> <543FF002.4060306@afo.net> <543FF132.8090504@gedalya.net> <543FF790.8040905@afo.net> <5440046B.4040308@gedalya.net> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Thu, 16 Oct 2014, Gedalya wrote: > btw I meant: the output of the 'dovecot -n' command > > OK so, first of all, lda doesn't do any passdb lookup at all, only userdb. It > doesn't have any password to check. Gedalya is correct. >> mail_location = mbox:/var/spool/mail/%u:INBOX=/var/spool/mail/%u This makes no sense, either /var/spool/mail/%u is your mail root or INBOX. >> mbox_write_locks = fcntl >> namespace { >> hidden = no >> inbox = yes >> list = yes >> location = >> prefix = comment them out >> separator = . >> subscriptions = yes >> type = private >> } >> passdb { >> args = /etc/dovecot/dovecot-sql.conf.ext >> driver = sql >> } >> userdb { >> args = uid=497 gid=12 home=/var/email/%u >> driver = static >> } quote of your 1st message: > Oct 16 00:10:26 avalon sendmail[2536]: s9G5APo9002535: forward /var/spool/mail/chayes at domain.tld/chayes/.forward.avalon: Group writable directory > Oct 16 00:10:26 avalon sendmail[2536]: s9G5APo9002535: forward /var/spool/mail/chayes at domain.tld/chayes/.forward: Group writable directory > Oct 16 00:10:26 avalon dovecot: lda(chayes): Debug: Effective uid=497, gid=497, home=/var/spool/mail/chayes at domain.tld/chayes > Oct 16 00:10:26 avalon dovecot: lda(chayes): Debug: Home dir not found: /var/spool/mail/chayes at domain.tld/chayes > Oct 16 00:10:26 avalon dovecot: lda(chayes): Debug: Namespace : type=private, prefix=, sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes > location=mbox:/var/spool/mail/chayes:INBOX=/var/spool/mail/chayes > Oct 16 00:10:26 avalon dovecot: lda(chayes): Debug: fs: root=/var/spool/mail/chayes, index=, control=, inbox=/var/spool/mail/chayes Both, sendmail and deliver use a non-existant home directory of user chayes. The last log line then has the values from your config. It looks like: a) /etc/passwd contains wrong values for "home", you need a home directory, which must differ from the the mail root b) you start Dovecot LDA _without_ -d option and not as root, that means, that the LDA does not query the userdb, but relies on the environment variables. See http://wiki2.dovecot.org/LDA c) Did you configured sendmail to pass the domain forth to the LDA? ==== Please tell us: 0) do you run sendmail in a multi-domain setup with system users? 1) what's the home directory for chayes, 2) what's the mail root and mailbox format for chayes, 3) what's the location of the INBOX of chayes, 4) what's the system user (name, uid & gid, other /etc/passwd data) the procmail script runs under. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBVEDAm3z1H7kL/d9rAQLNkgf/Ts0K14NahsEOZD0ocoPqCA/WzdNre2cC y3FxL4i50Kdr4Y2czso0xcR6cThtVTGLbiJGgG7Hvi4tDH5bTSESJU92BByHFMpD FCQO7o1j5ubw+0vPb70YCPw0z6OEsN4SPwkh8oLnjAW2PETNKmF5Y9a9v/JrdJeK yQz7RUy3mOO9g334sKTI3QzuvbFaEnZXPmoCbbOauIljUzTcFOaDg5qcKI9XjNQ5 uV9ZQdG1i2LCv6S88hAmip+/EgeK/FoD/syQYzXuSMjfHnJBnAPUbSBl/mQmMdF5 eRazYldyA7Qtk6Y/piQn24Di6E8Ri+XnfT9EpMDn/oDqBx/wLR+XLA== =6GuU -----END PGP SIGNATURE----- From r at sys4.de Fri Oct 17 07:47:31 2014 From: r at sys4.de (Ralf Hildebrandt) Date: Fri, 17 Oct 2014 09:47:31 +0200 Subject: Proxy problem: "imap-login: Error: proxy(USERNAME): connect(10.x.x.178, 993) failed: Cannot assign requested address (after 0 secs, local=10.x.x.104)" In-Reply-To: <95247B98-13B5-42C0-A8A4-10B8F9F6B77E@iki.fi> References: <20141016132612.GA16495@sys4.de> <95247B98-13B5-42C0-A8A4-10B8F9F6B77E@iki.fi> Message-ID: <20141017074731.GA11684@sys4.de> > > in the logs. We already tried raising the ulimit, the max number of > > open files. Once we reach about 25k connections, we're getting the > > error above... for all local addresses. It seems as if the system > > cannot create any more outgoing connections. > > I'd guess you're running out of TCP ports. I think so too, but it's somewhat unlikely! We're using 10 outbound IP adresses! In a random fashion (and I'm seeing this on the backend server!) > > We're using multiple local addresses when proxying to the backends > > How are you doing the multiple local addresses? In v2.2.14 there's > login_source_ips setting intended to solve this problem. Exactly like that! > http://wiki2.dovecot.org/PasswordDatabase/ExtraFields/Proxy -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From claus.r at bayern-mail.de Fri Oct 17 11:11:19 2014 From: claus.r at bayern-mail.de (Claus) Date: Fri, 17 Oct 2014 13:11:19 +0200 Subject: replicating (manage)sieve - no symlink on replica? In-Reply-To: <54176D17.7070408@rename-it.nl> References: <5aac7554cee68f3b811b38ad3b2b232e@posteo.de> <54176D17.7070408@rename-it.nl> Message-ID: <5440F957.3030103@bayern-mail.de> Hello Stephan, we have the same Problem. replication of script-files and directory works fine, but activation of script isn't replicated (missing symlink). regards claus Am 16.09.2014 um 00:49 schrieb Stephan Bosch: > On 9/11/2014 3:36 PM, Philipp wrote: >> 2.2.13/0.4.2, both from source-tarball, no fancy options. >> >> tcp-replication between two nodes and following plugin parameters >> (same on both sides, except the ip-addr) >> plugin { >> sieve_before = /home/ssfn/etc/dovecot/sieve.default >> sieve_global_dir = /home/ssfn/etc/dovecot >> sieve = ~/.dovecot.sieve >> sieve_dir = ~/.sieve >> sieve_extensions = +vnd.dovecot.duplicate >> sieve_duplicate_period = 6h >> mail_replica = tcp:10.66.50.15:9993 >> } >> >> mail_location = sdbox:/home/ssfn/var/mail/boxes/%n >> mail_home = /home/ssfn/var/mail/boxes/%n >> >> Testbed: user getting first email delivered, the subdir %n/.sieve/tmp >> is automatically created as expected. >> User logs into managesieve on node1 and uploads a script. >> The %n/.sieve/managesieve.sieve and the symlink .dovecot.sieve -> >> .sieve/managesieve.sieve >> is created as expected. >> >> One node2 (via replica) happens: >> automatically create %n/.sieve/tmp >> automatically create/sync %n/.sieve/managesieve.sieve >> just NOT the symlink .dovecot.sieve -> .sieve/managesieve.sieve >> >> Logfiles for lmtp,doveadm,dsync-local dont indicate an error why it >> could not create the link or such, >> to me it looks like it wouldnt even try. >> >> mail-syncing works flawlessly (for delivery, just read about the >> expunge .. hum.) >> >> I tried to force a full-resync via doveadm replicator afterwards, to >> no change on the matter. >> >> Any input? > Sorry, I haven't had time to look at this one. I believe a similar issue > was reported earlier. It is on my list, but testing this is a bit > cumbersome for me at the moment. > > Regards, > > Stephan. > From davide.marchi at mail.cgilfe.it Fri Oct 17 14:24:56 2014 From: davide.marchi at mail.cgilfe.it (Davide) Date: Fri, 17 Oct 2014 16:24:56 +0200 Subject: Dovecot-ee Message-ID: <544126B8.9050700@mail.cgilfe.it> Hi to all, i found that dovecot-ee repository access is free 0,00 $ cost; i'm running dovecot community 2.2.13 can i migrate my system to dovecot-ee? What are difference between Dovecot-ee and Dovecot-community? -- *Davide Marchi* *T*eorema *F*errara *Srl* Via Spronello, 7 - Ferrara - 44121 Tel. *0532783161* Fax. *0532783368* E-m at il: *davide.marchi at mail.cgilfe.it* Skype: *davide.marchi73* Web: *http://www.cgilfe.it* *CONFIDENZIALITA'* *Ai sensi del D.Lgs. 196/2003 si precisa che le informazioni contenute in questo messaggio sono riservate ed a uso esclusivo del destinatario/dei destinatari. Qualora il messaggio in parola Le fosse pervenuto per errore, La invitiamo ad eliminarlo senza copiarlo e a non inoltrarlo a terzi, dandocene gentilmente comunicazione.* *Per favore, pensa all'ambiente. Stampa questa email solo se necessario.* From hannar at ecuad.ca Fri Oct 17 17:54:17 2014 From: hannar at ecuad.ca (Hanna Ruotsalainen) Date: Fri, 17 Oct 2014 10:54:17 -0700 Subject: High memory usage Message-ID: <544157C9.8090204@ecuad.ca> Hi I recently (about 2 weeks ago) moved over my users over to a new version of dovecot (2.0.9) and now the memory usage on the new server seems much higher than it was before. The new server is a CentOS 6 VM with 4 GB of RAM and 4 CPUs and according to top, it's used up all of the RAM and all of the Swap. Here's a sample of the output from top (sorted by allocated memory). top - 10:42:36 up 22 days, 21:57, 1 user, load average: 1.04, 1.40, 1.52 Tasks: 1643 total, 1 running, 1642 sleeping, 0 stopped, 0 zombie Cpu(s): 0.7%us, 0.7%sy, 0.0%ni, 93.3%id, 5.1%wa, 0.0%hi, 0.1%si, 0.0%st Mem: 3924432k total, 3779236k used, 145196k free, 23740k buffers Swap: 4063228k total, 3181164k used, 882064k free, 156420k cached PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 16738 root 20 0 399m 182m 436 S 0.0 4.8 5:50.58 config 18790 dovenull 20 0 54528 11m 2036 S 0.0 0.3 0:00.05 imap-login 22277 dovenull 20 0 54528 11m 2156 S 0.0 0.3 0:00.04 imap-login 22796 dovenull 20 0 54528 11m 2140 S 0.0 0.3 0:00.03 imap-login 22749 dovenull 20 0 54528 11m 2148 S 0.0 0.3 0:00.03 imap-login 22825 dovenull 20 0 54528 11m 2156 S 0.0 0.3 0:00.03 imap-login This is with 1015 imap processes and 484 imap-login processes. The old version was 1.0.rc15 and running on a CentOS 4 box with 2GB of RAM. It was overloaded but the RAM usage wasn't maxed out like this one is (not much swap usage and a large amount of cached memory). Is this amount of memory usage normal? What could be causing it, if it isn't? Thanks for your help, Hanna Here is the output of dovecot -n: # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-431.29.2.el6.x86_64 x86_64 CentOS release 6.5 (Final) nfs auth_verbose = yes disable_plaintext_auth = no listen = * login_greeting = Ready. mail_debug = yes mail_location = maildir:/mail/%1Lu/%u:INDEX=/var/cache/dovecot/indexes/%1Lu/%u mail_plugins = " mail_log notify" maildir_very_dirty_syncs = yes mbox_lazy_writes = no namespace { inbox = yes location = prefix = separator = / type = private } passdb { args = /etc/dovecot/dovecot-ldap-pass.conf driver = ldap } plugin { mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size } protocols = imap pop3 service anvil { client_limit = 1250 } service auth { client_limit = 4300 user = root } service imap-login { process_limit = 600 service_count = 1 } service imap { process_limit = 1536 } service pop3-login { process_limit = 600 service_count = 1 } service pop3 { process_limit = 1536 } ssl_ca = | 1399 Johnston Street, Vancouver BC V6H 3R9 From tss at iki.fi Fri Oct 17 19:08:38 2014 From: tss at iki.fi (Timo Sirainen) Date: Fri, 17 Oct 2014 12:08:38 -0700 Subject: Dovecot-ee In-Reply-To: <544126B8.9050700@mail.cgilfe.it> References: <544126B8.9050700@mail.cgilfe.it> Message-ID: On 17 Oct 2014, at 07:24, Davide wrote: > Hi to all, i found that dovecot-ee repository access is free 0,00 $ cost; i'm running dovecot community 2.2.13 can i migrate my system to dovecot-ee? What are difference between Dovecot-ee and Dovecot-community? It's the same, except somewhat more stable with latest important bugfixes. We have some plans for how Dovecot releases could start working in somewhat near future and then there would be even less of a difference between the community and -ee versions. From gordon.grubert+lists at uni-greifswald.de Fri Oct 17 19:41:03 2014 From: gordon.grubert+lists at uni-greifswald.de (Gordon Grubert) Date: Fri, 17 Oct 2014 21:41:03 +0200 Subject: [Dovecot] 2.1: Error: Maildir filename has wrong S value, renamed the file from SOLVED In-Reply-To: <51505D8C.5050503@uni-greifswald.de> References: <5150355C.4000802@sys4.de> <515051D3.9040602@thelounge.net> <51505D8C.5050503@uni-greifswald.de> Message-ID: <544170CF.6060306@uni-greifswald.de> Hi, in our case, the problem is solved since dovecot 2.2.13. Best regards, Gordon From damien at desfontain.es Fri Oct 17 21:40:57 2014 From: damien at desfontain.es (Damien Desfontaines) Date: Fri, 17 Oct 2014 23:40:57 +0200 Subject: Permissions for shared mail don't work In-Reply-To: References: <20141016223305.GC17848@K3PO.thurnes.local> Message-ID: <20141017214057.GD17848@K3PO.thurnes.local> Hello, Here it is: http://paste.fulltxt.net/Xzoq9v You can actually see when I manually changed all permissions, around October 12, and the fact that the messages received afterwards don't have the correct permissions. Best, Damien On Fri, Oct 17, 2014 at 08:26:10AM +0200, Steffen Kaiser wrote: > On Fri, 17 Oct 2014, Damien Desfontaines wrote: > > >I'm trying to make the mailbox of (system) user "spam" available to > >user "ted". I followed these instructions: > > http://wiki2.dovecot.org/SharedMailboxes/Permissions > >and it doesn't seem to work. To be more precise: > >- I manually (and recursively) changed the permissions of all > > files in ~spam/Mail to 660 (and 770 for the directories); > >- I manually (and recursively) changed the group owner of everything > > in ~spam/Mail to "mailperso", where "mailperso" is a group whose > > users are spam and ted; > >- I added ? mail_access_groups=mailperso ? into my dovecot config; > >- and I restarted dovecot. > > > >But still, when I send a new email to spam, it appears as being owned > >by group "spam" and having permissions set to 600, so I can't access > >it with user "ted". I also tried to set the setgid bit for ~spam/Mail, > >it didn't change anything, and when I recursively set the setgid for > >all subdirectories of ~spam/Mail, it gives new mails the correct group > >(mailperso) but not the correct permissions. > > Please post (here in the list) > > ls -al ~spam/Mail ~spam/Mail/{new,cur} -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 213 bytes Desc: Digital signature URL: From lists at luigirosa.com Sat Oct 18 09:29:21 2014 From: lists at luigirosa.com (Luigi Rosa) Date: Sat, 18 Oct 2014 11:29:21 +0200 Subject: last_login plugin with MySQL Message-ID: <544232F1.6070508@luigirosa.com> Hi, I have a Dovecot test installation with MySQL userbase and authentication where I am trying to setup last_login plugin with SQL dictionary I read http://wiki2.dovecot.org/Plugins/LastLogin and I addes this to my configuration plugin { last_login_dict = sql:/etc/dovecot/dovecot-sql.conf.ext } mail_plugins = $mail_plugins stats protocol imap { mail_plugins = $mail_plugins imap_stats last_login } When I log in with IMAP I get this error: Error: last_login_dict: dict_init(sql:/etc/dovecot/dovecot-sql.conf.ext) failed: Unknown dict module: sql /etc/dovecot/dovecot-sql.conf.ext is the file taht contains the SQL configuration. If I put mysql instead of sql the result is the same: Error: last_login_dict: dict_init(mysql:/etc/dovecot/dovecot-sql.conf.ext) failed: Unknown dict module: mysql The output of doveconf -n follows. Do you have any idea on how to use MySQL for last_login? Ciao, luigi # 2.2.14: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-431.29.2.el6.x86_64 x86_64 CentOS release 6.5 (Final) auth_cache_negative_ttl = 0 auth_cache_size = 100 k auth_cache_ttl = 8 hours auth_mechanisms = plain login digest-md5 cram-md5 auth_verbose = yes base_dir = /var/run/dovecot/ listen = 127.0.0.1, 10.19.67.253 login_greeting = Ready. login_trusted_networks = 10.xx.xx.0/24, 2001:xxxx:xxxx:xxxx::/64 mail_plugins = " stats" mailbox_list_index = yes maildir_stat_dirs = yes passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { last_login_dict = mysql:/etc/dovecot/dovecot-sql.conf.ext sieve = ~/.dovecot.sieve sieve_dir = ~/sieve stats_refresh = 10s stats_track_cmds = yes } protocols = imap service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } service stats { fifo_listener stats-mail { mode = 0666 } } ssl_cert = References: <20141016223305.GC17848@K3PO.thurnes.local> <20141017214057.GD17848@K3PO.thurnes.local> Message-ID: <544265B6.8030504@smail.inf.fh-brs.de> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Damien Desfontaines wrote: > > Here it is: http://paste.fulltxt.net/Xzoq9v > > You can actually see when I manually changed all permissions, > around October 12, and the fact that the messages received > afterwards don't have the correct permissions. how do you deliver new messages to spam's INBOX? > > On Fri, Oct 17, 2014 at 08:26:10AM +0200, Steffen Kaiser wrote: >> On Fri, 17 Oct 2014, Damien Desfontaines wrote: >> >>> I'm trying to make the mailbox of (system) user "spam" >>> available to user "ted". I followed these instructions: >>> http://wiki2.dovecot.org/SharedMailboxes/Permissions and it >>> doesn't seem to work. To be more precise: - I manually (and >>> recursively) changed the permissions of all files in ~spam/Mail >>> to 660 (and 770 for the directories); - I manually (and >>> recursively) changed the group owner of everything in >>> ~spam/Mail to "mailperso", where "mailperso" is a group whose >>> users are spam and ted; - I added ? >>> mail_access_groups=mailperso ? into my dovecot config; - and I >>> restarted dovecot. >>> >>> But still, when I send a new email to spam, it appears as being >>> owned by group "spam" and having permissions set to 600, so I >>> can't access it with user "ted". I also tried to set the setgid >>> bit for ~spam/Mail, it didn't change anything, and when I >>> recursively set the setgid for all subdirectories of >>> ~spam/Mail, it gives new mails the correct group (mailperso) >>> but not the correct permissions. >> >> Please post (here in the list) >> >> ls -al ~spam/Mail ~spam/Mail/{new,cur} - -- Steffen -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (Darwin) Comment: Using GnuPG with undefined - http://www.enigmail.net/ iQEVAwUBVEJltnD1/YhP6VMHAQI7GAf+NfwOhFasVnecOXWLhrJWO4CNxk7e7A8x 42VudckKbY4WvgvnehhNWTvXYyJUPlDYpyijLWly2T3X2zjsQzwYiR6WCTxUCq5I mncZ7VEiMHRW+qsAQ5UWsZsrkcJy161m8+G3ZzcTyX18O1Zt0UL0DwQ1T2xRUuQx YMVdcvpEP0cygid6NBuT8x6+6MNMpJs3/G+M3SeOOdCgxOdIyYNYPSnlvWc07eJ2 6JC0TBXZ1Nnwf9XHLcSetR6tRBtN5aOQwTl6lpWa9rz31a5LXvR9W1kU19yqVQPA Be2VOwLCJW/eruYqXbxDg/eJZZiZRvnArNjBpteT4RdbDmgit3+SUQ== =KDpC -----END PGP SIGNATURE----- From lists at luigirosa.com Sat Oct 18 13:33:25 2014 From: lists at luigirosa.com (Luigi Rosa) Date: Sat, 18 Oct 2014 15:33:25 +0200 Subject: last_login plugin with MySQL In-Reply-To: <544232F1.6070508@luigirosa.com> References: <544232F1.6070508@luigirosa.com> Message-ID: <54426C25.6050805@luigirosa.com> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Luigi Rosa wrote on 18/10/2014 11:29: > Hi, I have a Dovecot test installation with MySQL userbase and > authentication where I am trying to setup last_login plugin with SQL > dictionary I figured out I have to use dovecot-dict-sql.conf.ext instead of dovecot-sql.conf.ext I configured dovecot-dict-sql.conf.ext this way: driver= mysql connect = {the connect string that works for user lookup} map { pattern = last-login table = mailbox username_field = username } And I defined the plugin this way: plugin { last_login_dict = sql:/etc/dovecot/dovecot-dict-sql.conf.ext last_login_key = last-login/%u # default } But I still get the same error: Error: last_login_dict: dict_init(sql:/etc/dovecot/dovecot-dict-sql.conf.ext) failed: Unknown dict module: sql Ciao, luigi - -- / +--[Luigi Rosa]-- \ Every program has (at least) two purposes: the one for which it was written and another for which it wasn't. -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQIcBAEBAgAGBQJUQmwfAAoJEO5WT/qgw4yKgV0P/iGjH7Tcy/tfCf9fVjECO187 fa07fBXwG+BR9CqDejmNeT0qGC8Vx3YebWl3Sc61N8z6CMXzwQUo4gAsLnw3bW/3 VTioxcZKULbE8bNE8goN/yrNur1N4yMcrQTSb+Lno4D5adXfWdXC2j8nwRrAnjXf om4XvWP+S/PX7oblqymNCHWtJhmOwPkCPKqKqpXxdZ4SXQHCb+96NI4Mkbp1WVEr 1npH8+p1ut8s1wjwGo56tE+EplJKNp4oMhQch4nHQp6uWnAH3IF6P8T23iLnog7p wuG0e2Mo1vDoMWaf7J+6lIUB45OizgA1qAHho5jpASCGQE5D/XqolRzTTvJJ2Ykh Jgll8Gc+/JqMeHX5XlsUsVdPGEFIvwTGyKjZB90qA5UPOJf6hgRQbcVam3iUDBRW v+KRrtPuTeExDj9nfxL1QZAwoFW6QY+mUNvS+jgb1vGmQlCK12lUgBzVPi1d72sN boHmpmGfLnl97cg+FjrAtU8N0aBeoOkIqECmLSmnQwdwz+PkoyrgKvAVt4IgI0aX WVNBSy1cir+/I2c9EY+FTYyRczSaRglTMBwLMM1O910NMRvsZmqniTCvfBnhv4Xv 95GhLhisAp/TBUSD8Jnk+K76Un/xfNSAex1t6NeyVdEKSOiqVlSMYo8o5wHBzaXV A6ztvItzmTnfOux5C03q =6gvz -----END PGP SIGNATURE----- From gedalya at gedalya.net Sat Oct 18 14:05:05 2014 From: gedalya at gedalya.net (Gedalya) Date: Sat, 18 Oct 2014 10:05:05 -0400 Subject: last_login plugin with MySQL In-Reply-To: <54426C25.6050805@luigirosa.com> References: <544232F1.6070508@luigirosa.com> <54426C25.6050805@luigirosa.com> Message-ID: <54427391.10604@gedalya.net> On 10/18/2014 09:33 AM, Luigi Rosa wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > Luigi Rosa wrote on 18/10/2014 11:29: >> Hi, I have a Dovecot test installation with MySQL userbase and >> authentication where I am trying to setup last_login plugin with SQL >> dictionary > I figured out I have to use dovecot-dict-sql.conf.ext instead of > dovecot-sql.conf.ext > > I configured dovecot-dict-sql.conf.ext this way: > > driver= mysql > connect = {the connect string that works for user lookup} > map { > pattern = last-login > table = mailbox > username_field = username > } > > And I defined the plugin this way: > > plugin { > last_login_dict = sql:/etc/dovecot/dovecot-dict-sql.conf.ext > last_login_key = last-login/%u # default > } > > But I still get the same error: > > Error: last_login_dict: dict_init(sql:/etc/dovecot/dovecot-dict-sql.conf.ext) > failed: Unknown dict module: sql > > It's been said here before, and I'll echo it again -- better documentation for dict would be helpful, a step-by-step guide to its principles of operation, rather than just the anecdotal examples we have, out of which we're supposed to extrapolate. From damien at desfontain.es Sat Oct 18 13:07:58 2014 From: damien at desfontain.es (Damien Desfontaines) Date: Sat, 18 Oct 2014 15:07:58 +0200 Subject: Permissions for shared mail don't work In-Reply-To: <544265B6.8030504@smail.inf.fh-brs.de> References: <20141016223305.GC17848@K3PO.thurnes.local> <20141017214057.GD17848@K3PO.thurnes.local> <544265B6.8030504@smail.inf.fh-brs.de> Message-ID: <20141018130758.GE17848@K3PO.thurnes.local> On Sat, Oct 18, 2014 at 03:05:58PM +0200, Steffen wrote: > Damien Desfontaines wrote: > > > > Here it is: http://paste.fulltxt.net/Xzoq9v > > > > You can actually see when I manually changed all permissions, > > around October 12, and the fact that the messages received > > afterwards don't have the correct permissions. > > how do you deliver new messages to spam's INBOX? By sending an e-mail to spam.whatever at desfontain.es?? (I'm not sure I understand the question?) Damien -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 213 bytes Desc: Digital signature URL: From gedalya at gedalya.net Sat Oct 18 14:10:25 2014 From: gedalya at gedalya.net (Gedalya) Date: Sat, 18 Oct 2014 10:10:25 -0400 Subject: last_login plugin with MySQL In-Reply-To: <54427391.10604@gedalya.net> References: <544232F1.6070508@luigirosa.com> <54426C25.6050805@luigirosa.com> <54427391.10604@gedalya.net> Message-ID: <544274D1.4010505@gedalya.net> On 10/18/2014 10:05 AM, Gedalya wrote: > On 10/18/2014 09:33 AM, Luigi Rosa wrote: >> -----BEGIN PGP SIGNED MESSAGE----- >> Hash: SHA1 >> >> Luigi Rosa wrote on 18/10/2014 11:29: >>> Hi, I have a Dovecot test installation with MySQL userbase and >>> authentication where I am trying to setup last_login plugin with SQL >>> dictionary >> I figured out I have to use dovecot-dict-sql.conf.ext instead of >> dovecot-sql.conf.ext >> >> I configured dovecot-dict-sql.conf.ext this way: >> >> driver= mysql >> connect = {the connect string that works for user lookup} >> map { >> pattern = last-login >> table = mailbox >> username_field = username >> } >> >> And I defined the plugin this way: >> >> plugin { >> last_login_dict = sql:/etc/dovecot/dovecot-dict-sql.conf.ext >> last_login_key = last-login/%u # default >> } >> >> But I still get the same error: >> >> Error: last_login_dict: >> dict_init(sql:/etc/dovecot/dovecot-dict-sql.conf.ext) >> failed: Unknown dict module: sql >> >> > It's been said here before, and I'll echo it again -- better > documentation for dict would be helpful, a step-by-step guide to its > principles of operation, rather than just the anecdotal examples we > have, out of which we're supposed to extrapolate. "The above SQL example uses dictionary proxy process (see below), because SQL libraries aren't linked to all Dovecot binaries. The file and Redis examples use direct access. " http://wiki2.dovecot.org/Quota/Dict I guess you have to use the proxy. So maybe something like plugin { last_login_dict = proxy::lastlogin } dict { lastlogin = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } I'll try it later myself, thanks for taking it thus far :-) I've been meaning to try this out but was rather perplexed. From lists at luigirosa.com Sat Oct 18 14:37:01 2014 From: lists at luigirosa.com (Luigi Rosa) Date: Sat, 18 Oct 2014 16:37:01 +0200 Subject: last_login plugin with MySQL In-Reply-To: <544274D1.4010505@gedalya.net> References: <544232F1.6070508@luigirosa.com> <54426C25.6050805@luigirosa.com> <54427391.10604@gedalya.net> <544274D1.4010505@gedalya.net> Message-ID: <54427B0D.90705@luigirosa.com> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Gedalya wrote on 18/10/2014 16:10: > I guess you have to use the proxy. > > So maybe something like > > plugin { last_login_dict = proxy::lastlogin } > > dict { lastlogin = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } > > I'll try it later myself, thanks for taking it thus far :-) I've been > meaning to try this out but was rather perplexed. I made some progress thank to your suggestions. dovecot-dict-sql.conf.ext content is: map { pattern = /shared/last-login/$user table = mailbox username_field = username value_field = lastlogin fields { username = $user } } Note that you must not specify "driver" parameter Plugin is defined this way: plugin { last_login_dict = proxy::lastlogin last_login_key = last-login/%u # default } dict { lastlogin = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext mode = 0660 user = 501 } But I get two errors. First is the permission of /var/run/dovecot/dict that is 700 root.root and I get a permission error. Nothing changes if I put user = root. I have to manually chmod /var/run/dovecot/dict every time I restart Dovecot otherwise I get Error: net_connect_unix(/var/run/dovecot//dict) failed: Permission denied (euid=501(mailvirtuale) egid=501(mailvirtuale) missing +r perm: /var/run/dovecot//dict, dir owned by 0:0 mode=0755) If I chmod 777 /var/run/dovecot/dict the error disappears but I get this: dovecot: imap-login: Login: user=, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=497913, secured, session=<6R0mYbMFFwB/AAAB> dovecot: dict: Error: sql dict set: Invalid/unmapped key: shared/last-login/username Ciao, luigi - -- / +--[Luigi Rosa]-- \ Don't tell me what you dreamed last night for I've been reading Freud. -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQIcBAEBAgAGBQJUQnsNAAoJEO5WT/qgw4yKPgsP/i3PvHmaHZ3FTyDkXczenVm+ 12dA5MHQ7p26Xai7C3hJeLn/mteZUqc7aEM839nB6vFo+nPBJYjPgVB7k24eSq4T ZV/F3RZV+I4f1oTvzxH8gKvFnXEEbGSXsM7/U+anSdbNVMEPfpZDxgf/DKJfCk61 NBJN+n9bqQ4ZhaN6UD9AGh5w3Oyh4GK40D7Xv6NVca+psMjuT17TKgZ1JaMg7Ir0 QV4f3wmCWfMFGIpxUvUca7UTENYWHkdfLqsWjDU8+tLM7meuJ3PKMasuOKTNMglY 8PyszRGPCBfPvoQluC0K7uXqlEMLpXEmdz354chilXYX4T7zUh+9IHV4MSg1SSQX B7HMrTOU5TY7HfqzHOtLrb4CVtj6thzl9Ixh7Qa13LDbjzqSI5Pe78nVcmfVqp8I Wqovm+XWqm6nUoNFh850iw57t15D6Pg+vZT/qJBT8o++lcA+ssriNsFHw8/nFqSV qe7Oxifhrn7j4KRdBlK8gKiydhxFT//bIdlS2bOwPi+nnkcnT7xT46L1WZVfhQez hYTxAK9ETKonT4O2IKSSn92fxqEobZu99Kom5sRm4uLsvQxdOwjKPJn0Bx00XCW1 vCp1/gmFYkLPAtB/hQ0U32WpL1x/GMKRd6BZXsHQMDgVkf4dVQqB23oUiugl/whE U5s4Dr/5WbmNITXOd0/W =LFZi -----END PGP SIGNATURE----- From gedalya at gedalya.net Sat Oct 18 14:48:10 2014 From: gedalya at gedalya.net (Gedalya) Date: Sat, 18 Oct 2014 10:48:10 -0400 Subject: last_login plugin with MySQL In-Reply-To: <54427B0D.90705@luigirosa.com> References: <544232F1.6070508@luigirosa.com> <54426C25.6050805@luigirosa.com> <54427391.10604@gedalya.net> <544274D1.4010505@gedalya.net> <54427B0D.90705@luigirosa.com> Message-ID: <54427DAA.5080704@gedalya.net> On 10/18/2014 10:37 AM, Luigi Rosa wrote: > But I get two errors. > > > First is the permission of /var/run/dovecot/dict that is 700 root.root and I > get a permission error. Nothing changes if I put user = root. I have to > manually chmod /var/run/dovecot/dict every time I restart Dovecot otherwise I get > > Error: net_connect_unix(/var/run/dovecot//dict) failed: Permission denied > (euid=501(mailvirtuale) egid=501(mailvirtuale) missing +r perm: > /var/run/dovecot//dict, dir owned by 0:0 mode=0755) In conf.d/10-master.conf (this is from my config): service dict { unix_listener dict { mode = 0660 user = vmail #group = } } > > If I chmod 777 /var/run/dovecot/dict the error disappears but I get this: > > dovecot: imap-login: Login: user=, method=PLAIN, rip=127.0.0.1, > lip=127.0.0.1, mpid=497913, secured, session=<6R0mYbMFFwB/AAAB> > dovecot: dict: Error: sql dict set: Invalid/unmapped key: > shared/last-login/username Ok, what were you thinking when you defined this pattern = /shared/last-login/$user ? I personally don't understand this part of the dovecot config at all.. Let's look into this.. > > > > Ciao, > luigi From gedalya at gedalya.net Sat Oct 18 15:02:52 2014 From: gedalya at gedalya.net (Gedalya) Date: Sat, 18 Oct 2014 11:02:52 -0400 Subject: last_login plugin with MySQL In-Reply-To: <54427DAA.5080704@gedalya.net> References: <544232F1.6070508@luigirosa.com> <54426C25.6050805@luigirosa.com> <54427391.10604@gedalya.net> <544274D1.4010505@gedalya.net> <54427B0D.90705@luigirosa.com> <54427DAA.5080704@gedalya.net> Message-ID: <5442811C.6060304@gedalya.net> On 10/18/2014 10:48 AM, Gedalya wrote: >> >> If I chmod 777 /var/run/dovecot/dict the error disappears but I get >> this: >> >> dovecot: imap-login: Login: user=, method=PLAIN, >> rip=127.0.0.1, >> lip=127.0.0.1, mpid=497913, secured, session=<6R0mYbMFFwB/AAAB> >> dovecot: dict: Error: sql dict set: Invalid/unmapped key: >> shared/last-login/username > Ok, what were you thinking when you defined this pattern = > /shared/last-login/$user ? > I personally don't understand this part of the dovecot config at all.. > > Let's look into this.. OK I suspect that" pattern = shared/{dictionary name}/$user So: pattern = shared/lastlogin/$user As per: dict { lastlogin = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext mode = 0660 user = 501 } From gedalya at gedalya.net Sat Oct 18 15:06:11 2014 From: gedalya at gedalya.net (Gedalya) Date: Sat, 18 Oct 2014 11:06:11 -0400 Subject: last_login plugin with MySQL In-Reply-To: <5442811C.6060304@gedalya.net> References: <544232F1.6070508@luigirosa.com> <54426C25.6050805@luigirosa.com> <54427391.10604@gedalya.net> <544274D1.4010505@gedalya.net> <54427B0D.90705@luigirosa.com> <54427DAA.5080704@gedalya.net> <5442811C.6060304@gedalya.net> Message-ID: <544281E3.2000604@gedalya.net> On 10/18/2014 11:02 AM, Gedalya wrote: > On 10/18/2014 10:48 AM, Gedalya wrote: >>> >>> If I chmod 777 /var/run/dovecot/dict the error disappears but I get >>> this: >>> >>> dovecot: imap-login: Login: user=, method=PLAIN, >>> rip=127.0.0.1, >>> lip=127.0.0.1, mpid=497913, secured, session=<6R0mYbMFFwB/AAAB> >>> dovecot: dict: Error: sql dict set: Invalid/unmapped key: >>> shared/last-login/username >> Ok, what were you thinking when you defined this pattern = >> /shared/last-login/$user ? >> I personally don't understand this part of the dovecot config at all.. >> >> Let's look into this.. > OK I suspect that" > > pattern = shared/{dictionary name}/$user > > So: > > pattern = shared/lastlogin/$user > > As per: > > dict { > lastlogin = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext > mode = 0660 > user = 501 > } Or it's plugin name so try last_login ?? From gedalya at gedalya.net Sat Oct 18 15:36:48 2014 From: gedalya at gedalya.net (Gedalya) Date: Sat, 18 Oct 2014 11:36:48 -0400 Subject: last_login plugin with MySQL In-Reply-To: <54427B0D.90705@luigirosa.com> References: <544232F1.6070508@luigirosa.com> <54426C25.6050805@luigirosa.com> <54427391.10604@gedalya.net> <544274D1.4010505@gedalya.net> <54427B0D.90705@luigirosa.com> Message-ID: <54428910.10001@gedalya.net> On 10/18/2014 10:37 AM, Luigi Rosa wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > Gedalya wrote on 18/10/2014 16:10: > >> I guess you have to use the proxy. >> >> So maybe something like >> >> plugin { last_login_dict = proxy::lastlogin } >> >> dict { lastlogin = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } >> >> I'll try it later myself, thanks for taking it thus far :-) I've been >> meaning to try this out but was rather perplexed. > I made some progress thank to your suggestions. > > dovecot-dict-sql.conf.ext content is: > > map { > pattern = /shared/last-login/$user > table = mailbox > username_field = username > value_field = lastlogin > fields { > username = $user > } > } > > Note that you must not specify "driver" parameter > > > Plugin is defined this way: > > > plugin { > last_login_dict = proxy::lastlogin > last_login_key = last-login/%u # default > } > > dict { > lastlogin = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext > mode = 0660 > user = 501 > } > > > But I get two errors. > > > First is the permission of /var/run/dovecot/dict that is 700 root.root and I > get a permission error. Nothing changes if I put user = root. I have to > manually chmod /var/run/dovecot/dict every time I restart Dovecot otherwise I get > > Error: net_connect_unix(/var/run/dovecot//dict) failed: Permission denied > (euid=501(mailvirtuale) egid=501(mailvirtuale) missing +r perm: > /var/run/dovecot//dict, dir owned by 0:0 mode=0755) > > If I chmod 777 /var/run/dovecot/dict the error disappears but I get this: > > dovecot: imap-login: Login: user=, method=PLAIN, rip=127.0.0.1, > lip=127.0.0.1, mpid=497913, secured, session=<6R0mYbMFFwB/AAAB> > dovecot: dict: Error: sql dict set: Invalid/unmapped key: > shared/last-login/username > > > OK I got it. The code looks at shared/$last_login_key, so shared/last-login/username, but your map says /shared/last-login/$user, note the leading slash! That's probably all it is. From lists at luigirosa.com Sat Oct 18 15:49:06 2014 From: lists at luigirosa.com (Luigi Rosa) Date: Sat, 18 Oct 2014 17:49:06 +0200 Subject: last_login plugin with MySQL In-Reply-To: <54427DAA.5080704@gedalya.net> References: <544232F1.6070508@luigirosa.com> <54426C25.6050805@luigirosa.com> <54427391.10604@gedalya.net> <544274D1.4010505@gedalya.net> <54427B0D.90705@luigirosa.com> <54427DAA.5080704@gedalya.net> Message-ID: <54428BF2.2060004@luigirosa.com> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Gedalya wrote on 18/10/2014 16:48: > service dict { unix_listener dict { mode = 0660 user = vmail #group = } } That solved the permission issue, thanks! Ciao, luigi - -- / +--[Luigi Rosa]-- \ Only one human captain has ever survived battle with a Minbari fleet. He is behind me. You are in front of me. If you value your lives, be somewhere else. --Delenn "Severed Dreams" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQIcBAEBAgAGBQJUQovyAAoJEO5WT/qgw4yKpzYP/i6WHK/4QkNPAgKX2o5fP+j8 qQKzmm8XXANd8qWDkMxlb0xyAqrNJsDAm1CKq5xI+r3QN+f8HcDqNzsDN7m0cqUf jyqJ+KDpbDnXbMU8DZHkK8vuKl+b5QpL5pSmrxYfAEfoJkrjIzGJ14EopbZ+dtXg 6xTY6RuQOF8XMNV1fy2k2TlCjD6rIE0YyanBB5BJvhKhAsZ3egwbhAoqvPPJi9CR 8s0zErdeiT+3MJKsGgmaTfrIa9yg3ADFLqgAQfS3OryRjVD7EThDSsh/uyLMSUWX 50Nv4+ItnszbCCVRfu8Al6IcGvGhnxgvMpibFJUomdrYkwIv9gnHe+vL8+HCAuTl 0ZMaWEYCDtf+4PLY3nznAe7/1QqF4C59vSGkYxp9jtFEvSZ2DIBny0fuzRFBS4Jl b5kdtsCCtknk25lXQzhPg/FE9q5Aj4Zo183/s8unoFKKxHq/Rwr2df1dpQw9ITDA FFcAMvkyRvTxGeldKpADTcm5bMOLZlKPmmf+UKViZFysXKgcm3SLVR+RpFkajQ4v l1BlpZ2wW2vjhYcfj9JZmd/+uEturA8vG6vbha2w4GP4zTwrKdZjEHiTvi4/nkMY LxogXNhBMCTCwiYkPZINb05Eagg++zcmaCbZM31tb2m3dHrnvtmuCZKGfKA4DTMZ NP/UCGkRQd96zRCTY8Ii =J7GG -----END PGP SIGNATURE----- From lists at luigirosa.com Sat Oct 18 15:53:13 2014 From: lists at luigirosa.com (Luigi Rosa) Date: Sat, 18 Oct 2014 17:53:13 +0200 Subject: last_login plugin with MySQL In-Reply-To: <54428910.10001@gedalya.net> References: <544232F1.6070508@luigirosa.com> <54426C25.6050805@luigirosa.com> <54427391.10604@gedalya.net> <544274D1.4010505@gedalya.net> <54427B0D.90705@luigirosa.com> <54428910.10001@gedalya.net> Message-ID: <54428CE9.2010800@luigirosa.com> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Gedalya wrote on 18/10/2014 17:36: > The code looks at shared/$last_login_key, so shared/last-login/username, > but your map says /shared/last-login/$user, note the leading slash! That's > probably all it is. BINGO! Now that we killed the mosters of this level, let's move to the next level..... Welcome to the SQL query level! I was expecting an UPDATE...WHERE but I got this: INSERT INTO mailbox (lastlogin,username) VALUES ('1413647370','username') ON DUPLICATE KEY UPDATE lastlogin='1413647370' This is not very useful if I want a `lastlogin` field of the `mailbox` table updated on every login. Ciao, luigi - -- / +--[Luigi Rosa]-- \ For every human problem, there is a neat, simple solution; and it is always wrong. -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQIcBAEBAgAGBQJUQozoAAoJEO5WT/qgw4yKXd0P/iGtE9bm3U3gUNqoOP8cI0Yi 2xU66Nk64jogcPyRXberWiaeXbytaJj15DAVwbQT08Iv53flOMbkNwn2LyfX2Yqi DThdCaH60ADTkBsU2NUepglv3mGisuZ/T8euKo6OdDBowZ1t0u8EW1J41DP/4K6M SWLDPcTkLGgcfJMCEvwP2JeWx6j0RCR2/e/mSe0Fvq9qUNYTbqHiDTLSh6bO/OPp 0vxj0LVb/xWIUlNS0pEbhFlSXaU5yNORyIacg0KMWEPB0d0qwGP6kusxi2l+huF/ VfbebBpj9qns8XJppxKTEpTKW7H3BoiM3vegLl7JNOwSKXa9xiNMhILkxcpgkRBi idu8w+p7KXWrOWqDQ3giFhFrtMuhYNGryVvetD168426+AVkVM8/Zb7dETajgzH3 75XLlc4fMhyW6aRV5vGDllY6MzyDrEFsO3vtCE7NKZq7WmImnlwKsbm3NbEYFWsn fEmOM9Hjc/DkRTTiejA31DztczrFd/f/kXXFSuPs25Dco6WVkojofpT4c8xhyS83 OTYBJY1gBfxSHn9zj3auTKYdxhOpzzopRn0uUT1M9iGYfy71ZJuL97dw1gOfkfOL /RbBQwut9RJJWRYlYhIHKc9cvnB21pO76OLHkPHmslNUBX67q4fS3gUuhMbAroq2 37gmW6grIMIvY6s4XgMJ =vXUT -----END PGP SIGNATURE----- From sven at svenhartge.de Sat Oct 18 16:07:05 2014 From: sven at svenhartge.de (Sven Hartge) Date: Sat, 18 Oct 2014 18:07:05 +0200 Subject: last_login plugin with MySQL References: <544232F1.6070508@luigirosa.com> <54426C25.6050805@luigirosa.com> <54427391.10604@gedalya.net> <544274D1.4010505@gedalya.net> <54427B0D.90705@luigirosa.com> <54428910.10001@gedalya.net> <54428CE9.2010800@luigirosa.com> Message-ID: <7b30o0l9dvv8@mids.svenhartge.de> Luigi Rosa wrote: > I was expecting an UPDATE...WHERE but I got this: > INSERT INTO mailbox (lastlogin,username) VALUES ('1413647370','username') ON > DUPLICATE KEY UPDATE lastlogin='1413647370' > This is not very useful if I want a `lastlogin` field of the `mailbox` table > updated on every login. This SQL query looks correct to me. It INSERTs a new row for a username if one does not already exist but UPDATEs it if there is already such a row. This is the normal and advised way of doing this specific task in an atomic way by using the "ON DUPLICATE" syntax of SQL. Gr??e, Sven. -- Sigmentation fault. Core dumped. From lists at luigirosa.com Sat Oct 18 16:16:01 2014 From: lists at luigirosa.com (Luigi Rosa) Date: Sat, 18 Oct 2014 18:16:01 +0200 Subject: last_login plugin with MySQL In-Reply-To: <7b30o0l9dvv8@mids.svenhartge.de> References: <544232F1.6070508@luigirosa.com> <54426C25.6050805@luigirosa.com> <54427391.10604@gedalya.net> <544274D1.4010505@gedalya.net> <54427B0D.90705@luigirosa.com> <54428910.10001@gedalya.net> <54428CE9.2010800@luigirosa.com> <7b30o0l9dvv8@mids.svenhartge.de> Message-ID: <54429241.6080604@luigirosa.com> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Sven Hartge wrote on 18/10/2014 18:07: > This SQL query looks correct to me. It INSERTs a new row for a username if > one does not already exist but UPDATEs it if there is already such a row. My fault: I didn't know this SQL syntax. In fact the field has been correctly updated. Thank you Sven! Ciao, luigi - -- / +--[Luigi Rosa]-- \ Every government is a parliament of whores. The trouble is, in a democracy, the whores are us. --P. J. O'Rourke -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQIcBAEBAgAGBQJUQpJBAAoJEO5WT/qgw4yKryAP/2237FGyMYw3tEq2HdN2JYDE QCxBRyUAVQSnIvJZwPhJxlFd2O3nkIrDEirpXUh4W5AhDSrTt517tiykCbQZzWz8 XN6t52PbAR4MdcdJu69c7fIzm1LfhCquPAJz+MLOOvBPXwzP2fOEL8tWWpKHAQeI uTktIzHGYEaHgX3V+LQ6TTCtofhi7oved5AaFiLYr42pYJSjKTlLvYa3Ycx3n8iz kF1QuHpIaOqO55CIzrc7LYgNAUhC5SKpxLlGcjYgHvE/q6Cet2CIIE5DWF/UCn7I PHcpLeEQS2YavfCWtKhAyb5qobP4zQFKG5lb09+BLIugZX/P4w1KYVBaNxfaDYRe X5hnat0GcMS7NQIvVLXlqVp/GLoG/AIynu+bfSZtpL00MznI5j6N+BvJZ4ygTTvL huIinr/6WaQvF7Gn+J6f741LqNDbRjajDgKlET3wVF25QfhVP/KNnNoSuZZ7LHnF b7ToIBtXBebGmrPX9GQuorYXTNTgZa6XrPACk/+y4YWp8lWxkWHoW3SUwqm79JS8 bKf3+xj6YPaFREVBbuzDkueaLrncFsWUuthxIO3JX5taOicplZf9GrDE6fRyF5Ew pdtGmxoFhhxV1SNPAZB6G5YciJrrMdaKYcHHxxQnKbTBVEHw4A98AcyGZHKCOwsP Wuq4sDEISdOxrk0Gp39T =hgL9 -----END PGP SIGNATURE----- From sven at svenhartge.de Sat Oct 18 16:30:44 2014 From: sven at svenhartge.de (Sven Hartge) Date: Sat, 18 Oct 2014 18:30:44 +0200 Subject: last_login plugin with MySQL References: <544232F1.6070508@luigirosa.com> <54426C25.6050805@luigirosa.com> <54427391.10604@gedalya.net> <544274D1.4010505@gedalya.net> <54427B0D.90705@luigirosa.com> <54428910.10001@gedalya.net> <54428CE9.2010800@luigirosa.com> <7b30o0l9dvv8@mids.svenhartge.de> <54429241.6080604@luigirosa.com> Message-ID: <8b30pd39dvv8@mids.svenhartge.de> Luigi Rosa wrote: > Sven Hartge wrote on 18/10/2014 18:07: >> This SQL query looks correct to me. It INSERTs a new row for a >> username if one does not already exist but UPDATEs it if there is >> already such a row. > My fault: I didn't know this SQL syntax. It is incredibly usefull. Otherwise you would have to do a SELECT first to decide if you want to INSERT or UPDATE as a second query and this creates a race condition if another process is able to do its INSERT after you decided there is no existing key because at the time if your first SELECT there was in fact none. Gr??e, Sven. -- Sigmentation fault. Core dumped. From lists at luigirosa.com Sat Oct 18 17:13:51 2014 From: lists at luigirosa.com (Luigi Rosa) Date: Sat, 18 Oct 2014 19:13:51 +0200 Subject: Recap: last_login plugin with MySQL Message-ID: <54429FCF.2080300@luigirosa.com> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 With many thanks to Gedalya and Sven Hartge Situation: Dovecot installation with userbase in a MySQL table with the same structure described in Postfix.Admin installation; filesystem permission is flat with a single user (vmail) who owns maildir mailbox files and directories. Procedure to implement last-login plugin to update mailbox table. The lastlogin value is an integer in time() format Alter mailbox SQL table to add a `lastlogin` unsigned int field Add this to 10-master.conf service dict { unix_listener dict { mode = 0660 user = vmail } } In 90-plugin.conf add this: plugin { last_login_dict = proxy::lastlogin last_login_key = last-login/%u # default } dict { lastlogin = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } Enable last login for IMAP and POP3: protocol imap { mail_plugins = $mail_plugins last_login } protocol pop3 { mail_plugins = $mail_plugins last_login } Finally edit dovecot-dict-sql.conf.ext and add this lines: connect = {same values as dovecot-sql.conf.ext} map { pattern = shared/last-login/$user table = mailbox username_field = username value_field = lastlogin fields { username = $user } } Ciao, luigi - -- / +--[Luigi Rosa]-- \ After things have gone from bad to worse, the cycle will repeat itself. -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQIcBAEBAgAGBQJUQp/PAAoJEO5WT/qgw4yKLscP/1ysmNOP23fQeqN2I7gxfhKp 4TF0Buf0rxKjxzjE5jcw4T/vDKhdjj2uaYtpUkE188l+tmGdeQ55ENyXEml/Svvw eEs9Kc2UJTlSQpQFpspUezvOtPwgb0L3720rCqs61BshGFgpZsiUEpPW8mHeVoo1 j5zmo9TVdrSPr8XqLzoR+fdIamZRzZH2pLA9x9cgzsVMmqSlMm4Xv3f/JMloNs98 fwWo13Ji5uFCRbbMmNUDCDOpd4wPYZ7ASS64Jf9nR4DZ75fnQmRgvsbl3EWicrqT 94Z4hlSEkOYWxDzooFta37+Sp61IjQWkWFiM+0260Q5u8IArpatW+tT2eD3jzaxP Gu0HB8jg+bT9cXXtfo1HyA+JYswEtwKiUvUKa/09j6oDGgBD2KR1yhDJNsZsJXkB bEKsACdSztEvfe9j91AzW8S/W3Uk5c7l9RH1CXVNTCbQXaeagScAguh94KKP0oiW P43mBkuFg2mM+5+bXz0U8EYfswt/zYkp/pKFajEwyXIWdeUICPmFJA+GKpBXeJPn CL8nJCnUpKNsy85+Z6MXYXIv6a0D0utocdsQzR8gjG2whNnv7EFeHa2hyagKfG5g ydOSG6tKlWHCOSFaTogmUVZVXEGsE1gUmJZMeoyZVI5jEl3b3KJSTxB7QHtMsm5q NOyZ+PdNJtyDC8n4T48t =MJj6 -----END PGP SIGNATURE----- From c128.mail at gmail.com Sat Oct 18 17:24:48 2014 From: c128.mail at gmail.com (c128 mail) Date: Sat, 18 Oct 2014 18:24:48 +0100 Subject: Wiki advice on running getmail on INBOX access - how does that work? Message-ID: <5442A260.1060505@gmail.com> Hi, I'm currently running getmail in a cron job every 2 minutes, so I was quite intrigued by this on the wiki: http://wiki2.dovecot.org/HowTo/TriggerGetmailOnIMAPAccess Thing is - I couldn't see how it would work and, when I tried it, it didn't work (at least not for me). It details using incrontab to monitor /home/username/.maildir/cur in order to trigger getmail. However, "cur" won't change unless populated with mail...as an initial result of actually running getmail? Seems like a chicken and egg situation. I reckon I'm missing something fundamental :-), but what is it? Ta. From gedalya at gedalya.net Sat Oct 18 18:28:19 2014 From: gedalya at gedalya.net (Gedalya) Date: Sat, 18 Oct 2014 14:28:19 -0400 Subject: Wiki advice on running getmail on INBOX access - how does that work? In-Reply-To: <5442A260.1060505@gmail.com> References: <5442A260.1060505@gmail.com> Message-ID: <5442B143.4090609@gedalya.net> On 10/18/2014 01:24 PM, c128 mail wrote: > Hi, > > I'm currently running getmail in a cron job every 2 minutes, so I was > quite intrigued by this on the wiki: > > http://wiki2.dovecot.org/HowTo/TriggerGetmailOnIMAPAccess > > Thing is - I couldn't see how it would work and, when I tried it, it > didn't work (at least not for me). What exactly did happen? > > It details using incrontab to monitor /home/username/.maildir/cur in > order to trigger getmail. > > However, "cur" won't change unless populated with mail...as an initial > result of actually running getmail? Seems like a chicken and egg > situation. access != change > > I reckon I'm missing something fundamental :-), but what is it? > > Ta. From c128.mail at gmail.com Sat Oct 18 18:38:23 2014 From: c128.mail at gmail.com (c128 mail) Date: Sat, 18 Oct 2014 19:38:23 +0100 Subject: Wiki advice on running getmail on INBOX access - how does that work? In-Reply-To: <5442B143.4090609@gedalya.net> References: <5442A260.1060505@gmail.com> <5442B143.4090609@gedalya.net> Message-ID: <5442B39F.3080501@gmail.com> > What exactly did happen? Oh, yeah, didn't make that clear ;-) Nothing happened...not without coaxing. If I forced a change to the directory, then it worked - but there wouldn't be a change to the directory in normal operation, other than by mail population? On 18/10/14 19:28, Gedalya wrote: > On 10/18/2014 01:24 PM, c128 mail wrote: >> Hi, >> >> I'm currently running getmail in a cron job every 2 minutes, so I was >> quite intrigued by this on the wiki: >> >> http://wiki2.dovecot.org/HowTo/TriggerGetmailOnIMAPAccess >> >> Thing is - I couldn't see how it would work and, when I tried it, it >> didn't work (at least not for me). > What exactly did happen? > >> >> It details using incrontab to monitor /home/username/.maildir/cur in >> order to trigger getmail. >> >> However, "cur" won't change unless populated with mail...as an initial >> result of actually running getmail? Seems like a chicken and egg >> situation. > access != change > >> >> I reckon I'm missing something fundamental :-), but what is it? >> >> Ta. > From gedalya at gedalya.net Sat Oct 18 18:50:55 2014 From: gedalya at gedalya.net (Gedalya) Date: Sat, 18 Oct 2014 14:50:55 -0400 Subject: Wiki advice on running getmail on INBOX access - how does that work? In-Reply-To: <5442B39F.3080501@gmail.com> References: <5442A260.1060505@gmail.com> <5442B143.4090609@gedalya.net> <5442B39F.3080501@gmail.com> Message-ID: <5442B68F.8020004@gedalya.net> On 10/18/2014 02:38 PM, c128 mail wrote: > > What exactly did happen? > > Oh, yeah, didn't make that clear ;-) > > Nothing happened...not without coaxing. > > If I forced a change to the directory, then it worked - but there > wouldn't be a change to the directory in normal operation, other than > by mail population? It's not supposed to require changes. Note the IN_ALL_EVENTS definition. This would include any attempt to open the directory and take a peek. If you configured it according to the wiki and it's not working then we have troubleshooting to do, but that's the theory. I'm not familiar with incron but I've worked with Linux's inotify. > > On 18/10/14 19:28, Gedalya wrote: >> On 10/18/2014 01:24 PM, c128 mail wrote: >>> Hi, >>> >>> I'm currently running getmail in a cron job every 2 minutes, so I was >>> quite intrigued by this on the wiki: >>> >>> http://wiki2.dovecot.org/HowTo/TriggerGetmailOnIMAPAccess >>> >>> Thing is - I couldn't see how it would work and, when I tried it, it >>> didn't work (at least not for me). >> What exactly did happen? >> >>> >>> It details using incrontab to monitor /home/username/.maildir/cur in >>> order to trigger getmail. >>> >>> However, "cur" won't change unless populated with mail...as an initial >>> result of actually running getmail? Seems like a chicken and egg >>> situation. >> access != change >> >>> >>> I reckon I'm missing something fundamental :-), but what is it? >>> >>> Ta. >> From c128.mail at gmail.com Sat Oct 18 18:54:46 2014 From: c128.mail at gmail.com (c128 mail) Date: Sat, 18 Oct 2014 19:54:46 +0100 Subject: Wiki advice on running getmail on INBOX access - how does that work? In-Reply-To: <5442B68F.8020004@gedalya.net> References: <5442A260.1060505@gmail.com> <5442B143.4090609@gedalya.net> <5442B39F.3080501@gmail.com> <5442B68F.8020004@gedalya.net> Message-ID: <5442B776.8020304@gmail.com> Yeah, I see what you mean - it should trigger by IN_ACCESS (from IN_ALL_EVENTS) shouldn't it. I hadn't previously scanned over the full set of events: http://manpages.ubuntu.com/manpages/intrepid/man5/incrontab.5.html I'll set this up again and report back one way or another. Thanks. On 18/10/14 19:50, Gedalya wrote: > On 10/18/2014 02:38 PM, c128 mail wrote: >> > What exactly did happen? >> >> Oh, yeah, didn't make that clear ;-) >> >> Nothing happened...not without coaxing. >> >> If I forced a change to the directory, then it worked - but there >> wouldn't be a change to the directory in normal operation, other than >> by mail population? > It's not supposed to require changes. Note the IN_ALL_EVENTS definition. > This would include any attempt to open the directory and take a peek. > If you configured it according to the wiki and it's not working then we > have troubleshooting to do, but that's the theory. > I'm not familiar with incron but I've worked with Linux's inotify. > >> >> On 18/10/14 19:28, Gedalya wrote: >>> On 10/18/2014 01:24 PM, c128 mail wrote: >>>> Hi, >>>> >>>> I'm currently running getmail in a cron job every 2 minutes, so I was >>>> quite intrigued by this on the wiki: >>>> >>>> http://wiki2.dovecot.org/HowTo/TriggerGetmailOnIMAPAccess >>>> >>>> Thing is - I couldn't see how it would work and, when I tried it, it >>>> didn't work (at least not for me). >>> What exactly did happen? >>> >>>> >>>> It details using incrontab to monitor /home/username/.maildir/cur in >>>> order to trigger getmail. >>>> >>>> However, "cur" won't change unless populated with mail...as an initial >>>> result of actually running getmail? Seems like a chicken and egg >>>> situation. >>> access != change >>> >>>> >>>> I reckon I'm missing something fundamental :-), but what is it? >>>> >>>> Ta. >>> > From c128.mail at gmail.com Sat Oct 18 19:26:55 2014 From: c128.mail at gmail.com (c128 mail) Date: Sat, 18 Oct 2014 20:26:55 +0100 Subject: Fwd: Re: Wiki advice on running getmail on INBOX access - how does that work? In-Reply-To: <5442BD3F.6030808@cotman.org.uk> References: <5442BD3F.6030808@cotman.org.uk> Message-ID: <5442BEFF.3000400@gmail.com> Just re-tried this, and it doesn't seem to fire getmail on access for me. My incrontab is as follows: /home/user/Maildir/cur/ IN_ALL_EVENTS,IN_ONESHOT /home/user/bin/mvmail.sh The incrontab rule does work, but only if I make a physical change in /home/user/Maildir/cur/ e.g. by moving a mail from another folder in there. Just accessing the particular inbox doesn't seem to trigger anything. On 18/10/14 19:54, c128 mail wrote: > Yeah, I see what you mean - it should trigger by IN_ACCESS (from > IN_ALL_EVENTS) shouldn't it. I hadn't previously scanned over the full > set of events: > http://manpages.ubuntu.com/manpages/intrepid/man5/incrontab.5.html > > I'll set this up again and report back one way or another. > > Thanks. > > On 18/10/14 19:50, Gedalya wrote: >> On 10/18/2014 02:38 PM, c128 mail wrote: >>> > What exactly did happen? >>> >>> Oh, yeah, didn't make that clear ;-) >>> >>> Nothing happened...not without coaxing. >>> >>> If I forced a change to the directory, then it worked - but there >>> wouldn't be a change to the directory in normal operation, other than >>> by mail population? >> It's not supposed to require changes. Note the IN_ALL_EVENTS definition. >> This would include any attempt to open the directory and take a peek. >> If you configured it according to the wiki and it's not working then we >> have troubleshooting to do, but that's the theory. >> I'm not familiar with incron but I've worked with Linux's inotify. >> >>> >>> On 18/10/14 19:28, Gedalya wrote: >>>> On 10/18/2014 01:24 PM, c128 mail wrote: >>>>> Hi, >>>>> >>>>> I'm currently running getmail in a cron job every 2 minutes, so I was >>>>> quite intrigued by this on the wiki: >>>>> >>>>> http://wiki2.dovecot.org/HowTo/TriggerGetmailOnIMAPAccess >>>>> >>>>> Thing is - I couldn't see how it would work and, when I tried it, it >>>>> didn't work (at least not for me). >>>> What exactly did happen? >>>> >>>>> >>>>> It details using incrontab to monitor /home/username/.maildir/cur in >>>>> order to trigger getmail. >>>>> >>>>> However, "cur" won't change unless populated with mail...as an initial >>>>> result of actually running getmail? Seems like a chicken and egg >>>>> situation. >>>> access != change >>>> >>>>> >>>>> I reckon I'm missing something fundamental :-), but what is it? >>>>> >>>>> Ta. >>>> >> From gedalya at gedalya.net Sat Oct 18 19:58:08 2014 From: gedalya at gedalya.net (Gedalya) Date: Sat, 18 Oct 2014 15:58:08 -0400 Subject: Fwd: Re: Wiki advice on running getmail on INBOX access - how does that work? In-Reply-To: <5442BEFF.3000400@gmail.com> References: <5442BD3F.6030808@cotman.org.uk> <5442BEFF.3000400@gmail.com> Message-ID: <5442C650.7090809@gedalya.net> On 10/18/2014 03:26 PM, c128 mail wrote: > Just re-tried this, and it doesn't seem to fire getmail on access for me. > > My incrontab is as follows: > > /home/user/Maildir/cur/ IN_ALL_EVENTS,IN_ONESHOT /home/user/bin/mvmail.sh > > The incrontab rule does work, but only if I make a physical change in > /home/user/Maildir/cur/ e.g. by moving a mail from another folder in > there. Just accessing the particular inbox doesn't seem to trigger > anything. In my testing I get 3 events every single time I list the test directory, if I remove the IN_ONESHOT. With IN_ONESHOT, I get only one, for the first time. The script on the wiki ends with: incrontab --reload # Rearm the one-shot rule So that makes sense. Debian Jessie, Linux 3.16.5-1 amd64, incron 0.5.10-2 > > On 18/10/14 19:54, c128 mail wrote: >> Yeah, I see what you mean - it should trigger by IN_ACCESS (from >> IN_ALL_EVENTS) shouldn't it. I hadn't previously scanned over the full >> set of events: >> http://manpages.ubuntu.com/manpages/intrepid/man5/incrontab.5.html >> >> I'll set this up again and report back one way or another. >> >> Thanks. >> >> On 18/10/14 19:50, Gedalya wrote: >>> On 10/18/2014 02:38 PM, c128 mail wrote: >>>> > What exactly did happen? >>>> >>>> Oh, yeah, didn't make that clear ;-) >>>> >>>> Nothing happened...not without coaxing. >>>> >>>> If I forced a change to the directory, then it worked - but there >>>> wouldn't be a change to the directory in normal operation, other than >>>> by mail population? >>> It's not supposed to require changes. Note the IN_ALL_EVENTS >>> definition. >>> This would include any attempt to open the directory and take a peek. >>> If you configured it according to the wiki and it's not working then we >>> have troubleshooting to do, but that's the theory. >>> I'm not familiar with incron but I've worked with Linux's inotify. >>> >>>> >>>> On 18/10/14 19:28, Gedalya wrote: >>>>> On 10/18/2014 01:24 PM, c128 mail wrote: >>>>>> Hi, >>>>>> >>>>>> I'm currently running getmail in a cron job every 2 minutes, so I >>>>>> was >>>>>> quite intrigued by this on the wiki: >>>>>> >>>>>> http://wiki2.dovecot.org/HowTo/TriggerGetmailOnIMAPAccess >>>>>> >>>>>> Thing is - I couldn't see how it would work and, when I tried it, it >>>>>> didn't work (at least not for me). >>>>> What exactly did happen? >>>>> >>>>>> >>>>>> It details using incrontab to monitor /home/username/.maildir/cur in >>>>>> order to trigger getmail. >>>>>> >>>>>> However, "cur" won't change unless populated with mail...as an >>>>>> initial >>>>>> result of actually running getmail? Seems like a chicken and egg >>>>>> situation. >>>>> access != change >>>>> >>>>>> >>>>>> I reckon I'm missing something fundamental :-), but what is it? >>>>>> >>>>>> Ta. >>>>> >>> From c128.mail at gmail.com Sat Oct 18 20:20:28 2014 From: c128.mail at gmail.com (c128 mail) Date: Sat, 18 Oct 2014 21:20:28 +0100 Subject: Fwd: Re: Wiki advice on running getmail on INBOX access - how does that work? In-Reply-To: <5442C650.7090809@gedalya.net> References: <5442BD3F.6030808@cotman.org.uk> <5442BEFF.3000400@gmail.com> <5442C650.7090809@gedalya.net> Message-ID: <5442CB8C.40603@gmail.com> Thanks for trying that. I'm running: Ubuntu 14.04, Linux 3.4.79 #1 SMP PREEMPT Wed May 14 18:19:18 CST 2014 armv7l armv7l armv7l GNU/Linux incrontab 0.5.10 Just found that if I "ls" that directory, the rule is fired. So - I suspect incrontab is fine. Is this an oddity of Thunderbird access to the particular mail folder, I wonder, as that's my use case for testing this? On 18/10/14 20:58, Gedalya wrote: > On 10/18/2014 03:26 PM, c128 mail wrote: >> Just re-tried this, and it doesn't seem to fire getmail on access for me. >> >> My incrontab is as follows: >> >> /home/user/Maildir/cur/ IN_ALL_EVENTS,IN_ONESHOT /home/user/bin/mvmail.sh >> >> The incrontab rule does work, but only if I make a physical change in >> /home/user/Maildir/cur/ e.g. by moving a mail from another folder in >> there. Just accessing the particular inbox doesn't seem to trigger >> anything. > > In my testing I get 3 events every single time I list the test > directory, if I remove the IN_ONESHOT. > With IN_ONESHOT, I get only one, for the first time. > The script on the wiki ends with: > incrontab --reload # Rearm the one-shot rule > So that makes sense. > > Debian Jessie, Linux 3.16.5-1 amd64, incron 0.5.10-2 > >> >> On 18/10/14 19:54, c128 mail wrote: >>> Yeah, I see what you mean - it should trigger by IN_ACCESS (from >>> IN_ALL_EVENTS) shouldn't it. I hadn't previously scanned over the full >>> set of events: >>> http://manpages.ubuntu.com/manpages/intrepid/man5/incrontab.5.html >>> >>> I'll set this up again and report back one way or another. >>> >>> Thanks. >>> >>> On 18/10/14 19:50, Gedalya wrote: >>>> On 10/18/2014 02:38 PM, c128 mail wrote: >>>>> > What exactly did happen? >>>>> >>>>> Oh, yeah, didn't make that clear ;-) >>>>> >>>>> Nothing happened...not without coaxing. >>>>> >>>>> If I forced a change to the directory, then it worked - but there >>>>> wouldn't be a change to the directory in normal operation, other than >>>>> by mail population? >>>> It's not supposed to require changes. Note the IN_ALL_EVENTS >>>> definition. >>>> This would include any attempt to open the directory and take a peek. >>>> If you configured it according to the wiki and it's not working then we >>>> have troubleshooting to do, but that's the theory. >>>> I'm not familiar with incron but I've worked with Linux's inotify. >>>> >>>>> >>>>> On 18/10/14 19:28, Gedalya wrote: >>>>>> On 10/18/2014 01:24 PM, c128 mail wrote: >>>>>>> Hi, >>>>>>> >>>>>>> I'm currently running getmail in a cron job every 2 minutes, so I >>>>>>> was >>>>>>> quite intrigued by this on the wiki: >>>>>>> >>>>>>> http://wiki2.dovecot.org/HowTo/TriggerGetmailOnIMAPAccess >>>>>>> >>>>>>> Thing is - I couldn't see how it would work and, when I tried it, it >>>>>>> didn't work (at least not for me). >>>>>> What exactly did happen? >>>>>> >>>>>>> >>>>>>> It details using incrontab to monitor /home/username/.maildir/cur in >>>>>>> order to trigger getmail. >>>>>>> >>>>>>> However, "cur" won't change unless populated with mail...as an >>>>>>> initial >>>>>>> result of actually running getmail? Seems like a chicken and egg >>>>>>> situation. >>>>>> access != change >>>>>> >>>>>>> >>>>>>> I reckon I'm missing something fundamental :-), but what is it? >>>>>>> >>>>>>> Ta. >>>>>> >>>> From c128.mail at gmail.com Sat Oct 18 21:39:12 2014 From: c128.mail at gmail.com (c128 mail) Date: Sat, 18 Oct 2014 22:39:12 +0100 Subject: Fwd: Re: Wiki advice on running getmail on INBOX access - how does that work? In-Reply-To: <5442CB8C.40603@gmail.com> References: <5442BD3F.6030808@cotman.org.uk> <5442BEFF.3000400@gmail.com> <5442C650.7090809@gedalya.net> <5442CB8C.40603@gmail.com> Message-ID: <5442DE00.8010904@gmail.com> Bit more investigation... So - the incrontab rule seems to work to the extent that if I directly "ls" the cur folder on the system then it's triggered. However, the only way I seem to be able to be able to get it to trigger from a mail client (I use both Thunderbird and Roundcube) is by performing some sort of action on the mail that's already in the folder e.g. shifting mail in/out, marking mail read, reading an existing mail (in Roundcube only, for the last one, which I suspect is related to Thunderbird and local caching?). Either way, I can't seem to get it to trigger on just access to the folder its monitoring... On 18/10/14 21:20, c128 mail wrote: > Thanks for trying that. > > I'm running: > > Ubuntu 14.04, Linux 3.4.79 #1 SMP PREEMPT Wed May 14 18:19:18 CST 2014 > armv7l armv7l armv7l GNU/Linux > > incrontab 0.5.10 > > Just found that if I "ls" that directory, the rule is fired. So - I > suspect incrontab is fine. > > Is this an oddity of Thunderbird access to the particular mail folder, I > wonder, as that's my use case for testing this? > > On 18/10/14 20:58, Gedalya wrote: >> On 10/18/2014 03:26 PM, c128 mail wrote: >>> Just re-tried this, and it doesn't seem to fire getmail on access for >>> me. >>> >>> My incrontab is as follows: >>> >>> /home/user/Maildir/cur/ IN_ALL_EVENTS,IN_ONESHOT >>> /home/user/bin/mvmail.sh >>> >>> The incrontab rule does work, but only if I make a physical change in >>> /home/user/Maildir/cur/ e.g. by moving a mail from another folder in >>> there. Just accessing the particular inbox doesn't seem to trigger >>> anything. >> >> In my testing I get 3 events every single time I list the test >> directory, if I remove the IN_ONESHOT. >> With IN_ONESHOT, I get only one, for the first time. >> The script on the wiki ends with: >> incrontab --reload # Rearm the one-shot rule >> So that makes sense. >> >> Debian Jessie, Linux 3.16.5-1 amd64, incron 0.5.10-2 >> >>> >>> On 18/10/14 19:54, c128 mail wrote: >>>> Yeah, I see what you mean - it should trigger by IN_ACCESS (from >>>> IN_ALL_EVENTS) shouldn't it. I hadn't previously scanned over the full >>>> set of events: >>>> http://manpages.ubuntu.com/manpages/intrepid/man5/incrontab.5.html >>>> >>>> I'll set this up again and report back one way or another. >>>> >>>> Thanks. >>>> >>>> On 18/10/14 19:50, Gedalya wrote: >>>>> On 10/18/2014 02:38 PM, c128 mail wrote: >>>>>> > What exactly did happen? >>>>>> >>>>>> Oh, yeah, didn't make that clear ;-) >>>>>> >>>>>> Nothing happened...not without coaxing. >>>>>> >>>>>> If I forced a change to the directory, then it worked - but there >>>>>> wouldn't be a change to the directory in normal operation, other than >>>>>> by mail population? >>>>> It's not supposed to require changes. Note the IN_ALL_EVENTS >>>>> definition. >>>>> This would include any attempt to open the directory and take a peek. >>>>> If you configured it according to the wiki and it's not working >>>>> then we >>>>> have troubleshooting to do, but that's the theory. >>>>> I'm not familiar with incron but I've worked with Linux's inotify. >>>>> >>>>>> >>>>>> On 18/10/14 19:28, Gedalya wrote: >>>>>>> On 10/18/2014 01:24 PM, c128 mail wrote: >>>>>>>> Hi, >>>>>>>> >>>>>>>> I'm currently running getmail in a cron job every 2 minutes, so I >>>>>>>> was >>>>>>>> quite intrigued by this on the wiki: >>>>>>>> >>>>>>>> http://wiki2.dovecot.org/HowTo/TriggerGetmailOnIMAPAccess >>>>>>>> >>>>>>>> Thing is - I couldn't see how it would work and, when I tried >>>>>>>> it, it >>>>>>>> didn't work (at least not for me). >>>>>>> What exactly did happen? >>>>>>> >>>>>>>> >>>>>>>> It details using incrontab to monitor >>>>>>>> /home/username/.maildir/cur in >>>>>>>> order to trigger getmail. >>>>>>>> >>>>>>>> However, "cur" won't change unless populated with mail...as an >>>>>>>> initial >>>>>>>> result of actually running getmail? Seems like a chicken and egg >>>>>>>> situation. >>>>>>> access != change >>>>>>> >>>>>>>> >>>>>>>> I reckon I'm missing something fundamental :-), but what is it? >>>>>>>> >>>>>>>> Ta. >>>>>>> >>>>> From pch at myzel.net Sat Oct 18 22:32:12 2014 From: pch at myzel.net (Peter Chiochetti) Date: Sun, 19 Oct 2014 00:32:12 +0200 Subject: Fwd: Re: Wiki advice on running getmail on INBOX access - how does that work? In-Reply-To: <5442DE00.8010904@gmail.com> References: <5442BD3F.6030808@cotman.org.uk> <5442BEFF.3000400@gmail.com> <5442C650.7090809@gedalya.net> <5442CB8C.40603@gmail.com> <5442DE00.8010904@gmail.com> Message-ID: <5442EA6C.3060601@myzel.net> Maybe off-topic, still: (If your remote server is imap,) why not use fetchmail? Here's a mangled/working /etc/fetchmailrc for an SSL imap account: > poll smtp.provider.net protocol IMAP port 993 > user 'somone at somewhere.com' is 'someone' here > password 'MyPass123' > folder 'INBOX' > fetchall > idle > ssl > > mda "HOME=/home/%T /usr/bin/sudo -u %T /usr/lib/dovecot/deliver" > > ## cf. /etc/sudoers.d/fetchmail-deliver > #fetchmail ALL=(ALL) NOPASSWD:/usr/lib/dovecot/deliver This uses imap idle over there and fetches new mail, as it arrives. Local users will be notified of new mail without looking explicitly? -- peter From c128.mail at gmail.com Sat Oct 18 22:46:33 2014 From: c128.mail at gmail.com (c128 mail) Date: Sat, 18 Oct 2014 23:46:33 +0100 Subject: Fwd: Re: Wiki advice on running getmail on INBOX access - how does that work? In-Reply-To: <5442EA6C.3060601@myzel.net> References: <5442BD3F.6030808@cotman.org.uk> <5442BEFF.3000400@gmail.com> <5442C650.7090809@gedalya.net> <5442CB8C.40603@gmail.com> <5442DE00.8010904@gmail.com> <5442EA6C.3060601@myzel.net> Message-ID: <5442EDC9.8080603@gmail.com> Thanks - not so off-topic at all, just looking for a good solution really to move away from using crontab to pull every 2 minutes. I'm currently using getmail to pull from about 10 accounts - haven't used fetchmail for quite some time, but that's definitely something to look into. Semi-related...I know there's also this: https://github.com/marschap/fetchmail_wakeup ...which does have a getmail script. I'm sure it's fine, but I'm semi-put off by the fact that it's not a dovecot-distributed plugin, so I wonder how it fares with upgrades etc. Still kind of wondering whether anyone has the incrontab approach working on a system though... On 18/10/14 23:32, Peter Chiochetti wrote: > Maybe off-topic, still: (If your remote server is imap,) why not use > fetchmail? > > Here's a mangled/working /etc/fetchmailrc for an SSL imap account: > >> poll smtp.provider.net protocol IMAP port 993 >> user 'somone at somewhere.com' is 'someone' here >> password 'MyPass123' >> folder 'INBOX' >> fetchall >> idle >> ssl >> >> mda "HOME=/home/%T /usr/bin/sudo -u %T /usr/lib/dovecot/deliver" >> >> ## cf. /etc/sudoers.d/fetchmail-deliver >> #fetchmail ALL=(ALL) NOPASSWD:/usr/lib/dovecot/deliver > > This uses imap idle over there and fetches new mail, as it arrives. > Local users will be notified of new mail without looking explicitly? > From michael at bigmichi1.de Sun Oct 19 08:10:46 2014 From: michael at bigmichi1.de (Michael Cramer) Date: Sun, 19 Oct 2014 10:10:46 +0200 Subject: last_login plugin with MySQL In-Reply-To: <54428CE9.2010800@luigirosa.com> References: <544232F1.6070508@luigirosa.com> <54426C25.6050805@luigirosa.com> <54427391.10604@gedalya.net> <544274D1.4010505@gedalya.net> <54427B0D.90705@luigirosa.com> <54428910.10001@gedalya.net> <54428CE9.2010800@luigirosa.com> Message-ID: <20141019101046.Horde.zFLqvhyINSMtWWh-ttIDpw1@horde.bigmichi1.de> Zitat von Luigi Rosa : > Gedalya wrote on 18/10/2014 17:36: > >> The code looks at shared/$last_login_key, so shared/last-login/username, >> but your map says /shared/last-login/$user, note the leading slash! That's >> probably all it is. > > > BINGO! > > Now that we killed the mosters of this level, let's move to the next > level..... > > > Welcome to the SQL query level! > > I was expecting an UPDATE...WHERE but I got this: > > INSERT INTO mailbox (lastlogin,username) VALUES ('1413647370','username') ON > DUPLICATE KEY UPDATE lastlogin='1413647370' > > This is not very useful if I want a `lastlogin` field of the `mailbox` table > updated on every login. > > > > > Ciao, > luigi > > - -- > / > +--[Luigi Rosa]-- > \ > > For every human problem, there is a neat, simple solution; > and it is always wrong. anybody knows how this can be achieved with postgresql, because 'ON DUPLICATE KEY UPDATE' syntax is mysql specific From gedalya at gedalya.net Sun Oct 19 08:29:51 2014 From: gedalya at gedalya.net (Gedalya) Date: Sun, 19 Oct 2014 04:29:51 -0400 Subject: last_login plugin with MySQL In-Reply-To: <20141019101046.Horde.zFLqvhyINSMtWWh-ttIDpw1@horde.bigmichi1.de> References: <544232F1.6070508@luigirosa.com> <54426C25.6050805@luigirosa.com> <54427391.10604@gedalya.net> <544274D1.4010505@gedalya.net> <54427B0D.90705@luigirosa.com> <54428910.10001@gedalya.net> <54428CE9.2010800@luigirosa.com> <20141019101046.Horde.zFLqvhyINSMtWWh-ttIDpw1@horde.bigmichi1.de> Message-ID: <5443767F.9050004@gedalya.net> On 10/19/2014 04:10 AM, Michael Cramer wrote: > Zitat von Luigi Rosa : > >> Gedalya wrote on 18/10/2014 17:36: >> >>> The code looks at shared/$last_login_key, so >>> shared/last-login/username, >>> but your map says /shared/last-login/$user, note the leading slash! >>> That's >>> probably all it is. >> >> >> BINGO! >> >> Now that we killed the mosters of this level, let's move to the next >> level..... >> >> >> Welcome to the SQL query level! >> >> I was expecting an UPDATE...WHERE but I got this: >> >> INSERT INTO mailbox (lastlogin,username) VALUES >> ('1413647370','username') ON >> DUPLICATE KEY UPDATE lastlogin='1413647370' >> >> This is not very useful if I want a `lastlogin` field of the >> `mailbox` table >> updated on every login. >> >> >> >> >> Ciao, >> luigi >> >> - -- >> / >> +--[Luigi Rosa]-- >> \ >> >> For every human problem, there is a neat, simple solution; >> and it is always wrong. > > anybody knows how this can be achieved with postgresql, because 'ON > DUPLICATE KEY UPDATE' syntax is mysql specific The user is not causing the 'ON DUPLICATE KEY UPDATE', that's the dovecot mysql driver. Dict is an abstraction layer. It will just work if you do pretty much the same config but with the postgres driver. From skdovecot at smail.inf.fh-brs.de Sun Oct 19 08:52:59 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen) Date: Sun, 19 Oct 2014 10:52:59 +0200 Subject: Permissions for shared mail don't work In-Reply-To: <20141018130758.GE17848@K3PO.thurnes.local> References: <20141016223305.GC17848@K3PO.thurnes.local> <20141017214057.GD17848@K3PO.thurnes.local> <544265B6.8030504@smail.inf.fh-brs.de> <20141018130758.GE17848@K3PO.thurnes.local> Message-ID: <54437BEB.4030407@smail.inf.fh-brs.de> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Damien Desfontaines wrote: > > On Sat, Oct 18, 2014 at 03:05:58PM +0200, Steffen wrote: >> Damien Desfontaines wrote: >>> >>> Here it is: http://paste.fulltxt.net/Xzoq9v >>> >>> You can actually see when I manually changed all permissions, >>> around October 12, and the fact that the messages received >>> afterwards don't have the correct permissions. >> >> how do you deliver new messages to spam's INBOX? > > By sending an e-mail to spam.whatever at desfontain.es ? > > (I'm not sure I understand the question?) > How does your MTA deliver the messages to the INBOX, do you use Dovecor LDA, LMTP or the MTA? - -- Steffen -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (Darwin) Comment: Using GnuPG with undefined - http://www.enigmail.net/ iQEVAwUBVEN76nD1/YhP6VMHAQKdygf+JNdSRmEzuUuSzeYTdpBy5lVs9lNVjEP3 WIYbQCySmquUNNxiBGNA/qHqeUol/43JpaoO8Bx3YppPcm/S1pl+oyOkX0GX4Nvu 6XSort0Gk9hPHROTL+xSfXXjwVe1AFJP9V8jjwngl8sAQo467Mn90G4VWlQm37WU jAgZS8oO/mEkiNJrNAOM14OyeTBGJ6wGsUn0QcUCK7D14At6clDvLzVjVOUdY+sa ZK6Mgm9FxnatLLsiZ2rM388h8zfhLFnRiW6PT+ksFV0Vch4hA3mNeOHBLy1PU07+ fxs02OU/mAbg5I6uw93XaQZWmCXFcfmrWGTjp9ZhIsy9m7Wf9rQNKQ== =pUXt -----END PGP SIGNATURE----- From gedalya at gedalya.net Sun Oct 19 10:25:26 2014 From: gedalya at gedalya.net (Gedalya) Date: Sun, 19 Oct 2014 06:25:26 -0400 Subject: Fwd: Re: Wiki advice on running getmail on INBOX access - how does that work? In-Reply-To: <5442DE00.8010904@gmail.com> References: <5442BD3F.6030808@cotman.org.uk> <5442BEFF.3000400@gmail.com> <5442C650.7090809@gedalya.net> <5442CB8C.40603@gmail.com> <5442DE00.8010904@gmail.com> Message-ID: <54439196.2010208@gedalya.net> On 10/18/2014 05:39 PM, c128 mail wrote: > Bit more investigation... > > So - the incrontab rule seems to work to the extent that if I directly > "ls" the cur folder on the system then it's triggered. > > However, the only way I seem to be able to be able to get it to > trigger from a mail client (I use both Thunderbird and Roundcube) is > by performing some sort of action on the mail that's already in the > folder e.g. shifting mail in/out, marking mail read, reading an > existing mail (in Roundcube only, for the last one, which I suspect is > related to Thunderbird and local caching?). > > Either way, I can't seem to get it to trigger on just access to the > folder its monitoring... Looks like the wiki page may be somewhat outdated. Try /home/user/Maildir rather than /home/user/Maildir/cur. It seems dovecot doesn't actually need to open the cur directory if it doesn't seem to have changed since indexes were last updated ... or something like that. As for Thunderbird, my guess is the problem is that it keeps connections already open. I guess it doesn't need to actually re-open things when you click "Get Messages", dovecot uses mmap alot. I've been able to get the events to trigger for /Maildir only when a new connection is opened. It should work for roundcube but perhaps not if you use imapproxy. From stephan at rename-it.nl Sun Oct 19 12:41:38 2014 From: stephan at rename-it.nl (Stephan Bosch) Date: Sun, 19 Oct 2014 14:41:38 +0200 Subject: sieve folder separator In-Reply-To: <201409250837.38256.thomas@koch.ro> References: <201409250837.38256.thomas@koch.ro> Message-ID: <5443B182.1060007@rename-it.nl> On 9/25/2014 8:37 AM, Thomas Koch wrote: > Hi, > > I'm moving from one email provider (me) to another (mailbox.org) and observed > that the new provider uses "/" instead of "." as a folder separator. Now I > need to adapt my sieve script. > > It's not too much work and I can even just define a variable at the beginning > of my script: > > set "SEP" "/" > > But it would be great, if SIEVE would come with a predefined constant for the > folder separator. Or does this already exists and I didn't find it? Currently, there is none. :/ Regards, Stephan. From c128.mail at gmail.com Sun Oct 19 12:52:19 2014 From: c128.mail at gmail.com (c128 mail) Date: Sun, 19 Oct 2014 13:52:19 +0100 Subject: Fwd: Re: Wiki advice on running getmail on INBOX access - how does that work? In-Reply-To: <54439196.2010208@gedalya.net> References: <5442BD3F.6030808@cotman.org.uk> <5442BEFF.3000400@gmail.com> <5442C650.7090809@gedalya.net> <5442CB8C.40603@gmail.com> <5442DE00.8010904@gmail.com> <54439196.2010208@gedalya.net> Message-ID: <5443B403.3060209@gmail.com> Switched to using /home/user/Maildir and, yes, I think you're totally right. With the changed location: Roundcube seems to work as it generates much more traffic with Dovecot - lots of opening and closing of connections and (when re-armed) the incrontab rule is triggered as you would expect it to be. Thunderbird doesn't work - much less traffic. You can get it fire the command with the ways detailed earlier (manipulating the folder in some way from the client), or just opening and closing the application, but no from "Get Messages" or entering the inbox. Considering the https://github.com/marschap/fetchmail_wakeup approach (with its getmail script) - dunno whether that would be any better in this respect though? On 19/10/14 11:25, Gedalya wrote: > On 10/18/2014 05:39 PM, c128 mail wrote: >> Bit more investigation... >> >> So - the incrontab rule seems to work to the extent that if I directly >> "ls" the cur folder on the system then it's triggered. >> >> However, the only way I seem to be able to be able to get it to >> trigger from a mail client (I use both Thunderbird and Roundcube) is >> by performing some sort of action on the mail that's already in the >> folder e.g. shifting mail in/out, marking mail read, reading an >> existing mail (in Roundcube only, for the last one, which I suspect is >> related to Thunderbird and local caching?). >> >> Either way, I can't seem to get it to trigger on just access to the >> folder its monitoring... > > Looks like the wiki page may be somewhat outdated. > Try /home/user/Maildir rather than /home/user/Maildir/cur. It seems > dovecot doesn't actually need to open the cur directory if it doesn't > seem to have changed since indexes were last updated ... or something > like that. > As for Thunderbird, my guess is the problem is that it keeps connections > already open. I guess it doesn't need to actually re-open things when > you click "Get Messages", dovecot uses mmap alot. I've been able to get > the events to trigger for /Maildir only when a new connection is opened. > It should work for roundcube but perhaps not if you use imapproxy. > From user+dovecot at localhost.localdomain.org Sun Oct 19 19:49:57 2014 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Sun, 19 Oct 2014 19:49:57 +0000 Subject: doveadm-move(1) In-Reply-To: References: Message-ID: <544415E5.5050007@localhost.localdomain.org> On 10/16/2014 09:01 AM, Joseph Tam wrote: > > It's Solaris10 nroff, and GNU groff 1.19.1. Ancient stuff so I wouldn't > spend too much time looking at it. It's weird that two independent > software implementations would do the same thing. Maybe ancient, but supported until January 2021. I've reworked the example commands in the manual pages. http://hg.dovecot.org/dovecot-2.2/rev/dcfb0baba621 Thanks for your input. Regards, Pascal -- The trapper recommends today: face1e55.1429221 at localdomain.org From skdovecot at smail.inf.fh-brs.de Mon Oct 20 06:27:59 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Mon, 20 Oct 2014 08:27:59 +0200 (CEST) Subject: Permissions for shared mail don't work In-Reply-To: <20141019190539.GG17848@K3PO.thurnes.local> References: <20141016223305.GC17848@K3PO.thurnes.local> <20141017214057.GD17848@K3PO.thurnes.local> <544265B6.8030504@smail.inf.fh-brs.de> <20141018130758.GE17848@K3PO.thurnes.local> <54437BEB.4030407@smail.inf.fh-brs.de> <20141019190539.GG17848@K3PO.thurnes.local> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Sun, 19 Oct 2014, Damien Desfontaines wrote: > On Sun, Oct 19, 2014 at 10:52:59AM +0200, Steffen wrote: >>>> how do you deliver new messages to spam's INBOX? >>> >>> By sending an e-mail to spam.whatever at desfontain.es ? >>> >>> (I'm not sure I understand the question?) >>> >> >> How does your MTA deliver the messages to the INBOX, do you use >> Dovecor LDA, LMTP or the MTA? > > The MTA itself delivers it, I think. Here are my config files?: > - http://paste.fulltxt.net/xx31R (/etc/postfix/main.cf) > - and http://paste.fulltxt.net/t9iXRBIH (/etc/postfix/master.cf) I don't use Postfix, but neither Postfix nor Maildrop honor Dovecot's permission settings obviously. So, you need to re-configure those to set the Unix permissions, too. I'd recommend to reconfigure Postfix to use Dovecot LMTP: http://wiki2.dovecot.org/HowTo/PostfixDovecotLMTP or Dovecot LDA. However, if you use maildrop filtering, you have to switch to Dovecot Pigeonhole Sieve filtering. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBVESrcHz1H7kL/d9rAQIDlggAgN1l0PA0yWYVIMIpuehVb0bKkdiKsDh1 adP899zThrl8/gKC6TQLldbCi92Kxnudt+yCZef07oFoiZxy3Xj+o7jECJrWI900 LLG1TrwR2IX2jmwKL3XNR2F5nOJl2ePp8YI5LxYZiys2eZ1Ug9Ks0klJTEBzKCY3 cZqad5+T7C1Lp39IjJF9ILPUWaCIFgkTgWBt/TvgXx6zj4zYxFL1bweN2zZOteFz m3nm8GcWlfXs2R9zc7Lpn+SM8IjRAZKB+/PtF2eqDHxQ+D8mddIqDFQhSK30sjfq Cf5ZMB7/+jEzSi4DdEnNwrsSGyuoJCEA5Ekoj1zR5M0HNOWMKy4V6A== =1q+8 -----END PGP SIGNATURE----- From skdovecot at smail.inf.fh-brs.de Mon Oct 20 07:00:31 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Mon, 20 Oct 2014 09:00:31 +0200 (CEST) Subject: last_login plugin with MySQL In-Reply-To: <20141019101046.Horde.zFLqvhyINSMtWWh-ttIDpw1@horde.bigmichi1.de> References: <544232F1.6070508@luigirosa.com> <54426C25.6050805@luigirosa.com> <54427391.10604@gedalya.net> <544274D1.4010505@gedalya.net> <54427B0D.90705@luigirosa.com> <54428910.10001@gedalya.net> <54428CE9.2010800@luigirosa.com> <20141019101046.Horde.zFLqvhyINSMtWWh-ttIDpw1@horde.bigmichi1.de> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Sun, 19 Oct 2014, Michael Cramer wrote: >> Gedalya wrote on 18/10/2014 17:36: >> >>> The code looks at shared/$last_login_key, so shared/last-login/username, >>> but your map says /shared/last-login/$user, note the leading slash! That's >>> probably all it is. >> >> >> BINGO! >> >> Now that we killed the mosters of this level, let's move to the next >> level..... >> >> I was expecting an UPDATE...WHERE but I got this: >> >> INSERT INTO mailbox (lastlogin,username) VALUES ('1413647370','username') >> ON >> DUPLICATE KEY UPDATE lastlogin='1413647370' > > anybody knows how this can be achieved with postgresql, because 'ON DUPLICATE > KEY UPDATE' syntax is mysql specific http://wiki2.dovecot.org/Quota/Dict see the section about "If you're using PostgreSQL, you'll need a trigger" - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBVESzD3z1H7kL/d9rAQLX8wf/WoO/J8GSf5ht2ZH7tV731jxvjd29epJr LzyqJ9DdwAt/4doR7/RK+3TKYfEzvkP7wkzOr7j6IkWhM9R2NXdXRLpYmKYG0GOb oPueNHQ3ibAcGgYHNL14UJve/H+laxJXOWYhlxM8CgR2IT+EBeJIGiHmVWjUm3DL f1Wxwzf4Ozdl0nRwZGr0nToVklaDabB9wdNNdBno+42UcbdENZdloWbAEs/2HjfA 0ckbJ4BXf+SR/TgeRmMPXMIN7/n4iIJnikTQuuE0MhV5DgdTfY0Xa1p+sE0Q1qSO pxC7FxYaaI+Yxk9q/NT8HJRwMbx3T0GQ0zyh8Bo0DH/v1QSvbgtJrg== =nZET -----END PGP SIGNATURE----- From Kind at adm.uib.no Mon Oct 20 08:26:48 2014 From: Kind at adm.uib.no (Hans Morten Kind) Date: Mon, 20 Oct 2014 10:26:48 +0200 Subject: 2.2.14 Panic in sync_expunge_range() Message-ID: <20141020082648.GA26400@alf.uib.no> I am getting some panics after upgrading from 2.2.13 to 2.2.14 This panic happens for one user only, he is subscribed to 86 folders, on two of them this panic happens quite often - several times a day. The mbox folders seems OK, less than 30M with 30 and 200 messages. Panic: file mail-index-sync-update.c: line 250 (sync_expunge_range): assertion failed: (count > 0) hmk GNU gdb 6.8 Copyright (C) 2008 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "i386-pc-solaris2.10"... Reading symbols from /datapool/local/dovecot-2.2.14/lib/dovecot/libdovecot-storage.so.0...done. Loaded symbols for /local/dovecot-2.2.14/lib/dovecot/libdovecot-storage.so.0 Reading symbols from /datapool/local/dovecot-2.2.14/lib/dovecot/libdovecot.so.0...done. Loaded symbols for /local/dovecot-2.2.14/lib/dovecot/libdovecot.so.0 Reading symbols from /datapool/local/program/lib/libssl.so.1.0.0...done. Loaded symbols for /local/program/lib/libssl.so.1.0.0 Reading symbols from /datapool/local/program/lib/libcrypto.so.1.0.0...done. Loaded symbols for /local/program/lib/libcrypto.so.1.0.0 Reading symbols from /datapool/local/program/lib/libz.so...done. Loaded symbols for /local/program/lib/libz.so Reading symbols from /lib/libm.so.2...done. Loaded symbols for /lib/libm.so.2 Reading symbols from /datapool/local/program/lib/libiconv.so.2...done. Loaded symbols for /local/program/lib/libiconv.so.2 Reading symbols from /lib/librt.so.1...done. Loaded symbols for /lib/librt.so.1 Reading symbols from /lib/libnsl.so.1...done. Loaded symbols for /lib/libnsl.so.1 Reading symbols from /lib/libsocket.so.1...done. Loaded symbols for /lib/libsocket.so.1 Reading symbols from /lib/libsendfile.so.1...done. Loaded symbols for /lib/libsendfile.so.1 Reading symbols from /lib/libc.so.1...done. Loaded symbols for /lib/libc.so.1 Reading symbols from /lib/libdl.so.1...done. Loaded symbols for /lib/libdl.so.1 Reading symbols from /usr/lib/libz.so...done. Loaded symbols for /usr/lib/libz.so Reading symbols from /lib/libaio.so.1...done. Loaded symbols for /lib/libaio.so.1 Reading symbols from /lib/libmd.so.1...done. Loaded symbols for /lib/libmd.so.1 Reading symbols from /lib/ld.so.1...done. Loaded symbols for /lib/ld.so.1 Core was generated by `dovecot/imap imap-postlogin'. Program terminated with signal 6, Aborted. [New process 76621 ] #0 0xfe7fc8e5 in _lwp_kill () from /lib/libc.so.1 #0 0xfe7fc8e5 in _lwp_kill () from /lib/libc.so.1 No symbol table info available. #1 0xfe7f7765 in thr_kill () from /lib/libc.so.1 No symbol table info available. #2 0xfe7a376f in raise () from /lib/libc.so.1 No symbol table info available. #3 0xfe7829e1 in abort () from /lib/libc.so.1 No symbol table info available. #4 0xfeda13ba in default_fatal_finish (type=LOG_TYPE_PANIC, status=0) at failures.c:152 backtrace = 0x8093660 "0xfeda22d7 -> 0xfeda15d3 -> 0xfef31e5f -> 0xfef32d65 -> 0xfef3349e -> 0xfef33b77 -> 0xfef1dcbd -> 0xfef170e4 -> 0xfef173a4 -> 0xfef1767d -> 0xfef03e09 -> 0xfeea5540 -> 0xfeea5714 -> 0xfeea5857 -> 0xfe"... #5 0xfeda22d7 in i_internal_fatal_handler (ctx=0x8047400, format=0xfef5ebc8 "file %s: line %d (%s): assertion failed: (%s)", args=0x8047424 ".????") at failures.c:152 status = 0 #6 0xfeda15d3 in i_panic (format=0xfef5ebc8 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:152 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0, timestamp_usecs = 0} args = 0x8047424 ".????" #7 0xfef31e5f in sync_expunge_range (ctx=0x8047600, seqs=0x80474d8) at ../../src/lib/array.h:197 map = (struct mail_index_map *) 0x80c5d90 range = (const struct seq_range *) 0x8093430 i = 134509780 count = 0 dest_seq1 = 562 prev_seq2 = 562 orig_rec_count = 4277606968 __FUNCTION__ = "sync_expunge_range" #8 0xfef32d65 in mail_index_sync_record_real (ctx=0x8047600, hdr=0x80b5d28, data=0x80b5df8) at ../../src/lib/array.h:197 rec = (const struct mail_transaction_expunge_guid *) 0x80b8968 end = (const struct mail_transaction_expunge_guid *) 0x80b8968 seqs = {arr = {buffer = 0x8093410, element_size = 8}, v = 0x8093410, v_modifiable = 0x8093410} seq = 0 modseq = 32612 ret = 0 __FUNCTION__ = "mail_index_sync_record_real" #9 0xfef3349e in mail_index_sync_record (ctx=0x8047600, hdr=0x80b5d28, data=0x80b5df8) at ../../src/lib/array.h:197 _data_stack_cur_id = 5 ret = 1 #10 0xfef33b77 in mail_index_sync_map (_map=0x80b5400, type=MAIL_INDEX_SYNC_HANDLER_HEAD, force=true) at ../../src/lib/array.h:197 map = (struct mail_index_map *) 0x0 index = (struct mail_index *) 0x80b53b0 view = (struct mail_index_view *) 0x80ab8b0 sync_map_ctx = {view = 0x80ab8b0, modseq_ctx = 0x809ca50, cur_ext_map_idx = 0, ext_intro_seq = 5, ext_intro_offset = 52, ext_intro_end_offset = 84, expunge_handlers = {arr = { buffer = 0x0, element_size = 0}, v = 0x0, v_modifiable = 0x0}, extra_contexts = {arr = { buffer = 0x809c348, element_size = 4}, v = 0x809c348, v_modifiable = 0x809c348}, unknown_extensions = 0x0, type = MAIL_INDEX_SYNC_HANDLER_HEAD, sync_handlers_initialized = 0, expunge_handlers_set = 0, expunge_handlers_used = 0, cur_ext_ignore = 0, internal_update = 0, errors = 0} thdr = (const struct mail_transaction_header *) 0x80b5d28 tdata = (const void *) 0x80b5df8 prev_seq = 5 start_offset = 0 prev_offset = 144 ret = 1 had_dirty = false reset = true __FUNCTION__ = "mail_index_sync_map" #11 0xfef1dcbd in mail_index_map (index=0x80b53b0, type=MAIL_INDEX_SYNC_HANDLER_HEAD) at mail-index-map-read.c:35 ret = 1 __FUNCTION__ = "mail_index_map" #12 0xfef170e4 in mail_index_try_open (index=0x80b53b0) at ../../src/lib/array.h:197 ret = 134919688 __FUNCTION__ = "mail_index_try_open" #13 0xfef173a4 in mail_index_open_files (index=0x80b53b0, flags=21) at ../../src/lib/array.h:197 ret = 1 #14 0xfef1767d in mail_index_open (index=0x80b53b0, flags=21) at ../../src/lib/array.h:197 ret = 134960048 __FUNCTION__ = "mail_index_open" #15 0xfef03e09 in index_storage_mailbox_open (box=0x80b47c8, move_to_memory=false) at index-storage.c:39 ibox = (struct index_mailbox_context *) 0x80b4a80 index_flags = 21 ret = 0 __FUNCTION__ = "index_storage_mailbox_open" #16 0xfeea5540 in mbox_mailbox_open_finish (mbox=0x80b47c8, move_to_memory=false) at mbox-storage.c:77 No locals. #17 0xfeea5714 in mbox_mailbox_open_existing (mbox=0x80b47c8) at mbox-storage.c:77 box = (struct mailbox *) 0x80b47c8 rootdir = 0xfeea581f "\215\225`???\211T$\004\211\004$?\023???\211E?\203}?" box_path = 0x80b4b78 "/Home/USER/mail/pro/triad" move_to_memory = false #18 0xfeea5857 in mbox_mailbox_open (box=0x80b47c8) at mbox-storage.c:77 mbox = (struct mbox_mailbox *) 0x80b47c8 st = {st_dev = 82051096, st_pad1 = {0, 0, 0}, st_ino = 4141941, st_mode = 33152, st_nlink = 1, st_uid = 32440, st_gid = 4601, st_rdev = 0, st_pad2 = {0, 0}, st_size = 16826589, st_atim = { tv_sec = 1411034237, tv_nsec = 0}, st_mtim = {tv_sec = 1413152136, tv_nsec = 0}, st_ctim = { tv_sec = 1413659956, tv_nsec = 975959000}, st_blksize = 8192, st_blocks = 33016, st_fstype = "nfs", '\0' , st_pad4 = {0, 0, 0, 0, 0, 0, 0, 0}} ret = 0 #19 0xfeec94cc in mailbox_open_full (box=0x80b47c8, input=0x0) at ../../src/lib/array.h:197 _data_stack_cur_id = 4 ret = 143 #20 0xfeec9807 in mailbox_open (box=0x80b47c8) at ../../src/lib/array.h:197 No locals. #21 0xfef024ec in index_storage_get_status (box=0x80b47c8, items=23, status_r=0x8047a04) at index-status.c:23 No locals. #22 0xfeeca8ac in mailbox_get_status (box=0x80b47c8, items=23, status_r=0x8047a04) at ../../src/lib/array.h:197 __FUNCTION__ = "mailbox_get_status" #23 0x08073ddb in imap_status_get (cmd=0x80b1fb8, ns=0x80ab1b0, mailbox=0x8093318 "pro/triad", items=0x8047a70, result_r=0x8047a04) at imap-status.c:23 client = (struct client *) 0x80b17b0 box = (struct mailbox *) 0x80b47c8 errstr = 0x8064d84 "\205?u\034\213\205h????D$\004\005" ret = 0 #24 0x08064e65 in cmd_status (cmd=0x80b1fb8) at cmd-status.c:23 client = (struct client *) 0x80b17b0 args = (const struct imap_arg *) 0x80ab240 list_args = (const struct imap_arg *) 0x80ab328 items = {status = 23, metadata = 0} result = {status = {messages = 0, recent = 0, unseen = 0, uidvalidity = 0, uidnext = 0, first_unseen_seq = 0, first_recent_uid = 0, last_cached_seq = 0, highest_modseq = 0, highest_pvt_modseq = 0, keywords = 0x0, permanent_flags = 0, permanent_keywords = 0, allow_new_keywords = 0, nonpermanent_modseqs = 0, no_modseq_tracking = 0, have_guids = 1, have_save_guids = 0, have_only_guid128 = 0}, metadata = { guid = "\000\000\000\000\001\000\000\000\r\000\000\000\033\000\000", virtual_size = 2199023255593, cache_fields = 0xfe7a67f2, precache_fields = 134861792, backend_ns_prefix = 0x80921a8 "0(\t\b\030", backend_ns_type = 134511236}, error = 134654712, errstr = 0x80b2038 "STATUS"} ns = (struct mail_namespace *) 0x80ab1b0 mailbox = 0x8093318 "pro/triad" orig_mailbox = 0x80ab2f8 "pro/triad" selected_mailbox = false #25 0x0806aa61 in command_exec (cmd=0x80b1fb8) at imap-commands.c:101 hook = (const struct command_hook *) 0x809bfd8 ret = 8 #26 0x080699d2 in client_command_input (cmd=0x80b1fb8) at imap-client.c:130 client = (struct client *) 0x80b17b0 command = (struct command *) 0x3 __FUNCTION__ = "client_command_input" #27 0x08069cb7 in client_command_input (cmd=0x80b1fb8) at imap-client.c:130 client = (struct client *) 0x80b17b0 command = (struct command *) 0x809d3d4 __FUNCTION__ = "client_command_input" #28 0x08069dba in client_handle_next_command (client=0x80b17b0, remove_io_r=0x8047b9d) at imap-client.c:130 No locals. #29 0x08069e57 in client_handle_input (client=0x80b17b0) at imap-client.c:130 _data_stack_cur_id = 3 ret = 10 remove_io = false handled_commands = false __FUNCTION__ = "client_handle_input" #30 0x08069fe0 in client_input (client=0x80b17b0) at imap-client.c:130 cmd = (struct client_command_context *) 0x80aa9a4 output = (struct ostream *) 0x80abe08 bytes = 55 __FUNCTION__ = "client_input" #31 0xfedba96d in io_loop_call_io (io=0x80abe70) at ioloop.c:28 ioloop = (struct ioloop *) 0x809bf20 t_id = 2 __FUNCTION__ = "io_loop_call_io" #32 0xfedbc0cc in io_loop_handler_run_internal (ioloop=0x809bf20) at ioloop-poll.c:96 ctx = (struct ioloop_handler_context *) 0x809ca10 pollfd = (struct pollfd *) 0x809e0a8 tv = {tv_sec = 1799, tv_usec = 999672} io = (struct io_file *) 0x80abe70 msecs = 1800000 ret = 0 call = true #33 0xfedbab06 in io_loop_handler_run (ioloop=0x809bf20) at ioloop.c:28 No locals. #34 0xfedbaa5d in io_loop_run (ioloop=0x809bf20) at ioloop.c:28 __FUNCTION__ = "io_loop_run" #35 0xfed41db1 in master_service_run (service=0x809be68, callback=0x80771da ) at master-service.c:75 No locals. #36 0x08077577 in main (argc=2, argv=0x809bc78) at main.c:72 set_roots = {0x8092fe0, 0x0} login_set = {auth_socket_path = 0x80930e8 "", postlogin_socket_path = 0x8093120 "", postlogin_timeout_secs = 60, callback = 0x8076f4e , failure_callback = 0x807715d , request_auth_token = 1} service_flags = MASTER_SERVICE_FLAG_KEEP_CONFIG_OPEN storage_service_flags = MAIL_STORAGE_SERVICE_FLAG_DISALLOW_ROOT username = 0x0 c = -1 From Kind at adm.uib.no Mon Oct 20 09:21:39 2014 From: Kind at adm.uib.no (Hans Morten Kind) Date: Mon, 20 Oct 2014 11:21:39 +0200 Subject: 2.2.14 Panic in imap_fetch_more() Message-ID: <20141020092139.GB26400@alf.uib.no> This panic happens with different users, and it also occured in 2.2.13 Panic: file imap-fetch.c: line 556 (imap_fetch_more): assertion failed: (ctx->client->output_cmd_lock == NULL || ctx->client->output_cmd_lock == cmd) hmk GNU gdb 6.8 Copyright (C) 2008 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "i386-pc-solaris2.10"... Reading symbols from /datapool/local/dovecot-2.2.14/lib/dovecot/libdovecot-storage.so.0...done. Loaded symbols for /local/dovecot-2.2.14/lib/dovecot/libdovecot-storage.so.0 Reading symbols from /datapool/local/dovecot-2.2.14/lib/dovecot/libdovecot.so.0...done. Loaded symbols for /local/dovecot-2.2.14/lib/dovecot/libdovecot.so.0 Reading symbols from /datapool/local/program/lib/libssl.so.1.0.0...done. Loaded symbols for /local/program/lib/libssl.so.1.0.0 Reading symbols from /datapool/local/program/lib/libcrypto.so.1.0.0...done. Loaded symbols for /local/program/lib/libcrypto.so.1.0.0 Reading symbols from /datapool/local/program/lib/libz.so...done. Loaded symbols for /local/program/lib/libz.so Reading symbols from /lib/libm.so.2...done. Loaded symbols for /lib/libm.so.2 Reading symbols from /datapool/local/program/lib/libiconv.so.2...done. Loaded symbols for /local/program/lib/libiconv.so.2 Reading symbols from /lib/librt.so.1...done. Loaded symbols for /lib/librt.so.1 Reading symbols from /lib/libnsl.so.1...done. Loaded symbols for /lib/libnsl.so.1 Reading symbols from /lib/libsocket.so.1...done. Loaded symbols for /lib/libsocket.so.1 Reading symbols from /lib/libsendfile.so.1...done. Loaded symbols for /lib/libsendfile.so.1 Reading symbols from /lib/libc.so.1...done. Loaded symbols for /lib/libc.so.1 Reading symbols from /lib/libdl.so.1...done. Loaded symbols for /lib/libdl.so.1 Reading symbols from /usr/lib/libz.so...done. Loaded symbols for /usr/lib/libz.so Reading symbols from /lib/libaio.so.1...done. Loaded symbols for /lib/libaio.so.1 Reading symbols from /lib/libmd.so.1...done. Loaded symbols for /lib/libmd.so.1 Reading symbols from /lib/ld.so.1...done. Loaded symbols for /lib/ld.so.1 Core was generated by `dovecot/imap imap-postlogin'. Program terminated with signal 6, Aborted. [New process 79111 ] #0 0xfe7fc8e5 in _lwp_kill () from /lib/libc.so.1 #0 0xfe7fc8e5 in _lwp_kill () from /lib/libc.so.1 No symbol table info available. #1 0xfe7f7765 in thr_kill () from /lib/libc.so.1 No symbol table info available. #2 0xfe7a376f in raise () from /lib/libc.so.1 No symbol table info available. #3 0xfe7829e1 in abort () from /lib/libc.so.1 No symbol table info available. #4 0xfeda13ba in default_fatal_finish (type=LOG_TYPE_PANIC, status=0) at failures.c:152 backtrace = 0x8093560 "0xfeda22d7 -> 0xfeda15d3 -> 0x806d60b -> 0x805d326 -> 0x806aa61 -> 0x80699d2 -> 0x8069cb7 -> 0x8069d15 -> 0x8069e57 -> 0x8069fe0 -> 0xfedba96d -> 0xfedbc0cc -> 0xfedbab06 -> 0xfedbaa5d -> 0xfed41db1 -"... #5 0xfeda22d7 in i_internal_fatal_handler (ctx=0x80479e0, format=0x807f310 "file %s: line %d (%s): assertion failed: (%s)", args=0x8047a04 "\236?\a\b,\002") at failures.c:152 status = 0 #6 0xfeda15d3 in i_panic (format=0x807f310 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:152 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0, timestamp_usecs = 0} args = 0x8047a04 "\236?\a\b,\002" #7 0x0806d60b in imap_fetch_more (ctx=0x80c20e0, cmd=0x80c2018) at ../../src/lib/array.h:158 ret = 135365712 __FUNCTION__ = "imap_fetch_more" #8 0x0805d326 in cmd_fetch (cmd=0x80c2018) at cmd-fetch.c:37 client = (struct client *) 0x80b17b8 ctx = (struct imap_fetch_context *) 0x80c20e0 args = (const struct imap_arg *) 0x80c99f0 next_arg = (const struct imap_arg *) 0x80c9a20 list_arg = (const struct imap_arg *) 0x8047a98 search_args = (struct mail_search_args *) 0x0 qresync_args = {qresync_sample_seqset = 0x80c20a8, qresync_sample_uidset = 0x807ee7e} messageset = 0x80c9ab8 "1899" send_vanished = false ret = 1 #9 0x0806aa61 in command_exec (cmd=0x80c2018) at imap-commands.c:101 hook = (const struct command_hook *) 0x809bfd8 ret = 8 #10 0x080699d2 in client_command_input (cmd=0x80c2018) at imap-client.c:130 client = (struct client *) 0x80b17b8 command = (struct command *) 0x3 __FUNCTION__ = "client_command_input" #11 0x08069cb7 in client_command_input (cmd=0x80c2018) at imap-client.c:130 client = (struct client *) 0x80b17b8 command = (struct command *) 0x809d41c __FUNCTION__ = "client_command_input" #12 0x08069d15 in client_handle_next_command (client=0x80b17b8, remove_io_r=0x8047b9d) at imap-client.c:130 No locals. #13 0x08069e57 in client_handle_input (client=0x80b17b8) at imap-client.c:130 _data_stack_cur_id = 3 ret = 10 remove_io = false handled_commands = false __FUNCTION__ = "client_handle_input" #14 0x08069fe0 in client_input (client=0x80b17b8) at imap-client.c:130 cmd = (struct client_command_context *) 0x80aa9ac output = (struct ostream *) 0x80abe10 bytes = 1143 __FUNCTION__ = "client_input" #15 0xfedba96d in io_loop_call_io (io=0x80b7fc8) at ioloop.c:28 ioloop = (struct ioloop *) 0x809bf20 t_id = 2 __FUNCTION__ = "io_loop_call_io" #16 0xfedbc0cc in io_loop_handler_run_internal (ioloop=0x809bf20) at ioloop-poll.c:96 ctx = (struct ioloop_handler_context *) 0x809ca10 pollfd = (struct pollfd *) 0x809e0a8 tv = {tv_sec = 299, tv_usec = 996793} io = (struct io_file *) 0x80b7fc8 msecs = 299997 ret = 0 call = true #17 0xfedbab06 in io_loop_handler_run (ioloop=0x809bf20) at ioloop.c:28 No locals. #18 0xfedbaa5d in io_loop_run (ioloop=0x809bf20) at ioloop.c:28 __FUNCTION__ = "io_loop_run" #19 0xfed41db1 in master_service_run (service=0x809be68, callback=0x80771da ) at master-service.c:75 No locals. #20 0x08077577 in main (argc=2, argv=0x809bc78) at main.c:72 set_roots = {0x8092fe0, 0x0} login_set = {auth_socket_path = 0x80930e8 "\2201\t\b\200", postlogin_socket_path = 0x8093120 "UID FETCH UID FETCH UID FETCH", postlogin_timeout_secs = 60, callback = 0x8076f4e , failure_callback = 0x807715d , request_auth_token = 1} service_flags = MASTER_SERVICE_FLAG_KEEP_CONFIG_OPEN storage_service_flags = MAIL_STORAGE_SERVICE_FLAG_DISALLOW_ROOT username = 0x0 c = -1 From leo at strike.wu.ac.at Mon Oct 20 09:48:32 2014 From: leo at strike.wu.ac.at (Alexander 'Leo' Bergolth) Date: Mon, 20 Oct 2014 11:48:32 +0200 Subject: Sieve: carry global variables from sieve_before to user sieve scripts Message-ID: <5444DA70.5080402@strike.wu.ac.at> Hi! Is there a way to initialize global variables with default values in sieve_before scripts that can be used in the sieve_default script or in user scripts? I've tried the following code but this doesn't work.. before.d/10-set-defaults.sieve: -------------------- 8< -------------------- require ["variables", "include"]; require "vnd.dovecot.debug"; set "global.S_TESTVAR leo"; debug_log "LEO SIEVE: in before.d/10-set-defaults, S_TESTVAR: ${global.S_TESTVAR}"; -------------------- 8< -------------------- default.sieve: -------------------- 8< -------------------- require ["variables", "include"]; require "vnd.dovecot.debug"; global "S_TESTVAR"; debug_log "LEO SIEVE: in default.sieve: S_TESTVAR: ${global.S_TESTVAR}, ${S_TESTVAR}"; -------------------- 8< -------------------- Is there any other way to set up defaults in a global sieve script? Cheers, --leo -- e-mail ::: Leo.Bergolth (at) wu.ac.at fax ::: +43-1-31336-906050 location ::: IT-Services | Vienna University of Economics | Austria From tk at giga.or.at Mon Oct 20 10:16:14 2014 From: tk at giga.or.at (Thomas Klausner) Date: Mon, 20 Oct 2014 12:16:14 +0200 Subject: fixes for quota support on NetBSD In-Reply-To: <20141010150738.GB997@danbala.tuwien.ac.at> References: <20141010150738.GB997@danbala.tuwien.ac.at> Message-ID: <20141020101614.GB12514@danbala.tuwien.ac.at> This patch still applies cleanly against 2.2.14, and is still needed. Thomas On Fri, Oct 10, 2014 at 05:07:38PM +0200, Thomas Klausner wrote: > Hi! > > dovecot-2.2.13 already has quota support for NetBSD, but it's buggy. > The attached patches by Manuel Bouyer fix the > issues. > > There is one thing that's not nice in them: one include is now for > "/usr/include/quota.h" since dovecot comes with its own file "quota.h" > which is earlier in the search path. Perhaps dovecot's copy can be > renamed to dovecot-quota.h or to some other non-conflicting name? > > Cheers, > Thomas > $NetBSD: patch-src_plugins_quota_quota-fs.c,v 1.4 2013/08/05 23:12:42 bouyer Exp $ > > fix support for NetBSD's libquota > > --- src/plugins/quota/quota-fs.c.orig 2013-02-26 09:42:04.000000000 +0100 > +++ src/plugins/quota/quota-fs.c 2013-08-06 01:00:32.000000000 +0200 > @@ -672,34 +672,38 @@ > { > struct quotakey qk; > struct quotaval qv; > + struct quotahandle *qh; > + int ret; > > - if (root->qh == NULL) { > - if ((root->qh = quota_open(root->mount->mount_path)) == NULL) { > - i_error("cannot open quota for %s: %m", > - root->mount->mount_path); > - fs_quota_root_disable(root, group); > - return 0; > - } > - } > + if ((qh = quota_open(root->mount->mount_path)) == NULL) { > + i_error("cannot open quota for %s: %m", > + root->mount->mount_path); > + fs_quota_root_disable(root, group); > + return 0; > + } > > qk.qk_idtype = group ? QUOTA_IDTYPE_GROUP : QUOTA_IDTYPE_USER; > qk.qk_id = group ? root->gid : root->uid; > qk.qk_objtype = bytes ? QUOTA_OBJTYPE_BLOCKS : QUOTA_OBJTYPE_FILES; > > - if (quota_get(root->qh, &qk, &qv) != 0) { > + if (quota_get(qh, &qk, &qv) != 0) { > if (errno == ESRCH) { > fs_quota_root_disable(root, group); > return 0; > } > i_error("quotactl(Q_GETQUOTA, %s) failed: %m", > root->mount->mount_path); > - return -1; > + ret = -1; > + goto end; > } > > *value_r = qv.qv_usage * DEV_BSIZE; > *limit_r = qv.qv_softlimit * DEV_BSIZE; > > - return 1; > + ret = 1; > +end: > + quota_close(qh); > + return ret; > } > #endif > > $NetBSD: patch-src_plugins_quota_quota-fs.h,v 1.4 2013/08/05 23:12:42 bouyer Exp $ > > fix support for NetBSD's libquota > > --- src/plugins/quota/quota-fs.h.orig 2013-08-06 00:53:34.000000000 +0200 > +++ src/plugins/quota/quota-fs.h 2013-08-06 00:54:29.000000000 +0200 > @@ -7,7 +7,8 @@ > #endif > > #ifdef HAVE_QUOTA_OPEN > -# include /* NetBSD with libquota */ > +/* absolute path to avoid confusion with ./quota.h */ > +# include "/usr/include/quota.h" /* NetBSD with libquota */ > #endif > > #ifdef HAVE_SYS_QUOTA_H From martinschmidtii at gmx.de Mon Oct 20 16:52:43 2014 From: martinschmidtii at gmx.de (Martin Schmidt) Date: Mon, 20 Oct 2014 18:52:43 +0200 Subject: replication sieve settings Message-ID: <54453DDB.8090904@gmx.de> Hello, can someone give me a hint, where to find an info, how to setup dovecote replication with sieve? On my active.active setup, it replicates the user mdboxes and sieve works also, on the active destination fileserver. Client changes the sieve, tests work fine. But the sieve file won't get replicated to the replica server. As i've researched, it was introduced in dovecot v2.2.rc3 Is it default, that doveadm replicator replicate '*' includes the sieve and i made a config error? Or is there an option to set for the replication service? On dovecot director server, i've set director in conf.d/20-managesieve.conf service managesieve-login { executable = managesieve-login director inet_listener sieve { port = 4190 } } and added sieve to plugins in conf.d/20-lmtp.conf protocol lmtp { mail_plugins = $mail_plugins sieve } doveconf -n ... director_mail_servers = 192.168.200.10 192.168.200.11 director_servers = 192.168.200.1:9090 192.168.200.2:9090 disable_plaintext_auth = no doveadm_port = 24245 lmtp_proxy = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave duplicate plugin { sieve = file:~/sieve;active=~/.dovecot.sieve } protocols = " imap lmtp sieve pop3" ... service managesieve-login { executable = managesieve-login director inet_listener sieve { port = 4190 } } ... protocol lmtp { auth_socket_path = director-userdb mail_plugins = " sieve" } ... Thank you Martin Schmidt Germany From Dovecot-mailing-list at whyaskwhy.org Mon Oct 20 16:59:08 2014 From: Dovecot-mailing-list at whyaskwhy.org (deoren) Date: Mon, 20 Oct 2014 11:59:08 -0500 Subject: 90-sieve.conf syntax - moving from v2.0.x to v2.2.x Message-ID: Hi, I'm currently running version v2.0.x in production (using Maildir storage) and it's been working well. I'm interested in moving to version 2.2.x and am preparing a test server to do so. As I have been merging the conf file changes between the two versions I noticed syntax changes for the 90-sieve.conf file. There are now 'locations' and presumably to keep referring to local content I'll need to use the 'file:' location type. On my production box (v2.0.x) I have 90-sieve.conf configured like so: sieve = /var/vmail/sieve/%d/%n/.dovecot.sieve sieve_default = /var/vmail/sieve/global.sieve sieve_dir = /var/vmail/sieve/%d/%n/sieve_dir Inside of the /var/vmail/sieve/%d/%n/ directory (i.e., /var/vmail/sieve/example.com/testuser/) I find: drwxr-xr-x 3 vmail vmail 64 Oct 19 12:07 . drwxr-xr-x 9 vmail vmail 101 Jun 21 10:47 .. lrwxrwxrwx 1 vmail vmail 25 Jun 21 11:10 .dovecot.sieve -> sieve_dir/roundcube.sieve -rw------- 1 vmail vmail 3694 Oct 19 12:07 .dovecot.svbin drwx------ 3 vmail vmail 38 Oct 19 11:58 sieve_dir and that works well. I look at the current wiki documentation: http://wiki2.dovecot.org/Pigeonhole/Sieve/Configuration and I find that the 'seive_dir' conf option is still listed, but the comments for it appear very similar to the comments that precede the 'sieve' conf option in the stock 90-sieve.conf file: # The location of the user's main Sieve script or script storage. The LDA # Sieve plugin uses this to find the active script for Sieve filtering at # delivery. The "include" extension uses this location for retrieving # :personal" scripts. This is also where the ManageSieve service will store # the user's scripts, if supported. Assuming that the 'sieve' and 'sieve_dir' conf settings have not been merged into just 'sieve' (and that I need to use the 'file:' location specifier), is this how I would configure the two settings for Dovecot 2.2.x? sieve = file:/var/vmail/sieve/%d/%n;active=~/.dovecot.sieve sieve_dir = file:/var/vmail/sieve/%d/%n/sieve_dir If the two have been merged, how would I go about configuring the 90-sieve.conf file to get the same results? Thanks for your help. From jtam.home at gmail.com Mon Oct 20 22:42:48 2014 From: jtam.home at gmail.com (Joseph Tam) Date: Mon, 20 Oct 2014 15:42:48 -0700 (PDT) Subject: last_login plugin with MySQL In-Reply-To: References: Message-ID: Michael Cramer writes: > anybody knows how this can be achieved with postgresql, because 'ON > DUPLICATE KEY UPDATE' syntax is mysql specific A clear, concise explanation of consistency problems with SQL update-or-insert ("upsert") operation, including a PostgreSQL implementation: http://www.depesz.com/2012/06/10/why-is-upsert-so-complicated/ Joseph Tam From r at sys4.de Tue Oct 21 08:01:40 2014 From: r at sys4.de (Ralf Hildebrandt) Date: Tue, 21 Oct 2014 10:01:40 +0200 Subject: Proxy problem: "imap-login: Error: proxy(USERNAME): connect(10.x.x.178, 993) failed: Cannot assign requested address (after 0 secs, local=10.x.x.104)" In-Reply-To: <20141017074731.GA11684@sys4.de> References: <20141016132612.GA16495@sys4.de> <95247B98-13B5-42C0-A8A4-10B8F9F6B77E@iki.fi> <20141017074731.GA11684@sys4.de> Message-ID: <20141021080140.GC29100@sys4.de> * Ralf Hildebrandt : > > I'd guess you're running out of TCP ports. > > I think so too, but it's somewhat unlikely! We're using 10 outbound IP > adresses! In a random fashion (and I'm seeing this on the backend > server!) FYI: It was a kernel bug. -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From lst_hoe02 at kwsoft.de Tue Oct 21 09:41:35 2014 From: lst_hoe02 at kwsoft.de (lst_hoe02 at kwsoft.de) Date: Tue, 21 Oct 2014 11:41:35 +0200 Subject: Proxy problem: "imap-login: Error: proxy(USERNAME): connect(10.x.x.178, 993) failed: Cannot assign requested address (after 0 secs, local=10.x.x.104)" In-Reply-To: <20141021080140.GC29100@sys4.de> References: <20141016132612.GA16495@sys4.de> <95247B98-13B5-42C0-A8A4-10B8F9F6B77E@iki.fi> <20141017074731.GA11684@sys4.de> <20141021080140.GC29100@sys4.de> Message-ID: <20141021114135.Horde.5IeDkO5Bhf33XjDmVtL8sA1@webmail.kwsoft.de> Zitat von Ralf Hildebrandt : > * Ralf Hildebrandt : > >> > I'd guess you're running out of TCP ports. >> >> I think so too, but it's somewhat unlikely! We're using 10 outbound IP >> adresses! In a random fashion (and I'm seeing this on the backend >> server!) > > FYI: It was a kernel bug. Do you mind sharing the actual technical background. Which kernel was affected and how? Thanks Andreas -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 5931 bytes Desc: S/MIME Cryptographic Signature URL: From r at sys4.de Tue Oct 21 10:29:26 2014 From: r at sys4.de (Ralf Hildebrandt) Date: Tue, 21 Oct 2014 12:29:26 +0200 Subject: Proxy problem: "imap-login: Error: proxy(USERNAME): connect(10.x.x.178, 993) failed: Cannot assign requested address (after 0 secs, local=10.x.x.104)" In-Reply-To: <20141021114135.Horde.5IeDkO5Bhf33XjDmVtL8sA1@webmail.kwsoft.de> References: <20141016132612.GA16495@sys4.de> <95247B98-13B5-42C0-A8A4-10B8F9F6B77E@iki.fi> <20141017074731.GA11684@sys4.de> <20141021080140.GC29100@sys4.de> <20141021114135.Horde.5IeDkO5Bhf33XjDmVtL8sA1@webmail.kwsoft.de> Message-ID: <20141021102926.GA14739@sys4.de> > >FYI: It was a kernel bug. > > Do you mind sharing the actual technical background. Which kernel > was affected and how? We didn't track it down to a specific bug, but we finally decided that our setup using multiple IPs for source and destination was OK and should work as intended - but it didn't. So we switched from Debians 3.2 kernel to a 3.14 from backports and - surprise - it worked as designed. Something in the 3.2 kernel limited the number of established connections to the frame given by the local port range, even incoming ones. I still don't know what, but I am quite sure it's not a new feature in 3.14 which makes our setup work, as it should be possible to have many connects from different source IPs on basically every linux kernel. There are other limits (as some TCP hashtable sizes) which can be tuned, but that was not the limit we were hitting... Old (not working): linux-image-3.2.0-4-amd64 3.2.63-2 New (working OK): linux-image-3.14-0.bpo.2-rt-amd64 3.14.15-2~bpo70+1 -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From bstringfellow at bobcad.com Tue Oct 21 12:40:47 2014 From: bstringfellow at bobcad.com (Brian) Date: Tue, 21 Oct 2014 08:40:47 -0400 Subject: SMTP authentication setup Message-ID: <5446544F.2010804@bobcad.com> At my company we've had a longstanding problem of not being able to send email from devices outside of our internal network and any specific IP address that we open the relay to. As it turns out, SASL has never been set up. I need to set up SASL ASAP but none of the guides I've found seem to work. This is the latest guide I tried: http://wiki2.dovecot.org/HowTo/PostfixAndDovecotSASL I did everything on here minus the last part because it's on the same server. Also, instead of submission inet n - - - - smtpd I did: 127.0.0.1:1025 inet n - - - - smtpd After all is done, however, I'm unable to send any mail. Thunderbird just says sending message but doesn't send and I don't even get an error. I end up having to disable SASL again before I can send mail. Dovecot version 2.0.9 Postfix version 2.6.6 CentOS 6 I have Postfix, Dovecot, and ASSP on the same server. Thanks everyone. -- This email was Virus checked by Astaro Security Gateway. http://www.sophos.com From CMarcus at Media-Brokers.com Tue Oct 21 12:45:49 2014 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Tue, 21 Oct 2014 08:45:49 -0400 Subject: SMTP authentication setup In-Reply-To: <5446544F.2010804@bobcad.com> References: <5446544F.2010804@bobcad.com> Message-ID: <5446557D.90303@Media-Brokers.com> On 10/21/2014 8:40 AM, Brian wrote: > Also, instead of > submission inet n - - - - smtpd > I did: > 127.0.0.1:1025 inet n - - - - smtpd > > After all is done, however, I'm unable to send any mail. No surprise there. You *must* use the submission port if you want it to work. Not sure why you thought otherwise. From h.reindl at thelounge.net Tue Oct 21 12:47:52 2014 From: h.reindl at thelounge.net (Reindl Harald) Date: Tue, 21 Oct 2014 14:47:52 +0200 Subject: SMTP authentication setup In-Reply-To: <5446544F.2010804@bobcad.com> References: <5446544F.2010804@bobcad.com> Message-ID: <544655F8.1080106@thelounge.net> Am 21.10.2014 um 14:40 schrieb Brian: > At my company we've had a longstanding problem of not being able to send > email from devices outside of our internal network and any specific IP > address that we open the relay to. As it turns out, SASL has never been > set up. I need to set up SASL ASAP but none of the guides I've found > seem to work. > This is the latest guide I tried: > http://wiki2.dovecot.org/HowTo/PostfixAndDovecotSASL > I did everything on here minus the last part because it's on the same > server. don't pretend - "postconf -n" and "dovecot -n" # dovecot service auth { unix_listener /var/spool/postfix/private/auth { mode = 0660 user = postfix group = postfix } } # postfix smtpd_sasl_auth_enable = yes smtpd_sasl_type = dovecot smtpd_sasl_path = private/auth > Also, instead of > submission inet n - - - - smtpd > I did: > 127.0.0.1:1025 inet n - - - - smtpd that is complete nonsense * 1025 is not a standard port * the port only listens on localhost * no way to connect from outside > After all is done, however, I'm unable to send any mail. Thunderbird > just says sending message but doesn't send and I don't even get an > error. I end up having to disable SASL again before I can send mail. because most likely 1025 is not opened in the firewall and even if since you misconfigured the server it could not connect > Dovecot version 2.0.9 > Postfix version 2.6.6 > CentOS 6 > I have Postfix, Dovecot, and ASSP on the same server -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 181 bytes Desc: OpenPGP digital signature URL: From h.reindl at thelounge.net Tue Oct 21 12:49:38 2014 From: h.reindl at thelounge.net (Reindl Harald) Date: Tue, 21 Oct 2014 14:49:38 +0200 Subject: SMTP authentication setup In-Reply-To: <5446557D.90303@Media-Brokers.com> References: <5446544F.2010804@bobcad.com> <5446557D.90303@Media-Brokers.com> Message-ID: <54465662.7070200@thelounge.net> Am 21.10.2014 um 14:45 schrieb Charles Marcus: > On 10/21/2014 8:40 AM, Brian wrote: >> Also, instead of >> submission inet n - - - - smtpd >> I did: >> 127.0.0.1:1025 inet n - - - - smtpd >> >> After all is done, however, I'm unable to send any mail. > > No surprise there. > > You *must* use the submission port if you want it to work. > Not sure why you thought otherwise. no, you can use any port you want if you configure the client on the same one - but it must not only listen on 127.0.0.1 not postfix nor the client are interested in a specific port, that's why we have 587 *and* 588, 588 only opened for specific client IP's with other rate-limits -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 181 bytes Desc: OpenPGP digital signature URL: From CMarcus at Media-Brokers.com Tue Oct 21 13:17:22 2014 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Tue, 21 Oct 2014 09:17:22 -0400 Subject: SMTP authentication setup In-Reply-To: <54465662.7070200@thelounge.net> References: <5446544F.2010804@bobcad.com> <5446557D.90303@Media-Brokers.com> <54465662.7070200@thelounge.net> Message-ID: <54465CE2.9000101@Media-Brokers.com> On 10/21/2014 8:49 AM, Reindl Harald wrote: > Am 21.10.2014 um 14:45 schrieb Charles Marcus: >> On 10/21/2014 8:40 AM, Brian wrote: >>> Also, instead of >>> submission inet n - - - - smtpd >>> I did: >>> 127.0.0.1:1025 inet n - - - - smtpd >>> >>> After all is done, however, I'm unable to send any mail. >> No surprise there. >> >> You *must* use the submission port if you want it to work. >> Not sure why you thought otherwise. > no, you can use any port you want if you configure the client on the > same one - but it must not only listen on 127.0.0.1 That was obviously my point. From Dovecot-mailing-list at whyaskwhy.org Tue Oct 21 14:24:07 2014 From: Dovecot-mailing-list at whyaskwhy.org (deoren) Date: Tue, 21 Oct 2014 09:24:07 -0500 Subject: 90-sieve.conf syntax - moving from v2.0.x to v2.2.x In-Reply-To: References: Message-ID: On 2014-10-20 11:59, deoren wrote: > Hi, > > I'm currently running version v2.0.x in production (using Maildir > storage) and it's been working well. I'm interested in moving to > version 2.2.x and am preparing a test server to do so. As I have been > merging the conf file changes between the two versions I noticed > syntax changes for the 90-sieve.conf file. > > There are now 'locations' and presumably to keep referring to local > content I'll need to use the 'file:' location type. > > On my production box (v2.0.x) I have 90-sieve.conf configured like so: > > sieve = /var/vmail/sieve/%d/%n/.dovecot.sieve > sieve_default = /var/vmail/sieve/global.sieve > sieve_dir = /var/vmail/sieve/%d/%n/sieve_dir > > Inside of the /var/vmail/sieve/%d/%n/ directory (i.e., > /var/vmail/sieve/example.com/testuser/) I find: > > drwxr-xr-x 3 vmail vmail 64 Oct 19 12:07 . > drwxr-xr-x 9 vmail vmail 101 Jun 21 10:47 .. > lrwxrwxrwx 1 vmail vmail 25 Jun 21 11:10 .dovecot.sieve -> > sieve_dir/roundcube.sieve > -rw------- 1 vmail vmail 3694 Oct 19 12:07 .dovecot.svbin > drwx------ 3 vmail vmail 38 Oct 19 11:58 sieve_dir > > and that works well. I never did work out the new syntax, so I kept the older and so far it is working fine with v2.2.13. I did have to remove the old compiled versions of the Sieve scripts to get things working. I had at least one case (one specific account) where the script was recompiled automatically, but for the other accounts I did have to nuke the *.svbin file to force a recompilation of the Sieve scripts. Only in one case was a message logged (with debug mode enabled) re a version mismatch and the script recompiled automatically. It may not be the best way to do it, but this is what I did: rm -i $(find . -type f /var/vmail/sieve/example.com/ | grep svbin) After that the scripts began working as expected (using the older syntax which I mentioned in the last email). If anyone has any suggestions for updating the syntax for those configuration options I'd appreciate it. I couldn't make heads or tails of it. Everything I thought should work didn't. From Dovecot-mailing-list at whyaskwhy.org Tue Oct 21 15:06:29 2014 From: Dovecot-mailing-list at whyaskwhy.org (deoren) Date: Tue, 21 Oct 2014 10:06:29 -0500 Subject: SMTP authentication setup In-Reply-To: <5446544F.2010804@bobcad.com> References: <5446544F.2010804@bobcad.com> Message-ID: On 2014-10-21 07:40, Brian wrote: > At my company we've had a longstanding problem of not being able to > send email from devices outside of our internal network and any > specific IP address that we open the relay to. As it turns out, SASL > has never been set up. I need to set up SASL ASAP but none of the > guides I've found seem to work. I recommend reading over these guides and doing outside research to fill in any blanks: * https://www.linode.com/docs/email/postfix/email-with-postfix-dovecot-and-mysql * https://workaround.org/ispmail * http://wiki2.dovecot.org/Authentication/PasswordSchemes They walk you through setting up SASL for Postfix which uses Dovecot for auth. Dovecot in turn uses a MySQL database that you put together, but Dovecot supports many other auth sources such as LDAP that might be more relevant to your setup. It's worth mentioning (although you probably already know this) to double-check any recommendations you find in guides against official docs when it comes to security practices. For example, one guide recommends using the MD5 hashing algorithm (without a salt) to store passwords. I'm (very) far from being a security expert, but I recommend you research an alternative hashing scheme if you're setting up an auth source from scratch. From austin.einter at gmail.com Tue Oct 21 15:44:40 2014 From: austin.einter at gmail.com (Austin Einter) Date: Tue, 21 Oct 2014 21:14:40 +0530 Subject: Dovecot Auth Issue Message-ID: Dear All I have been able to setup postfix and dovecot. Through command line, I can send mail out. Now I have installed roundcube in mail server side, and I am able to access like https://mydomain/webmail.com Login was failing. Then I debugged and modified settings in dovecot and using PAM for authentication. Now I trying to login to email server. I am not sure if authentication by dovecot and pam is successful. I enabled logging for dovecot. The below logs I get when a user "try" logs in. Oct 21 07:44:55 auth: Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Oct 21 07:44:55 auth: Debug: Module loaded: /usr/lib/dovecot/modules/auth/libdriver_mysql.so Oct 21 07:44:55 auth: Debug: auth client connected (pid=15357) Oct 21 07:44:55 auth: Debug: client in: AUTH 1 PLAIN service=imap secured lip=128.199.214.27 rip=128.199.214.27 lport=993 rport=43323 resp=AHRyeUBsb2FkbXVsdGlwbGllci5jb20AdHJ5MTIz Oct 21 07:44:55 auth-worker: Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Oct 21 07:44:55 auth-worker: Debug: Module loaded: /usr/lib/dovecot/modules/auth/libdriver_mysql.so Oct 21 07:44:55 auth-worker: Debug: pam(try,128.199.214.27): lookup service=dovecot Oct 21 07:44:55 auth-worker: Debug: pam(try,128.199.214.27): #1/1 style=1 msg=Password: Oct 21 07:44:55 auth: Debug: client out: OK 1 user=try Oct 21 07:44:55 auth: Debug: master in: REQUEST 1571291137 15357 1 b3cc155dfd3bb2fd576bfeeceaf1ce3d Oct 21 07:44:55 auth: Debug: passwd(try,128.199.214.27): lookup *Oct 21 07:44:55 auth: Debug: master out: USER 1571291137 try home=/var/mail/ mail=maildir:/var/mail/try system_groups_user=try uid=5001 gid=5001*Oct 21 07:44:55 imap-login: Info: Login: user=, method=PLAIN, rip=128.199.214.27, lip=128.199.214.27, mpid=15361, TLS *Oct 21 07:44:55 imap(try): Info: Disconnected: Logged out bytes=29/399* >From the logs above (in bold), I hope auth is successful, then in last line why it is logging out.., I am confused , not sure if auth is completely successful or not. Kindly experts please help. Best Regards, Austin From barraudu at tiscali.it Tue Oct 21 16:00:37 2014 From: barraudu at tiscali.it (brd) Date: Tue, 21 Oct 2014 18:00:37 +0200 Subject: Proxy problem: "imap-login: Error: proxy(USERNAME): connect(10.x.x.178, 993) failed: Cannot assign requested address (after 0 secs, local=10.x.x.104)" In-Reply-To: <20141016132612.GA16495@sys4.de> References: <20141016132612.GA16495@sys4.de> Message-ID: <20141021160036.GA5119@tiscali.com> Ralf Hildebrandt wrote: [...] > We already optimized: > ---- snip ---- > net.ipv4.tcp_fin_timeout=5 > # down from 30s > net.ipv4.tcp_tw_reuse=1 > net.ipv4.tcp_tw_recycle=1 > # http://redis4you.com/articles.php?id=012&name=Redis+high+traffic+connection+issue just a note on enabling tcp_tw_recycle, it is known to have side-effects and issues when you have lots of connections from the same source IP, such as many clients behind same NAT IP or a reverse proxy see http://vincent.bernat.im/en/blog/2014-tcp-time-wait-state-linux.html -brd From Dovecot-mailing-list at whyaskwhy.org Tue Oct 21 16:18:07 2014 From: Dovecot-mailing-list at whyaskwhy.org (deoren) Date: Tue, 21 Oct 2014 11:18:07 -0500 Subject: What is the correct way to configure the =?UTF-8?Q?mail=5Flocatio?= =?UTF-8?Q?n=20option=20for=20Mailidr=20format=3F?= Message-ID: Short version: What is the correct way to configure the mail_location option for Mailidr format? I've long had it setup this way: mail_location = maildir:/var/vmail/%d/%n based on this guide: https://www.linode.com/docs/email/postfix/email-with-postfix-dovecot-and-mysql Is that correct? Longer version: After upgrading from Dovecot v2.0.x to v2.2.x yesterday I'm coming to the conclusion that I've got it configured wrong. This is probably compounded by my bright idea of explicitly setting the path separator prior to the upgrade like so: separator = . Because we're using Maildir I thought it would be useful to explicitly set the separator value to what the default is for Maildir. I figured this would be a good way to remind myself what the separator is by default. I also figured while I was merging the conf changes between v2.0 and v2.2 I could roll that additional change in also. Looks like that was a bad idea to include unnecessary changes until things had stabilized. I should know better; I was too optimistic for my own good. Here is an example error message I ran into: stat(/var/vmail/example.com/username/.dovecot.lda-dupes/tmp) failed: Not a directory which is nearly identical (other than leading path) to what is shown here: http://www.dovecot.org/list/dovecot/2010-April/048227.html Steffen Kaiser responded with, "You should not (must not) have home == maildir root." That is when I double-checked the guide that I mentioned above and found that I had followed their directions exactly for that conf setting. Looking at some other guides/tutorials shows something more like: mail_location = maildir:/var/vmail/%d/%n/Maildir I assume the latter is how it's supposed to be done? If so, that would explain the problems I've had with Sieve scripts in the past until I explicitly set 'sieve_dir' like so: sieve_dir = /var/vmail/sieve/%d/%n/sieve_dir I did review the official docs here: http://wiki2.dovecot.org/MailLocation/Maildir but I didn't find where it explicitly warns against setting home == maildir root. It should probably be apparent, but it wasn't to me when I first configured that setting. Thanks in advance for your help. If it turns out that the linode.com guide is wrong I'll create a Pull request to have that guide updated. From malucosfe at gmail.com Tue Oct 21 16:40:15 2014 From: malucosfe at gmail.com (Luciano Gabriel Andino) Date: Tue, 21 Oct 2014 13:40:15 -0300 Subject: only inbox folder after courier-imap migration Message-ID: Hello, after courier-dovecot-migrate.pl, the only folder appears in webmail menu is "Inbox". The others still are in Maildir "Maildir/.myfolder" and contains its "dovecot-uidlist" and "dovecot-keywords" files. May I need to edit some file? -- Saludos!! Luciano Andino GNU/Linux user #185103 Santa Fe - Argentina ----------------------------------------------- From me at junc.eu Tue Oct 21 16:44:03 2014 From: me at junc.eu (Benny Pedersen) Date: Tue, 21 Oct 2014 18:44:03 +0200 Subject: What is the correct way to configure the mail_location option for Mailidr format? In-Reply-To: References: Message-ID: <14933980468.280b.d475fad7b14312f5d8424e35e39f7512@junc.eu> On October 21, 2014 6:18:07 PM deoren wrote: > mail_location = maildir:/var/vmail/%d/%n/Maildir > sieve_dir = /var/vmail/sieve/%d/%n/sieve_dir mail_location = maildir:/var/vmail/%d/%n/.maildir sieve_dir = /var/vmail/%d/%n/.sieve More simple, and more easy to tarball backup From r at sys4.de Tue Oct 21 17:00:59 2014 From: r at sys4.de (Ralf Hildebrandt) Date: Tue, 21 Oct 2014 19:00:59 +0200 Subject: Proxy problem: "imap-login: Error: proxy(USERNAME): connect(10.x.x.178, 993) failed: Cannot assign requested address (after 0 secs, local=10.x.x.104)" In-Reply-To: <20141021160036.GA5119@tiscali.com> References: <20141016132612.GA16495@sys4.de> <20141021160036.GA5119@tiscali.com> Message-ID: <20141021170059.GB7741@sys4.de> * brd : > Ralf Hildebrandt wrote: > [...] > > We already optimized: > > ---- snip ---- > > net.ipv4.tcp_fin_timeout=5 > > # down from 30s > > net.ipv4.tcp_tw_reuse=1 > > net.ipv4.tcp_tw_recycle=1 > > # http://redis4you.com/articles.php?id=012&name=Redis+high+traffic+connection+issue > > just a note on enabling tcp_tw_recycle, it is known to have side-effects > and issues when you have lots of connections from the same source IP, such > as many clients behind same NAT IP or a reverse proxy > > see http://vincent.bernat.im/en/blog/2014-tcp-time-wait-state-linux.html Yes, we might want to disable that again. -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From Dovecot-mailing-list at whyaskwhy.org Tue Oct 21 17:04:38 2014 From: Dovecot-mailing-list at whyaskwhy.org (deoren) Date: Tue, 21 Oct 2014 12:04:38 -0500 Subject: What is the correct way to configure the mail_location option for Mailidr format? In-Reply-To: <14933980468.280b.d475fad7b14312f5d8424e35e39f7512@junc.eu> References: <14933980468.280b.d475fad7b14312f5d8424e35e39f7512@junc.eu> Message-ID: <54469226.5040305@whyaskwhy.org> On 10/21/2014 11:44 AM, Benny Pedersen wrote: > On October 21, 2014 6:18:07 PM deoren > wrote: > >> mail_location = maildir:/var/vmail/%d/%n/Maildir >> sieve_dir = /var/vmail/sieve/%d/%n/sieve_dir > > mail_location = maildir:/var/vmail/%d/%n/.maildir > sieve_dir = /var/vmail/%d/%n/.sieve > > More simple, and more easy to tarball backup Thank you for the advice. Can you comment re these two approaches for configuring the 'mail_location' option? I assume the first is simply wrong? mail_location = maildir:/var/vmail/%d/%n mail_location = maildir:/var/vmail/%d/%n/.maildir Also, why do you use the '.maildir' folder name instead of 'Maildir'? Is that so it doesn't appear in the ls output by default? Some other reason perhaps? I agree that having the sieve scripts in a different location than the mail content is less than ideal. When the sieve scripts were originally stored in the /var/vmail/%d/%n directory they showed up within Thunderbird as folders, so to get things working again quickly I made sure to move the sieve scripts completely outside of where the mail content was stored. The cause was likely the 'mail_location' option being misconfigured (assuming that it really is, I'm still trying to nail that down), so once that is resolved I'm planning on moving them back. Thanks for the reply. I'm hoping rearranging the mail content will be just as easy to do. From r at sys4.de Tue Oct 21 18:27:29 2014 From: r at sys4.de (Ralf Hildebrandt) Date: Tue, 21 Oct 2014 20:27:29 +0200 Subject: Properly "locking" a useraccount (on a proxy) Message-ID: <20141021182729.GB15212@sys4.de> I'm preparing a migration of several mailboxes to another machine. The different useraccounts are distributed to different backend machines by means of a dovecot LMTP/IMAP/POP proxy. Proxying is working really well (now that the kernel does as it should). But how can I "lock" a user during migration? The plan is: ============ * lock the user * kick the user (doveadm kick) * migrate mailbox (some rsync magic) * unlock the user again But how would I lock the user? What locking needs to achieve: 1) Disallow IMAP/POP login (that's easy!) 2) defer LMTP delivery somehow (Postfix is talking to dovecot's LMTP server) Because currently, we're seeing dovecot trying local delivery on the proxy machine once an account is locked (probably because LMTP proxying uses passdb lookups, and since that one is failing it's using the userdb lookup?): Oct 21 20:15:27 lmtp(87892): Error: user sys4 at test.invalid: Initialization failed: Namespace '': mkdir(/var/mail/test.invalid/sys4/mdbox/mailboxes) failed: Permission denied (euid=10000(vmail) egid=10000(vmail) missing +w perm: /var/mail, we're not in group 8(mail), dir owned by 0:8 mode=0775) Admittedly, this is somehow working. But it's not very elegant to use a side-effect. Is the a reserved userdb/passwd return value which will let dovecot "tempfail" in a n elegant fashion? -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From r at sys4.de Tue Oct 21 18:37:28 2014 From: r at sys4.de (Ralf Hildebrandt) Date: Tue, 21 Oct 2014 20:37:28 +0200 Subject: Properly "locking" a useraccount (on a proxy) In-Reply-To: <20141021182729.GB15212@sys4.de> References: <20141021182729.GB15212@sys4.de> Message-ID: <20141021183728.GC15212@sys4.de> * Ralf Hildebrandt : > 2) defer LMTP delivery somehow (Postfix is talking to dovecot's LMTP server) I could of course put a mysql: query into postfix which would return user at domain retry: for the "locked" user. But I'm lazy and would prefer a single place / a single query to lock the account -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From bind at enas.net Tue Oct 21 18:50:03 2014 From: bind at enas.net (Urban Loesch) Date: Tue, 21 Oct 2014 20:50:03 +0200 Subject: Properly "locking" a useraccount (on a proxy) In-Reply-To: <20141021183728.GC15212@sys4.de> References: <20141021182729.GB15212@sys4.de> <20141021183728.GC15212@sys4.de> Message-ID: <5446AADB.9090701@enas.net> Hi, Am 21.10.2014 20:37, schrieb Ralf Hildebrandt: > * Ralf Hildebrandt : > >> 2) defer LMTP delivery somehow (Postfix is talking to dovecot's LMTP server) > > I could of course put a mysql: query into postfix which would return > > user at domain retry: > > for the "locked" user. But I'm lazy and would prefer a single place / > a single query to lock the account > Why do you not put the mails on hold in some frontend postfix queue (i think you have) with a check_recipient_access table? We did that during our last migration from an old CGP system. Ok, it's not the elegant way but for us it worked. From dovecot-ml at makomi.de Tue Oct 21 19:01:43 2014 From: dovecot-ml at makomi.de (=?utf-8?Q?Michael_K=C3=B6hler?=) Date: Tue, 21 Oct 2014 21:01:43 +0200 Subject: 2.2.14 and "Panic: file virtual-sync.c" Message-ID: Hi, after upgrading to 2.2.14 (debian wheezy with apt source from rename-it.nl) I?ve got from time to time a panic in virtual plugin. Here are an excerpt from the log file: ---------------------------------- Oct 21 20:44:15 mailserver dovecot: imap(michael at DOMAIN): flag_change: box=Virtual.Ungelesen, uid=1, msgid=<54466F71.3050702 at makomi.de>, size=1661, flags=(\Seen \Draft \Recent) Oct 21 20:44:15 mailserver dovecot: imap(michael at DOMAIN): Panic: file virtual-sync.c: line 1115 (virtual_sync_backend_box): assertion failed: (array_count(&bbox->sync_pending_removes) == 0) Oct 21 20:44:15 mailserver dovecot: imap(michael at DOMAIN): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x752af) [0x7f5f2630e2af] -> /usr/lib/dovecot/libdovecot .so.0(+0x7530e) [0x7f5f2630e30e] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f5f262c05de] -> /usr/lib/dovecot/modules/lib20_virtual_plugin.so(virtual_storage_sync_init+0x266c ) [0x7f5f24abb9cc] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x35) [0x7f5f26601195] -> dovecot/imap(imap_sync_init+0x7a) [0x41faaa] -> dovecot/imap(cmd_sync_dela yed+0x190) [0x420710] -> dovecot/imap(client_handle_input+0x1d5) [0x417a35] -> dovecot/imap(client_input+0x72) [0x417d22] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x5b) [ 0x7f5f263200fb] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xbb) [0x7f5f2632117b] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x9) [0x7f5f26320189] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f5f26320208] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f5f262c5ab3] -> dovecot/imap(main+0x2a1) [0x 40c311] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xfd) [0x7f5f25f2bead] -> dovecot/imap() [0x40c475] Oct 21 20:44:15 mailserver dovecot: imap(michael at DOMAIN): Fatal: master: service(imap): child 31075 killed with signal 6 (core dumps disabled) ????????????????? Are the problem well-known? And what could I do? Thanks, Michael From lbinotto at sidor.com Tue Oct 21 19:26:58 2014 From: lbinotto at sidor.com (BINOTTO Luis SIDOR) Date: Tue, 21 Oct 2014 14:56:58 -0430 Subject: Multiple user attributes in LDAP userdb query strings Message-ID: <053764CC50A02440B7A5626084822F2A0108FBD8@sirprdexh1.sidor.net> Hello list, I have an issue with dovecot and Ldap... Any help will be grateful... I have my virtual users stored in an Active Directory database. I am using 2 attributes in AD to locate the user account: mail (their primary email address) and proxyAddresses (a multivalue attribute containing their mail aliases). I also control the mount point in which the mail is located with another attribute in AD, in this case I used "pager". I have dovecot 1.2.15 and there are no immediate plans to upgrade it. I configured Dovecot's deliver process in order to integrate sieve capability. I have configured userdb ldap and passdb ldap in Dovecot and have set up master and client sockets. I am using maildir format for directory layout. The problem is to set the variables home and mail that will define the mail location. The format must be like this: home: /Mailboxes/// mail: /Mailboxes///Maildir So, for a particular user (Login: user1, smtp: user1 at domain1.com, alias smtp: user1_alias at domain1.com) the variables will be: home: /Mailboxes/AdmUsers/user1/ mail: /Mailboxes/AdmUsers/user1/Maildir Active Directory has the values in: mail:(user1 at domain1.com), proxyAddresses:(user1_alias at domain1.com), sAMAaccountName(user1). I have defined home and mail in dovecot-ldap.conf. # User attributes are given in LDAP-name=dovecot-internal-name list. The # internal names are: # uid - System UID # gid - System GID # home - Home directory # mail - Mail location # # There are also other special fields which can be returned, see # http://wiki.dovecot.org/UserDatabase/ExtraFields user_attrs = pager=home=/mailboxes/%$/%u,mobile=quota_rule=*:storage=%$M If the mail is sent to the Principal SMTP (user1 at domain1.com) in which the user part (%u) is the same as sAMAccountName, it works. The variable home is set correctly (home: /Mailboxes/AdmUsers/user1/). The problem is when the mail is sent to the smtp alias, in which the variable home is set incorrectly (home: /Mailboxes/AdmUsers/user1_alias/). There is a way to set two values to user_attrs?, in this case I would need to set pager and sAMAccountName (instead of %u), to it. Thanking you in anticipation... Attached is the out of dovecot -n # 1.2.15: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-686 i686 Debian 6.0.7 log_path: /var/log/dovecot.log protocols: imap imaps pop3 pop3s disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login mail_uid: 16343 mail_gid: 16343 mail_location: maildir:~/Maildir mail_debug: yes mbox_write_locks: fcntl dotlock mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_plugins(default): autocreate deleted_to_trash quota imap_quota expire mail_plugins(imap): autocreate deleted_to_trash quota imap_quota expire mail_plugins(pop3): quota expire mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 imap_client_workarounds(default): delay-newmail outlook-idle netscape-eoh imap_client_workarounds(imap): delay-newmail outlook-idle netscape-eoh imap_client_workarounds(pop3): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh lda: postmaster_address: postmaster at domain1.com mail_plugins: quota expire log_path: /var/log/dovecot.log auth default: mechanisms: gssapi gss-spnego login ntlm plain username_format: %Ln use_winbind: yes passdb: driver: pam userdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: vmail plugin: autocreate: Deleted Items autocreate: Sent Items autosubscribe: Deleted Items autosubscribe: Sent Items deleted_to_trash_folder: Sent Items quota: maildir:User quota quota_rule: *:storage=100M quota_rule2: Deleted Items:ignore quota_warning: storage=80%% /etc/dovecot/scripts/quota-warning.sh 80 quota_warning2: storage=90%% /etc/dovecot/scripts/quota-warning.sh 90 quota_warning3: storage=99%% /etc/dovecot/scripts/quota-exceeded.sh 100 expire: "Deleted Items" 1 "Deleted Items/*" 1 expire_dict: proxy::expire dict: expire: pgsql:/etc/dovecot/dovecot-dict-expire.conf " Notificacion Automatica: Este mensaje y cualquier archivo que se adjunte contiene informacion privilegiada y confidencial. Es para uso exclusivo del destinatario. Si usted ha recibido esta comunicacion por error, por favor avisenos inmediatamente. Automatic notification: This e-mail and any file transmitted with it are confidential and may be legally privileged. It is intended solely for the addressee and may not be disclosed to or used by anyone other than the addressee. If you have received this e-mail by mistake , please advise the sender immediately" From rs at sys4.de Tue Oct 21 19:46:54 2014 From: rs at sys4.de (Robert Schetterer) Date: Tue, 21 Oct 2014 21:46:54 +0200 Subject: Properly "locking" a useraccount (on a proxy) In-Reply-To: <20141021183728.GC15212@sys4.de> References: <20141021182729.GB15212@sys4.de> <20141021183728.GC15212@sys4.de> Message-ID: <5446B82E.4060300@sys4.de> Am 21.10.2014 um 20:37 schrieb Ralf Hildebrandt: > * Ralf Hildebrandt : > >> 2) defer LMTP delivery somehow (Postfix is talking to dovecot's LMTP server) > > I could of course put a mysql: query into postfix which would return > > user at domain retry: > > for the "locked" user. But I'm lazy and would prefer a single place / > a single query to lock the account > in sql postfixadmin schema there is an "active" flag 0 vs 1 per user smtpd_recipient_restrictions = reject_unknown_recipient_domain, reject_non_fqdn_recipient, permit_mynetworks, check_recipient_access mysql:/etc/postfix/mysql_virtual_inactive_mailaddress.cf i use configured it as query = SELECT CONCAT('REJECT mailaddress %s is set in inactive mode') address FROM mailbox WHERE username='%s' AND active = '0' you may use not REJECT but http://www.postfix.org/access.5.html 421 text (Postfix 2.3 and later) which is tmp error dovecot site may look like this /etc/dovecot/dovecot-sql.conf.ext password_query = SELECT username as user, password, \ 1001 as userdb_uid, \ 1001 as userdb_gid, \ "/usr/local/virtual/%d/%u/" AS userdb_home, \ "maildir:/usr/local/virtual/%d/%u/" AS userdb_mail \ FROM mailbox WHERE username = '%u' AND active = '1' but to be honest, its a long time ago i tested this feature, and in real world nobody seems to use "active" settings however perhaps you can adapt this idea to fit in your setup somehow Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From damien at desfontain.es Sun Oct 19 19:05:39 2014 From: damien at desfontain.es (Damien Desfontaines) Date: Sun, 19 Oct 2014 21:05:39 +0200 Subject: Permissions for shared mail don't work In-Reply-To: <54437BEB.4030407@smail.inf.fh-brs.de> References: <20141016223305.GC17848@K3PO.thurnes.local> <20141017214057.GD17848@K3PO.thurnes.local> <544265B6.8030504@smail.inf.fh-brs.de> <20141018130758.GE17848@K3PO.thurnes.local> <54437BEB.4030407@smail.inf.fh-brs.de> Message-ID: <20141019190539.GG17848@K3PO.thurnes.local> On Sun, Oct 19, 2014 at 10:52:59AM +0200, Steffen wrote: > >> how do you deliver new messages to spam's INBOX? > > > > By sending an e-mail to spam.whatever at desfontain.es ? > > > > (I'm not sure I understand the question?) > > > > How does your MTA deliver the messages to the INBOX, do you use > Dovecor LDA, LMTP or the MTA? The MTA itself delivers it, I think. Here are my config files?: - http://paste.fulltxt.net/xx31R (/etc/postfix/main.cf) - and http://paste.fulltxt.net/t9iXRBIH (/etc/postfix/master.cf) Best, Damien -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 213 bytes Desc: Digital signature URL: From damien at desfontain.es Sun Oct 19 19:05:39 2014 From: damien at desfontain.es (Damien Desfontaines) Date: Sun, 19 Oct 2014 21:05:39 +0200 Subject: Permissions for shared mail don't work In-Reply-To: <54437BEB.4030407@smail.inf.fh-brs.de> References: <20141016223305.GC17848@K3PO.thurnes.local> <20141017214057.GD17848@K3PO.thurnes.local> <544265B6.8030504@smail.inf.fh-brs.de> <20141018130758.GE17848@K3PO.thurnes.local> <54437BEB.4030407@smail.inf.fh-brs.de> Message-ID: <20141019190539.GG17848@K3PO.thurnes.local> On Sun, Oct 19, 2014 at 10:52:59AM +0200, Steffen wrote: > >> how do you deliver new messages to spam's INBOX? > > > > By sending an e-mail to spam.whatever at desfontain.es ? > > > > (I'm not sure I understand the question?) > > > > How does your MTA deliver the messages to the INBOX, do you use > Dovecor LDA, LMTP or the MTA? The MTA itself delivers it, I think. Here are my config files?: - http://paste.fulltxt.net/xx31R (/etc/postfix/main.cf) - and http://paste.fulltxt.net/t9iXRBIH (/etc/postfix/master.cf) Best, Damien -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 213 bytes Desc: Digital signature URL: From me at junc.eu Tue Oct 21 20:53:53 2014 From: me at junc.eu (Benny Pedersen) Date: Tue, 21 Oct 2014 22:53:53 +0200 Subject: What is the correct way to configure the mail_location option for Mailidr format? In-Reply-To: <54469226.5040305@whyaskwhy.org> References: <14933980468.280b.d475fad7b14312f5d8424e35e39f7512@junc.eu> <54469226.5040305@whyaskwhy.org> Message-ID: <149347cc6e8.280b.d475fad7b14312f5d8424e35e39f7512@junc.eu> On October 21, 2014 7:04:38 PM deoren wrote: > On 10/21/2014 11:44 AM, Benny Pedersen wrote: > > On October 21, 2014 6:18:07 PM deoren > > wrote: > > > >> mail_location = maildir:/var/vmail/%d/%n/Maildir > >> sieve_dir = /var/vmail/sieve/%d/%n/sieve_dir > > > > mail_location = maildir:/var/vmail/%d/%n/.maildir > > sieve_dir = /var/vmail/%d/%n/.sieve > > > > More simple, and more easy to tarball backup > > Thank you for the advice. Can you comment re these two approaches for > configuring the 'mail_location' option? I assume the first is simply wrong? > > mail_location = maildir:/var/vmail/%d/%n > mail_location = maildir:/var/vmail/%d/%n/.maildir > > Also, why do you use the '.maildir' folder name instead of 'Maildir'? Is > that so it doesn't appear in the ls output by default? Some other reason > perhaps? > > I agree that having the sieve scripts in a different location than the > mail content is less than ideal. When the sieve scripts were originally > stored in the /var/vmail/%d/%n directory they showed up within > Thunderbird as folders, so to get things working again quickly I made > sure to move the sieve scripts completely outside of where the mail > content was stored. > > The cause was likely the 'mail_location' option being misconfigured > (assuming that it really is, I'm still trying to nail that down), so > once that is resolved I'm planning on moving them back. > > Thanks for the reply. I'm hoping rearranging the mail content will be > just as easy to do. I just remember to use $HOME or ~ fetched here from mysql or static args, thus all none existing temp dirs will not be a problem, and it fits with maildrop and procmail, still running dovecot 1.2.17 with gentoo So $HOME/.maildir $HOME/.sieve Yes it will hide dirs in ls, but you can list hidded dirs with a option From me at junc.eu Tue Oct 21 21:02:34 2014 From: me at junc.eu (Benny Pedersen) Date: Tue, 21 Oct 2014 23:02:34 +0200 Subject: Properly "locking" a useraccount (on a proxy) In-Reply-To: <20141021183728.GC15212@sys4.de> References: <20141021182729.GB15212@sys4.de> <20141021183728.GC15212@sys4.de> Message-ID: <1493484b628.280b.d475fad7b14312f5d8424e35e39f7512@junc.eu> > for the "locked" user. But I'm lazy and would prefer a single place / > a single query to lock the account Setup postfix to check the recipient account is active, then set a temp new password while move mail to the new server, when its done change password back to user, and setup postfix to know its active again From chayes at afo.net Tue Oct 21 21:28:46 2014 From: chayes at afo.net (Cliff Hayes) Date: Tue, 21 Oct 2014 16:28:46 -0500 Subject: dictionary attack defense Message-ID: <5446D00E.8050702@afo.net> Does dovecot have any dictionary attack defenses yet? In the past I have had to implement defense from outside dovecot, but since dovecot is at the front lines and therefore is the first to know I'm hoping by now there is something we can set. For example, a limit on access failures per minut/hour/day or some such. If not why not? From h.reindl at thelounge.net Tue Oct 21 22:02:20 2014 From: h.reindl at thelounge.net (Reindl Harald) Date: Wed, 22 Oct 2014 00:02:20 +0200 Subject: dictionary attack defense In-Reply-To: <5446D00E.8050702@afo.net> References: <5446D00E.8050702@afo.net> Message-ID: <5446D7EC.4010303@thelounge.net> Am 21.10.2014 um 23:28 schrieb Cliff Hayes: > Does dovecot have any dictionary attack defenses yet? > In the past I have had to implement defense from outside dovecot, but > since dovecot is at the front lines and therefore is the first to know > I'm hoping by now there is something we can set. For example, a limit > on access failures per minut/hour/day or some such. If not why not? no - but you can set "auth_failure_delay = 5" and limit new connections per IP to something around 40 per 5 minutes and 100 per 30 minutes which stops many of them or at least limit the amount of tries dramatically -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 181 bytes Desc: OpenPGP digital signature URL: From wegge at wegge.dk Tue Oct 21 22:57:34 2014 From: wegge at wegge.dk (Anders Wegge Keller) Date: Wed, 22 Oct 2014 00:57:34 +0200 Subject: dictionary attack defense In-Reply-To: <5446D00E.8050702@afo.net> References: <5446D00E.8050702@afo.net> Message-ID: <20141022005734.7f6ee29d@wegge.dk> On Tue, 21 Oct 2014 16:28:46 -0500 Cliff Hayes wrote: > Does dovecot have any dictionary attack defenses yet? > In the past I have had to implement defense from outside dovecot, but > since dovecot is at the front lines and therefore is the first to know > I'm hoping by now there is something we can set. For example, a limit > on access failures per minut/hour/day or some such. If not why not? In my opinion, fail2ban is the right strategy to deal with a dictionary attack. Instead of adding a layer of attack detection and handling onto every outward facing service running on your server, you can centralize the detection and blocking at one place. -- //Wegge From me at junc.eu Tue Oct 21 23:12:02 2014 From: me at junc.eu (Benny Pedersen) Date: Wed, 22 Oct 2014 01:12:02 +0200 Subject: dictionary attack defense In-Reply-To: <20141022005734.7f6ee29d@wegge.dk> References: <5446D00E.8050702@afo.net> <20141022005734.7f6ee29d@wegge.dk> Message-ID: <14934fb41d0.280b.d475fad7b14312f5d8424e35e39f7512@junc.eu> On October 22, 2014 12:57:34 AM Anders Wegge Keller wrote: > On Tue, 21 Oct 2014 16:28:46 -0500 > Cliff Hayes wrote: > > Does dovecot have any dictionary attack defenses yet? > In my opinion, fail2ban is the right strategy to deal with a dictionary > attack. Fokus should just be reversed to allow ip ranges not deny ip ranges From wegge at wegge.dk Tue Oct 21 23:16:45 2014 From: wegge at wegge.dk (Anders Wegge Keller) Date: Wed, 22 Oct 2014 01:16:45 +0200 Subject: dictionary attack defense In-Reply-To: <14934fb41d0.280b.d475fad7b14312f5d8424e35e39f7512@junc.eu> References: <5446D00E.8050702@afo.net> <20141022005734.7f6ee29d@wegge.dk> <14934fb41d0.280b.d475fad7b14312f5d8424e35e39f7512@junc.eu> Message-ID: <20141022011645.1537d883@wegge.dk> On Wed, 22 Oct 2014 01:12:02 +0200 Benny Pedersen wrote: > On October 22, 2014 12:57:34 AM Anders Wegge Keller wrote: > > > On Tue, 21 Oct 2014 16:28:46 -0500 > > Cliff Hayes wrote: > > > Does dovecot have any dictionary attack defenses yet? > > In my opinion, fail2ban is the right strategy to deal with a dictionary > > attack. > > Fokus should just be reversed to allow ip ranges not deny ip ranges Even if you have the luxury of not having users accessing their mail from all over the world, you still need to defend against a breach of safety on a legitimate users machine. Even in a strongly restricted corporate environment. -- //Wegge From h.reindl at thelounge.net Tue Oct 21 23:38:43 2014 From: h.reindl at thelounge.net (Reindl Harald) Date: Wed, 22 Oct 2014 01:38:43 +0200 Subject: dictionary attack defense In-Reply-To: <14934fb41d0.280b.d475fad7b14312f5d8424e35e39f7512@junc.eu> References: <5446D00E.8050702@afo.net> <20141022005734.7f6ee29d@wegge.dk> <14934fb41d0.280b.d475fad7b14312f5d8424e35e39f7512@junc.eu> Message-ID: <5446EE83.1010905@thelounge.net> Am 22.10.2014 um 01:12 schrieb Benny Pedersen: > On October 22, 2014 12:57:34 AM Anders Wegge Keller wrote: > >> On Tue, 21 Oct 2014 16:28:46 -0500 >> Cliff Hayes wrote: >> > Does dovecot have any dictionary attack defenses yet? >> In my opinion, fail2ban is the right strategy to deal with a dictionary >> attack. > > Fokus should just be reversed to allow ip ranges not deny ip ranges *loool* -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 181 bytes Desc: OpenPGP digital signature URL: From chayes at afo.net Wed Oct 22 03:59:18 2014 From: chayes at afo.net (Cliff Hayes) Date: Tue, 21 Oct 2014 22:59:18 -0500 Subject: dictionary attack defense In-Reply-To: <5446D7EC.4010303@thelounge.net> References: <5446D00E.8050702@afo.net> <5446D7EC.4010303@thelounge.net> Message-ID: <54472B96.3060200@afo.net> a) I read about auth_failure_delay even before I posted my question and I could not figure out the one-line explanation in the dovecot wiki: "Number of seconds to delay before replying to failed authentications." It's delaying a reply. Does that mean the hacker can keep asking as fast as he wants? Is it per user or per IP? b) I'm familiar with mail_max_userip_connections = x, but I'm not familiar with the time limit you mention. On 10/21/2014 5:02 PM, Reindl Harald wrote: > > > Am 21.10.2014 um 23:28 schrieb Cliff Hayes: >> Does dovecot have any dictionary attack defenses yet? >> In the past I have had to implement defense from outside dovecot, but >> since dovecot is at the front lines and therefore is the first to know >> I'm hoping by now there is something we can set. For example, a limit >> on access failures per minut/hour/day or some such. If not why not? > > no - but you can set "auth_failure_delay = 5" and limit new connections > per IP to something around 40 per 5 minutes and 100 per 30 minutes which > stops many of them or at least limit the amount of tries dramatically > > > From eric at ericabrahamsen.net Wed Oct 22 04:32:01 2014 From: eric at ericabrahamsen.net (Eric Abrahamsen) Date: Wed, 22 Oct 2014 12:32:01 +0800 Subject: authenticate plain, and virtual users Message-ID: <87wq7sd8se.fsf@ericabrahamsen.net> I'm running dovecot 2.2.14 on Archlinux. I've been using it with the isync syncing utility for quite some time with no problems, using the LOGIN authentication mechanism. Recently Isync was updated to support PLAIN, and I'm having trouble moving to that. The authenticate string that isync is sending is not the one that dovecot is expecting. I suspect this is because of how I have virtual users set up on my machine. This is a personal laptop, no other users, and so I didn't want to go through the rigmarole of creating more system users just for mail accounts. I also wanted everything stored under my home directory. So my dovecot config looks like this: # 2.2.14: /etc/dovecot/dovecot.conf # OS: Linux 3.16.4-1-ARCH i686 auth_verbose = yes disable_plaintext_auth = no info_log_path = /var/log/dovecot-info.log log_path = /var/log/dovecot.log mail_plugins = " fts fts_lucene" passdb { args = username_format=%u /etc/dovecot/passwd driver = passwd-file } plugin { fts = lucene fts_autoindex = yes fts_lucene = whitespace_chars=@. } protocols = imap ssl = no userdb { args = uid=eric gid=users home=/home/eric/.mail/%d/%n username_format=%u default_fields = mail=maildir:/home/eric/.mail/%d/%n/mail driver = static } My /etc/dovecot/passwd looks like this: eric at ericabrahamsen.net:{PLAIN}password1 eric at paper-republic.org:{PLAIN}password2 When isync tries to log into the local dovecot using PLAIN, it sends the base64-encoded version of this string: eric at paper-republic.org\0eric\0password2 With my current dovecot config, telnet experimentation shows that dovecot will accept either of these two: \0eric at paper-republic.org\0password2 eric at paper-republic.org\0eric at paper-republic.org\0password2 Ie, either with or without the authorization ID, just like it says at http://wiki2.dovecot.org/Debugging/Authentication Given that I'm unlikely to be able to change how isync sends the string (and that it's really doing the right thing), are there alterations I can make to my dovecot config to get it to accept the authenticate string that isync is sending? Ideally, can I do that without having to set up system users? I've already tried using the other fields in the passwd file, putting "eric" and "eric at paper-republic.org" into the UID fields, just in case. No dice. Thanks in advance for any advice! Eric From skdovecot at smail.inf.fh-brs.de Wed Oct 22 07:29:25 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Wed, 22 Oct 2014 09:29:25 +0200 (CEST) Subject: What is the correct way to configure the mail_location option for Mailidr format? In-Reply-To: References: Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Tue, 21 Oct 2014, deoren wrote: > What is the correct way to configure the mail_location option for Mailidr > format? mail_location = maildir: > I've long had it setup this way: > > mail_location = maildir:/var/vmail/%d/%n > > Is that correct? any path is OK, as long: 1) it identifies the mail storage uniquely for the user, 2) does not store any other information in it. > Here is an example error message I ran into: > > stat(/var/vmail/example.com/username/.dovecot.lda-dupes/tmp) failed: Not > a directory That's because you use $HOME == Maildir root. > Looking at some other guides/tutorials shows something more like: > > mail_location = maildir:/var/vmail/%d/%n/Maildir "Maildir" is the default name for "Maildir"-type mail storeage root. No more, no less. If Dovecot is automatically detecting the type of storage, it probes for this directory name in $HOME. > I assume the latter is how it's supposed to be done? If so, that would No, you are not "supposed" to do so. > I did review the official docs here: > > http://wiki2.dovecot.org/MailLocation/Maildir > > but I didn't find where it explicitly warns against setting home == maildir > root. It should probably be apparent, but it wasn't to me when I first it applies to all mail storages. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBVEdc13z1H7kL/d9rAQIoSAf/WwdI10EmJbVfDGz+UJgE44kmNjicpiVt DJlkQyYp66s955UmepLMXfvRSZ5KeCAVOXZs1Oe1LYTKqmjzIOyFGBjDcoYGfIIV 6nEABpWUGTHjEuCpGfY/IvFlFE1gYUojKC2zrTFk1P3brvZ3nIBMrZ6hEOjh3bQJ 3m0SsOuu+9ZYvSxNt2EaVa7EkbTZdmLRN1K21JUDDoTXJ+myMsT3z2gJF+Gnr6Cr IppGlYRmVfSQ9E3Kpq7RxoJ4O29uIJa+dWB2fJYsctGxFrR4q6v6yZ//UuZWSrDo 7sdZUaugq2Y7nlimZKhsqsa/ly6AFlSfpto/Cc7AG7JEqpIG2vJKLw== =lNuJ -----END PGP SIGNATURE----- From h.reindl at thelounge.net Wed Oct 22 08:55:26 2014 From: h.reindl at thelounge.net (Reindl Harald) Date: Wed, 22 Oct 2014 10:55:26 +0200 Subject: dictionary attack defense In-Reply-To: <54472B96.3060200@afo.net> References: <5446D00E.8050702@afo.net> <5446D7EC.4010303@thelounge.net> <54472B96.3060200@afo.net> Message-ID: <544770FE.5000006@thelounge.net> Am 22.10.2014 um 05:59 schrieb Cliff Hayes: > a) I read about auth_failure_delay even before I posted my question and > I could not figure out the one-line explanation in the dovecot wiki: > "Number of seconds to delay before replying to failed authentications." > It's delaying a reply. Does that mean the hacker can keep asking as > fast as he wants? Is it per user or per IP? it does not help him to ask fast he needs responses too and can't open endless connections parallel > b) I'm familiar with mail_max_userip_connections = x, but I'm not > familiar with the time limit you mention. iptables 0 0 REJECT tcp -- eth0 * !192.168.196/24 0.0.0.0/0 multiport dports 110,143,993,995 ctstate NEW recent: UPDATE seconds: 1800 hit_count: 100 name: dovecot2 side: source mask: 255.255.255.255 reject-with icmp-port-unreachable 4 256 REJECT tcp -- eth0 * !192.168.196/24 0.0.0.0/0 multiport dports 110,143,993,995 ctstate NEW recent: UPDATE seconds: 300 hit_count: 50 name: dovecot1 side: source mask: 2 55.255.255.255 reject-with icmp-port-unreachable 0 0 REJECT tcp -- eth0 * !192.168.196/24 0.0.0.0/0 multiport dports 25,465,587 ctstate NEW recent: UPDATE seconds: 1800 hit_count: 75 name: postfix2 side: source mask: 255.2 55.255.255 reject-with icmp-port-unreachable 9 448 REJECT tcp -- eth0 * !192.168.196/24 0.0.0.0/0 multiport dports 25,465,587 ctstate NEW recent: UPDATE seconds: 300 hit_count: 40 name: postfix1 side: source mask: 255.25 5.255.255 reject-with icmp-port-unreachable 0 0 DROP udp -- eth0 * !192.168.196/24 0.0.0.0/0 ctstate NEW recent: UPDATE seconds: 2 hit_count: 75 name: udpflood side: source mask: 255.255.255.255 0 0 DROP tcp -- eth0 * !192.168.196/24 0.0.0.0/0 ctstate NEW recent: UPDATE seconds: 2 hit_count: 75 name: DEFAULT side: source mask: 255.255.255.255 0 0 DROP tcp -- eth0 * !192.168.196/24 0.0.0.0/0 multiport dports 25,80,443,465,587 tcp flags:0x17/0x02 #conn src/32 > 75 0 0 DROP tcp -- eth0 * !192.168.196/24 0.0.0.0/0 multiport dports 25,80,443,465,587 tcp flags:0x17/0x02 #conn src/24 > 150 0 0 DROP tcp -- eth0 * !192.168.196/24 0.0.0.0/0 multiport dports 25,80,443,465,587 tcp flags:0x17/0x02 #conn src/16 > 175 0 0 DROP tcp -- eth0 * !192.168.196/24 0.0.0.0/0 multiport dports 25,80,443,465,587 tcp flags:0x17/0x02 #conn src/8 > 200 > On 10/21/2014 5:02 PM, Reindl Harald wrote: >> >> >> Am 21.10.2014 um 23:28 schrieb Cliff Hayes: >>> Does dovecot have any dictionary attack defenses yet? >>> In the past I have had to implement defense from outside dovecot, but >>> since dovecot is at the front lines and therefore is the first to know >>> I'm hoping by now there is something we can set. For example, a limit >>> on access failures per minut/hour/day or some such. If not why not? >> >> no - but you can set "auth_failure_delay = 5" and limit new connections >> per IP to something around 40 per 5 minutes and 100 per 30 minutes which >> stops many of them or at least limit the amount of tries dramatically -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 181 bytes Desc: OpenPGP digital signature URL: From lists at xunil.at Wed Oct 22 09:35:12 2014 From: lists at xunil.at (Stefan G. Weichinger) Date: Wed, 22 Oct 2014 11:35:12 +0200 Subject: Public mailbox confusion Message-ID: <54477A50.3040405@xunil.at> greets, I am quite sure I ask some faq here ... sorry, but I am confused by the many options and choices here. What I want to do is: I migrate lots of public folders from a MS Exchange Server ... The customer wants that there is a "Public" folder containing all these hundreds of folders, the public folder should be visible for all the dovecot-users and all the subfolders should be automatically subscribed as soon a new user logs in. What I have now: namespace { type = private separator = / prefix = inbox = yes } namespace { type = public separator = / prefix = Public/ location = maildir:/home/vmail/public:INDEXPVT=/home/vmail/public/index/%d/%u/index subscriptions = yes } As far as I see from testing this doesn't yet work that way. When I open the mailbox with eg. roundcube I see "Public" but nothing below it ... Could someone please give me a good pointer here? Thanks! Stefan From skdovecot at smail.inf.fh-brs.de Wed Oct 22 09:42:47 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Wed, 22 Oct 2014 11:42:47 +0200 (CEST) Subject: Public mailbox confusion In-Reply-To: <54477A50.3040405@xunil.at> References: <54477A50.3040405@xunil.at> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Wed, 22 Oct 2014, Stefan G. Weichinger wrote: > The customer wants that there is a "Public" folder containing all these > hundreds of folders, the public folder should be visible for all the > dovecot-users and all the subfolders should be automatically subscribed > as soon a new user logs in. I dunno if the "automatically subscribed" can be achieved. > namespace { > type = private > separator = / > prefix = > inbox = yes > } > > namespace { > type = public > separator = / > prefix = Public/ > location = > maildir:/home/vmail/public:INDEXPVT=/home/vmail/public/index/%d/%u/index > subscriptions = yes > } > > As far as I see from testing this doesn't yet work that way. > > When I open the mailbox with eg. roundcube I see "Public" but nothing > below it ... How does ls -al /home/vmail/public look like? This is _one_ Maildir storage, hence, all mailboxes have to comply to its naming convention: .mailbox1.sub1-1.sub1-2, ..., .mailbox2.sub2-1.sub2-1, ... . Do you have errors in the Dovecot logs? - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBVEd8GHz1H7kL/d9rAQIbZAgArZOP6aDO2Zb6++mggaVn+8khLMLpZ8Ey hYxoFM4x5ts9ZYLQr+3Hjmt5oGCJjuBMab4J3rCqi2Bq3DgwQH4JcckPo0pNFS3S OVVbVgVr8MjYIXtGlSuC9H8AOIC65jHVI01pZTK9uYtSWHtQVcB8+E29nFZHrDhD ZmQ4EtPCg/x0G/7um/CQzTi1NFGGJ+4tFezwbA1tXcGXz9xV7q3Ch1uOsZ2MpDgx 3Yq5OIBz+Vrj3yRLpPMFDQhri05nLBzZ6ZalgtYPKCQWUuWIzlZzljxeP6ZGAvrt YY5E1q0isTLH+JHHNSjcLJ8aN8cTxWdgt4QT31EOhFXZuAAIOejCCQ== =ttiZ -----END PGP SIGNATURE----- From lists at xunil.at Wed Oct 22 09:47:48 2014 From: lists at xunil.at (Stefan G. Weichinger) Date: Wed, 22 Oct 2014 11:47:48 +0200 Subject: Public mailbox confusion In-Reply-To: References: <54477A50.3040405@xunil.at> Message-ID: <54477D44.5020506@xunil.at> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Am 22.10.2014 um 11:42 schrieb Steffen Kaiser: > I dunno if the "automatically subscribed" can be achieved. oh ... >> When I open the mailbox with eg. roundcube I see "Public" but >> nothing below it ... > > How does ls -al /home/vmail/public look like? This is _one_ Maildir > storage, hence, all mailboxes have to comply to its naming > convention: .mailbox1.sub1-1.sub1-2, ..., .mailbox2.sub2-1.sub2-1, > ... . Do you have errors in the Dovecot logs? oh, I have a mistake in my plans ;-) I haven't yet moved the stuff in there fully, I see now ... I synced the exchange-account of user1 to dummy at tld.com on the dovecot, including the "?ffentliche Ordner" ... this took until 1am or so and I haven't yet moved these folders to the correct location within "Public". May I simply do a "mv /home/vmail/tld.com/dummy/.&ANY-ffentliche Ordner* /home/vmail/public" ? S -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iQIcBAEBAgAGBQJUR31EAAoJEClcuD1V0PzmNCIP/3T8JtDEY6+j3xk8r6OnIleF mzEM4jBxt/Y18LaInV21qL6GHDkJ5c+TOC1euOvOxlaq2d/8eVvLd5fxvv+Q0ihk q7ieMkMii/4UdkRTida1fUeYlIdAGCwGZPQuKpCXH63SJ9HmloVwFUTU4V6ioBnW NxcKyPpCy0X37HigePuwQw2Wja/Q7krz4DHtXIbpQuZWQq51ByBT+e0nj4Zq39FS hnYdccm9ZDYRUSU2JfMWV6oeC8OKEM3HZhx1G+qs+JucHD5I06JU+zHDDSOhYvTJ wq3W4G4E/TQjc3QuxmClAcxh1IpMTaSqsCrhlfg4mkyIkMCzlJBGlqFLLo8sb1oS T62pnmcoNgJUec8EWWGaJkxGNLa8luMJwaQqUeuepmxWgYuMvJpw/9E1icSMnrmn bwtZ2dPW1jzVKe+mIQ4zbeE7XU71g0ep+7i1mBXkLTNmBd9Y01Hquv2EqPZ6q7k/ G4lp57duK7eIlRyRzRtri4kpfy8hkFuhEEPfzL0F5NiQFLWj8NW6ZbwtaXBhGntu g2DAXQNwxuGbBGA9/p5FtfUfbcMdHQw7yb/N8cWF2+2r1Z3RtZAdhyoT7TS12Y1M +RDn1+ECbKgjUBd4Gl0kmtOy/pS5rgavaWFcbdh2Iq7/U6ECIvIwq3Rcw0QmOhwm g5qD547EJwz/DXFlItvW =J4eu -----END PGP SIGNATURE----- From lists at xunil.at Wed Oct 22 09:59:15 2014 From: lists at xunil.at (Stefan G. Weichinger) Date: Wed, 22 Oct 2014 11:59:15 +0200 Subject: Public mailbox confusion In-Reply-To: <54477D44.5020506@xunil.at> References: <54477A50.3040405@xunil.at> <54477D44.5020506@xunil.at> Message-ID: <54477FF3.20803@xunil.at> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Am 22.10.2014 um 11:47 schrieb Stefan G. Weichinger: > Am 22.10.2014 um 11:42 schrieb Steffen Kaiser: > >> I dunno if the "automatically subscribed" can be achieved. > > oh ... > >>> When I open the mailbox with eg. roundcube I see "Public" but >>> nothing below it ... > >> How does ls -al /home/vmail/public look like? This is _one_ >> Maildir storage, hence, all mailboxes have to comply to its >> naming convention: .mailbox1.sub1-1.sub1-2, ..., >> .mailbox2.sub2-1.sub2-1, ... . Do you have errors in the Dovecot >> logs? > > oh, I have a mistake in my plans ;-) > > I haven't yet moved the stuff in there fully, I see now ... > > I synced the exchange-account of user1 to dummy at tld.com on the > dovecot, including the "?ffentliche Ordner" ... this took until 1am > or so and I haven't yet moved these folders to the correct > location within "Public". > > May I simply do a "mv /home/vmail/tld.com/dummy/.&ANY-ffentliche > Ordner* /home/vmail/public" ? synced some folders, yes, now they show up. I am unsure about the "subscriptions" parameter and how to achieve that all the subfolders are visible/subscribed from the start. S -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iQIcBAEBAgAGBQJUR3/zAAoJEClcuD1V0PzmlAQP/jsb6uAITPJwOKi7g4GB7I3Z 7CpfzmEfx4jjNLYRvakOAEbyjriNVZ3QCdBh5KFc+Bk+fhC08P+FYIjJOthHtu/A KqVqpzNIoVzKW91okqU5a+EFgYfDiDm7DISY1YGgvuJwtu5905zpMGFRYX/dxRPO 12ckRvkahDXcnloN7vF/Rdzb+oQagzJU3szIGGKX+KL4xIGiU92mUOBxAWOR/0wt i4YFng6qJzQf3H4I1yQcj7yy+6SvpD0GDwmkJX8E0IAjDMEegKRRCz/HQuwipVzQ PkLuMs8MN4/prDLtamDteVWXwZ3Cv7QhulzlI+z6+mmEQFaiqWCTP+dNlqDSOhk+ aVcECegl0jJq/xi79b0jbrDipleSaIp4G/t/7i7Oim1BC2mUJjpgWiwVNPhiOXuW 7+nuzbR0BelvNsPNL1cNYQMW0jlf7mACq/SBszhzSJqqyXLkukDDMgx10k8rXZyN yWWUf//ndDTw/I39aYrQWO+6eiz6kQUVnIAxTO/27Hie5Dgbv9hyozShql1K5X6X hFcgGzzchgX+cp5XM+3Ee1CZfHve1lKVH7q+ERrweDRVCI7yQs01IuI0f54stUiI qrLimk6tq4ZS4i1f+qxW01mtR8ec2VMKPxNfmh4gWRfsWvX0mf4jxFtouS/z2D/z Vq+yC56xwL5nLj6u5t1n =32r7 -----END PGP SIGNATURE----- From r at sys4.de Wed Oct 22 12:22:52 2014 From: r at sys4.de (Ralf Hildebrandt) Date: Wed, 22 Oct 2014 14:22:52 +0200 Subject: Properly "locking" a useraccount (on a proxy) In-Reply-To: <1493484b628.280b.d475fad7b14312f5d8424e35e39f7512@junc.eu> References: <20141021182729.GB15212@sys4.de> <20141021183728.GC15212@sys4.de> <1493484b628.280b.d475fad7b14312f5d8424e35e39f7512@junc.eu> Message-ID: <20141022122252.GA30825@sys4.de> * Benny Pedersen : > > >for the "locked" user. But I'm lazy and would prefer a single place / > >a single query to lock the account > > Setup postfix to check the recipient account is active, then set a > temp new password while move mail to the new server, when its done > change password back to user, and setup postfix to know its active > again See my "lazy" comment above. -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From me at junc.eu Wed Oct 22 12:40:15 2014 From: me at junc.eu (Benny Pedersen) Date: Wed, 22 Oct 2014 14:40:15 +0200 Subject: Properly "locking" a useraccount (on a proxy) In-Reply-To: <20141022122252.GA30825@sys4.de> References: <20141021182729.GB15212@sys4.de> <20141021183728.GC15212@sys4.de> <1493484b628.280b.d475fad7b14312f5d8424e35e39f7512@junc.eu> <20141022122252.GA30825@sys4.de> Message-ID: <14937df3398.280b.d475fad7b14312f5d8424e35e39f7512@junc.eu> On October 22, 2014 2:22:52 PM Ralf Hildebrandt wrote: > * Benny Pedersen : Not my domain :) > See my "lazy" comment above. If active state 2, then update postfix maps to query this, with a key result of defer if permit :) And dovecot auth to include active 1 or 2, then you manage the sql data in one place From sca at andreasschulze.de Wed Oct 22 14:14:27 2014 From: sca at andreasschulze.de (A. Schulze) Date: Wed, 22 Oct 2014 16:14:27 +0200 Subject: special "what's my ip" pop account Message-ID: <20141022161427.Horde.gM7OyVMSSE9N2YZR8yCWRA1@horde.andreasschulze.de> Hello, I like to enable the allow_nets Feature (http://wiki2.dovecot.org/PasswordDatabase/ExtraFields/AllowNets) for my customers. To help them knowing there own IP I imagine a special mailbox/loginuser at the pop3 server. That user could give a valid pop3 answer from a dummy pop3 server or simply throw a login error with customised answer containing the IP information. Has anybody done something similar or ideas to build such a system? Thanks for ideas Andreas From h.reindl at thelounge.net Wed Oct 22 14:22:23 2014 From: h.reindl at thelounge.net (Reindl Harald) Date: Wed, 22 Oct 2014 16:22:23 +0200 Subject: special "what's my ip" pop account In-Reply-To: <20141022161427.Horde.gM7OyVMSSE9N2YZR8yCWRA1@horde.andreasschulze.de> References: <20141022161427.Horde.gM7OyVMSSE9N2YZR8yCWRA1@horde.andreasschulze.de> Message-ID: <5447BD9F.9070201@thelounge.net> Am 22.10.2014 um 16:14 schrieb A. Schulze: > I like to enable the allow_nets Feature > (http://wiki2.dovecot.org/PasswordDatabase/ExtraFields/AllowNets) > for my customers. To help them knowing there own IP I imagine a special > mailbox/loginuser at the pop3 server. > > That user could give a valid pop3 answer from a dummy pop3 server or > simply throw a login error with customised answer containing the IP > information. > > Has anybody done something similar or ideas to build such a system? jesus - why that complex? just point them to a website which display the remote IP or just to http://whatismyipaddress.com/ http://php.net/manual/de/reserved.variables.server.php -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 181 bytes Desc: OpenPGP digital signature URL: From Dovecot-mailing-list at whyaskwhy.org Wed Oct 22 15:00:40 2014 From: Dovecot-mailing-list at whyaskwhy.org (deoren) Date: Wed, 22 Oct 2014 10:00:40 -0500 Subject: What is the correct way to configure the =?UTF-8?Q?mail=5Flocation=20option=20for=20Mailidr=20format=3F?= In-Reply-To: References: Message-ID: <5447C3A4.8040503@dawnofhope.org> On 10/22/2014 2:29 AM, Steffen Kaiser wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > On Tue, 21 Oct 2014, deoren wrote: > >> What is the correct way to configure the mail_location option for >> Mailidr format? > > mail_location = maildir: > >> I've long had it setup this way: >> >> mail_location = maildir:/var/vmail/%d/%n >> >> Is that correct? > > any path is OK, as long: > > 1) it identifies the mail storage uniquely for the user, > 2) does not store any other information in it. > >> Here is an example error message I ran into: >> >> stat(/var/vmail/example.com/username/.dovecot.lda-dupes/tmp) >> failed: Not a directory > > That's because you use $HOME == Maildir root. > >> Looking at some other guides/tutorials shows something more like: >> >> mail_location = maildir:/var/vmail/%d/%n/Maildir > > "Maildir" is the default name for "Maildir"-type mail storeage root. No > more, no less. If Dovecot is automatically detecting the type of > storage, it probes for this directory name in $HOME. > >> I assume the latter is how it's supposed to be done? If so, that would > > No, you are not "supposed" to do so. > >> I did review the official docs here: >> >> http://wiki2.dovecot.org/MailLocation/Maildir >> >> but I didn't find where it explicitly warns against setting home == >> maildir root. It should probably be apparent, but it wasn't to me when >> I first > > it applies to all mail storages. > > - -- Steffen Kaiser Thanks for the reply and for answering my questions. Just to make sure I understand properly, I have a few additional questions that I am hoping will cement really drive the point home so to speak. Regarding the guide that I followed, it suggests the following userdb and mail_location configuration: userdb { driver = static args = uid=vmail gid=vmail home=/var/mail/vhosts/%d/%n } mail_location = maildir:/var/mail/vhosts/%d/%n This results in the $HOME == Maildir root situation which you mentioned shouldn't be done, correct? Instead mail_location should point to some other directory, perhaps one of: * mail_location = /var/mail/vhosts/%d/%n/Maildir * mail_location = ~/Maildir If I understand properly the mail_location doesn't have to be a subdirectory within the home directory, it just typically is in common examples? If so, that guide should probably be updated to use one of the above mail_location settings. If you will confirm that is the case I'll submit a GitHub pull request as previously mentioned so it can be corrected. Apologies if this is rehashing what you've already said, I'm just looking to make sure I understand this 100%. So for cases where I have made the mistake like I mentioned above, how would I (properly) fix the problem? After stopping Dovecot, I ended up doing this: #1) service dovecot stop #2) cd /var/vmail/example.com/username/ #3) mkdir Maildir #4) mv -i * Maildir/ #5) mv -i .* Maildir/ #6) chown -R vmail:vmail /var/vmail/example.com/username/ #7) service dovecot start which moved the content into the Maildir subfolder and fixed permissions back to what is specified in the conf files. I also adjusted mail_location like so: mail_location = maildir:~/Maildir and I made sure that the home setting is configured as /var/vmail/%d/%n That seems to work fine, but I still got error messages like this when using doveadm search "Error: Syncing mailbox dovecot.lda-dupes failed: Internal error occurred." In my testing I found that I could move the file from this location: /var/vmail/example.com/username/Maildir/.dovecot.ldap-dupes to this one: /var/vmail/example.com/username/.dovecot.ldap-dupes choosing to overwrite the file if it should be there and the error message would not be generated anymore. This suggests that I shouldn't have moved it in the first place. Looking through the mailing list archives I found a message thread titled "Lifetime of redirect info stored by Sieve in .dovecot.lda-dupes" which indicates that the Message-ID and recipient of forwarded messages are stored in .dovecot.ldap-dupes files. I do forward mail daily from the two accounts where doveadm search generates the errors, so it sounds like I would probably be OK to just nuke the file in this location: /var/vmail/example.com/username/Maildir/.dovecot.ldap-dupes and let it be auto-generated in the proper location the next time mail is forwarded. Can you confirm whether that is the case? I appreciate your help. From chayes at afo.net Wed Oct 22 15:55:25 2014 From: chayes at afo.net (Cliff Hayes) Date: Wed, 22 Oct 2014 10:55:25 -0500 Subject: dictionary attack defense In-Reply-To: <544770FE.5000006@thelounge.net> References: <5446D00E.8050702@afo.net> <5446D7EC.4010303@thelounge.net> <54472B96.3060200@afo.net> <544770FE.5000006@thelounge.net> Message-ID: <5447D36D.9040708@afo.net> Good idea! Thanks! On 10/22/2014 3:55 AM, Reindl Harald wrote: > > Am 22.10.2014 um 05:59 schrieb Cliff Hayes: >> a) I read about auth_failure_delay even before I posted my question and >> I could not figure out the one-line explanation in the dovecot wiki: >> "Number of seconds to delay before replying to failed authentications." >> It's delaying a reply. Does that mean the hacker can keep asking as >> fast as he wants? Is it per user or per IP? > > it does not help him to ask fast > he needs responses too and can't open endless connections parallel > >> b) I'm familiar with mail_max_userip_connections = x, but I'm not >> familiar with the time limit you mention. > > iptables > > 0 0 REJECT tcp -- eth0 * !192.168.196/24 > 0.0.0.0/0 multiport dports 110,143,993,995 ctstate NEW > recent: UPDATE seconds: 1800 hit_count: 100 name: dovecot2 side: source > mask: > 255.255.255.255 reject-with icmp-port-unreachable > 4 256 REJECT tcp -- eth0 * !192.168.196/24 > 0.0.0.0/0 multiport dports 110,143,993,995 ctstate NEW > recent: UPDATE seconds: 300 hit_count: 50 name: dovecot1 side: source > mask: 2 > 55.255.255.255 reject-with icmp-port-unreachable > 0 0 REJECT tcp -- eth0 * !192.168.196/24 > 0.0.0.0/0 multiport dports 25,465,587 ctstate NEW recent: > UPDATE seconds: 1800 hit_count: 75 name: postfix2 side: source mask: 255.2 > 55.255.255 reject-with icmp-port-unreachable > 9 448 REJECT tcp -- eth0 * !192.168.196/24 > 0.0.0.0/0 multiport dports 25,465,587 ctstate NEW recent: > UPDATE seconds: 300 hit_count: 40 name: postfix1 side: source mask: 255.25 > 5.255.255 reject-with icmp-port-unreachable > 0 0 DROP udp -- eth0 * !192.168.196/24 > 0.0.0.0/0 ctstate NEW recent: UPDATE seconds: 2 hit_count: 75 > name: udpflood side: source mask: 255.255.255.255 > 0 0 DROP tcp -- eth0 * !192.168.196/24 > 0.0.0.0/0 ctstate NEW recent: UPDATE seconds: 2 hit_count: 75 > name: DEFAULT side: source mask: 255.255.255.255 > 0 0 DROP tcp -- eth0 * !192.168.196/24 > 0.0.0.0/0 multiport dports 25,80,443,465,587 tcp > flags:0x17/0x02 #conn src/32 > 75 > 0 0 DROP tcp -- eth0 * !192.168.196/24 > 0.0.0.0/0 multiport dports 25,80,443,465,587 tcp > flags:0x17/0x02 #conn src/24 > 150 > 0 0 DROP tcp -- eth0 * !192.168.196/24 > 0.0.0.0/0 multiport dports 25,80,443,465,587 tcp > flags:0x17/0x02 #conn src/16 > 175 > 0 0 DROP tcp -- eth0 * !192.168.196/24 > 0.0.0.0/0 multiport dports 25,80,443,465,587 tcp > flags:0x17/0x02 #conn src/8 > 200 > >> On 10/21/2014 5:02 PM, Reindl Harald wrote: >>> >>> >>> Am 21.10.2014 um 23:28 schrieb Cliff Hayes: >>>> Does dovecot have any dictionary attack defenses yet? >>>> In the past I have had to implement defense from outside dovecot, but >>>> since dovecot is at the front lines and therefore is the first to know >>>> I'm hoping by now there is something we can set. For example, a limit >>>> on access failures per minut/hour/day or some such. If not why not? >>> >>> no - but you can set "auth_failure_delay = 5" and limit new connections >>> per IP to something around 40 per 5 minutes and 100 per 30 minutes which >>> stops many of them or at least limit the amount of tries dramatically > From sca at andreasschulze.de Wed Oct 22 18:16:35 2014 From: sca at andreasschulze.de (A. Schulze) Date: Wed, 22 Oct 2014 20:16:35 +0200 Subject: special "what's my ip" pop account In-Reply-To: <5447BD9F.9070201@thelounge.net> References: <20141022161427.Horde.gM7OyVMSSE9N2YZR8yCWRA1@horde.andreasschulze.de> <5447BD9F.9070201@thelounge.net> Message-ID: <20141022201635.Horde.4J3Go8xpPS-zEIGOfpKL-A1@horde.andreasschulze.de> Reindl Harald: > why that complex? > just point them to a website webtraffic goes other ways via proxy server then pop3 From leolistas at solutti.com.br Wed Oct 22 20:29:28 2014 From: leolistas at solutti.com.br (Leonardo Rodrigues) Date: Wed, 22 Oct 2014 18:29:28 -0200 Subject: special "what's my ip" pop account In-Reply-To: <20141022201635.Horde.4J3Go8xpPS-zEIGOfpKL-A1@horde.andreasschulze.de> References: <20141022161427.Horde.gM7OyVMSSE9N2YZR8yCWRA1@horde.andreasschulze.de> <5447BD9F.9070201@thelounge.net> <20141022201635.Horde.4J3Go8xpPS-zEIGOfpKL-A1@horde.andreasschulze.de> Message-ID: <544813A8.1080707@solutti.com.br> On 22/10/14 16:16, A. Schulze wrote: > > Reindl Harald: > >> why that complex? >> just point them to a website > > webtraffic goes other ways via proxy server then pop3 so just get that fixed !!! Every good proxy solution can work in ways of exposing the real user IP to the internet. Just get that configured ! -- Atenciosamente / Sincerily, Leonardo Rodrigues Solutti Tecnologia http://www.solutti.com.br Minha armadilha de SPAM, N?O mandem email gertrudes at solutti.com.br My SPAMTRAP, do not email it From h.reindl at thelounge.net Wed Oct 22 20:33:36 2014 From: h.reindl at thelounge.net (Reindl Harald) Date: Wed, 22 Oct 2014 22:33:36 +0200 Subject: special "what's my ip" pop account In-Reply-To: <544813A8.1080707@solutti.com.br> References: <20141022161427.Horde.gM7OyVMSSE9N2YZR8yCWRA1@horde.andreasschulze.de> <5447BD9F.9070201@thelounge.net> <20141022201635.Horde.4J3Go8xpPS-zEIGOfpKL-A1@horde.andreasschulze.de> <544813A8.1080707@solutti.com.br> Message-ID: <544814A0.4020209@thelounge.net> Am 22.10.2014 um 22:29 schrieb Leonardo Rodrigues: > On 22/10/14 16:16, A. Schulze wrote: >> >> Reindl Harald: >> >>> why that complex? >>> just point them to a website >> >> webtraffic goes other ways via proxy server then pop3 > > so just get that fixed !!! Every good proxy solution can work in > ways of exposing the real user IP to the internet. Just get that > configured! that's not the point, i understand the difference of *what* goes through a proxy - but frankly *if* it goes through a proxy somebody just knows the public IP and it has to be whitelisted *before* the enduser comes in touch abuse POP3 and error messages to find your connecting IP is just nonsense, especially in context of imit users to IP's - before WL them they can't connect (otherwise your design is broken) -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 181 bytes Desc: OpenPGP digital signature URL: From felix at fuqu.me Wed Oct 22 20:43:01 2014 From: felix at fuqu.me (Felix Amler) Date: Wed, 22 Oct 2014 22:43:01 +0200 Subject: Dovecot Master/Master Replication Problem Message-ID: <544816D5.3070407@fuqu.me> Hi, I've set up 2 servers with dovecot 2.2.9 using maildir using structure: /var/maildir/domain/localpart Server A: mx1.xxx.de Server B: mx2.xxx.de Mails are delivered to dovecot only on server A by exim4/dovecot deliver replication to Server B works immediatelly: mark mail as read on server A, mail is marked as read on server B. BUT: when i mark a mail as read on Server B, noting happens. On Server A I get messages like this in dovecot-error.log: 2014-10-22 22:35:05 dsync-server(localpart at domain.de): Error: stat(/var/maildir/domain.de/localpart/.dovecot-sync.lock/tmp) failed: Not a directory 2014-10-22 22:35:05 dsync-server(localpart at domain.de): Error: Failed to access mailbox dovecot-sync.lock: Internal error occurred. Refer to server log for more information. [2014-10-22 22:35:05] I googled a bit, this could habben if there is a file ".dovecot-sync.lock" in the maildir, but I've double checked that, there is no such file... Why does it work in one direction, but not in the other? Please help best regards Felix From dovecot-mailing-list at whyaskwhy.org Wed Oct 22 21:35:47 2014 From: dovecot-mailing-list at whyaskwhy.org (deoren) Date: Wed, 22 Oct 2014 16:35:47 -0500 Subject: Where can I find change logs/release notes for Dovecot EE releases? Message-ID: <54482333.3@whyaskwhy.org> I searched for them and haven't come across them yet. Could any point me in the right direction? Specifically the Ubuntu 12.04 package notes if they're split out. Thanks! From jtam.home at gmail.com Wed Oct 22 23:02:04 2014 From: jtam.home at gmail.com (Joseph Tam) Date: Wed, 22 Oct 2014 16:02:04 -0700 (PDT) Subject: dictionary attack defense In-Reply-To: References: Message-ID: Cliff Hayes writes: > a) I read about auth_failure_delay even before I posted my question and > I could not figure out the one-line explanation in the dovecot wiki: > "Number of seconds to delay before replying to failed authentications." > It's delaying a reply. Does that mean the hacker can keep asking as > fast as he wants? As Reindl states, authentication is a synchronous operation so the BFD attacker must wait for a reply before continuing. An attacker can get around this by running a botnet against you or opening up many concurrent connections (I think the latter can be capped), but I've rarely seen this. A botnet attack will defeat IP based blocking anyways. > Is it per user or per IP? Irrelevant -- there is no tracking. It's simply pauses the reply to bad auth attempts and tarpits the session. auth_failure_delay does not block BFD attacks, but makes it infeasable for reasonable strength passwords. It's simpler to implement, robust, and fault tolerant (e.g. a user cannot accidentally lock themselves out requiring administrative intervention to restore immediate access, or repeated failures from a NAT'd network does not DoS everything within the NAT'd network). Joseph Tam From teemu.huovila at dovecot.fi Thu Oct 23 07:34:16 2014 From: teemu.huovila at dovecot.fi (Teemu Huovila) Date: Thu, 23 Oct 2014 10:34:16 +0300 Subject: Where can I find change logs/release notes for Dovecot EE releases? In-Reply-To: <54482333.3@whyaskwhy.org> References: <54482333.3@whyaskwhy.org> Message-ID: <5448AF78.1090804@dovecot.fi> On 10/23/2014 12:35 AM, deoren wrote: > I searched for them and haven't come across them yet. Could any point me in the right direction? Specifically the Ubuntu 12.04 > package notes if they're split out. On a Debian based system you should find them in /usr/share/doc/dovecot-ee-core/chagnelog.gz On a Redhat based system it is /usr/share/doc/dovecot-ee-/ChageLog br, Teemu Huovila From teemu.huovila at dovecot.fi Thu Oct 23 07:36:14 2014 From: teemu.huovila at dovecot.fi (Teemu Huovila) Date: Thu, 23 Oct 2014 10:36:14 +0300 Subject: Where can I find change logs/release notes for Dovecot EE releases? In-Reply-To: <5448AF78.1090804@dovecot.fi> References: <54482333.3@whyaskwhy.org> <5448AF78.1090804@dovecot.fi> Message-ID: <5448AFEE.8030908@dovecot.fi> On 10/23/2014 10:34 AM, Teemu Huovila wrote: > On 10/23/2014 12:35 AM, deoren wrote: >> I searched for them and haven't come across them yet. Could any point me in the right direction? Specifically the Ubuntu 12.04 >> package notes if they're split out. > On a Debian based system you should find them in /usr/share/doc/dovecot-ee-core/chagnelog.gz /usr/share/doc/dovecot-ee-core/changelog.gz From skdovecot at smail.inf.fh-brs.de Thu Oct 23 07:37:54 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Thu, 23 Oct 2014 09:37:54 +0200 (CEST) Subject: special "what's my ip" pop account In-Reply-To: <20141022161427.Horde.gM7OyVMSSE9N2YZR8yCWRA1@horde.andreasschulze.de> References: <20141022161427.Horde.gM7OyVMSSE9N2YZR8yCWRA1@horde.andreasschulze.de> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Wed, 22 Oct 2014, A. Schulze wrote: > I like to enable the allow_nets Feature > (http://wiki2.dovecot.org/PasswordDatabase/ExtraFields/AllowNets) > for my customers. To help them knowing there own IP I imagine a special > mailbox/loginuser at the pop3 server. > > That user could give a valid pop3 answer from a dummy pop3 server or > simply throw a login error with customised answer containing the IP > information. let's put aside the question, if this way is sensible or not. I would give the http://wiki2.dovecot.org/PostLoginScripting a try. Maybe you can enable it for your dummy account via ExtraFields specifically. Because I wonder, if you will be successful with "throw a login error with customised answer" [any MUA displays what it wants], you might prefer a MUA-independ script or program that queries your server. And if you are at it, maybe a dummy server with a self-made script that returns "+OK POP3 your IP is ....", then return +FAIL for any further command. You need to return the greeting and keep the connection open, in order to bypass IDS firewalls. Now back to sensible or not ;-) : Of course, if you use a dummy server (IP address) for probing the IP address, an intermediate firewall could re-route the connection differently. If you use another demon [port] on the same server, the same may happen. If you or your customers do not have control over the routing and final public IP address, that IP might change any now and then anyway. So, if you've experienced problems in this regard, you probably need to implement a completely different protection scheme, that are independed on the IP address. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBVEiwU3z1H7kL/d9rAQJJxwgAxEzY+h8Yfh2xTdvwX8wuVOcMVSzK2MLC Cfq4BitXPZEZliVL4un8b5SjFOhMFS32wG4DtlUxbkL6rrJUuM6U+2pUhOE6a1hM hAMAUyZYYwhCc517XfEkp+YEb85cCgaMX6BRfnWHnFklMAtWK3WoLlfY6ZzMeTt3 zPjgRlb0JRw5CPE5r6v9GElk4QdwR8LZAMvIzx1FcMv5lG/bOqIUAkoQewwzoIP5 vpWkfR3thkT0Dh4ibcoP5Vp7ecC+EDsJobOjBkRQIbCedojk0V515xsXK9h9q6qm 3JLTWNVO/PyoClgpVmNI0ZFW8S2vijc5DVb9lxr4neehBfTMNlZ9Gg== =2mdO -----END PGP SIGNATURE----- From skdovecot at smail.inf.fh-brs.de Thu Oct 23 08:39:57 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Thu, 23 Oct 2014 10:39:57 +0200 (CEST) Subject: What is the correct way to configure the mail_location option for Mailidr format? In-Reply-To: <5447C3A4.8040503@dawnofhope.org> References: <5447C3A4.8040503@dawnofhope.org> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Wed, 22 Oct 2014, deoren wrote: > On 10/22/2014 2:29 AM, Steffen Kaiser wrote: >> On Tue, 21 Oct 2014, deoren wrote: >> >>> What is the correct way to configure the mail_location option for >>> Mailidr format? >> >> mail_location = maildir: >> >>> I've long had it setup this way: >>> >>> mail_location = maildir:/var/vmail/%d/%n >>> >>> Is that correct? >> >> any path is OK, as long: >> >> 1) it identifies the mail storage uniquely for the user, >> 2) does not store any other information in it. >> >>> Here is an example error message I ran into: >>> >>> stat(/var/vmail/example.com/username/.dovecot.lda-dupes/tmp) >>> failed: Not a directory >> >> That's because you use $HOME == Maildir root. >> >>> Looking at some other guides/tutorials shows something more like: >>> >>> mail_location = maildir:/var/vmail/%d/%n/Maildir >> >> "Maildir" is the default name for "Maildir"-type mail storeage root. No >> more, no less. If Dovecot is automatically detecting the type of >> storage, it probes for this directory name in $HOME. >> >>> I assume the latter is how it's supposed to be done? If so, that would >> >> No, you are not "supposed" to do so. >> >>> I did review the official docs here: >>> >>> http://wiki2.dovecot.org/MailLocation/Maildir >>> >>> but I didn't find where it explicitly warns against setting home == >>> maildir root. It should probably be apparent, but it wasn't to me when >>> I first >> >> it applies to all mail storages. > Thanks for the reply and for answering my questions. > > Just to make sure I understand properly, I have a few additional questions > that I am hoping will cement really drive the point home so to speak. > Regarding the guide that I followed, it suggests the following userdb and > mail_location configuration: > > userdb { > driver = static > args = uid=vmail gid=vmail home=/var/mail/vhosts/%d/%n > } > > mail_location = maildir:/var/mail/vhosts/%d/%n > > This results in the $HOME == Maildir root situation which you mentioned > shouldn't be done, correct? Instead mail_location should point to some other > directory, Yes! > perhaps one of: > > * mail_location = /var/mail/vhosts/%d/%n/Maildir > * mail_location = ~/Maildir for instance, yes. > If I understand properly the mail_location doesn't have to be a subdirectory > within the home directory, it just typically is in common examples? If so, Yes again. And "Maildir" is just common and the default, but you could name the last path component anyway you like, even "mbox", "sdbox", or "mdbox", but such name probably would confuse any admin, that take the server over, because the dir name does imply something different than Maildir. > that guide should probably be updated to use one of the above mail_location > settings. If you will confirm that is the case I'll submit a GitHub pull > request as previously mentioned so it can be corrected. > > Apologies if this is rehashing what you've already said, I'm just looking to > make sure I understand this 100%. > > So for cases where I have made the mistake like I mentioned above, how would > I (properly) fix the problem? > > After stopping Dovecot, I ended up doing this: > > #1) service dovecot stop > #2) cd /var/vmail/example.com/username/ > #3) mkdir Maildir > #4) mv -i * Maildir/ > #5) mv -i .* Maildir/ > #6) chown -R vmail:vmail /var/vmail/example.com/username/ > #7) service dovecot start #5 will match "..", too. Better: mv -i * .??* Maildir That will move the Sieve and LDA files, too, as you found out yourself, so: mkdir Maildir ; mv -i * .??* Maildir && for file in Maildir/.dovecot.*; do test -f "$file" && mv "$file" . done; mv Maildir/sieve_dir . The 1st "mv" moves all files into Maildir, the for loop is to move the sieve files back, and the 3rd mv moves the sieve folder back - you have to adjust your name there. > > which moved the content into the Maildir subfolder and fixed permissions back > to what is specified in the conf files. I also adjusted mail_location like > so: > > mail_location = maildir:~/Maildir > > and I made sure that the home setting is configured as /var/vmail/%d/%n > > That seems to work fine, but I still got error messages like this when using > doveadm search > > "Error: Syncing mailbox dovecot.lda-dupes failed: Internal error occurred." > > In my testing I found that I could move the file from this location: > > /var/vmail/example.com/username/Maildir/.dovecot.ldap-dupes > > to this one: > > /var/vmail/example.com/username/.dovecot.ldap-dupes > > choosing to overwrite the file if it should be there and the error message > would not be generated anymore. This suggests that I shouldn't have moved it > in the first place. > > Looking through the mailing list archives I found a message thread titled > "Lifetime of redirect info stored by Sieve in .dovecot.lda-dupes" which > indicates that the Message-ID and recipient of forwarded messages are stored > in .dovecot.ldap-dupes files. I do forward mail daily from the two accounts > where doveadm search generates the errors, so it sounds like I would probably > be OK to just nuke the file in this location: > > /var/vmail/example.com/username/Maildir/.dovecot.ldap-dupes > > and let it be auto-generated in the proper location the next time mail is > forwarded. Can you confirm whether that is the case? .dovecot.lda-dupes is not essential, but you might get (seldomly) some dupes or some users might get duplicate vacation responses from Sieve. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBVEi+3Xz1H7kL/d9rAQL4+ggAmElvOUFvfcYJOjxByQBA6JDYrSU7uk/1 C21L6QyOl+gS8HGXKQBAEKNywe5/a8QyWYa9z46n/mVGxwU/BgEntqiawyrsYT1q /Rjz+9AjNVYNhmRlegb/dXemMinN0+GHRINYWJSz7Uu9CRvGrstQLD7zMl3BA2+A faLDoCnDKc2gDr+qLcgrfCjSDgl2btMho5ApBc4ecFpBnEMIIGA/n7M7xGBaDJqT 65GLUoXAoW5DmriW/w4g3wCaUyAdvYO8+EfYSx5mwIxYSxhzDBb0kbRLEHGdRDOR q4xEZMMDc42PW1xHSCKuzNkZeQf6G1mRFzVL+no3pvSev6gmLWCl9g== =TvfG -----END PGP SIGNATURE----- From sca at andreasschulze.de Thu Oct 23 11:29:34 2014 From: sca at andreasschulze.de (A. Schulze) Date: Thu, 23 Oct 2014 13:29:34 +0200 Subject: special "what's my ip" pop account In-Reply-To: References: <20141022161427.Horde.gM7OyVMSSE9N2YZR8yCWRA1@horde.andreasschulze.de> Message-ID: <20141023132934.Horde.NfN8LtjqU9wl1vBr67415w5@horde.andreasschulze.de> Steffen Kaiser: > I would give the http://wiki2.dovecot.org/PostLoginScripting a try. I never used PostLoginScripting before. I have concerns about additional serverload if that scripting is executed for every pop3 login and every user. ( and there are *many* ) > Maybe you can enable it for your dummy account via ExtraFields specifically. That sounds I like additional scripting could be selective enabled via ExtraFields? It' try to find documentation ... > Because I wonder, if you will be successful with "throw a login > error with customised answer" [any MUA displays what it wants], you > might prefer a MUA-independ script or program that queries your > server. And if you are at it, maybe a dummy server with a self-made > script that returns "+OK POP3 your IP is ....", then return +FAIL > for any further command. You need to return the greeting and keep > the connection open, in order to bypass IDS firewalls. I also thought about that. Thanks for your constructive statement. Andreas From uothrawn at yahoo.com Thu Oct 23 14:01:36 2014 From: uothrawn at yahoo.com (G H) Date: Thu, 23 Oct 2014 07:01:36 -0700 Subject: Public root folder is \Noselect Message-ID: <1414072896.27460.YahooMailNeo@web161403.mail.bf1.yahoo.com> I am utilizing a public namespace via http://wiki2.dovecot.org/SharedMailboxes/Public and using sdbox storage format. How can I get rid of the \Noselect flag that is set by default for this folder? IMAP output: b LIST "" "*" * LIST (\HasNoChildren \Sent) "/" Sent * LIST (\HasNoChildren \Trash) "/" Trash * LIST (\Noselect \HasNoChildren) "/" Public * LIST (\HasNoChildren) "/" INBOX If this is not possible, what is the best way to create a sub-folder in here upon system setup (one w/o a \Noselect flag)? Thanks, G H From suy at badopi.org Thu Oct 23 15:11:42 2014 From: suy at badopi.org (Alejandro Exojo) Date: Thu, 23 Oct 2014 17:11:42 +0200 Subject: Invoking the spam checker on the sieve script Message-ID: <201410231711.42325.suy@badopi.org> Hi. TL/DR version: Is it advisable to invoke an spam checker from the sieve script, and then, once the message is filtered, decide if should be moved to a certain spam folder? A bit more context on why I'm considering this: I'm just a geek who wants to handle his own mail, but not a great experience as a system administrator. I don't have any corporate setup, just a simple VPS with me as the only user. Previously I fetched all my mail through POP, and in the client of my PC I moved (lots of) mailing list traffic to its folders. Then, for those remaining messages (and only those remaining) I passed the spam filter and moved to spam folder. That's a significant saving since I have many mailing list subscriptions, and now I'm even using rss2email, so I have lots of email that is not spam. I moved to IMAP and my filters are server side with sieve, but I don't have spam filtering yet. I thought I could replicate the setup easily, but it seems nobody is doing that, and everyone has the mail already scored when it reaches sieve. Seems like the "extprograms" extension would be a fit, but again, nobody seems to mention on documentation, so I'm fearing I'm probably wrong. Suggestions? Thank you very much! -- Alex (a.k.a. suy) | GPG ID 0x0B8B0BC2 http://barnacity.net/ | http://disperso.net From rs at sys4.de Thu Oct 23 15:56:49 2014 From: rs at sys4.de (Robert Schetterer) Date: Thu, 23 Oct 2014 17:56:49 +0200 Subject: Invoking the spam checker on the sieve script In-Reply-To: <201410231711.42325.suy@badopi.org> References: <201410231711.42325.suy@badopi.org> Message-ID: <54492541.5020604@sys4.de> Am 23.10.2014 um 17:11 schrieb Alejandro Exojo: > Hi. > > TL/DR version: > > Is it advisable to invoke an spam checker from the sieve script, and then, > once the message is filtered, decide if should be moved to a certain spam > folder? why not use i.e spamass milter with postfix to flag, and then use sieve global rule to sort in Users Imap Junk Folder, to download SPAM Mails in imap Junk folder via pop3 to , use dovecot virtual plugin see https://sys4.de/de/blog/2013/02/11/dovecot-virtual-setup-mit-globaler-sieve-spamfilter-regel-fur-pop3-nutzer/ sorry german only but configs should speak for its own > > A bit more context on why I'm considering this: > > I'm just a geek who wants to handle his own mail, but not a great experience > as a system administrator. I don't have any corporate setup, just a simple VPS > with me as the only user. > > Previously I fetched all my mail through POP, and in the client of my PC I > moved (lots of) mailing list traffic to its folders. Then, for those remaining > messages (and only those remaining) I passed the spam filter and moved to spam > folder. That's a significant saving since I have many mailing list > subscriptions, and now I'm even using rss2email, so I have lots of email that > is not spam. > > I moved to IMAP and my filters are server side with sieve, but I don't have > spam filtering yet. I thought I could replicate the setup easily, but it seems > nobody is doing that, and everyone has the mail already scored when it reaches > sieve. Seems like the "extprograms" extension would be a fit, but again, nobody > seems to mention on documentation, so I'm fearing I'm probably wrong. > > Suggestions? i dont get what your problem is exactly but looks like you wanna pre sort mail about other stuff ( i.e. sender ) and doing spam sort at last, should be no problem with a sieve user rule if spam score is allready in the mail ( flagged by spamassassin before) etc > > Thank you very much! > i wouldnt use extprograms for spam scanning, i see no need for it Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From suy at badopi.org Thu Oct 23 16:19:06 2014 From: suy at badopi.org (Alejandro Exojo) Date: Thu, 23 Oct 2014 18:19:06 +0200 Subject: Invoking the spam checker on the sieve script In-Reply-To: <54492541.5020604@sys4.de> References: <201410231711.42325.suy@badopi.org> <54492541.5020604@sys4.de> Message-ID: <201410231819.06655.suy@badopi.org> El Thursday 23 October 2014, Robert Schetterer escribi?: > i dont get what your problem is exactly > but looks like you wanna pre sort mail about other stuff ( i.e. sender > ) and doing spam sort at last, should be no problem with a sieve user > rule if spam score is allready in the mail ( flagged by spamassassin > before) etc That most of my mail comes from 100% assured not spam sources: mailing lists that are already filtered or rss2email (the second probably can be skipped easily because it comes locally). I only have a small VPS, so I'm trying to save some resources if possible. Spamassassin consumes quite a lot, AFAIK. -- Alex (a.k.a. suy) | GPG ID 0x0B8B0BC2 http://barnacity.net/ | http://disperso.net From rs at sys4.de Thu Oct 23 16:39:41 2014 From: rs at sys4.de (Robert Schetterer) Date: Thu, 23 Oct 2014 18:39:41 +0200 Subject: Invoking the spam checker on the sieve script In-Reply-To: <201410231819.06655.suy@badopi.org> References: <201410231711.42325.suy@badopi.org> <54492541.5020604@sys4.de> <201410231819.06655.suy@badopi.org> Message-ID: <54492F4D.8030509@sys4.de> Am 23.10.2014 um 18:19 schrieb Alejandro Exojo: > El Thursday 23 October 2014, Robert Schetterer escribi?: >> i dont get what your problem is exactly >> but looks like you wanna pre sort mail about other stuff ( i.e. sender >> ) and doing spam sort at last, should be no problem with a sieve user >> rule if spam score is allready in the mail ( flagged by spamassassin >> before) etc > > That most of my mail comes from 100% assured not spam sources: mailing lists > that are already filtered or rss2email (the second probably can be skipped > easily because it comes locally). I only have a small VPS, so I'm trying to > save some resources if possible. Spamassassin consumes quite a lot, AFAIK. anyway if you want classify spam by your own you need some spam score software, if you know senders bypass them from spam scoring > Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From jtam.home at gmail.com Thu Oct 23 23:05:19 2014 From: jtam.home at gmail.com (Joseph Tam) Date: Thu, 23 Oct 2014 16:05:19 -0700 (PDT) Subject: special "what's my ip" pop account In-Reply-To: References: Message-ID: Steffen Kaiser writes: > let's put aside the question, if this way is sensible or not. [... continuing in nonsensible mode ...] > And if you are at it, maybe a dummy server with a self-made script that > returns "+OK POP3 your IP is ....", then return +FAIL for any further > command. Been there, done that (for a different problem). Not all mail readers will show you banners; to make this really work, you have to implement USER and PASS (accepts anything), STAT and LIST (one message available), RETR (dump your informational message payload), QUIT (disconnect), maybe TOP, and everything else is an +OK no-op. I patched Qualcomm's qpopper to do this. As to whether the OP *should* do this, definitely not. Find a better solution. Joseph Tam From pch at myzel.net Thu Oct 23 23:35:28 2014 From: pch at myzel.net (Peter Chiochetti) Date: Fri, 24 Oct 2014 01:35:28 +0200 Subject: Invoking the spam checker on the sieve script In-Reply-To: <201410231711.42325.suy@badopi.org> References: <201410231711.42325.suy@badopi.org> Message-ID: <544990C0.2010104@myzel.net> Am 2014-10-23 um 17:11 schrieb Alejandro Exojo: > > I moved to IMAP and my filters are server side with sieve, but I don't have > spam filtering yet. I understand, that you do not want spamassassin (SA) to check lots of messages that are clean anyways. If you can call SA from sieve, as a condtion in an if clause, filtering should be no problem, should it? MUAs, e.g. Thunderbird (TB) also have good junk filters, so that might be an option too. In one account of mine, mail is filtered on the server and I later have TB filter the SPAM folder locally and occasionally they both disagree ;) False SA positives are more rare than false SA negatives. SA and TB score about the same, though TB seems to me to be more accustomed to my spool. On a server I administer, quite similar to your setup, very few users, I recently had to turn on greylisting, which proved exceptionally well in reducing SA load: Checking is done there during SMTP time. Of course this will not help in your case when the bulk will pass... > I thought I could replicate the setup easily, but it seems > nobody is doing that, and everyone has the mail already scored when it reaches > sieve. Seems like the "extprograms" extension would be a fit, but again, nobody > seems to mention on documentation, so I'm fearing I'm probably wrong. You can use this list to provide the missing documentation ;) -- peter From MailList at nerdworld.org Fri Oct 24 02:26:13 2014 From: MailList at nerdworld.org (Casey Bralla) Date: Thu, 23 Oct 2014 22:26:13 -0400 Subject: Sieve Advice Needed, Please Message-ID: <1644664.k46JXDv0lc@m5> Anybody here familiar with the Sieve language? I'm rebuilding my mail server, and I am working with the sieve language to automatically filter spam into a separate account. However, I've hit a snag that I can't get around. BTW, I'm using a clean install of dovecot, postfix, spamassassin on Debian 7.5. I want to do server-side spam filtering, so I've got spamasassin identifying spam, and then have sieve sorting the mail to a special spam folder. I can easily send spam to special folder in the inbox for each mail user, but I wanted to have a single mail account for spam. I can use the "redirect" sieve command to send anything with the X-spam-flag set, but this triggers an error and bounces the offending mail. The bounce message is: From: MAILER-DAEMON at NerdWorld.org (Mail Delivery System) To: casey at vmailservertest.nerdworld.org Subject: Undelivered Mail Returned to Sender Date: Sun, 19 Oct 2014 16:41:49 -0400 (EDT) This is the mail system at host VMailServerTest.NerdWorld.org. I'm sorry to have to inform you that your message could not be delivered to one or more recipients. It's attached below. For further assistance, please send mail to postmaster. If you do so, please include this problem report. You can delete your own text from the attached returned message. The mail system : mail forwarding loop for spam at vmailservertest.nerdworld.org From: casey at vmailservertest.nerdworld.org Date: Sun, 19 Oct 2014 16:41:20 -0400 (EDT) viagra!!!! www.viagra.com I think this is a recursion problem, since the redirected mail has to go through the spamassassin check and sieve again. I tried to get clever and prevent the recursion, but I'm not clever enough. Here is my sieve rule file. # # # A rule to move spam to the spam user # based on spamassassin setting the spam flag # # # require ["redirect"]; (Not needed, since it is part of the basis sieve spec) # # rule:[SPAM] if header :contains "X-Spam-Flag" ["YES"] { if address :is "to" "Spam at VMailServerTest.NerdWorld.org" { keep; } else { redirect "spam at VMailServerTest.NerdWorld.org"; } } # # # Anybody able to give me any advice? TIA -- Casey Bralla Chief Nerd in Residence The NerdWorld Organisation www.NerdWorld.org From dovecot-list at mohtex.net Fri Oct 24 02:47:10 2014 From: dovecot-list at mohtex.net (Tamsy) Date: Fri, 24 Oct 2014 09:47:10 +0700 Subject: Sieve Advice Needed, Please In-Reply-To: <1644664.k46JXDv0lc@m5> References: <1644664.k46JXDv0lc@m5> Message-ID: <5449BDAE.8010806@mohtex.net> Casey Bralla wrote on 24.10.2014 09:26: > Anybody here familiar with the Sieve language? > > I'm rebuilding my mail server, and I am working with the sieve language to > automatically filter spam into a separate account. However, I've hit a > snag that I can't get around. > > BTW, I'm using a clean install of dovecot, postfix, spamassassin on Debian 7.5. > > > I want to do server-side spam filtering, so I've got spamasassin > identifying spam, and then have sieve sorting the mail to a special spam > folder. I can easily send spam to special folder in the inbox for each > mail user, but I wanted to have a single mail account for spam. I can use > the "redirect" sieve command to send anything with the X-spam-flag set, but > this triggers an error and bounces the offending mail. The bounce message > is: > > > From: MAILER-DAEMON at NerdWorld.org (Mail Delivery System) > To: casey at vmailservertest.nerdworld.org > Subject: Undelivered Mail Returned to Sender > Date: Sun, 19 Oct 2014 16:41:49 -0400 (EDT) > > This is the mail system at host VMailServerTest.NerdWorld.org. > > I'm sorry to have to inform you that your message could not > be delivered to one or more recipients. It's attached below. > > For further assistance, please send mail to postmaster. > > If you do so, please include this problem report. You can > delete your own text from the attached returned message. > > The mail system > > : mail forwarding loop for > spam at vmailservertest.nerdworld.org > > From: casey at vmailservertest.nerdworld.org > Date: Sun, 19 Oct 2014 16:41:20 -0400 (EDT) > > viagra!!!! > www.viagra.com > > > > > I think this is a recursion problem, since the redirected mail has to go > through the spamassassin check and sieve again. I tried to get clever and > prevent the recursion, but I'm not clever enough. Here is my sieve rule > file. > > # > # > # A rule to move spam to the spam user > # based on spamassassin setting the spam flag > # > # > # require ["redirect"]; (Not needed, since it is part of the basis sieve > spec) > # > # rule:[SPAM] > if header :contains "X-Spam-Flag" ["YES"] > { > if address :is "to" "Spam at VMailServerTest.NerdWorld.org" > { > keep; > } > else > { > redirect "spam at VMailServerTest.NerdWorld.org"; > } > } > # > # > # > > Anybody able to give me any advice? TIA > > We are using the below to file spam messages (tagged by Spamassassin) to a global Spam-mailbox for all users except for some system users. Still a copy of Spam gets delivered to the user's spam folder in case of false positives etc. We use this as a sieve before rule to all other rules and it works as expected. require ["copy", "fileinto"]; if not anyof (address :is ["To", "Cc", "Bcc"] ["Spam at VMailServerTest.NerdWorld.org"], address :is ["To", "Cc", "Bcc"] ["postmaster at VMailServerTest.NerdWorld.org"], address :is ["To", "Cc", "Bcc"] ["sysadmin at VMailServerTest.NerdWorld.org"], address :is ["To", "Cc", "Bcc"] ["abuse at VMailServerTest.NerdWorld.org"], address :is ["To", "Cc", "Bcc"] ["webmaster at VMailServerTest.NerdWorld.org"]){ if anyof (header :contains "X-Spam-Flag" "YES") { redirect :copy "spam at VMailServerTest.NerdWorld.org"; fileinto "Spam"; stop; } } From mtrainer at cloud-free.com Fri Oct 24 03:06:01 2014 From: mtrainer at cloud-free.com (mtrainer at cloud-free.com) Date: Fri, 24 Oct 2014 11:06:01 +0800 Subject: Error renaming folders with spaces Message-ID: Hi All, I am getting frequent errors of the form below. In most cases the path has spaces in it. Oct 24 07:27:08 mailstore03 dovecot: imap(sam at userdomain.com.au): Error: rename(/home8/rs7-username/mail/xyzmortgages.com.au/sam/.Valuations - ABC, /home8/rs7-username/mail/xyzmortgages.com.au/sam/.Valuations - ABC/Subfolder) failed: Invalid argument The user home directories are on NFSv3 and are the user attributes are stored in ldap. My config is below. Any ideas what is causing these errors? Thanks Murray # doveconf -n # 2.2.9: /etc/dovecot/dovecot.conf doveconf: Warning: service auth { client_limit=40960 } is lower than required under max. load (41280) doveconf: Warning: service anvil { client_limit=40970 } is lower than required under max. load (41183) # OS: Linux 3.14-0.bpo.2-amd64 x86_64 Debian 7.5 auth_cache_size = 64 M auth_cache_ttl = 2 hours auth_failure_delay = 0 auth_mechanisms = plain login auth_username_chars = "abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ0123456789!#$-=?^_{}~./@+%" auth_username_translation = +@ auth_worker_max_count = 256 base_dir = /var/run/dovecot/ disable_plaintext_auth = no first_valid_gid = 1001 first_valid_uid = 1001 mail_fsync = always mail_location = maildir:~/ maildir_very_dirty_syncs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mmap_disable = yes namespace { inbox = yes location = prefix = INBOX. type = private } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile quota = maildir quota_rule = INBOX.Trash:ignore } protocols = " imap lmtp sieve pop3" service anvil { client_limit = 40970 } service auth-worker { user = dovecot } service auth { client_limit = 40960 unix_listener auth-userdb { group = mail mode = 0666 user = dovecot } } service imap-login { chroot = login inet_listener imap { address = *, [::] port = 143 } inet_listener imaps { address = * port = 993 ssl = yes } process_limit = 20480 process_min_avail = 32 service_count = 0 user = dovecot vsz_limit = 256 M } service imap { process_limit = 40960 vsz_limit = 512 M } service lmtp { inet_listener lmtp { address = 27.54.95.43 port = 24 } process_min_avail = 32 } service managesieve-login { client_limit = 40960 process_limit = 120 process_min_avail = 5 service_count = 0 vsz_limit = 64 M } service managesieve { process_limit = 4096 vsz_limit = 256 M } service pop3-login { chroot = login inet_listener pop3 { address = *, [::] port = 110 } inet_listener pop3s { address = * port = 995 ssl = yes } process_limit = 20480 process_min_avail = 32 service_count = 0 user = dovecot vsz_limit = 256 M } service pop3 { process_limit = 40960 vsz_limit = 256 M } ssl_cert = From skdovecot at smail.inf.fh-brs.de Fri Oct 24 06:46:55 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Fri, 24 Oct 2014 08:46:55 +0200 (CEST) Subject: Error renaming folders with spaces In-Reply-To: References: Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Fri, 24 Oct 2014, mtrainer at cloud-free.com wrote: > I am getting frequent errors of the form below. In most > cases the path has spaces in it. > > Oct 24 07:27:08 mailstore03 dovecot: > imap(sam at userdomain.com.au): Error: > rename(/home8/rs7-username/mail/xyzmortgages.com.au/sam/.Valuations - ABC, /home8/rs7-username/mail/xyzmortgages.com.au/sam/.Valuations - ABC/Subfolder) failed: Invalid argument > > Any ideas what is causing these errors? > > mail_location = maildir:~/ the "/Subfolder" part looks erroreously for me. Your setup does not support slashes in mailbox names. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBVEn14Xz1H7kL/d9rAQKJKAf+Nt6gOPEspAlFiTqC4GiP8UTGBO4YbvRv C2EdDdFVO3zDpgmu7rNwnjVRvWtIYCQ3535O08J2aQznXcVT75HAEdl2o6YJh5QL B8/Wz/u3+WCXLvtfyC0WqpJzqE58+fNg9PyOg88R+FgPBBvy6VcNcuJGlsl7/dRN FbviVWvszUjw6fWC+DaH/fL+CPyPxPA0GemLfPSmPNe91jZlK5nOt0ga7DSczFjI jSRw35ZeJxuH3d+d0+IOVveEEEBySodT2fecUOYvURwSViaaFOk/tBm5nxAylB8h SP9yi042dDGIfMnniEGvcWJdUg9seHkHpAqZ65FGZilOHdMXqvzfIw== =dbjl -----END PGP SIGNATURE----- From skdovecot at smail.inf.fh-brs.de Fri Oct 24 06:54:53 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Fri, 24 Oct 2014 08:54:53 +0200 (CEST) Subject: Sieve Advice Needed, Please In-Reply-To: <1644664.k46JXDv0lc@m5> References: <1644664.k46JXDv0lc@m5> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Thu, 23 Oct 2014, Casey Bralla wrote: > I think this is a recursion problem, since the redirected mail has to go > through the spamassassin check and sieve again. I tried to get clever and > prevent the recursion, but I'm not clever enough. Here is my sieve rule > file. the easiest way would be to prevent Sieve filtering for "spam" at all. Or use another filter without this check. > # rule:[SPAM] > if header :contains "X-Spam-Flag" ["YES"] > { > if address :is "to" "Spam at VMailServerTest.NerdWorld.org" > { > keep; > } > else > { > redirect "spam at VMailServerTest.NerdWorld.org"; > } > } Did you've verified that "redirect" really alters the "to" header? Otherwise you need to use the envelope information. See http://wiki2.dovecot.org/Pigeonhole/Sieve - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBVEn3vnz1H7kL/d9rAQLpWggAtL976eZWk7xyI4WcqMMv6Zzuy4ylFf0z 2wbMt+YzuZ3oRWDw/K6Fqx4CqaWxte0MqdqzDpbJb2wrQSDXHRvs16oUOss0WN7o cL/o4mdI4sn9W1/I1+QZb5kb+CqAT8HgvWdek4kQYoG01QN8NtvtEEliRttMMT/D KAecKG+RvHdYfTOxyEAjKGcCZBspd928qCKZiqM4nyGtNM7tavLb9xaQd1ueRE/b UD54MY896+AemRUITMQDqbyDVHWIawcpCcoLMq2+uTGtatBhdUuNERcbXQrzj3cB kbXuJSMnODoOKYK0e/3ZMHPZYo5v/KQftasi0BACUHI8mTe0HUpMIw== =KtCK -----END PGP SIGNATURE----- From tom at whyscream.net Fri Oct 24 09:18:50 2014 From: tom at whyscream.net (Tom Hendrikx) Date: Fri, 24 Oct 2014 11:18:50 +0200 Subject: Invoking the spam checker on the sieve script In-Reply-To: <544990C0.2010104@myzel.net> References: <201410231711.42325.suy@badopi.org> <544990C0.2010104@myzel.net> Message-ID: <544A197A.7020108@whyscream.net> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256 On 24-10-14 01:35, Peter Chiochetti wrote: > Am 2014-10-23 um 17:11 schrieb Alejandro Exojo: >> >> I moved to IMAP and my filters are server side with sieve, but I >> don't have spam filtering yet. > > I understand, that you do not want spamassassin (SA) to check lots > of messages that are clean anyways. > > If you can call SA from sieve, as a condtion in an if clause, > filtering should be no problem, should it? > SIeve even has a facility for doing virus/spam filtering: http://wiki2.dovecot.org/Pigeonhole/Sieve/Examples#Filtering_using_the_spamtest_and_virustest_extensions But running spamasassin on the MTA level with some whitelist entries would also work, and is probably a lot easier to setup. Regards, Tom -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQIcBAEBCAAGBQJUShl3AAoJEJPfMZ19VO/1NfcQALheA5RhOsMbgy2hP0pjEhNe O49rjC8OTAIeTD7Eb+p6bWQ+fI03uHrpmNFeq9zMdaYeiRaJQLvi34M1xK3qC53O lyq+sPkwvqnU6Ak0G1E+UN3/BvJh22kPZJYaoMELxHh0smfnmZwNeyPjK/sBYblE 1vTo6bdPX/r9QtINxkW8cqqjlrx1FtV7PX4Nzuy/HpvtigcM8nwQFDE5QvZabXNt pT2camQtP96YHofwFQSrND+q1y2TgCribHMPi0bWxwmktAThkEFl4kDA1KUsNVmR 2tX4nk5HHkuynCWK9oNkM8FhLyraESu1JySBsghbQFk6VBnmapsYkgcpRRnOwIGF HFRIGbSsXwbue5HPkkLrNfIBZR1L7V4iJqmzWw19IrnOylE8okUL6KQcFWPA1yPS 6pL9VT2quIm9Eyqh3gbOEDtTtKg2tkI6E7DSmNEj0WqTnc7+Ax39r8zqTX47/b0N 8Xasiw3RANU1xUdXSXY8D4bGrSJ4GaKaOWIOQwICv6Lk6L6mIeRaK/OyNnLBGxwK ekOFmcTG5RdboQIjzjS9S2Rxyw/KAIxHPuWYZH9cq2IM4qKxLutogQQxkKD1MIEm IgylLkQSqnRszyz+d9shWpD1tTbXAEGN+ZNWREFHL/CeaE5YphCTvjU0nHfl+6bF Muv/j4Qh1L2acmwnIy+O =808Z -----END PGP SIGNATURE----- From tom at whyscream.net Fri Oct 24 09:26:12 2014 From: tom at whyscream.net (Tom Hendrikx) Date: Fri, 24 Oct 2014 11:26:12 +0200 Subject: Invoking the spam checker on the sieve script In-Reply-To: <544A197A.7020108@whyscream.net> References: <201410231711.42325.suy@badopi.org> <544990C0.2010104@myzel.net> <544A197A.7020108@whyscream.net> Message-ID: <544A1B34.9090900@whyscream.net> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256 On 24-10-14 11:18, Tom Hendrikx wrote: > > > On 24-10-14 01:35, Peter Chiochetti wrote: >> Am 2014-10-23 um 17:11 schrieb Alejandro Exojo: >>> >>> I moved to IMAP and my filters are server side with sieve, but >>> I don't have spam filtering yet. > >> I understand, that you do not want spamassassin (SA) to check >> lots of messages that are clean anyways. > >> If you can call SA from sieve, as a condtion in an if clause, >> filtering should be no problem, should it? > > SIeve even has a facility for doing virus/spam filtering: > http://wiki2.dovecot.org/Pigeonhole/Sieve/Examples#Filtering_using_the_spamtest_and_virustest_extensions Never > mind, this was only for evaluating the headers added in an earlier stage, not running the spam classifier itself. You could still do that on a sieve level using extprograms, but the MTA route is a lot easier to setup. I did use extprograms to do automated bayes training as an experiment: while running 2 spam filters (X and Y), if X thinks it's spam and Y is unsure, sieve automatically triggers a script that makes Y learn the message as spam. Regards, Tom -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQIcBAEBCAAGBQJUShs0AAoJEJPfMZ19VO/1wKYP/3SXXlgktjFKL7wy90zJwFcy WoXAIMFbq2JJNbIcPDdzVR4xY7SDMTAcNNbuzJKVU/dPxNfbGIs1rlaM3hF3pdx3 nRpLhICAyD6J+IC4Ov5nBE/N0tbh5pefLkEvCyIRuKtRBljkbrKp2xy//mad+5yP pBkGVwNYaLcLeYsTIkiDD6zErRJknXJw/ddnsRRfAb/dwOT38XdP72ZzojndI3CC +hbh21iaTebkyNAL1N7ekR/IJ/kMK9cPDLKWoM/aa7SFpqYkd2tNqIBHmwDhXbAw MhF/S46qvejbBCqFhEvfoWWpIJrHeji5QfSpYe9fp5K3cQtN/gdVcl0w7T+vr8C1 UHnvoCIGNeN6HsabaTyNnoKh90oneEO7io6/e5AsZWPkBll3jgBmxHwctojd4/qC bQRqK7LXyMia+ff+YgHmseyif56dLX6R96CFI3Y1OhnMPRQxPlSczTDEXPpRxiwl bpIa54iJP9bitooq024F31/olaSy4qpsAzDe4tEm3J2iRHh3RcGDQbMw+ogiVTn/ owuvzxBBj/0Hx8HswYrp2hOy+jt29kbTNpP2fmfev66aRYERJT7SUeRlwL5mfNwt BuVy28ctq0JXuc/X7NfkGo4wRJedy2RmKnODVRg9JFXAtIy/GbJ4d8hYxt2MAD6f Ubl/0gv96T2GSgi31CKu =W8PB -----END PGP SIGNATURE----- From nik600 at gmail.com Fri Oct 24 10:20:08 2014 From: nik600 at gmail.com (nik600) Date: Fri, 24 Oct 2014 12:20:08 +0200 Subject: dovecot-lda from postfix on remote dovecot server Message-ID: Dear all i've got many SMTP front-end that filter the mail and do some custom stuff... then when i've decided the final destination i'd like to call /usr/lib/dovecot/dovecot-lda to deliver the mail. Actually i have in master.cf: #####################? dovecot unix - n n - - pipe flags=DRhu user=vmail:vmail null_sender= argv=/usr/lib/dovecot/dovecot-lda -f ${sender} -d ${recipient} #####################? I'd like to know if is possible to use some other command or some additional parameter to deliver the mail to a remote dovecot server. Thanks -- /*************/ nik600 http://www.kumbe.it From tom at whyscream.net Fri Oct 24 10:27:45 2014 From: tom at whyscream.net (Tom Hendrikx) Date: Fri, 24 Oct 2014 12:27:45 +0200 Subject: dovecot-lda from postfix on remote dovecot server In-Reply-To: References: Message-ID: <544A29A1.2040704@whyscream.net> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256 On 24-10-14 12:20, nik600 wrote: > Dear all > > i've got many SMTP front-end that filter the mail and do some > custom stuff... then when i've decided the final destination i'd > like to call > > /usr/lib/dovecot/dovecot-lda to deliver the mail. > > Actually i have in master.cf: > > #####################? dovecot unix - n n - > - pipe flags=DRhu user=vmail:vmail null_sender= > argv=/usr/lib/dovecot/dovecot-lda -f ${sender} -d ${recipient} > #####################? > > I'd like to know if is possible to use some other command or some > additional parameter to deliver the mail to a remote dovecot > server. > You could enable LMTP on the remote server, and deliver to that. I don't know how secure that is: do postfix and dovecot both support lmtp over tls, and does that even matter when hardware is in the same rack and has dedicated networking? Or you could install an MTA on the remote server which delivers to dovecot, and configure postfix to relay the mail to that mta. Tom -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQIcBAEBCAAGBQJUSimhAAoJEJPfMZ19VO/10ngP/0dF4PqkFE7vy+jCxlM7tkN/ dhr+btTSNhcjKlt1BgGkH4AJEidQLXKqFX7YOcAs+ZdLPwKthxIP8irokZwM0GkT d1crTQ0HoA8a3Mw6gw1Xw4qrpQnhhzBjEK4yPWLe9gig+ocgozfWM8+8sSNzZa5S 9R8WzaAXhAox8ppZT9BR3a+hHPih0BSYA9yKwGQ2T/OzLjHhytLE46ZBmjBL09tp UM+ifYcjko1udFkZumbyGrdVBDjg3wG0veC+bCmFwLldOM7+cfsNqwuil5BST0JC Lz/98by/8mDJcF8645lcRkKkIGgQhmIg1VxjeGXRThFM64k+8iauClPb0/bdpvzw GvDN51R0ljjR8nGU2zpnax+BaxItgo8inDpE5CVaaH3gKAwpxaKOdgkABLldGMPH hNLpajHO15c/I/MNktDjRNojm9vP39jh7YRFVpkg6s2QjsDdjiP5EhaJkdfKe334 hpVI5nJNwZUAuUCE72h0MO2vPesQZzZjH4T7WpxTCcVja3VNQnmWoJ/6MOgzHKOt l7jksmJwIFKukSTLZf1zEehyDjBcpbvDmgOY5r52SmBeY0QGyq7QpMs30iXFRmX0 Qj8BYrknXB8EdV0GXb3voRxjjT6H4nBYfBkfQYOSMTxZ5g19NQ6Zzy5bpVpPfPQ+ 9pYFJ0mnxaV2vYdhXxvo =VY8B -----END PGP SIGNATURE----- From deano-dovecot at areyes.com Fri Oct 24 12:46:56 2014 From: deano-dovecot at areyes.com (deano-dovecot at areyes.com) Date: Fri, 24 Oct 2014 08:46:56 -0400 Subject: Invoking the spam checker on the sieve script In-Reply-To: <201410231819.06655.suy@badopi.org> References: <201410231711.42325.suy@badopi.org> <54492541.5020604@sys4.de> <201410231819.06655.suy@badopi.org> Message-ID: On 2014-10-23 12:19, Alejandro Exojo wrote: > That most of my mail comes from 100% assured not spam sources: mailing > lists > that are already filtered or rss2email (the second probably can be > skipped > easily because it comes locally). I only have a small VPS, so I'm > trying to > save some resources if possible. Spamassassin consumes quite a lot, > AFAIK. What kind of VPS are you using ? I'm in a similar boat to you, running my own domain(s) and email, and have built the mail system on a set of 3 VPS', two 6G ram that cost $7/mo and one 1G ram that's $3.50/mo. The two larger ones run exim4, spamassassin, clamav, nginx, roundcube, dovecot, munin (stats), solr (search), zpush, tinyrss, percona (mysql). It all works swimmingly well. The main setup will run in a 2G ram VPS, albeit with some swapping. If you're on an SSD-backed VPS, it works OK - that was my old setup with Digital Ocean. ClamAV is the memory hog, spamassassin really isn't bad , so you might give it a shot ... 24576 www-data php /usr/share/tt-rss/www/u 0 10732 12943 17572 3310 unbound /usr/sbin/unbound 0 17644 17779 19084 5298 debian-spamd spamd chil 0 1860 34989 101596 5297 debian-spamd spamd chil 0 2156 35137 101596 5292 root /usr/sbin/spamd --max-child 0 3148 36869 104944 3474 tomcat6 /usr/lib/jvm/default-java/b 0 122240 122621 124692 5480 clamav /usr/sbin/clamd 0 416496 416726 417804 20010 mysql /usr/sbin/mysqld --basedir= 0 684200 684523 686692 All the mysql stuff is a 3-node replication cluster, the two main systems and a 3rd (small one) just running percona. Dovecot is also replicating between the two main systems. This way ALL the data is replicated between them, and I can hit either main system for all functionality. Replication is over tinc encrypted sessions. -- Dean Carpenter deano is at areyes dot com 203 six oh four 6644 From hans at MPA-Garching.MPG.DE Fri Oct 24 13:16:12 2014 From: hans at MPA-Garching.MPG.DE (Hans-Werner Paulsen) Date: Fri, 24 Oct 2014 15:16:12 +0200 Subject: Replication .dovecot-sync.lock Message-ID: <20141024131612.GA4005@nct-6.MPA-Garching.MPG.DE> Hello all, I have set up two servers with dovecot and replication. The mail location is mail_location = sdbox:/var/spool/mail/%u Everything works fine when I override the homedirectories userdb { driver = passwd override_fields = home=/var/spool/mail/%u } But, when I do not override the homedirectories, replication does not work, and the following error is logged: Oct 24 14:40:45 dsync-local(hans): Error: Couldn't create lock /afs/mpa/home/hans/.dovecot-sync.lock: Permission denied With a self-written module an IMAP user can get access to his homedirectory: protocol imap { mail_plugins = afsToken } The user has to type in his password. Obviously this does not work for replication. Is there a way to specify a different location for the lockfile? Isn't better to use the maildirectory but the homedirectory? Is there a way to set the homedirectory differently for replication? Thank you for any help. HW -- Hans-Werner Paulsen hans at MPA-Garching.MPG.DE MPI f?r Astrophysik Tel 089-30000-2602 Karl-Schwarzschild-Str. 1 Fax 089-30000-2235 D-85741 Garching From nik600 at gmail.com Fri Oct 24 14:57:37 2014 From: nik600 at gmail.com (nik600) Date: Fri, 24 Oct 2014 16:57:37 +0200 Subject: dovecot-lda from postfix on remote dovecot server In-Reply-To: <544A29A1.2040704@whyscream.net> References: <544A29A1.2040704@whyscream.net> Message-ID: Ok i've used lmtp with some acl on firewall...thanks! Il 24/ott/2014 12:27 "Tom Hendrikx" ha scritto: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA256 > > On 24-10-14 12:20, nik600 wrote: > > Dear all > > > > i've got many SMTP front-end that filter the mail and do some > > custom stuff... then when i've decided the final destination i'd > > like to call > > > > /usr/lib/dovecot/dovecot-lda to deliver the mail. > > > > Actually i have in master.cf: > > > > #####################? dovecot unix - n n - > > - pipe flags=DRhu user=vmail:vmail null_sender= > > argv=/usr/lib/dovecot/dovecot-lda -f ${sender} -d ${recipient} > > #####################? > > > > I'd like to know if is possible to use some other command or some > > additional parameter to deliver the mail to a remote dovecot > > server. > > > > You could enable LMTP on the remote server, and deliver to that. I > don't know how secure that is: do postfix and dovecot both support > lmtp over tls, and does that even matter when hardware is in the same > rack and has dedicated networking? > > Or you could install an MTA on the remote server which delivers to > dovecot, and configure postfix to relay the mail to that mta. > > Tom > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1 > > iQIcBAEBCAAGBQJUSimhAAoJEJPfMZ19VO/10ngP/0dF4PqkFE7vy+jCxlM7tkN/ > dhr+btTSNhcjKlt1BgGkH4AJEidQLXKqFX7YOcAs+ZdLPwKthxIP8irokZwM0GkT > d1crTQ0HoA8a3Mw6gw1Xw4qrpQnhhzBjEK4yPWLe9gig+ocgozfWM8+8sSNzZa5S > 9R8WzaAXhAox8ppZT9BR3a+hHPih0BSYA9yKwGQ2T/OzLjHhytLE46ZBmjBL09tp > UM+ifYcjko1udFkZumbyGrdVBDjg3wG0veC+bCmFwLldOM7+cfsNqwuil5BST0JC > Lz/98by/8mDJcF8645lcRkKkIGgQhmIg1VxjeGXRThFM64k+8iauClPb0/bdpvzw > GvDN51R0ljjR8nGU2zpnax+BaxItgo8inDpE5CVaaH3gKAwpxaKOdgkABLldGMPH > hNLpajHO15c/I/MNktDjRNojm9vP39jh7YRFVpkg6s2QjsDdjiP5EhaJkdfKe334 > hpVI5nJNwZUAuUCE72h0MO2vPesQZzZjH4T7WpxTCcVja3VNQnmWoJ/6MOgzHKOt > l7jksmJwIFKukSTLZf1zEehyDjBcpbvDmgOY5r52SmBeY0QGyq7QpMs30iXFRmX0 > Qj8BYrknXB8EdV0GXb3voRxjjT6H4nBYfBkfQYOSMTxZ5g19NQ6Zzy5bpVpPfPQ+ > 9pYFJ0mnxaV2vYdhXxvo > =VY8B > -----END PGP SIGNATURE----- > From sire8c at sidor.com Fri Oct 24 18:55:26 2014 From: sire8c at sidor.com (CARDENAS Eduardo SIDOR) Date: Fri, 24 Oct 2014 14:25:26 -0430 Subject: Multiple user attributes in LDAP Message-ID: <544AA09E.7000306@sidor.com> Hello, I have an issue with dovecot and Ldap? Any help will be grateful? I have dovecot 1.2.15 and i want to know if in that version can i use two values returned from LDAP in the user_attrs template? Thanking you in anticipation? -- " Notificaci?n Autom?tica: Este mensaje y cualquier archivo que se adjunte contiene informaci?n privilegiada y confidencial. Es para uso exclusivo del destinatario. Si usted ha recibido esta comunicaci?n por error, por favor av?senos inmediatamente. Automatic notification: This e-mail and any file transmitted with it are confidential and may be legally privileged. It is intended solely for the addressee and may not be disclosed to or used by anyone other than the addressee. If you have received this e-mail by mistake , please advise the sender immediately" -------------- next part -------------- A non-text attachment was scrubbed... Name: Firma.png Type: image/png Size: 12072 bytes Desc: not available URL: From info at eye-catching-webdesign.de Fri Oct 24 19:02:09 2014 From: info at eye-catching-webdesign.de (Lucas Rothamel - Eye Catching Webdesign) Date: Fri, 24 Oct 2014 21:02:09 +0200 Subject: Replication only sporadic Message-ID: <544AA231.6010203@eye-catching-webdesign.de> Hello dear Dovecot Gurus, I am setting up two servers with Dovecot replication as hot-standby servers for a small high availability cluster, switch-over through DNS-redirect. For testing purposes, both servers are generating a small test mail every few minutes and delivering to the local dovecot each. In my mail client, I added both servers through IMAP to watch how the replication is working. However, I noted that replication is very sporadic: sometimes a new email is received "instantaneous" by both servers, then no replication updates are visible for hours, and suddenly all missing mail appear in the other server. Why is this? Can this be changed to be more realtime? Thank you! Lucas doveconf -n: # 2.2.14: /usr/local/etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.7 ext4 auth_mechanisms = plain login cram-md5 disable_plaintext_auth = no info_log_path = /var/log/dovecot-info.log log_timestamp = "%Y-%m-%d %H:%M:%S " mail_debug = yes mail_location = maildir:/home/%d/%n/Maildir mail_plugins = " notify replication" mail_privileged_group = mail passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } plugin { mail_replica = remote:vmail at ... quota = maildir:User quota quota_rule = *:storage=1GB replication_full_sync_interval = 1 hours } protocols = imap pop3 service aggregator { fifo_listener replication-notify-fifo { mode = 0600 user = vmail } unix_listener replication-notify { mode = 0600 user = vmail } } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } user = root } service config { unix_listener config { user = vmail } } service doveadm { user = vmail } service replicator { process_min_avail = 1 } ssl_cert = ... ssl_key = ... userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } protocol imap { mail_plugins = quota imap_quota } protocol pop3 { mail_plugins = quota pop3_uidl_format = %08Xu%08Xv } protocol lda { info_log_path = /var/log/dovecot-lda.log mail_plugins = quota postmaster_address = ... } -- Lucas Rothamel Eye Catching Webdesign info at eye-catching-webdesign.de - www.eye-catching-webdesign.de You know, we go to the gym to keep the body fit. Similarly the mind needs some rest. The mind is bombarded with so many impressions. Our mind has been bombarded by impressions the whole time. It needs a different kind of rest other than sleep. And meditation is such a rest. It calms the mind. energizes the spirit and makes the body more strong and vibrant. improves the immune system. The immune cells, the T-cell count go higher through Sudarshan Kriya and meditation. And you feel so nice inside. - Sri Sri Ravi Shankar I love deadlines. I like the whooshing sound they make as they fly by. -- Douglas Adams -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4222 bytes Desc: S/MIME Cryptographic Signature URL: From h.reindl at thelounge.net Fri Oct 24 19:05:26 2014 From: h.reindl at thelounge.net (Reindl Harald) Date: Fri, 24 Oct 2014 21:05:26 +0200 Subject: Multiple user attributes in LDAP In-Reply-To: <544AA09E.7000306@sidor.com> References: <544AA09E.7000306@sidor.com> Message-ID: <544AA2F6.4070206@thelounge.net> Am 24.10.2014 um 20:55 schrieb CARDENAS Eduardo SIDOR: and *that* is why you should not post HTML at all to lists as well as not put *disclaimer* crap while write to a *public* list - if your company thinks it is smart to add that unconditionally just use a sane freemail provider for lists! the only thing thunderbird shows is the beautiful but *useless* vcard-img, the rest of your posting is the invisible plain-text alternate if someone looks in the source code -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 181 bytes Desc: OpenPGP digital signature URL: From sire8c at sidor.com Fri Oct 24 19:07:40 2014 From: sire8c at sidor.com (CARDENAS Eduardo SIDOR) Date: Fri, 24 Oct 2014 14:37:40 -0430 Subject: Multiple user attributes in LDAP In-Reply-To: <544AA09E.7000306@sidor.com> References: <544AA09E.7000306@sidor.com> Message-ID: <544AA37C.8070405@sidor.com> > Hello, I have an issue with dovecot and Ldap? Any help will be grateful? > I have dovecot 1.2.15 and i want to know if in that version can i use two values returned from LDAP in the user_attrs template? > > Thanking you in anticipation? > > -- " Notificaci?n Autom?tica: Este mensaje y cualquier archivo que se adjunte contiene informaci?n privilegiada y confidencial. Es para uso exclusivo del destinatario. Si usted ha recibido esta comunicaci?n por error, por favor av?senos inmediatamente. Automatic notification: This e-mail and any file transmitted with it are confidential and may be legally privileged. It is intended solely for the addressee and may not be disclosed to or used by anyone other than the addressee. If you have received this e-mail by mistake , please advise the sender immediately" From me at junc.eu Fri Oct 24 22:27:01 2014 From: me at junc.eu (Benny Pedersen) Date: Sat, 25 Oct 2014 00:27:01 +0200 Subject: dovecot-lda from postfix on remote dovecot server In-Reply-To: References: Message-ID: <14944451b20.280b.d475fad7b14312f5d8424e35e39f7512@junc.eu> On October 24, 2014 12:20:08 PM nik600 wrote: > I'd like to know if is possible to use some other command or some > additional parameter to deliver the mail to a remote dovecot server. Dovecot lda is local, with postfix lmtp you can deliver to remote dovecot lmtp, hope you will see wiki or google how to setup lmtp From tss at iki.fi Fri Oct 24 23:14:05 2014 From: tss at iki.fi (Timo Sirainen) Date: Fri, 24 Oct 2014 16:14:05 -0700 Subject: 2.2.14 and "Panic: file virtual-sync.c" In-Reply-To: References: Message-ID: <36DF3AEB-34F9-4709-A092-0B51B2999950@iki.fi> On 21 Oct 2014, at 12:01, Michael K?hler wrote: > after upgrading to 2.2.14 (debian wheezy with apt source from rename-it.nl) I?ve got from time to time a panic in virtual plugin. Here are an excerpt from the log file: > > ---------------------------------- > Oct 21 20:44:15 mailserver dovecot: imap(michael at DOMAIN): flag_change: box=Virtual.Ungelesen, uid=1, msgid=<54466F71.3050702 at makomi.de>, size=1661, flags=(\Seen \Draft \Recent) > Oct 21 20:44:15 mailserver dovecot: imap(michael at DOMAIN): Panic: file virtual-sync.c: line 1115 (virtual_sync_backend_box): assertion failed: (array_count(&bbox->sync_pending_removes) == 0) Fixed: http://hg.dovecot.org/dovecot-2.2/rev/37a3c6c001b7 From tss at iki.fi Fri Oct 24 23:18:25 2014 From: tss at iki.fi (Timo Sirainen) Date: Fri, 24 Oct 2014 16:18:25 -0700 Subject: Replication .dovecot-sync.lock In-Reply-To: <20141024131612.GA4005@nct-6.MPA-Garching.MPG.DE> References: <20141024131612.GA4005@nct-6.MPA-Garching.MPG.DE> Message-ID: <49341971-C4A0-4FEE-B8C3-66F49C2040BF@iki.fi> On 24 Oct 2014, at 06:16, Hans-Werner Paulsen wrote: > Hello all, > I have set up two servers with dovecot and replication. The mail location is > mail_location = sdbox:/var/spool/mail/%u > Everything works fine when I override the homedirectories > userdb { > driver = passwd > override_fields = home=/var/spool/mail/%u > } > But, when I do not override the homedirectories, replication does not work, > and the following error is logged: > Oct 24 14:40:45 dsync-local(hans): Error: Couldn't create lock /afs/mpa/home/hans/.dovecot-sync.lock: Permission denied > > With a self-written module an IMAP user can get access to his homedirectory: > protocol imap { > mail_plugins = afsToken > } > The user has to type in his password. Obviously this does not work for > replication. > Is there a way to specify a different location for the lockfile? > Isn't better to use the maildirectory but the homedirectory? > Is there a way to set the homedirectory differently for replication? Is there anything in the user's real home directory that Dovecot needs? Dovecot expects to be able to write there. It's not just replicator, it's also if you use LDA/LMTP it writes .dovecot.lda-dupes files in there. http://wiki2.dovecot.org/VirtualUsers/Home From tss at iki.fi Fri Oct 24 23:20:34 2014 From: tss at iki.fi (Timo Sirainen) Date: Fri, 24 Oct 2014 16:20:34 -0700 Subject: Dovecot Master/Master Replication Problem In-Reply-To: <544816D5.3070407@fuqu.me> References: <544816D5.3070407@fuqu.me> Message-ID: On 22 Oct 2014, at 13:43, Felix Amler wrote: > 2014-10-22 22:35:05 dsync-server(localpart at domain.de): Error: stat(/var/maildir/domain.de/localpart/.dovecot-sync.lock/tmp) failed: Not a directory > 2014-10-22 22:35:05 dsync-server(localpart at domain.de): Error: Failed to access mailbox dovecot-sync.lock: Internal error occurred. Refer to server log for more information. [2014-10-22 22:35:05] Ideally don't use home dir = maildir. http://wiki2.dovecot.org/VirtualUsers/Home > I googled a bit, this could habben if there is a file ".dovecot-sync.lock" in the maildir, but I've double checked that, there is no such file... > Why does it work in one direction, but not in the other? Set maildir_stat_dirs=yes or change the home. From tss at iki.fi Fri Oct 24 23:43:28 2014 From: tss at iki.fi (Timo Sirainen) Date: Fri, 24 Oct 2014 16:43:28 -0700 Subject: Properly "locking" a useraccount (on a proxy) In-Reply-To: <20141021182729.GB15212@sys4.de> References: <20141021182729.GB15212@sys4.de> Message-ID: <410C7A3F-322F-4400-9D5C-36E6274AD68F@iki.fi> On 21 Oct 2014, at 11:27, Ralf Hildebrandt wrote: > But how can I "lock" a user during migration? > > The plan is: > ============ > > * lock the user > * kick the user (doveadm kick) > * migrate mailbox (some rsync magic) > * unlock the user again Alternative is to use "doveadm sync" and you don't necessarily even need to lock anything at all. > But how would I lock the user? > > What locking needs to achieve: > > 1) Disallow IMAP/POP login (that's easy!) Yeah, many ways. > 2) defer LMTP delivery somehow (Postfix is talking to dovecot's LMTP server) - LMTP proxy does a passdb lookup. I'm not sure if there's any good way to fail in here. I was planning to suggest allow_nets=0.0.0.0/32 but looks like LMTP proxying just ignores that. Fixed now: http://hg.dovecot.org/dovecot-2.2/rev/3a8b417b0b80 - LMTP backend does a userdb lookup. Userdb lookup can return either "user doesn't exist" or "temporary failure". Nothing else. You can have it return a temporary failure by having it return "tempfail" extra field. From tss at iki.fi Fri Oct 24 23:57:01 2014 From: tss at iki.fi (Timo Sirainen) Date: Fri, 24 Oct 2014 16:57:01 -0700 Subject: 2.2.14 Panic in sync_expunge_range() In-Reply-To: <20141020082648.GA26400@alf.uib.no> References: <20141020082648.GA26400@alf.uib.no> Message-ID: Fixed: http://hg.dovecot.org/dovecot-2.2/rev/1886e0616ab5 On 20 Oct 2014, at 01:26, Hans Morten Kind wrote: > I am getting some panics after upgrading from 2.2.13 to 2.2.14 > > This panic happens for one user only, he is subscribed to 86 folders, > on two of them this panic happens quite often - several times a day. > > The mbox folders seems OK, less than 30M with 30 and 200 messages. > > Panic: file mail-index-sync-update.c: line 250 (sync_expunge_range): assertion failed: (count > 0) > > hmk > > > GNU gdb 6.8 > Copyright (C) 2008 Free Software Foundation, Inc. > License GPLv3+: GNU GPL version 3 or later > This is free software: you are free to change and redistribute it. > There is NO WARRANTY, to the extent permitted by law. Type "show copying" > and "show warranty" for details. > This GDB was configured as "i386-pc-solaris2.10"... > Reading symbols from /datapool/local/dovecot-2.2.14/lib/dovecot/libdovecot-storage.so.0...done. > Loaded symbols for /local/dovecot-2.2.14/lib/dovecot/libdovecot-storage.so.0 > Reading symbols from /datapool/local/dovecot-2.2.14/lib/dovecot/libdovecot.so.0...done. > Loaded symbols for /local/dovecot-2.2.14/lib/dovecot/libdovecot.so.0 > Reading symbols from /datapool/local/program/lib/libssl.so.1.0.0...done. > Loaded symbols for /local/program/lib/libssl.so.1.0.0 > Reading symbols from /datapool/local/program/lib/libcrypto.so.1.0.0...done. > Loaded symbols for /local/program/lib/libcrypto.so.1.0.0 > Reading symbols from /datapool/local/program/lib/libz.so...done. > Loaded symbols for /local/program/lib/libz.so > Reading symbols from /lib/libm.so.2...done. > Loaded symbols for /lib/libm.so.2 > Reading symbols from /datapool/local/program/lib/libiconv.so.2...done. > Loaded symbols for /local/program/lib/libiconv.so.2 > Reading symbols from /lib/librt.so.1...done. > Loaded symbols for /lib/librt.so.1 > Reading symbols from /lib/libnsl.so.1...done. > Loaded symbols for /lib/libnsl.so.1 > Reading symbols from /lib/libsocket.so.1...done. > Loaded symbols for /lib/libsocket.so.1 > Reading symbols from /lib/libsendfile.so.1...done. > Loaded symbols for /lib/libsendfile.so.1 > Reading symbols from /lib/libc.so.1...done. > Loaded symbols for /lib/libc.so.1 > Reading symbols from /lib/libdl.so.1...done. > Loaded symbols for /lib/libdl.so.1 > Reading symbols from /usr/lib/libz.so...done. > Loaded symbols for /usr/lib/libz.so > Reading symbols from /lib/libaio.so.1...done. > Loaded symbols for /lib/libaio.so.1 > Reading symbols from /lib/libmd.so.1...done. > Loaded symbols for /lib/libmd.so.1 > Reading symbols from /lib/ld.so.1...done. > Loaded symbols for /lib/ld.so.1 > Core was generated by `dovecot/imap imap-postlogin'. > Program terminated with signal 6, Aborted. > [New process 76621 ] > #0 0xfe7fc8e5 in _lwp_kill () from /lib/libc.so.1 > #0 0xfe7fc8e5 in _lwp_kill () from /lib/libc.so.1 > No symbol table info available. > #1 0xfe7f7765 in thr_kill () from /lib/libc.so.1 > No symbol table info available. > #2 0xfe7a376f in raise () from /lib/libc.so.1 > No symbol table info available. > #3 0xfe7829e1 in abort () from /lib/libc.so.1 > No symbol table info available. > #4 0xfeda13ba in default_fatal_finish (type=LOG_TYPE_PANIC, status=0) at failures.c:152 > backtrace = 0x8093660 "0xfeda22d7 -> 0xfeda15d3 -> 0xfef31e5f -> 0xfef32d65 -> 0xfef3349e -> 0xfef33b77 -> 0xfef1dcbd -> 0xfef170e4 -> 0xfef173a4 -> 0xfef1767d -> 0xfef03e09 -> 0xfeea5540 -> 0xfeea5714 -> 0xfeea5857 -> 0xfe"... > #5 0xfeda22d7 in i_internal_fatal_handler (ctx=0x8047400, > format=0xfef5ebc8 "file %s: line %d (%s): assertion failed: (%s)", args=0x8047424 ".????") > at failures.c:152 > status = 0 > #6 0xfeda15d3 in i_panic (format=0xfef5ebc8 "file %s: line %d (%s): assertion failed: (%s)") > at failures.c:152 > ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0, timestamp_usecs = 0} > args = 0x8047424 ".????" > #7 0xfef31e5f in sync_expunge_range (ctx=0x8047600, seqs=0x80474d8) at ../../src/lib/array.h:197 > map = (struct mail_index_map *) 0x80c5d90 > range = (const struct seq_range *) 0x8093430 > i = 134509780 > count = 0 > dest_seq1 = 562 > prev_seq2 = 562 > orig_rec_count = 4277606968 > __FUNCTION__ = "sync_expunge_range" > #8 0xfef32d65 in mail_index_sync_record_real (ctx=0x8047600, hdr=0x80b5d28, data=0x80b5df8) > at ../../src/lib/array.h:197 > rec = (const struct mail_transaction_expunge_guid *) 0x80b8968 > end = (const struct mail_transaction_expunge_guid *) 0x80b8968 > seqs = {arr = {buffer = 0x8093410, element_size = 8}, v = 0x8093410, v_modifiable = 0x8093410} > seq = 0 > modseq = 32612 > ret = 0 > __FUNCTION__ = "mail_index_sync_record_real" > #9 0xfef3349e in mail_index_sync_record (ctx=0x8047600, hdr=0x80b5d28, data=0x80b5df8) > at ../../src/lib/array.h:197 > _data_stack_cur_id = 5 > ret = 1 > #10 0xfef33b77 in mail_index_sync_map (_map=0x80b5400, type=MAIL_INDEX_SYNC_HANDLER_HEAD, force=true) > at ../../src/lib/array.h:197 > map = (struct mail_index_map *) 0x0 > index = (struct mail_index *) 0x80b53b0 > view = (struct mail_index_view *) 0x80ab8b0 > sync_map_ctx = {view = 0x80ab8b0, modseq_ctx = 0x809ca50, cur_ext_map_idx = 0, > ext_intro_seq = 5, ext_intro_offset = 52, ext_intro_end_offset = 84, expunge_handlers = {arr = { > buffer = 0x0, element_size = 0}, v = 0x0, v_modifiable = 0x0}, extra_contexts = {arr = { > buffer = 0x809c348, element_size = 4}, v = 0x809c348, v_modifiable = 0x809c348}, > unknown_extensions = 0x0, type = MAIL_INDEX_SYNC_HANDLER_HEAD, sync_handlers_initialized = 0, > expunge_handlers_set = 0, expunge_handlers_used = 0, cur_ext_ignore = 0, internal_update = 0, > errors = 0} > thdr = (const struct mail_transaction_header *) 0x80b5d28 > tdata = (const void *) 0x80b5df8 > prev_seq = 5 > start_offset = 0 > prev_offset = 144 > ret = 1 > had_dirty = false > reset = true > __FUNCTION__ = "mail_index_sync_map" > #11 0xfef1dcbd in mail_index_map (index=0x80b53b0, type=MAIL_INDEX_SYNC_HANDLER_HEAD) > at mail-index-map-read.c:35 > ret = 1 > __FUNCTION__ = "mail_index_map" > #12 0xfef170e4 in mail_index_try_open (index=0x80b53b0) at ../../src/lib/array.h:197 > ret = 134919688 > __FUNCTION__ = "mail_index_try_open" > #13 0xfef173a4 in mail_index_open_files (index=0x80b53b0, flags=21) at ../../src/lib/array.h:197 > ret = 1 > #14 0xfef1767d in mail_index_open (index=0x80b53b0, flags=21) at ../../src/lib/array.h:197 > ret = 134960048 > __FUNCTION__ = "mail_index_open" > #15 0xfef03e09 in index_storage_mailbox_open (box=0x80b47c8, move_to_memory=false) at index-storage.c:39 > ibox = (struct index_mailbox_context *) 0x80b4a80 > index_flags = 21 > ret = 0 > __FUNCTION__ = "index_storage_mailbox_open" > #16 0xfeea5540 in mbox_mailbox_open_finish (mbox=0x80b47c8, move_to_memory=false) at mbox-storage.c:77 > No locals. > #17 0xfeea5714 in mbox_mailbox_open_existing (mbox=0x80b47c8) at mbox-storage.c:77 > box = (struct mailbox *) 0x80b47c8 > rootdir = 0xfeea581f "\215\225`???\211T$\004\211\004$?\023???\211E?\203}?" > box_path = 0x80b4b78 "/Home/USER/mail/pro/triad" > move_to_memory = false > #18 0xfeea5857 in mbox_mailbox_open (box=0x80b47c8) at mbox-storage.c:77 > mbox = (struct mbox_mailbox *) 0x80b47c8 > st = {st_dev = 82051096, st_pad1 = {0, 0, 0}, st_ino = 4141941, st_mode = 33152, st_nlink = 1, > st_uid = 32440, st_gid = 4601, st_rdev = 0, st_pad2 = {0, 0}, st_size = 16826589, st_atim = { > tv_sec = 1411034237, tv_nsec = 0}, st_mtim = {tv_sec = 1413152136, tv_nsec = 0}, st_ctim = { > tv_sec = 1413659956, tv_nsec = 975959000}, st_blksize = 8192, st_blocks = 33016, > st_fstype = "nfs", '\0' , st_pad4 = {0, 0, 0, 0, 0, 0, 0, 0}} > ret = 0 > #19 0xfeec94cc in mailbox_open_full (box=0x80b47c8, input=0x0) at ../../src/lib/array.h:197 > _data_stack_cur_id = 4 > ret = 143 > #20 0xfeec9807 in mailbox_open (box=0x80b47c8) at ../../src/lib/array.h:197 > No locals. > #21 0xfef024ec in index_storage_get_status (box=0x80b47c8, items=23, status_r=0x8047a04) > at index-status.c:23 > No locals. > #22 0xfeeca8ac in mailbox_get_status (box=0x80b47c8, items=23, status_r=0x8047a04) > at ../../src/lib/array.h:197 > __FUNCTION__ = "mailbox_get_status" > #23 0x08073ddb in imap_status_get (cmd=0x80b1fb8, ns=0x80ab1b0, mailbox=0x8093318 "pro/triad", > items=0x8047a70, result_r=0x8047a04) at imap-status.c:23 > client = (struct client *) 0x80b17b0 > box = (struct mailbox *) 0x80b47c8 > errstr = 0x8064d84 "\205?u\034\213\205h????D$\004\005" > ret = 0 > #24 0x08064e65 in cmd_status (cmd=0x80b1fb8) at cmd-status.c:23 > client = (struct client *) 0x80b17b0 > args = (const struct imap_arg *) 0x80ab240 > list_args = (const struct imap_arg *) 0x80ab328 > items = {status = 23, metadata = 0} > result = {status = {messages = 0, recent = 0, unseen = 0, uidvalidity = 0, uidnext = 0, > first_unseen_seq = 0, first_recent_uid = 0, last_cached_seq = 0, highest_modseq = 0, > highest_pvt_modseq = 0, keywords = 0x0, permanent_flags = 0, permanent_keywords = 0, > allow_new_keywords = 0, nonpermanent_modseqs = 0, no_modseq_tracking = 0, have_guids = 1, > have_save_guids = 0, have_only_guid128 = 0}, metadata = { > guid = "\000\000\000\000\001\000\000\000\r\000\000\000\033\000\000", virtual_size = 2199023255593, > cache_fields = 0xfe7a67f2, precache_fields = 134861792, backend_ns_prefix = 0x80921a8 "0(\t\b\030", > backend_ns_type = 134511236}, error = 134654712, errstr = 0x80b2038 "STATUS"} > ns = (struct mail_namespace *) 0x80ab1b0 > mailbox = 0x8093318 "pro/triad" > orig_mailbox = 0x80ab2f8 "pro/triad" > selected_mailbox = false > #25 0x0806aa61 in command_exec (cmd=0x80b1fb8) at imap-commands.c:101 > hook = (const struct command_hook *) 0x809bfd8 > ret = 8 > #26 0x080699d2 in client_command_input (cmd=0x80b1fb8) at imap-client.c:130 > client = (struct client *) 0x80b17b0 > command = (struct command *) 0x3 > __FUNCTION__ = "client_command_input" > #27 0x08069cb7 in client_command_input (cmd=0x80b1fb8) at imap-client.c:130 > client = (struct client *) 0x80b17b0 > command = (struct command *) 0x809d3d4 > __FUNCTION__ = "client_command_input" > #28 0x08069dba in client_handle_next_command (client=0x80b17b0, remove_io_r=0x8047b9d) > at imap-client.c:130 > No locals. > #29 0x08069e57 in client_handle_input (client=0x80b17b0) at imap-client.c:130 > _data_stack_cur_id = 3 > ret = 10 > remove_io = false > handled_commands = false > __FUNCTION__ = "client_handle_input" > #30 0x08069fe0 in client_input (client=0x80b17b0) at imap-client.c:130 > cmd = (struct client_command_context *) 0x80aa9a4 > output = (struct ostream *) 0x80abe08 > bytes = 55 > __FUNCTION__ = "client_input" > #31 0xfedba96d in io_loop_call_io (io=0x80abe70) at ioloop.c:28 > ioloop = (struct ioloop *) 0x809bf20 > t_id = 2 > __FUNCTION__ = "io_loop_call_io" > #32 0xfedbc0cc in io_loop_handler_run_internal (ioloop=0x809bf20) at ioloop-poll.c:96 > ctx = (struct ioloop_handler_context *) 0x809ca10 > pollfd = (struct pollfd *) 0x809e0a8 > tv = {tv_sec = 1799, tv_usec = 999672} > io = (struct io_file *) 0x80abe70 > msecs = 1800000 > ret = 0 > call = true > #33 0xfedbab06 in io_loop_handler_run (ioloop=0x809bf20) at ioloop.c:28 > No locals. > #34 0xfedbaa5d in io_loop_run (ioloop=0x809bf20) at ioloop.c:28 > __FUNCTION__ = "io_loop_run" > #35 0xfed41db1 in master_service_run (service=0x809be68, callback=0x80771da ) > at master-service.c:75 > No locals. > #36 0x08077577 in main (argc=2, argv=0x809bc78) at main.c:72 > set_roots = {0x8092fe0, 0x0} > login_set = {auth_socket_path = 0x80930e8 "", postlogin_socket_path = 0x8093120 "", > postlogin_timeout_secs = 60, callback = 0x8076f4e , > failure_callback = 0x807715d , request_auth_token = 1} > service_flags = MASTER_SERVICE_FLAG_KEEP_CONFIG_OPEN > storage_service_flags = MAIL_STORAGE_SERVICE_FLAG_DISALLOW_ROOT > username = 0x0 > c = -1 From marc at eciceron.se Sun Oct 19 15:25:01 2014 From: marc at eciceron.se (Marc Rantanen) Date: Sun, 19 Oct 2014 17:25:01 +0200 Subject: Dovecote 1.2.17 poodle Message-ID: Hi, how do I protect dovecot 1.2.17 against poodle? Br /Marc -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 842 bytes Desc: Message signed with OpenPGP using GPGMail URL: From fridi at dds.nl Wed Oct 22 13:15:14 2014 From: fridi at dds.nl (Frido Otten) Date: Wed, 22 Oct 2014 15:15:14 +0200 Subject: High I/O wait with Dovecot POP3 Message-ID: <5447ADE2.2070108@dds.nl> Hello, In the past we've had 4 loadbalanced servers configured with courier pop3 and dovecot handling respectively POP3 and IMAP connections. These 4 servers have a shared NFS storage on a Netapp FAS3220 controller with SAS disks. This setup is handling 50 POP3 sessions per second without any problems. Now we're installing 6 new loadbalanced servers to do the same job on the same storage, but using Dovecot to handle the POP3 sessions instead of Courier. The IMAP sessions are already handled by those 6 new servers, but we're encountering high iowait issues when using POP3 on those servers. I've applied the hints from http://wiki2.dovecot.org/NFS but this had no improvement. The 6 new servers are quad core Intel(R) Xeon(R) CPU X3323 @ 2.50GHz, with 4 GB RAM connected with gigabit ethernet connection to the storage. The 4 old servers are single core (w/o HT) P4 2,8 GHz with 1 GB RAM. # dovecot --version 2.1.7 # /usr/sbin/dovecot -n # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-686-bigmem i686 Debian 6.0.10 ext4 auth_cache_negative_ttl = 0 auth_cache_size = 8 k auth_mechanisms = plain digest-md5 cram-md5 login base_dir = /var/run/imap/ dict { acl = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no login_greeting = Dovecot MX. login_log_format_elements = user=<%u> method=%m rip=%r lip=%l %c mail_fsync = always mail_location = maildir:/var/spool/mail/%1u/%1.1u/%u mail_nfs_index = yes mail_nfs_storage = yes maildir_stat_dirs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mmap_disable = yes namespace { inbox = yes location = prefix = separator = . type = private } namespace { list = children location = maildir:/var/spool/mail/%%1u/%%1.1u/%%u/:INDEX=/var/spool/mail/%1u/%1.1u/%u/shared/%%u prefix = shared.%%u. separator = . subscriptions = no type = shared } passdb { args = /etc/dovecot/dovecot-sql-auth.conf driver = sql } plugin { acl = vfile acl_shared_dict = proxy::acl quota = maildir quota_rule2 = Trash:storage=+25M } protocols = imap service anvil { client_limit = 4614 } service auth { client_limit = 2560 executable = /usr/lib/dovecot/auth unix_listener auth-master { mode = 0600 user = exim } user = dovecot } service dict { unix_listener dict { group = exim mode = 0660 user = exim } } service imap-login { chroot = login client_limit = 2048 executable = /usr/lib/dovecot/imap-login inet_listener imap { address = *, :: port = 143 } inet_listener imaps { address = *, :: port = 993 } process_limit = 2048 process_min_avail = 3 service_count = 0 user = dovecot vsz_limit = 128 M } service imap { executable = /usr/lib/dovecot/imap process_limit = 2048 } service managesieve-login { chroot = login client_limit = 2048 process_limit = 2048 process_min_avail = 3 service_count = 0 user = dovecot vsz_limit = 128 M } service managesieve { process_limit = 2048 } service pop3-login { chroot = login client_limit = 512 inet_listener pop3 { address = 1.2.3.4 port = 110 } inet_listener pop3s { address = 1.2.3.4 port = 0 } process_limit = 512 process_min_avail = 3 service_count = 0 user = dovecot vsz_limit = 128 M } service pop3 { process_limit = 2560 } ssl_cert = Hi. I would appreciate your advice about this PROBLEM: ======================================================= Find the simplest way to configure a Dovecot 2.2.10 IMAP server to access existing email users' (mbox-format) mail folders via a master_user ****in read-only mode.**** (I've got the master_user access working.) Simplest because while I'm proficient at UNIX systems administration, I'm under time pressure and dovecot has a lot of configuration flexibility. Identifying the right way to do this is proving time- consuming. Namespaces? ACL's? Passdb's? Mounting the mail-containing file systems in read-only mode did not work. (Would it have worked if I had disabled all file-locking rules (if so, how?)?) I thought it was time to bring in the dovecot wizards. You! GOAL: ======================================================= Without knowing or changing users' passwords, migrate several hundred users of dovecot IMAP to MS Exchange using the commercial product Transend. I'm manging the dovecot side, someone else is doing the Transend/Exchange piece. Migration would occur in batches due to slowness of the Transend side when dealing with users with email collections over a few gigabytes. I have a production IMAP server (dovecot 1.0.13 on 32-bit RHEL 4.9). Let's call it PROD for short. Users INBOXes are stored locally on PROD. Their other mail folders are stored on a second machine and accessed via NFS. Those other folders contain the great majority of the email to be migrated. Let's call the NFS server MIGR for short. On MIGR, I've set up a migration IMAP server (dovecot 2.2.10 on 64-bit RHEL 5.10). MIGR is a dedicated NFS server with newer hardware than PROD. It has an unused Ethernet NIC I can tell Transend to use. Both PROD and MIGR use NIS for authentication. Therefore PAM is consulted for passdb information, normally. No SQL db's used. I set up the second server (MIGR) for several reasons: 1) there are some users mail folders larger than the 32-bit file size limit found on the PROD server. 2) the bulk of the email is stored locally on the MIGR server. 3) the version of dovecot is much newer and therefore more likely to have fewer bugs and more configuration options. 4) I don't want to modify the production environment except where really necessary. Pointing Transend at MIGR instead of PROD seems like it will be faster and better. Telling end-users to use MIGR instead of PROD would allow them to verify that their email came across okay (into MS Exchange) without being able to modify the original copy of email (in Dovecot). In the days and weeks after migration. I'd like to disable access ***for a batch of users*** on the PROD server at the time the migration begins for that batch. I may need to re-enable access on PROD for certain users if the migration does not succeed. Transend has been dying on a number of test users despite tweaking its parameters in consultation with the vendor. "Corrupt" messages seem to be the issue. Users (or sysadmins) might be required to identify and delete the offending messages before we retry their migration. (Which folders and which messages are causing problems will hopefully be discernible in Transend logs.) Ha! If you've read this far, then I'd also say that I welcome any advice on changes to increase performance on MIGR, such as whether trying to minimize indexing as I've done is useful. Current configurations of the two servers follow. =========================================================================== PRODUCTION: =========================================================================== # 1.0.13: /etc/dovecot.conf log_path: /var/log/dovecot.log info_log_path: /var/log/dovecot.log protocols: imaps imap listen: *:143 ssl_listen: *:993 ssl_cert_file: /etc/pki/dovecot/certs/dovecot.pem ssl_key_file: /etc/pki/dovecot/private/dovecot.key login_dir: /var/run/dovecot/login login_executable: /usr/libexec/dovecot/imap-login login_processes_count: 20 login_max_processes_count: 500 max_mail_processes: 1524 first_valid_uid: 100 mail_location: mbox:~/Mail:INBOX=/var/mail/%u:INDEX=/var/spool/dovecot-indexes/%u/ mbox_read_locks: dotlock mbox_write_locks: dotlock mbox_dotlock_change_timeout: 60 mbox_min_index_size: 2048 namespace: type: private separator: / inbox: yes namespace: type: private separator: / prefix: Mail/ hidden: yes namespace: type: private separator: / prefix: ~/Mail/ hidden: yes namespace: type: private separator: / prefix: mail/ hidden: yes namespace: type: private separator: / prefix: ~/mail/ hidden: yes auth default: master_user_separator: * verbose: yes debug: yes debug_passwords: yes passdb: driver: passwd-file args: /etc/dovecot.deny deny: yes passdb: driver: passwd-file args: /etc/dovecot.transend master: yes passdb: driver: shadow passdb: driver: pam userdb: driver: passwd =========================================================================== MIGRATION: =========================================================================== # 2.2.10: /etc/dovecot/dovecot.conf # OS: Linux 2.6.18-348.18.1.el5 x86_64 Scientific Linux release 5.10 (Boron) auth_debug = yes auth_debug_passwords = yes auth_master_user_separator = * auth_verbose = yes auth_verbose_passwords = plain disable_plaintext_auth = no first_valid_uid = 100 log_path = /var/log/dovecot.log mail_debug = yes mail_location = mbox:~/Mail:INBOX=/var/spool/concmail/%u:INDEX=MEMORY mbox_min_index_size = 50048 B mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } namespace one { hidden = yes location = prefix = Mail/ separator = / } namespace three { hidden = yes location = prefix = mail/ separator = / } passdb { args = /etc/dovecot/deny-users deny = yes driver = passwd-file } passdb { args = /etc/dovecot/dovecot.transend driver = passwd-file master = yes } passdb { driver = pam } protocols = imap service imap-login { process_min_avail = 15 service_count = 10 } service imap { executable = imap postlogin process_limit = 2048 } service postlogin { executable = script-login -d rawlog } ssl_cert = References: Message-ID: <544AEC82.6010805@thelounge.net> Am 19.10.2014 um 17:25 schrieb Marc Rantanen: > Hi, how do I protect dovecot 1.2.17 against poodle? a) Dovecot is hardly affected by Poodle, read how it works b) Dovecot 1.2 is unsupported c) running unsupported SW has much more problems than Poodle -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 181 bytes Desc: OpenPGP digital signature URL: From tss at iki.fi Sat Oct 25 00:21:18 2014 From: tss at iki.fi (Timo Sirainen) Date: Fri, 24 Oct 2014 17:21:18 -0700 Subject: High I/O wait with Dovecot POP3 In-Reply-To: <5447ADE2.2070108@dds.nl> References: <5447ADE2.2070108@dds.nl> Message-ID: On 22 Oct 2014, at 06:15, Frido Otten wrote: > In the past we've had 4 loadbalanced servers configured with courier > pop3 and dovecot handling respectively POP3 and IMAP connections. These > 4 servers have a shared NFS storage on a Netapp FAS3220 controller with > SAS disks. This setup is handling 50 POP3 sessions per second without > any problems. > > Now we're installing 6 new loadbalanced servers to do the same job on > the same storage, but using Dovecot to handle the POP3 sessions instead > of Courier. The IMAP sessions are already handled by those 6 new > servers, but we're encountering high iowait issues when using POP3 on > those servers. > > I've applied the hints from http://wiki2.dovecot.org/NFS but this had no > improvement. See also http://wiki2.dovecot.org/POP3Server - especially pop3_fast_size_lookups may be useful. > mail_nfs_index = yes > mail_nfs_storage = yes These slow things down a bit, ideally get rid of these and use Dovecot directors instead. > protocol pop3 { > pop3_uidl_format = %v.%u > } I don't think your Courier installation was using this UIDL format? If you switched to Dovecot the UIDLs would likely differ and clients would redownload mails. Try to preserve the UIDLs as described in http://wiki2.dovecot.org/Migration/Courier - and even then I'd recommend setting pop3_uidl_format to something else, for example %f From tss at iki.fi Sat Oct 25 04:11:08 2014 From: tss at iki.fi (Timo Sirainen) Date: Fri, 24 Oct 2014 21:11:08 -0700 Subject: v2.2.15 released Message-ID: <96FB5E7D-DFC2-410E-8827-78961029EB72@iki.fi> http://dovecot.org/releases/2.2/dovecot-2.2.15.tar.gz http://dovecot.org/releases/2.2/dovecot-2.2.15.tar.gz.sig Some small fixes and changes to v2.2.14. This release is mainly in the hope that it could still make it into the next Debian stable instead of v2.2.14 - mainly because of a couple of new assert crashes that started happening in v2.2.14 and should be fixed now. * Plugins can now print a banner comment in doveconf output (typically the plugin version) * Replication plugin now triggers low (instead of high) priority for mail copying operations. * IMAP/POP3/ManageSieve proxy: If destination server can't be connected to, retry connecting once per second up to the value of proxy_timeout. This allows quick restarts/upgrades on the backend server without returning login failures. * Internal passdb lookups (e.g. done by lmtp/doveadm proxy) wasn't returning failure in some situations where it should have (e.g. allow_nets mismatch) * LMTP uses mail_log_prefix now for logging mail deliveries instead of a hardcoded prefix. The non-delivery log prefix is still hardcoded though. + passdb allow_nets=local matches lookups that don't contain an IP address (internally done by Dovecot services) + Various debug logging and error logging improvements - Various race condition fixes to LAYOUT=index - v2.2.14 virtual plugin crashed in some situations From jaldhar at debian.org Sat Oct 25 06:50:51 2014 From: jaldhar at debian.org (Jaldhar H. Vyas) Date: Sat, 25 Oct 2014 02:50:51 -0400 (EDT) Subject: v2.2.15 released In-Reply-To: <96FB5E7D-DFC2-410E-8827-78961029EB72@iki.fi> References: <96FB5E7D-DFC2-410E-8827-78961029EB72@iki.fi> Message-ID: On Fri, 24 Oct 2014, Timo Sirainen wrote: > Some small fixes and changes to v2.2.14. This release is mainly in the > hope that it could still make it into the next Debian stable instead of > v2.2.14 - mainly because of a couple of new assert crashes that started > happening in v2.2.14 and should be fixed now. > Timo, FYI at the moment we think we will probably go with 2.2.13. That there are still assert crashes in the latest release makes us a little bit concerned if we should use that so close to the freeze. (Effectively this Sunday for new upstream releases.) In your honest opinion are we being overcautious? Are there any compelling reasons we must go with 2.2.15 for Jessie or will 2.2.13 be adequate? Also I have one minor issue to report. dovecot broke API from 2.2.13 to 2.2.14 but it only provides version macros for the first two components of the version number. This has caused a small upgrade problem for the antispam plugin which is in a separate package (dovecot-antispam.) Was that addressed in 2.2.15? -- Jaldhar H. Vyas From Dovecot-mailing-list at whyaskwhy.org Sat Oct 25 07:05:51 2014 From: Dovecot-mailing-list at whyaskwhy.org (deoren) Date: Sat, 25 Oct 2014 02:05:51 -0500 Subject: Where can I find change logs/release notes for Dovecot EE releases? In-Reply-To: <5448AFEE.8030908@dovecot.fi> References: <54482333.3@whyaskwhy.org> <5448AF78.1090804@dovecot.fi> <5448AFEE.8030908@dovecot.fi> Message-ID: <544B4BCF.5080103@whyaskwhy.org> On 10/23/2014 2:36 AM, Teemu Huovila wrote: > On 10/23/2014 10:34 AM, Teemu Huovila wrote: >> On 10/23/2014 12:35 AM, deoren wrote: >>> I searched for them and haven't come across them yet. Could any point me in the right direction? Specifically the Ubuntu 12.04 >>> package notes if they're split out. >> On a Debian based system you should find them in /usr/share/doc/dovecot-ee-core/chagnelog.gz > /usr/share/doc/dovecot-ee-core/changelog.gz > Thanks Teemu. I was hoping that there was an online copy somewhere that I could review, but it doesn't appear too troublesome to pull off by unpacking the dovecot-ee-core deb file prior to installing the updates. First, I note what version I'm currently running. Prior to the latest updates, it was v2.2.13.25. Once I have that I can proceed to follow these steps to extract the recent changes. #1) apt-get clean #2) apt-get dist-upgrade -d #3) cp /var/cache/apt/archives/dovecot-ee-core*.deb /tmp/ #4) cd /tmp #5) mkdir dovecot-ee-core #6) ar p dovecot-ee-core_*.deb data.tar.gz | tar zx -C dovecot-ee-core #7) zcat dovecot-ee-core/usr/share/doc/dovecot-ee-core/changelog.gz | grep 2.2.13.25 -B 100 It's a few steps, but that gives me the changelog I was looking for prior to installing the updates. From rs at sys4.de Sat Oct 25 07:11:33 2014 From: rs at sys4.de (Robert Schetterer) Date: Sat, 25 Oct 2014 09:11:33 +0200 Subject: v2.2.15 released In-Reply-To: References: <96FB5E7D-DFC2-410E-8827-78961029EB72@iki.fi> Message-ID: <544B4D25.1000002@sys4.de> Am 25.10.2014 um 08:50 schrieb Jaldhar H. Vyas: > On Fri, 24 Oct 2014, Timo Sirainen wrote: > >> Some small fixes and changes to v2.2.14. This release is mainly in the >> hope that it could still make it into the next Debian stable instead >> of v2.2.14 - mainly because of a couple of new assert crashes that >> started happening in v2.2.14 and should be fixed now. >> > > Timo, > > FYI at the moment we think we will probably go with 2.2.13. That there > are still assert crashes in the latest release makes us a little bit > concerned if we should use that so close to the freeze. (Effectively > this Sunday for new upstream releases.) > > In your honest opinion are we being overcautious? Are there any > compelling reasons we must go with 2.2.15 for Jessie or will 2.2.13 be > adequate? > > Also I have one minor issue to report. dovecot broke API from 2.2.13 to > 2.2.14 but it only provides version macros for the first two components > of the version number. This has caused a small upgrade problem for the > antispam plugin which is in a separate package (dovecot-antispam.) Was > that addressed in 2.2.15? > my opinion go 2.2.15, lots of people want to use debian sources only , but ask for help on this list for allready fixed stuff if debian versions are much older then recent versions. Dovecot is used in simple up to very complex setups, so no wonder there will be patches ever. Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From tss at iki.fi Sat Oct 25 07:41:40 2014 From: tss at iki.fi (Timo Sirainen) Date: Sat, 25 Oct 2014 00:41:40 -0700 Subject: v2.2.15 released In-Reply-To: References: <96FB5E7D-DFC2-410E-8827-78961029EB72@iki.fi> Message-ID: <5BB39377-634E-48DC-965F-11DAD33D45AA@iki.fi> On 24 Oct 2014, at 23:50, Jaldhar H. Vyas wrote: > On Fri, 24 Oct 2014, Timo Sirainen wrote: > >> Some small fixes and changes to v2.2.14. This release is mainly in the hope that it could still make it into the next Debian stable instead of v2.2.14 - mainly because of a couple of new assert crashes that started happening in v2.2.14 and should be fixed now. >> > > Timo, > > FYI at the moment we think we will probably go with 2.2.13. That there are still assert crashes in the latest release makes us a little bit concerned if we should use that so close to the freeze. (Effectively this Sunday for new upstream releases.) > > In your honest opinion are we being overcautious? Are there any compelling reasons we must go with 2.2.15 for Jessie or will 2.2.13 be adequate? 2.2.13 has many bugs that are definitely bad. I was going to make v2.2.14 only a few weeks afterwards, but then I just got more and more busy and it took forever to do the release. If you want to go with it, please use the dovecot-ee 2.2.13.31 release instead with many many important patches. I can put the .tar.gz somewhere if needed. > Also I have one minor issue to report. dovecot broke API from 2.2.13 to 2.2.14 but it only provides version macros for the first two components of the version number. This has caused a small upgrade problem for the antispam plugin which is in a separate package (dovecot-antispam.) Was that addressed in 2.2.15? I only remember an ABI problem with antispam. Recompiling fixed that AFAIK. (And no Dovecot version guarantees ABI compatibility.) Is there some API problem also? From tss at iki.fi Sat Oct 25 07:44:45 2014 From: tss at iki.fi (Timo Sirainen) Date: Sat, 25 Oct 2014 00:44:45 -0700 Subject: Where can I find change logs/release notes for Dovecot EE releases? In-Reply-To: <544B4BCF.5080103@whyaskwhy.org> References: <54482333.3@whyaskwhy.org> <5448AF78.1090804@dovecot.fi> <5448AFEE.8030908@dovecot.fi> <544B4BCF.5080103@whyaskwhy.org> Message-ID: <0D04E399-EE0E-4FF3-A60B-EF860335197D@iki.fi> On 25 Oct 2014, at 00:05, deoren wrote: > On 10/23/2014 2:36 AM, Teemu Huovila wrote: >> On 10/23/2014 10:34 AM, Teemu Huovila wrote: >>> On 10/23/2014 12:35 AM, deoren wrote: >>>> I searched for them and haven't come across them yet. Could any point me in the right direction? Specifically the Ubuntu 12.04 >>>> package notes if they're split out. >>> On a Debian based system you should find them in /usr/share/doc/dovecot-ee-core/chagnelog.gz >> /usr/share/doc/dovecot-ee-core/changelog.gz >> > > Thanks Teemu. > > I was hoping that there was an online copy somewhere that I could > review, but it doesn't appear too troublesome to pull off by unpacking > the dovecot-ee-core deb file prior to installing the updates. That'll happen at some point when things become a bit less busy. Sometimes next year definitely, hopefully early. From me at junc.eu Sat Oct 25 07:45:33 2014 From: me at junc.eu (Benny Pedersen) Date: Sat, 25 Oct 2014 09:45:33 +0200 Subject: Dovecote 1.2.17 poodle In-Reply-To: References: Message-ID: <14946447178.280b.d475fad7b14312f5d8424e35e39f7512@junc.eu> On October 19, 2014 5:25:01 PM Marc Rantanen wrote: > Hi, how do I protect dovecot 1.2.17 against poodle? http://en.m.wikipedia.org/wiki/Poodle If its not that then sorry, tell more to get more help From tolga at ozses.net Sat Oct 25 07:49:47 2014 From: tolga at ozses.net (Muzaffer Tolga Ozses) Date: Sat, 25 Oct 2014 10:49:47 +0300 Subject: Dovecote 1.2.17 poodle In-Reply-To: <14946447178.280b.d475fad7b14312f5d8424e35e39f7512@junc.eu> References: <14946447178.280b.d475fad7b14312f5d8424e35e39f7512@junc.eu> Message-ID: I'm pretty sure he means http://en.m.wikipedia.org/wiki/POODLE On 25 October 2014 10:45, Benny Pedersen wrote: > On October 19, 2014 5:25:01 PM Marc Rantanen wrote: > > Hi, how do I protect dovecot 1.2.17 against poodle? >> > > http://en.m.wikipedia.org/wiki/Poodle > > If its not that then sorry, tell more to get more help > From me at junc.eu Sat Oct 25 07:55:55 2014 From: me at junc.eu (Benny Pedersen) Date: Sat, 25 Oct 2014 09:55:55 +0200 Subject: High I/O wait with Dovecot POP3 In-Reply-To: <5447ADE2.2070108@dds.nl> References: <5447ADE2.2070108@dds.nl> Message-ID: <149464df6f8.280b.d475fad7b14312f5d8424e35e39f7512@junc.eu> On October 22, 2014 3:15:14 PM Frido Otten wrote: > The 6 new servers are quad core Intel(R) Xeon(R) CPU X3323 @ 2.50GHz, > with 4 GB RAM connected with gigabit ethernet connection to the storage. > The 4 old servers are single core (w/o HT) P4 2,8 GHz with 1 GB RAM. Can you test the new servers with ht disabled, atleast to see if the iowait are then gone, not perfect, but i like to know if it helps, then try another kernel more optimized for the xeon cpu From me at junc.eu Sat Oct 25 08:16:04 2014 From: me at junc.eu (Benny Pedersen) Date: Sat, 25 Oct 2014 10:16:04 +0200 Subject: Dovecote 1.2.17 poodle In-Reply-To: <544AEC82.6010805@thelounge.net> References: <544AEC82.6010805@thelounge.net> Message-ID: <149466065b8.280b.d475fad7b14312f5d8424e35e39f7512@junc.eu> On October 25, 2014 2:19:14 AM Reindl Harald wrote: > a) Dovecot is hardly affected by Poodle, read how it works > b) Dovecot 1.2 is unsupported > c) running unsupported SW has much more problems than Poodle What about cats ? :) Zzz From me at junc.eu Sat Oct 25 08:40:21 2014 From: me at junc.eu (Benny Pedersen) Date: Sat, 25 Oct 2014 10:40:21 +0200 Subject: Dovecote 1.2.17 poodle In-Reply-To: References: <14946447178.280b.d475fad7b14312f5d8424e35e39f7512@junc.eu> Message-ID: <1494676a120.280b.d475fad7b14312f5d8424e35e39f7512@junc.eu> On October 25, 2014 9:49:47 AM Muzaffer Tolga Ozses wrote: > I'm pretty sure he means http://en.m.wikipedia.org/wiki/POODLE Nice wiki, but is that sslv3 problem not better solved in openssl then screwup dovecot ? Yes i am using 1.2.17 in gentoo, with latest openssl problem fixes, its never ending route to keep up with ssl fixes From h.reindl at thelounge.net Sat Oct 25 10:20:37 2014 From: h.reindl at thelounge.net (Reindl Harald) Date: Sat, 25 Oct 2014 12:20:37 +0200 Subject: Dovecote 1.2.17 poodle In-Reply-To: <14946447178.280b.d475fad7b14312f5d8424e35e39f7512@junc.eu> References: <14946447178.280b.d475fad7b14312f5d8424e35e39f7512@junc.eu> Message-ID: <544B7975.4010608@thelounge.net> Am 25.10.2014 um 09:45 schrieb Benny Pedersen: > On October 19, 2014 5:25:01 PM Marc Rantanen wrote: > >> Hi, how do I protect dovecot 1.2.17 against poodle? > > http://en.m.wikipedia.org/wiki/Poodle > > If its not that then sorry, tell more to get more help you are *not* funny, on no list at all and the really sad is that i think it's possible in your case that you really don't read recent IT news -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 181 bytes Desc: OpenPGP digital signature URL: From h.reindl at thelounge.net Sat Oct 25 10:21:59 2014 From: h.reindl at thelounge.net (Reindl Harald) Date: Sat, 25 Oct 2014 12:21:59 +0200 Subject: Dovecote 1.2.17 poodle In-Reply-To: <149466065b8.280b.d475fad7b14312f5d8424e35e39f7512@junc.eu> References: <544AEC82.6010805@thelounge.net> <149466065b8.280b.d475fad7b14312f5d8424e35e39f7512@junc.eu> Message-ID: <544B79C7.1080402@thelounge.net> Am 25.10.2014 um 10:16 schrieb Benny Pedersen: > On October 25, 2014 2:19:14 AM Reindl Harald > wrote: > >> a) Dovecot is hardly affected by Poodle, read how it works >> b) Dovecot 1.2 is unsupported >> c) running unsupported SW has much more problems than Poodle > > What about cats ? :) shut up - you are not funny nor are your foolish one liners on any list with no content let look you smart -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 181 bytes Desc: OpenPGP digital signature URL: From jerry at seibercom.net Sat Oct 25 11:46:38 2014 From: jerry at seibercom.net (Jerry) Date: Sat, 25 Oct 2014 07:46:38 -0400 Subject: Multiple user attributes in LDAP In-Reply-To: <544AA37C.8070405@sidor.com> References: <544AA09E.7000306@sidor.com> <544AA37C.8070405@sidor.com> Message-ID: <20141025074638.06e97f42@scorpio> On Fri, 24 Oct 2014 14:37:40 -0430, CARDENAS Eduardo SIDOR stated: >> Hello, I have an issue with dovecot and Ldap? Any help will be grateful? >> I have dovecot 1.2.15 and i want to know if in that version can i use two >> values returned from LDAP in the user_attrs template? >> >> Thanking you in anticipation? > >" Notificaci?n Autom?tica: >Este mensaje y cualquier archivo que se adjunte contiene informaci?n >privilegiada y confidencial. Es para uso exclusivo del destinatario. Si >usted ha recibido esta comunicaci?n por error, por favor av?senos >inmediatamente. Automatic notification: This e-mail and any file transmitted >with it are confidential and may be legally privileged. It is intended >solely for the addressee and may not be disclosed to or used by anyone other >than the addressee. If you have received this e-mail by mistake , please >advise the sender immediately" Legally useless and an annoyance to most. Why waste everybody's time? -- Jerry -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 473 bytes Desc: not available URL: From gedalya at gedalya.net Sat Oct 25 11:59:30 2014 From: gedalya at gedalya.net (Gedalya) Date: Sat, 25 Oct 2014 07:59:30 -0400 Subject: v2.2.15 released In-Reply-To: <5BB39377-634E-48DC-965F-11DAD33D45AA@iki.fi> References: <96FB5E7D-DFC2-410E-8827-78961029EB72@iki.fi> <5BB39377-634E-48DC-965F-11DAD33D45AA@iki.fi> Message-ID: <544B90A2.80006@gedalya.net> >> Also I have one minor issue to report. dovecot broke API from 2.2.13 to 2.2.14 but it only provides version macros for the first two components of the version number. This has caused a small upgrade problem for the antispam plugin which is in a separate package (dovecot-antispam.) Was that addressed in 2.2.15? > I only remember an ABI problem with antispam. Recompiling fixed that AFAIK. (And no Dovecot version guarantees ABI compatibility.) Is there some API problem also? https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=765943 From h.reindl at thelounge.net Sat Oct 25 12:19:12 2014 From: h.reindl at thelounge.net (Reindl Harald) Date: Sat, 25 Oct 2014 14:19:12 +0200 Subject: master: Error: service(log): command startup failed, throttling for 2 secs Message-ID: <544B9540.1060604@thelounge.net> master: Error: service(log): command startup failed, throttling for 2 secs i see that due restart on any machine acting as IMAP/POP3 proxy why? -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 181 bytes Desc: OpenPGP digital signature URL: From arekm at maven.pl Sat Oct 25 13:11:31 2014 From: arekm at maven.pl (Arkadiusz =?utf-8?q?Mi=C5=9Bkiewicz?=) Date: Sat, 25 Oct 2014 15:11:31 +0200 Subject: v2.2.15 released - test suite segfault In-Reply-To: <96FB5E7D-DFC2-410E-8827-78961029EB72@iki.fi> References: <96FB5E7D-DFC2-410E-8827-78961029EB72@iki.fi> Message-ID: <201410251511.31726.arekm@maven.pl> On Saturday 25 of October 2014, Timo Sirainen wrote: > http://dovecot.org/releases/2.2/dovecot-2.2.15.tar.gz > http://dovecot.org/releases/2.2/dovecot-2.2.15.tar.gz.sig Test suite passes but at the end: fatal_printf_format_fix .............................................. : ok 0 / 190 tests failed ==6098== Invalid read of size 16 ==6098== at 0x317B880804: ??? (in /lib64/libc-2.20.so) ==6098== by 0x317B8A93B6: ??? (in /lib64/libc-2.20.so) ==6098== by 0x317B8AAA21: ??? (in /lib64/libc-2.20.so) ==6098== by 0x317B8A9C0F: ??? (in /lib64/libc-2.20.so) ==6098== by 0x317B8A9F94: ??? (in /lib64/libc-2.20.so) ==6098== by 0x42A0D7: utc_mktime (utc-mktime.c:39) ==6098== by 0x41340B: iso8601_date_do_parse (iso8601-date.c:250) ==6098== by 0x4134C0: iso8601_date_parse_tm (iso8601-date.c:274) ==6098== by 0x4062B2: test_iso8601_date_valid (test-iso8601-date.c:75) ==6098== by 0x4062B2: test_iso8601_date (test-iso8601-date.c:145) ==6098== by 0x40D3E0: test_run_funcs (test-common.c:305) ==6098== by 0x40DA5C: test_run_with_fatals (test-common.c:362) ==6098== by 0x317B821C14: (below main) (in /lib64/libc-2.20.so) ==6098== Address 0x5d22690 is 16 bytes inside a block of size 20 alloc'd ==6098== at 0x4A05C00: malloc (in /usr/lib64/valgrind/vgpreload_memcheck-amd64-linux.so) ==6098== by 0x317B8A93CB: ??? (in /lib64/libc-2.20.so) ==6098== by 0x317B8AAA21: ??? (in /lib64/libc-2.20.so) ==6098== by 0x317B8A9C0F: ??? (in /lib64/libc-2.20.so) ==6098== by 0x317B8A9F94: ??? (in /lib64/libc-2.20.so) ==6098== by 0x42A0D7: utc_mktime (utc-mktime.c:39) ==6098== by 0x41340B: iso8601_date_do_parse (iso8601-date.c:250) ==6098== by 0x4134C0: iso8601_date_parse_tm (iso8601-date.c:274) ==6098== by 0x4062B2: test_iso8601_date_valid (test-iso8601-date.c:75) ==6098== by 0x4062B2: test_iso8601_date (test-iso8601-date.c:145) ==6098== by 0x40D3E0: test_run_funcs (test-common.c:305) ==6098== by 0x40DA5C: test_run_with_fatals (test-common.c:362) ==6098== by 0x317B821C14: (below main) (in /lib64/libc-2.20.so) ==6098== ==6098== Invalid read of size 8 ==6098== at 0x317B88032A: ??? (in /lib64/libc-2.20.so) ==6098== by 0x317B8A93B6: ??? (in /lib64/libc-2.20.so) ==6098== by 0x317B8AAA21: ??? (in /lib64/libc-2.20.so) ==6098== by 0x317B8A9C0F: ??? (in /lib64/libc-2.20.so) ==6098== by 0x317B8A9F94: ??? (in /lib64/libc-2.20.so) ==6098== by 0x42A0D7: utc_mktime (utc-mktime.c:39) ==6098== by 0x41340B: iso8601_date_do_parse (iso8601-date.c:250) ==6098== by 0x4134C0: iso8601_date_parse_tm (iso8601-date.c:274) ==6098== by 0x4062B2: test_iso8601_date_valid (test-iso8601-date.c:75) ==6098== by 0x4062B2: test_iso8601_date (test-iso8601-date.c:145) ==6098== by 0x40D3E0: test_run_funcs (test-common.c:305) ==6098== by 0x40DA5C: test_run_with_fatals (test-common.c:362) ==6098== by 0x317B821C14: (below main) (in /lib64/libc-2.20.so) ==6098== Address 0x5d22690 is 16 bytes inside a block of size 20 alloc'd ==6098== at 0x4A05C00: malloc (in /usr/lib64/valgrind/vgpreload_memcheck-amd64-linux.so) ==6098== by 0x317B8A93CB: ??? (in /lib64/libc-2.20.so) ==6098== by 0x317B8AAA21: ??? (in /lib64/libc-2.20.so) ==6098== by 0x317B8A9C0F: ??? (in /lib64/libc-2.20.so) ==6098== by 0x317B8A9F94: ??? (in /lib64/libc-2.20.so) ==6098== by 0x42A0D7: utc_mktime (utc-mktime.c:39) ==6098== by 0x41340B: iso8601_date_do_parse (iso8601-date.c:250) ==6098== by 0x4134C0: iso8601_date_parse_tm (iso8601-date.c:274) ==6098== by 0x4062B2: test_iso8601_date_valid (test-iso8601-date.c:75) ==6098== by 0x4062B2: test_iso8601_date (test-iso8601-date.c:145) ==6098== by 0x40D3E0: test_run_funcs (test-common.c:305) ==6098== by 0x40DA5C: test_run_with_fatals (test-common.c:362) ==6098== by 0x317B821C14: (below main) (in /lib64/libc-2.20.so) ==6098== ==6098== Invalid read of size 8 ==6098== at 0x317B880333: ??? (in /lib64/libc-2.20.so) ==6098== by 0x317B8A93B6: ??? (in /lib64/libc-2.20.so) ==6098== by 0x317B8AAA21: ??? (in /lib64/libc-2.20.so) ==6098== by 0x317B8A9C0F: ??? (in /lib64/libc-2.20.so) ==6098== by 0x317B8A9F94: ??? (in /lib64/libc-2.20.so) ==6098== by 0x42A0D7: utc_mktime (utc-mktime.c:39) ==6098== by 0x41340B: iso8601_date_do_parse (iso8601-date.c:250) ==6098== by 0x4134C0: iso8601_date_parse_tm (iso8601-date.c:274) ==6098== by 0x4062B2: test_iso8601_date_valid (test-iso8601-date.c:75) ==6098== by 0x4062B2: test_iso8601_date (test-iso8601-date.c:145) ==6098== by 0x40D3E0: test_run_funcs (test-common.c:305) ==6098== by 0x40DA5C: test_run_with_fatals (test-common.c:362) ==6098== by 0x317B821C14: (below main) (in /lib64/libc-2.20.so) ==6098== Address 0x5d22698 is 4 bytes after a block of size 20 alloc'd ==6098== at 0x4A05C00: malloc (in /usr/lib64/valgrind/vgpreload_memcheck-amd64-linux.so) ==6098== by 0x317B8A93CB: ??? (in /lib64/libc-2.20.so) ==6098== by 0x317B8AAA21: ??? (in /lib64/libc-2.20.so) ==6098== by 0x317B8A9C0F: ??? (in /lib64/libc-2.20.so) ==6098== by 0x317B8A9F94: ??? (in /lib64/libc-2.20.so) ==6098== by 0x42A0D7: utc_mktime (utc-mktime.c:39) ==6098== by 0x41340B: iso8601_date_do_parse (iso8601-date.c:250) ==6098== by 0x4134C0: iso8601_date_parse_tm (iso8601-date.c:274) ==6098== by 0x4062B2: test_iso8601_date_valid (test-iso8601-date.c:75) ==6098== by 0x4062B2: test_iso8601_date (test-iso8601-date.c:145) ==6098== by 0x40D3E0: test_run_funcs (test-common.c:305) ==6098== by 0x40DA5C: test_run_with_fatals (test-common.c:362) ==6098== by 0x317B821C14: (below main) (in /lib64/libc-2.20.so) ==6098== ==6098== Conditional jump or move depends on uninitialised value(s) ==6098== at 0x317B8817ED: ??? (in /lib64/libc-2.20.so) ==6098== by 0x317B8A93ED: ??? (in /lib64/libc-2.20.so) ==6098== by 0x317B8AAA21: ??? (in /lib64/libc-2.20.so) ==6098== by 0x317B8A9C0F: ??? (in /lib64/libc-2.20.so) ==6098== by 0x317B8A9F94: ??? (in /lib64/libc-2.20.so) ==6098== by 0x42A0D7: utc_mktime (utc-mktime.c:39) ==6098== by 0x41340B: iso8601_date_do_parse (iso8601-date.c:250) ==6098== by 0x4134C0: iso8601_date_parse_tm (iso8601-date.c:274) ==6098== by 0x4062B2: test_iso8601_date_valid (test-iso8601-date.c:75) ==6098== by 0x4062B2: test_iso8601_date (test-iso8601-date.c:145) ==6098== by 0x40D3E0: test_run_funcs (test-common.c:305) ==6098== by 0x40DA5C: test_run_with_fatals (test-common.c:362) ==6098== by 0x317B821C14: (below main) (in /lib64/libc-2.20.so) ==6098== ==6098== Invalid read of size 8 ==6098== at 0x317B88032A: ??? (in /lib64/libc-2.20.so) ==6098== by 0x317B8A93B6: ??? (in /lib64/libc-2.20.so) ==6098== by 0x317B8AAA9D: ??? (in /lib64/libc-2.20.so) ==6098== by 0x317B8A9C0F: ??? (in /lib64/libc-2.20.so) ==6098== by 0x317B8A9F94: ??? (in /lib64/libc-2.20.so) ==6098== by 0x42A0D7: utc_mktime (utc-mktime.c:39) ==6098== by 0x41340B: iso8601_date_do_parse (iso8601-date.c:250) ==6098== by 0x4134C0: iso8601_date_parse_tm (iso8601-date.c:274) ==6098== by 0x4062B2: test_iso8601_date_valid (test-iso8601-date.c:75) ==6098== by 0x4062B2: test_iso8601_date (test-iso8601-date.c:145) ==6098== by 0x40D3E0: test_run_funcs (test-common.c:305) ==6098== by 0x40DA5C: test_run_with_fatals (test-common.c:362) ==6098== by 0x317B821C14: (below main) (in /lib64/libc-2.20.so) ==6098== Address 0x5d22690 is 16 bytes inside a block of size 20 alloc'd ==6098== at 0x4A05C00: malloc (in /usr/lib64/valgrind/vgpreload_memcheck-amd64-linux.so) ==6098== by 0x317B8A93CB: ??? (in /lib64/libc-2.20.so) ==6098== by 0x317B8AAA21: ??? (in /lib64/libc-2.20.so) ==6098== by 0x317B8A9C0F: ??? (in /lib64/libc-2.20.so) ==6098== by 0x317B8A9F94: ??? (in /lib64/libc-2.20.so) ==6098== by 0x42A0D7: utc_mktime (utc-mktime.c:39) ==6098== by 0x41340B: iso8601_date_do_parse (iso8601-date.c:250) ==6098== by 0x4134C0: iso8601_date_parse_tm (iso8601-date.c:274) ==6098== by 0x4062B2: test_iso8601_date_valid (test-iso8601-date.c:75) ==6098== by 0x4062B2: test_iso8601_date (test-iso8601-date.c:145) ==6098== by 0x40D3E0: test_run_funcs (test-common.c:305) ==6098== by 0x40DA5C: test_run_with_fatals (test-common.c:362) ==6098== by 0x317B821C14: (below main) (in /lib64/libc-2.20.so) ==6098== ==6098== Invalid read of size 8 ==6098== at 0x317B880333: ??? (in /lib64/libc-2.20.so) ==6098== by 0x317B8A93B6: ??? (in /lib64/libc-2.20.so) ==6098== by 0x317B8AAA9D: ??? (in /lib64/libc-2.20.so) ==6098== by 0x317B8A9C0F: ??? (in /lib64/libc-2.20.so) ==6098== by 0x317B8A9F94: ??? (in /lib64/libc-2.20.so) ==6098== by 0x42A0D7: utc_mktime (utc-mktime.c:39) ==6098== by 0x41340B: iso8601_date_do_parse (iso8601-date.c:250) ==6098== by 0x4134C0: iso8601_date_parse_tm (iso8601-date.c:274) ==6098== by 0x4062B2: test_iso8601_date_valid (test-iso8601-date.c:75) ==6098== by 0x4062B2: test_iso8601_date (test-iso8601-date.c:145) ==6098== by 0x40D3E0: test_run_funcs (test-common.c:305) ==6098== by 0x40DA5C: test_run_with_fatals (test-common.c:362) ==6098== by 0x317B821C14: (below main) (in /lib64/libc-2.20.so) ==6098== Address 0x5d22698 is 4 bytes after a block of size 20 alloc'd ==6098== at 0x4A05C00: malloc (in /usr/lib64/valgrind/vgpreload_memcheck-amd64-linux.so) ==6098== by 0x317B8A93CB: ??? (in /lib64/libc-2.20.so) ==6098== by 0x317B8AAA21: ??? (in /lib64/libc-2.20.so) ==6098== by 0x317B8A9C0F: ??? (in /lib64/libc-2.20.so) ==6098== by 0x317B8A9F94: ??? (in /lib64/libc-2.20.so) ==6098== by 0x42A0D7: utc_mktime (utc-mktime.c:39) ==6098== by 0x41340B: iso8601_date_do_parse (iso8601-date.c:250) ==6098== by 0x4134C0: iso8601_date_parse_tm (iso8601-date.c:274) ==6098== by 0x4062B2: test_iso8601_date_valid (test-iso8601-date.c:75) ==6098== by 0x4062B2: test_iso8601_date (test-iso8601-date.c:145) ==6098== by 0x40D3E0: test_run_funcs (test-common.c:305) ==6098== by 0x40DA5C: test_run_with_fatals (test-common.c:362) ==6098== by 0x317B821C14: (below main) (in /lib64/libc-2.20.so) ==6098== Makefile:1877: recipe for target 'check-test' failed make[2]: *** [check-test] Error 1 -- Arkadiusz Mi?kiewicz, arekm / ( maven.pl | pld-linux.org ) From leo at strike.wu.ac.at Sat Oct 25 13:50:58 2014 From: leo at strike.wu.ac.at (Alexander 'Leo' Bergolth) Date: Sat, 25 Oct 2014 15:50:58 +0200 Subject: Sieve: carry global variables from sieve_before to user sieve scripts In-Reply-To: <5444DA70.5080402@strike.wu.ac.at> References: <5444DA70.5080402@strike.wu.ac.at> Message-ID: <544BAAC2.1000503@strike.wu.ac.at> On 20.10.2014 11:48, Alexander 'Leo' Bergolth wrote: > Is there a way to initialize global variables with default values in > sieve_before scripts that can be used in the sieve_default script or in > user scripts? OK. I guess that's currently not possible. I had a quick look in the code, the global variable namespace seems to be copied from the parent script during execution of the include statement. (In ext_include_generate_include() which calls ext_include_create_ast_context().) So maybe it is possible to take another approach: Instead of executing sieve_before scripts and sieve_default side by side, maybe it is feasible to set the "before-script" as sieve_default and include the default personal user script from there if it exists? That way global variable inheritance should work, shouldn't it? Did anyone try this approach? Any caveats? Any security implications? Cheers, --leo > I've tried the following code but this doesn't work.. > > before.d/10-set-defaults.sieve: > -------------------- 8< -------------------- > require ["variables", "include"]; > require "vnd.dovecot.debug"; > set "global.S_TESTVAR leo"; > debug_log "LEO SIEVE: in before.d/10-set-defaults, S_TESTVAR: > ${global.S_TESTVAR}"; > -------------------- 8< -------------------- > > default.sieve: > -------------------- 8< -------------------- > require ["variables", "include"]; > require "vnd.dovecot.debug"; > > global "S_TESTVAR"; > debug_log "LEO SIEVE: in default.sieve: S_TESTVAR: ${global.S_TESTVAR}, > ${S_TESTVAR}"; > -------------------- 8< -------------------- > > Is there any other way to set up defaults in a global sieve script? -- e-mail ::: Leo.Bergolth (at) wu.ac.at fax ::: +43-1-31336-906050 location ::: IT-Services | Vienna University of Economics | Austria From suy at badopi.org Sat Oct 25 13:55:05 2014 From: suy at badopi.org (Alejandro Exojo) Date: Sat, 25 Oct 2014 15:55:05 +0200 Subject: Invoking the spam checker on the sieve script In-Reply-To: References: <201410231711.42325.suy@badopi.org> <201410231819.06655.suy@badopi.org> Message-ID: <201410251555.05773.suy@badopi.org> El Friday 24 October 2014, deano-dovecot at areyes.com escribi?: > On 2014-10-23 12:19, Alejandro Exojo wrote: > What kind of VPS are you using ? I'm in a similar boat to you, running > my own domain(s) and email, and have built the mail system on a set of 3 > VPS', two 6G ram that cost $7/mo and one 1G ram that's $3.50/mo. The > two larger ones run exim4, spamassassin, clamav, nginx, roundcube, > dovecot, munin (stats), solr (search), zpush, tinyrss, percona (mysql). That's quite a powerful setup. :) My VPS is one of the cheapest in Hetzner: 7.9? for 512MB of RAM. I thought of upgrading, specially because the sovereign guys (https://github.com/al3x/sovereign) claim that with 512/1024 you can use all of their setup, which is pretty powerful, much more than I would really use, I think. > It all works swimmingly well. The main setup will run in a 2G ram VPS, > albeit with some swapping. If you're on an SSD-backed VPS, it works OK > - that was my old setup with Digital Ocean. > > ClamAV is the memory hog, spamassassin really isn't bad , so you might > give it a shot ... I think that running some simple spam filtering would be enough for me, so maybe I'll try to hardcode some stuff to make it at least filter something but not much. Well, thank you all for the advice. I'll see what's easier to setup for me and give it a try next week. -- Alex (a.k.a. suy) | GPG ID 0x0B8B0BC2 http://barnacity.net/ | http://disperso.net From tss at iki.fi Sat Oct 25 15:43:48 2014 From: tss at iki.fi (Timo Sirainen) Date: Sat, 25 Oct 2014 08:43:48 -0700 Subject: v2.2.15 released In-Reply-To: <544B90A2.80006@gedalya.net> References: <96FB5E7D-DFC2-410E-8827-78961029EB72@iki.fi> <5BB39377-634E-48DC-965F-11DAD33D45AA@iki.fi> <544B90A2.80006@gedalya.net> Message-ID: On 25 Oct 2014, at 04:59, Gedalya wrote: > >>> Also I have one minor issue to report. dovecot broke API from 2.2.13 to 2.2.14 but it only provides version macros for the first two components of the version number. This has caused a small upgrade problem for the antispam plugin which is in a separate package (dovecot-antispam.) Was that addressed in 2.2.15? >> I only remember an ABI problem with antispam. Recompiling fixed that AFAIK. (And no Dovecot version guarantees ABI compatibility.) Is there some API problem also? > > https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=765943 Oh, it uses the really old way to do things. In v1.1+ T_BEGIN { .. } T_END should have been used instead. Patch attached. -------------- next part -------------- A non-text attachment was scrubbed... Name: antispam.diff Type: application/octet-stream Size: 6363 bytes Desc: not available URL: -------------- next part -------------- From tss at iki.fi Sat Oct 25 15:51:22 2014 From: tss at iki.fi (Timo Sirainen) Date: Sat, 25 Oct 2014 08:51:22 -0700 Subject: master: Error: service(log): command startup failed, throttling for 2 secs In-Reply-To: <544B9540.1060604@thelounge.net> References: <544B9540.1060604@thelounge.net> Message-ID: On 25 Oct 2014, at 05:19, Reindl Harald wrote: > master: Error: service(log): command startup failed, throttling for 2 secs > > i see that due restart on any machine acting as IMAP/POP3 proxy > why? With what Dovecot version? And doveconf -n? From bbodger at bodcon.com Sat Oct 25 15:52:38 2014 From: bbodger at bodcon.com (Bruce Bodger) Date: Sat, 25 Oct 2014 10:52:38 -0500 Subject: Sieve duplicate detection Message-ID: <4FFFA9B1-0B27-4F43-B470-38CC44989A43@bodcon.com> Good day, Gents. We are running: dovecot 1.2.17 dovecot-1.2-sieve-0.1.19 dovecot-1.2-managesieve-0.11.13 postfix 2.4.3 on OS X 10.5.8 server. Only about 15 users access the server. No problems. My question is... what would I have to upgrade, and to what version, in order to take advantage of pigeonhole sieve's duplicate detection (vnd.dovecot.duplicate) functionality? Thank you very much. Bruce From h.reindl at thelounge.net Sat Oct 25 15:59:42 2014 From: h.reindl at thelounge.net (Reindl Harald) Date: Sat, 25 Oct 2014 17:59:42 +0200 Subject: master: Error: service(log): command startup failed, throttling for 2 secs In-Reply-To: References: <544B9540.1060604@thelounge.net> Message-ID: <544BC8EE.6080208@thelounge.net> Am 25.10.2014 um 17:51 schrieb Timo Sirainen: > On 25 Oct 2014, at 05:19, Reindl Harald wrote: > >> master: Error: service(log): command startup failed, throttling for 2 secs >> >> i see that due restart on any machine acting as IMAP/POP3 proxy >> why? > > With what Dovecot version? And doveconf -n? at least 2.2.14 and 2.2.15 with a really simple config # 2.2.15: /etc/dovecot/dovecot.conf # OS: Linux 3.16.6-200.fc20.x86_64 x86_64 Fedora release 20 (Heisenbug) auth_cache_size = 1 k auth_cache_ttl = 30 mins auth_failure_delay = 5 secs auth_mechanisms = CRAM-MD5 DIGEST-MD5 APOP LOGIN PLAIN SCRAM-SHA-1 auth_username_chars = abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@% auth_username_translation = %@AaBbCcDdEeFfGgHhIiJjKkLlMmNnOoPpQqRrSsTtUuVvWwXxYyZz auth_worker_max_count = 5 disable_plaintext_auth = no imap_capability = IMAP4 IMAP4rev1 ACL RIGHTS=texk NAMESPACE CHILDREN SORT QUOTA THREAD=ORDEREDSUBJECT UNSELECT IDLE login_greeting = login_log_format = %{login_status}: %s login_log_format_elements = %u %r %m %c mail_max_userip_connections = 100 passdb { args = /etc/dovecot/sql.conf driver = sql } pop3_client_workarounds = outlook-no-nuls oe-ns-eoh protocols = imap service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service imap-login { inet_listener imap { address = * port = 143 } inet_listener imaps { address = * port = 993 } process_limit = 100 process_min_avail = 0 service_count = 1 vsz_limit = 64 M } shutdown_clients = no ssl_cert = From tss at iki.fi Sat Oct 25 16:07:50 2014 From: tss at iki.fi (Timo Sirainen) Date: Sat, 25 Oct 2014 09:07:50 -0700 Subject: v2.2.15 released - test suite segfault In-Reply-To: <201410251511.31726.arekm@maven.pl> References: <96FB5E7D-DFC2-410E-8827-78961029EB72@iki.fi> <201410251511.31726.arekm@maven.pl> Message-ID: <23590017-2B91-4D01-BB6E-90E22AADB83C@iki.fi> On 25 Oct 2014, at 06:11, Arkadiusz Mi?kiewicz wrote: > fatal_printf_format_fix .............................................. : ok > 0 / 190 tests failed > ==6098== Invalid read of size 16 > ==6098== at 0x317B880804: ??? (in /lib64/libc-2.20.so) > ==6098== by 0x317B8A93B6: ??? (in /lib64/libc-2.20.so) > ==6098== by 0x317B8AAA21: ??? (in /lib64/libc-2.20.so) > ==6098== by 0x317B8A9C0F: ??? (in /lib64/libc-2.20.so) > ==6098== by 0x317B8A9F94: ??? (in /lib64/libc-2.20.so) > ==6098== by 0x42A0D7: utc_mktime (utc-mktime.c:39) That's inside gmtime() call. Looks to me like a libc bug. What OS / libc / CPU is this with? Anyway this code hasn't changed for years. From tss at iki.fi Sat Oct 25 16:18:22 2014 From: tss at iki.fi (Timo Sirainen) Date: Sat, 25 Oct 2014 09:18:22 -0700 Subject: master: Error: service(log): command startup failed, throttling for 2 secs In-Reply-To: <544BC8EE.6080208@thelounge.net> References: <544B9540.1060604@thelounge.net> <544BC8EE.6080208@thelounge.net> Message-ID: On 25 Oct 2014, at 08:59, Reindl Harald wrote: > > Am 25.10.2014 um 17:51 schrieb Timo Sirainen: >> On 25 Oct 2014, at 05:19, Reindl Harald wrote: >> >>> master: Error: service(log): command startup failed, throttling for 2 secs >>> >>> i see that due restart on any machine acting as IMAP/POP3 proxy >>> why? >> >> With what Dovecot version? And doveconf -n? > > at least 2.2.14 and 2.2.15 with a really simple config Nothing else is logged besides that error? Does the log process start later on? I can't really think of a good reason why it would happen. From h.reindl at thelounge.net Sat Oct 25 16:22:40 2014 From: h.reindl at thelounge.net (Reindl Harald) Date: Sat, 25 Oct 2014 18:22:40 +0200 Subject: master: Error: service(log): command startup failed, throttling for 2 secs In-Reply-To: References: <544B9540.1060604@thelounge.net> <544BC8EE.6080208@thelounge.net> Message-ID: <544BCE50.4060207@thelounge.net> Am 25.10.2014 um 18:18 schrieb Timo Sirainen: > On 25 Oct 2014, at 08:59, Reindl Harald wrote: > >> >> Am 25.10.2014 um 17:51 schrieb Timo Sirainen: >>> On 25 Oct 2014, at 05:19, Reindl Harald wrote: >>> >>>> master: Error: service(log): command startup failed, throttling for 2 secs >>>> >>>> i see that due restart on any machine acting as IMAP/POP3 proxy >>>> why? >>> >>> With what Dovecot version? And doveconf -n? >> >> at least 2.2.14 and 2.2.15 with a really simple config > > Nothing else is logged besides that error? Does the log process start later on? I can't really think of a good reason why it would happen nothing else, see blow including "journalctl" output starting with the ssh-login and the service-status is showing "dovecot/log" finally ________________________________________________________________________________________ [root at srv-rhsoft:~]$ systemctl status dovecot.service dovecot.service - Dovecot IMAP/POP3 Proxy Loaded: loaded (/usr/lib/systemd/system/dovecot.service; enabled) Active: active (running) since Sa 2014-10-25 18:19:56 CEST; 52s ago Main PID: 1156 (dovecot) CGroup: /system.slice/dovecot.service ??1156 /usr/sbin/dovecot -F ??1157 dovecot/anvil ??1158 dovecot/log ??1160 dovecot/config Okt 25 18:19:56 srv-rhsoft.rhsoft.net systemd[1]: Started Dovecot IMAP/POP3 Proxy. Okt 25 18:19:56 srv-rhsoft.rhsoft.net dovecot[1156]: master: Dovecot v2.2.15 starting up for imap (core dumps disabled) ________________________________________________________________________________________ [root at srv-rhsoft:~]$ cat messages [root at srv-rhsoft:~]$ > messages [root at srv-rhsoft:~]$ > maillog [root at srv-rhsoft:~]$ systemctl restart dovecot [root at srv-rhsoft:~]$ cat messages Oct 25 18:19:56 srv-rhsoft systemd: Stopping Dovecot IMAP/POP3 Proxy... Oct 25 18:19:56 srv-rhsoft systemd: Starting Dovecot IMAP/POP3 Proxy... Oct 25 18:19:56 srv-rhsoft systemd: Started Dovecot IMAP/POP3 Proxy. [root at srv-rhsoft:~]$ cat maillog Oct 25 18:19:56 srv-rhsoft dovecot: master: Warning: Killed with signal 15 (by pid=1 uid=0 code=kill) Oct 25 18:19:56 srv-rhsoft dovecot: log: Warning: Killed with signal 15 (by pid=1 uid=0 code=kill) Oct 25 18:19:56 srv-rhsoft dovecot: master: Error: service(log): command startup failed, throttling for 2 secs Oct 25 18:19:56 srv-rhsoft dovecot: master: Dovecot v2.2.15 starting up for imap (core dumps disabled) ________________________________________________________________________________________ Okt 25 18:19:45 srv-rhsoft.rhsoft.net systemd[1]: Starting Session 11436 of user root. Okt 25 18:19:45 srv-rhsoft.rhsoft.net systemd-logind[824]: New session 11436 of user root. Okt 25 18:19:45 srv-rhsoft.rhsoft.net systemd[1]: Started Session 11436 of user root. Okt 25 18:19:45 srv-rhsoft.rhsoft.net sshd[1057]: pam_unix(sshd:session): session opened for user root by (uid=0) Okt 25 18:19:56 srv-rhsoft.rhsoft.net systemd[1]: Stopping Dovecot IMAP/POP3 Proxy... Okt 25 18:19:56 srv-rhsoft.rhsoft.net dovecot[31209]: master: Warning: Killed with signal 15 (by pid=1 uid=0 code=kill) Okt 25 18:19:56 srv-rhsoft.rhsoft.net dovecot[31211]: log: Warning: Killed with signal 15 (by pid=1 uid=0 code=kill) Okt 25 18:19:56 srv-rhsoft.rhsoft.net dovecot[31209]: master: Error: service(log): command startup failed, throttling for 2 secs Okt 25 18:19:56 srv-rhsoft.rhsoft.net systemd[1]: Starting Dovecot IMAP/POP3 Proxy... Okt 25 18:19:56 srv-rhsoft.rhsoft.net systemd[1]: Started Dovecot IMAP/POP3 Proxy. Okt 25 18:19:56 srv-rhsoft.rhsoft.net dovecot[1156]: master: Dovecot v2.2.15 starting up for imap (core dumps disabled) Okt 25 18:20:01 srv-rhsoft.rhsoft.net systemd[1]: Starting Session 11439 of user root. -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 181 bytes Desc: OpenPGP digital signature URL: From tss at iki.fi Sat Oct 25 16:42:33 2014 From: tss at iki.fi (Timo Sirainen) Date: Sat, 25 Oct 2014 09:42:33 -0700 Subject: master: Error: service(log): command startup failed, throttling for 2 secs In-Reply-To: <544BCE50.4060207@thelounge.net> References: <544B9540.1060604@thelounge.net> <544BC8EE.6080208@thelounge.net> <544BCE50.4060207@thelounge.net> Message-ID: <2A5C41C2-0AA3-49A8-8C0B-55CE83F27B40@iki.fi> On 25 Oct 2014, at 09:22, Reindl Harald wrote: >>>>> master: Error: service(log): command startup failed, throttling for 2 secs >>>>> >>>>> i see that due restart on any machine acting as IMAP/POP3 proxy >>>>> why? >>>> >>>> With what Dovecot version? And doveconf -n? >>> >>> at least 2.2.14 and 2.2.15 with a really simple config >> >> Nothing else is logged besides that error? Does the log process start later on? I can't really think of a good reason why it would happen > > nothing else, see blow including "journalctl" output starting with the ssh-login and the service-status is showing "dovecot/log" finally > Oct 25 18:19:56 srv-rhsoft dovecot: master: Warning: Killed with signal 15 (by pid=1 uid=0 code=kill) > Oct 25 18:19:56 srv-rhsoft dovecot: log: Warning: Killed with signal 15 (by pid=1 uid=0 code=kill) > Oct 25 18:19:56 srv-rhsoft dovecot: master: Error: service(log): command startup failed, throttling for 2 secs > Oct 25 18:19:56 srv-rhsoft dovecot: master: Dovecot v2.2.15 starting up for imap (core dumps disabled) Oh, "restart", not "start". That makes more sense, yes. I'll see about fixing it, but it's harmless anyway. From arekm at maven.pl Sat Oct 25 16:51:40 2014 From: arekm at maven.pl (Arkadiusz =?utf-8?q?Mi=C5=9Bkiewicz?=) Date: Sat, 25 Oct 2014 18:51:40 +0200 Subject: v2.2.15 released - test suite segfault In-Reply-To: <23590017-2B91-4D01-BB6E-90E22AADB83C@iki.fi> References: <96FB5E7D-DFC2-410E-8827-78961029EB72@iki.fi> <201410251511.31726.arekm@maven.pl> <23590017-2B91-4D01-BB6E-90E22AADB83C@iki.fi> Message-ID: <201410251851.40184.arekm@maven.pl> On Saturday 25 of October 2014, Timo Sirainen wrote: > On 25 Oct 2014, at 06:11, Arkadiusz Mi?kiewicz wrote: > > fatal_printf_format_fix .............................................. : > > ok 0 / 190 tests failed > > ==6098== Invalid read of size 16 > > ==6098== at 0x317B880804: ??? (in /lib64/libc-2.20.so) > > ==6098== by 0x317B8A93B6: ??? (in /lib64/libc-2.20.so) > > ==6098== by 0x317B8AAA21: ??? (in /lib64/libc-2.20.so) > > ==6098== by 0x317B8A9C0F: ??? (in /lib64/libc-2.20.so) > > ==6098== by 0x317B8A9F94: ??? (in /lib64/libc-2.20.so) > > ==6098== by 0x42A0D7: utc_mktime (utc-mktime.c:39) > > That's inside gmtime() call. Looks to me like a libc bug. What OS / libc / > CPU is this with? > > Anyway this code hasn't changed for years. Ok, looks like that was valgrind fault. linux, glibc 2.20, x86_64 -- Arkadiusz Mi?kiewicz, arekm / ( maven.pl | pld-linux.org ) From Wolfgang.Friebel at desy.de Sat Oct 25 17:13:16 2014 From: Wolfgang.Friebel at desy.de (Wolfgang.Friebel at desy.de) Date: Sat, 25 Oct 2014 19:13:16 +0200 (CEST) Subject: Segfault in pigeonhole tests with v2.2.15 but not in 2.2.14 In-Reply-To: <96FB5E7D-DFC2-410E-8827-78961029EB72@iki.fi> References: <96FB5E7D-DFC2-410E-8827-78961029EB72@iki.fi> Message-ID: On Fri, 24 Oct 2014, Timo Sirainen wrote: > http://dovecot.org/releases/2.2/dovecot-2.2.15.tar.gz > http://dovecot.org/releases/2.2/dovecot-2.2.15.tar.gz.sig > When building an rpm with dovecot 2.2.15. one test in the pigeonhole-0.4.3 test suite causes a segmentation fault: Test case: ./tests/extensions/editheader/deleteheader.svtest: 1: Test 'Deleteheader - nonexistent' SUCCEEDED make: *** [tests/extensions/editheader/deleteheader.svtest] Segmentation fault error: Bad exit status from /var/tmp/rpm-tmp.kap6R7 (%check) If I just replace the dovecot with the 2.2.14 soure the error disappears. I am compiling on Scientific Linux 6, gcc 4.4.7, but there is no change with 4.8.2. The configure used was ./configure --build=x86_64-redhat-linux-gnu --host=x86_64-redhat-linux-gnu --target=x86_64-redhat-linux-gnu --program-prefix= --prefix=/usr --exec-prefix=/usr --bindir=/usr/bin --sbindir=/usr/sbin --sysconfdir=/etc --datadir=/usr/share --includedir=/usr/include --libdir=/usr/lib64 --libexecdir=/usr/libexec --localstatedir=/var --sharedstatedir=/var/lib --mandir=/usr/share/man --infodir=/usr/share/info INSTALL_DATA=install -c -p -m644 --docdir=/usr/share/doc/dovecot --disable-static --disable-rpath --with-nss --with-shadow --with-pam --with-gssapi=plugin --with-ldap=plugin --with-sql=plugin --with-pgsql --with-mysql --with-sqlite --with-zlib --without-lzma --with-libcap --with-ssl=openssl --with-ssldir=/etc/pki/dovecot --with-solr --with-docs I am using --without-lzma as also the xz compression test fails, but this is hopefully because the liblzma is coming from a very old xz-4.999.9-0.3.beta package. -- Best regards Wolfgang Friebel From blackvoid+dovecot at fantas.in Sat Oct 25 18:12:21 2014 From: blackvoid+dovecot at fantas.in (Felix Gustavsson) Date: Sat, 25 Oct 2014 20:12:21 +0200 Subject: Dynamic tags in email address Message-ID: <544BE805.2020808@fantas.in> I'm trying to get dynamic tagging (user+sometag at example.com) to work on a mail server I'm setting up, however it only works as long as it's sent to the main user and not to aliases. virtual-alias-maps query: SELECT get_email_alias_dyn('%s') virtual-mailbox-domains query: SELECT 1 FROM domain WHERE name='%s' virtual-mailbox-maps query: SELECT 1 FROM user_alias INNER JOIN domain ON user_alias.domainID = domain.id WHERE user_alias.primary = 1 AND CONCAT(user_alias.name, '@', domain.name)='%s' "get_email_alias_dyn()" is a stored function which returns the destination email, so alias+tag at example.com returns user at example.com, alias at example.com returns user at example.com and so on. It works perfectly fine when the mail does not contain any tags (alias at example.com or user at example.com) or if it's the primary email which contains tags (user+sometag at example.com), but when it's tags on an alias the mail is bounced due to "user unknown". I tried modifying the dovecot service in master.cf so the addresses can be filtered with Sieve (http://wiki2.dovecot.org/LDA/Postfix), but that did not solve the issue either, so I have not idea where it goes wrong or how to solve it. I have included the logs from when I sent to alias+tag at example.com below: Oct 25 19:54:20 xx postfix/smtpd[10987]: connect from mail-wg0-f50.google.com[74.125.82.50] Oct 25 19:54:21 xx postfix/smtpd[10987]: 10585DFA63: client=mail-wg0-f50.google.com[74.125.82.50] Oct 25 19:54:21 xx postfix/cleanup[10995]: 10585DFA63: message-id= Oct 25 19:54:25 xx postfix/qmgr[9945]: 10585DFA63: from=, size=1743, nrcpt=1 (queue active) Oct 25 19:54:25 xx postfix/smtpd[10987]: disconnect from mail-wg0-f50.google.com[74.125.82.50] Oct 25 19:54:25 xx dovecot: auth-worker(11000): mysql(127.0.0.1): Connected to database mailcp Oct 25 19:54:25 xx postfix/pipe[10998]: 10585DFA63: to=, relay=dovecot, delay=5.4, delays=5.4/0/0/0.03, dsn=5.1.1, status=bounced (user unknown) Oct 25 19:54:25 xx postfix/cleanup[10995]: D39B2DFC7D: message-id=<20141025175425.D39B2DFC7D at xx.com> Oct 25 19:54:25 xx postfix/bounce[11002]: 10585DFA63: sender non-delivery notification: D39B2DFC7D Oct 25 19:54:25 xx postfix/qmgr[9945]: D39B2DFC7D: from=<>, size=3937, nrcpt=1 (queue active) Oct 25 19:54:25 xx postfix/qmgr[9945]: 10585DFA63: removed Oct 25 19:54:26 xx postfix/smtp[11004]: D39B2DFC7D: to=, relay=gmail-smtp-in.l.google.com[74.125.195.27]:25, delay=0.24, delays=0/0/0.16/0.07, dsn=2.0.0, status=sent (250 2.0.0 OK 1414259666 d8si5463492wiv.41 - gsmtp) Oct 25 19:54:26 xx postfix/qmgr[9945]: D39B2DFC7D: removed The dovecot-sql.conf.ext file looks like this: driver = mysql connect = host=127.0.0.1 dbname=mailcp user=mailcp password=xxx default_pass_scheme = SHA512-CRYPT password_query = SELECT CONCAT(user_alias.name, '@', domain.name) as user, user.password as password, concat('*:bytes=', (CASE WHEN user.quota -1 THEN user.quota ELSE domain.quota END)*1000000) AS userdb_quota_rule FROM user INNER JOIN user_alias ON user.id = user_alias.userID AND user_alias.primary = 1 INNER JOIN domain ON user_alias.domainID = domain.id WHERE CONCAT(user_alias.name, '@', domain.name) ='%u' AND user.status = 1 user_query = SELECT CONCAT('/var/mail/vmail/', domain.name, '/', user_alias.name) as home, 5000 AS uid, 5000 AS gid, concat('*:bytes=', (CASE WHEN user.quota != -1 THEN user.quota ELSE domain.quota END)*1000000) AS userdb_quota_rule FROM user INNER JOIN user_alias ON user.id = user_alias.userID AND user_alias.primary = 1 INNER JOIN domain ON user_alias.domainID = domain.id WHERE CONCAT(user_alias.name, '@', domain.name) ='%u' AND user.status = 1 From Kind at adm.uib.no Sat Oct 25 19:16:23 2014 From: Kind at adm.uib.no (Hans Morten Kind) Date: Sat, 25 Oct 2014 21:16:23 +0200 Subject: imap-postlogin and doveadm Message-ID: <20141025191623.GA23@alf.uib.no> We are configuring location= running a bash-script during imap-postlogin setting $MAIL in $USERDB_KEYS, as described in wiki/PostLoginScripting.txt This works fine. However, running a command like 'dovadm index [-u user] folder' only works for users with settings that match the default in mail_location= Would it be possible to make the location available for doveadm in a similar way, either with command line arguments or in the enviroment? hmk From rs at sys4.de Sat Oct 25 19:27:26 2014 From: rs at sys4.de (Robert Schetterer) Date: Sat, 25 Oct 2014 21:27:26 +0200 Subject: Dynamic tags in email address In-Reply-To: <544BE805.2020808@fantas.in> References: <544BE805.2020808@fantas.in> Message-ID: <544BF99E.3040300@sys4.de> Am 25.10.2014 um 20:12 schrieb Felix Gustavsson: > I'm trying to get dynamic tagging (user+sometag at example.com) to work on > a mail server I'm setting up, however it only works as long as it's sent > to the main user and not to aliases. > > virtual-alias-maps query: SELECT get_email_alias_dyn('%s') > virtual-mailbox-domains query: SELECT 1 FROM domain WHERE name='%s' > virtual-mailbox-maps query: SELECT 1 FROM user_alias INNER JOIN domain > ON user_alias.domainID = domain.id WHERE user_alias.primary = 1 AND > CONCAT(user_alias.name, '@', domain.name)='%s' > > "get_email_alias_dyn()" is a stored function which returns the > destination email, so alias+tag at example.com returns user at example.com, > alias at example.com returns user at example.com and so on. > > It works perfectly fine when the mail does not contain any tags > (alias at example.com or user at example.com) or if it's the primary email > which contains tags (user+sometag at example.com), but when it's tags on an > alias the mail is bounced due to "user unknown". > > I tried modifying the dovecot service in master.cf so the addresses can > be filtered with Sieve (http://wiki2.dovecot.org/LDA/Postfix), but that > did not solve the issue either, so I have not idea where it goes wrong > or how to solve it. seems complex have you read http://wiki2.dovecot.org/Pigeonhole/Sieve/Examples Plus Addressed mail filtering Using the subaddress extension, it is possible to match against the 'detail' part of an e-mail address, e.g. a '+tag' suffix to the local part of the address. This is for example useful when you don't want just any +tag to create a directory, but you want to use tagged addresses such as with amavisd-new. This example would place email addressed to user+spam at example.com into user's Spam folder. require ["fileinto", "envelope", "subaddress"]; if envelope :detail "to" "spam"{ fileinto "Spam"; } The following more advanced example uses the subaddress extension to handle recipient addresses structured as sales+@company.com in a special way. The part is extracted from the address using variables extension, transformed into a format with the first letter in upper case and subsequently used to create the folder name where the message is stored. The folder name is structured as users/. If the + detail is omitted from the recipient address, the message is filed in the sales folder. require ["variables", "envelope", "fileinto", "subaddress"]; if envelope :is :user "to" "sales" { if envelope :matches :detail "to" "*" { /* Save name in ${name} in all lowercase except for the first letter. * Joe, joe, jOe thus all become 'Joe'. */ set :lower :upperfirst "name" "${1}"; } if string :is "${name}" "" { /* Default case if no detail is specified */ fileinto "sales"; } else { /* For sales+joe@ this will become users/Joe */ fileinto "users/${name}"; } } To work with Postfix, this requires that the envelope "to" still contains the full address, so pass it with the -a flag. dovecot unix - n n - - pipe flags=DRhu user=mail:mail argv=/usr/local/libexec/dovecot/dovecot-lda -f ${sender} -d ${user}@${nexthop} -a ${recipient} or mailbox_command = /usr/lib/dovecot/dovecot-lda -a "$RECIPIENT" also there is 15-lda.conf # Delimiter character between local-part and detail in email address. #recipient_delimiter = + 90-sieve.conf # The separator that is expected between the :user and :detail # address parts introduced by the subaddress extension. This may # also be a sequence of characters (e.g. '--'). The current # implementation looks for the separator from the left of the # localpart and uses the first one encountered. The :user part is # left of the separator and the :detail part is right. This setting # is also used by Dovecot's LMTP service. #recipient_delimiter = + dont know if this helps > > I have included the logs from when I sent to alias+tag at example.com below: > > Oct 25 19:54:20 xx postfix/smtpd[10987]: connect from > mail-wg0-f50.google.com[74.125.82.50] > Oct 25 19:54:21 xx postfix/smtpd[10987]: 10585DFA63: > client=mail-wg0-f50.google.com[74.125.82.50] > Oct 25 19:54:21 xx postfix/cleanup[10995]: 10585DFA63: > message-id= > > Oct 25 19:54:25 xx postfix/qmgr[9945]: 10585DFA63: from=, > size=1743, nrcpt=1 (queue active) > Oct 25 19:54:25 xx postfix/smtpd[10987]: disconnect from > mail-wg0-f50.google.com[74.125.82.50] > Oct 25 19:54:25 xx dovecot: auth-worker(11000): mysql(127.0.0.1): > Connected to database mailcp > Oct 25 19:54:25 xx postfix/pipe[10998]: 10585DFA63: to=, > relay=dovecot, delay=5.4, delays=5.4/0/0/0.03, dsn=5.1.1, status=bounced > (user unknown) > Oct 25 19:54:25 xx postfix/cleanup[10995]: D39B2DFC7D: > message-id=<20141025175425.D39B2DFC7D at xx.com> > Oct 25 19:54:25 xx postfix/bounce[11002]: 10585DFA63: sender > non-delivery notification: D39B2DFC7D > Oct 25 19:54:25 xx postfix/qmgr[9945]: D39B2DFC7D: from=<>, size=3937, > nrcpt=1 (queue active) > Oct 25 19:54:25 xx postfix/qmgr[9945]: 10585DFA63: removed > Oct 25 19:54:26 xx postfix/smtp[11004]: D39B2DFC7D: to=, > relay=gmail-smtp-in.l.google.com[74.125.195.27]:25, delay=0.24, > delays=0/0/0.16/0.07, dsn=2.0.0, status=sent (250 2.0.0 OK 1414259666 > d8si5463492wiv.41 - gsmtp) > Oct 25 19:54:26 xx postfix/qmgr[9945]: D39B2DFC7D: removed > > The dovecot-sql.conf.ext file looks like this: > > driver = mysql > connect = host=127.0.0.1 dbname=mailcp user=mailcp password=xxx > default_pass_scheme = SHA512-CRYPT > password_query = SELECT CONCAT(user_alias.name, '@', domain.name) as > user, user.password as password, concat('*:bytes=', (CASE WHEN > user.quota -1 THEN user.quota ELSE domain.quota END)*1000000) AS > userdb_quota_rule FROM user INNER JOIN user_alias ON user.id = > user_alias.userID AND user_alias.primary = 1 INNER JOIN domain ON > user_alias.domainID = domain.id WHERE CONCAT(user_alias.name, '@', > domain.name) ='%u' AND user.status = 1 > user_query = SELECT CONCAT('/var/mail/vmail/', domain.name, '/', > user_alias.name) as home, 5000 AS uid, 5000 AS gid, concat('*:bytes=', > (CASE WHEN user.quota != -1 THEN user.quota ELSE domain.quota > END)*1000000) AS userdb_quota_rule FROM user INNER JOIN user_alias ON > user.id = user_alias.userID AND user_alias.primary = 1 INNER JOIN domain > ON user_alias.domainID = domain.id WHERE CONCAT(user_alias.name, '@', > domain.name) ='%u' AND user.status = 1 Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From gedalya at gedalya.net Sat Oct 25 20:14:44 2014 From: gedalya at gedalya.net (Gedalya) Date: Sat, 25 Oct 2014 16:14:44 -0400 Subject: imap-postlogin and doveadm In-Reply-To: <20141025191623.GA23@alf.uib.no> References: <20141025191623.GA23@alf.uib.no> Message-ID: <544C04B4.9090403@gedalya.net> On 10/25/2014 03:16 PM, Hans Morten Kind wrote: > We are configuring location= running a bash-script during imap-postlogin > setting $MAIL in $USERDB_KEYS, as described in wiki/PostLoginScripting.txt > This works fine. > > However, running a command like 'dovadm index [-u user] folder' > only works for users with settings that match the default in mail_location= > > Would it be possible to make the location available for doveadm > in a similar way, either with command line arguments or in the > enviroment? > > hmk Normally you would return this from the userdb. I normally like to use SQL, among the reasons is the fact that the SQL language allows to do some logic beyond just returning the contents of a column. You didn't specify what your auth backend is and what logic is being done in your bash script. But if you can get the right response to come straight from the userdb, that would affect doveadm too. From Kind at adm.uib.no Sat Oct 25 20:31:20 2014 From: Kind at adm.uib.no (Hans Morten Kind) Date: Sat, 25 Oct 2014 22:31:20 +0200 Subject: imap-postlogin and doveadm In-Reply-To: <544C04B4.9090403@gedalya.net> References: <20141025191623.GA23@alf.uib.no> <544C04B4.9090403@gedalya.net> Message-ID: <20141025203120.GB23@alf.uib.no> On Sat, Oct 25, 2014 at 04:14:44PM -0400, Gedalya wrote: > On 10/25/2014 03:16 PM, Hans Morten Kind wrote: >> Would it be possible to make the location available for doveadm >> in a similar way, either with command line arguments or in the >> enviroment? >> > > Normally you would return this from the userdb. I normally like to use > SQL, among the reasons is the fact that the SQL language allows to do > some logic beyond just returning the contents of a column. > You didn't specify what your auth backend is and what logic is being > done in your bash script. But if you can get the right response to come > straight from the userdb, that would affect doveadm too. The placement of INBOX is not known by userdb, it is picked from a CDB shared by exim, the delivery agent. The bash-script exports something like this before exec libexec/imap MAIL="mbox:INBOX=$MAILDIRECTORY/$USER" hmk From blackvoid+dovecot at fantas.in Sat Oct 25 20:38:16 2014 From: blackvoid+dovecot at fantas.in (Felix Gustavsson) Date: Sat, 25 Oct 2014 22:38:16 +0200 Subject: Dynamic tags in email address In-Reply-To: <544BF99E.3040300@sys4.de> References: <544BE805.2020808@fantas.in> <544BF99E.3040300@sys4.de> Message-ID: <544C0A38.3090805@fantas.in> On 2014-10-25 21:27, Robert Schetterer wrote: > Am 25.10.2014 um 20:12 schrieb Felix Gustavsson: >> I'm trying to get dynamic tagging (user+sometag at example.com) to work on >> a mail server I'm setting up, however it only works as long as it's sent >> to the main user and not to aliases. >> >> virtual-alias-maps query: SELECT get_email_alias_dyn('%s') >> virtual-mailbox-domains query: SELECT 1 FROM domain WHERE name='%s' >> virtual-mailbox-maps query: SELECT 1 FROM user_alias INNER JOIN domain >> ON user_alias.domainID = domain.id WHERE user_alias.primary = 1 AND >> CONCAT(user_alias.name, '@', domain.name)='%s' >> >> "get_email_alias_dyn()" is a stored function which returns the >> destination email, so alias+tag at example.com returns user at example.com, >> alias at example.com returns user at example.com and so on. >> >> It works perfectly fine when the mail does not contain any tags >> (alias at example.com or user at example.com) or if it's the primary email >> which contains tags (user+sometag at example.com), but when it's tags on an >> alias the mail is bounced due to "user unknown". >> >> I tried modifying the dovecot service in master.cf so the addresses can >> be filtered with Sieve (http://wiki2.dovecot.org/LDA/Postfix), but that >> did not solve the issue either, so I have not idea where it goes wrong >> or how to solve it. > seems complex > > have you read > > http://wiki2.dovecot.org/Pigeonhole/Sieve/Examples Didn't know that feature existed. I have now changed so it uses recipient_delimiter and I've changed the virtual-alias-maps query to fetch the primary email only instead of handling everything after the plus sign, however it still does not work. So I decided to log which queries are sent to the mysql database and it looks like it tries to get the home path of the alias and not the primary email. So when dovecot runs the user_query, %u is replaced with alias at example.com and not user at example.com which is weird, because the virtual-alias-maps query returns the primary email (user at example.com), so there should be no reason for alias at example.com to be used to get the mailbox. Here is the results from postmap when trying to maps: # postmap -q alias at example.com mysql:/etc/postfix/mysql-virtual-alias-maps.cf user at example.com # postmap -q user at example.com mysql:/etc/postfix/mysql-virtual-alias-maps.cf user at example.com # postmap -q example.com mysql:/etc/postfix/mysql-virtual-mailbox-domains.cf 1 # postmap -q user at example.com mysql:/etc/postfix/mysql-virtual-mailbox-maps.cf 1 # postmap -q alias at example.com mysql:/etc/postfix/mysql-virtual-mailbox-maps.cf (no result) > Plus Addressed mail filtering > > Using the subaddress extension, it is possible to match against the > 'detail' part of an e-mail address, e.g. a '+tag' suffix to the local > part of the address. This is for example useful when you don't want just > any +tag to create a directory, but you want to use tagged addresses > such as with amavisd-new. This example would place email addressed to > user+spam at example.com into user's Spam folder. > > require ["fileinto", "envelope", "subaddress"]; > if envelope :detail "to" "spam"{ > fileinto "Spam"; > } > > The following more advanced example uses the subaddress extension to > handle recipient addresses structured as sales+@company.com in a > special way. The part is extracted from the address using > variables extension, transformed into a format with the first letter in > upper case and subsequently used to create the folder name where the > message is stored. The folder name is structured as users/. If the > + detail is omitted from the recipient address, the message is > filed in the sales folder. > > require ["variables", "envelope", "fileinto", "subaddress"]; > > if envelope :is :user "to" "sales" { > if envelope :matches :detail "to" "*" { > /* Save name in ${name} in all lowercase except for the first letter. > * Joe, joe, jOe thus all become 'Joe'. > */ > set :lower :upperfirst "name" "${1}"; > } > > if string :is "${name}" "" { > /* Default case if no detail is specified */ > fileinto "sales"; > } else { > /* For sales+joe@ this will become users/Joe */ > fileinto "users/${name}"; > } > } > > To work with Postfix, this requires that the envelope "to" still > contains the full address, so pass it with the -a flag. > > dovecot unix - n n - - pipe > flags=DRhu user=mail:mail argv=/usr/local/libexec/dovecot/dovecot-lda > -f ${sender} -d ${user}@${nexthop} -a ${recipient} > > or > > mailbox_command = /usr/lib/dovecot/dovecot-lda -a "$RECIPIENT" > > > also there is > > 15-lda.conf > > # Delimiter character between local-part and detail in email address. > #recipient_delimiter = + > > 90-sieve.conf > > > # The separator that is expected between the :user and :detail > # address parts introduced by the subaddress extension. This may > # also be a sequence of characters (e.g. '--'). The current > # implementation looks for the separator from the left of the > # localpart and uses the first one encountered. The :user part is > # left of the separator and the :detail part is right. This setting > # is also used by Dovecot's LMTP service. > #recipient_delimiter = + > > > dont know if this helps > > >> I have included the logs from when I sent to alias+tag at example.com below: >> >> Oct 25 19:54:20 xx postfix/smtpd[10987]: connect from >> mail-wg0-f50.google.com[74.125.82.50] >> Oct 25 19:54:21 xx postfix/smtpd[10987]: 10585DFA63: >> client=mail-wg0-f50.google.com[74.125.82.50] >> Oct 25 19:54:21 xx postfix/cleanup[10995]: 10585DFA63: >> message-id= >> >> Oct 25 19:54:25 xx postfix/qmgr[9945]: 10585DFA63: from=, >> size=1743, nrcpt=1 (queue active) >> Oct 25 19:54:25 xx postfix/smtpd[10987]: disconnect from >> mail-wg0-f50.google.com[74.125.82.50] >> Oct 25 19:54:25 xx dovecot: auth-worker(11000): mysql(127.0.0.1): >> Connected to database mailcp >> Oct 25 19:54:25 xx postfix/pipe[10998]: 10585DFA63: to=, >> relay=dovecot, delay=5.4, delays=5.4/0/0/0.03, dsn=5.1.1, status=bounced >> (user unknown) >> Oct 25 19:54:25 xx postfix/cleanup[10995]: D39B2DFC7D: >> message-id=<20141025175425.D39B2DFC7D at xx.com> >> Oct 25 19:54:25 xx postfix/bounce[11002]: 10585DFA63: sender >> non-delivery notification: D39B2DFC7D >> Oct 25 19:54:25 xx postfix/qmgr[9945]: D39B2DFC7D: from=<>, size=3937, >> nrcpt=1 (queue active) >> Oct 25 19:54:25 xx postfix/qmgr[9945]: 10585DFA63: removed >> Oct 25 19:54:26 xx postfix/smtp[11004]: D39B2DFC7D: to=, >> relay=gmail-smtp-in.l.google.com[74.125.195.27]:25, delay=0.24, >> delays=0/0/0.16/0.07, dsn=2.0.0, status=sent (250 2.0.0 OK 1414259666 >> d8si5463492wiv.41 - gsmtp) >> Oct 25 19:54:26 xx postfix/qmgr[9945]: D39B2DFC7D: removed >> >> The dovecot-sql.conf.ext file looks like this: >> >> driver = mysql >> connect = host=127.0.0.1 dbname=mailcp user=mailcp password=xxx >> default_pass_scheme = SHA512-CRYPT >> password_query = SELECT CONCAT(user_alias.name, '@', domain.name) as >> user, user.password as password, concat('*:bytes=', (CASE WHEN >> user.quota -1 THEN user.quota ELSE domain.quota END)*1000000) AS >> userdb_quota_rule FROM user INNER JOIN user_alias ON user.id = >> user_alias.userID AND user_alias.primary = 1 INNER JOIN domain ON >> user_alias.domainID = domain.id WHERE CONCAT(user_alias.name, '@', >> domain.name) ='%u' AND user.status = 1 >> user_query = SELECT CONCAT('/var/mail/vmail/', domain.name, '/', >> user_alias.name) as home, 5000 AS uid, 5000 AS gid, concat('*:bytes=', >> (CASE WHEN user.quota != -1 THEN user.quota ELSE domain.quota >> END)*1000000) AS userdb_quota_rule FROM user INNER JOIN user_alias ON >> user.id = user_alias.userID AND user_alias.primary = 1 INNER JOIN domain >> ON user_alias.domainID = domain.id WHERE CONCAT(user_alias.name, '@', >> domain.name) ='%u' AND user.status = 1 > > > Best Regards > MfG Robert Schetterer > From gedalya at gedalya.net Sat Oct 25 20:39:29 2014 From: gedalya at gedalya.net (Gedalya) Date: Sat, 25 Oct 2014 16:39:29 -0400 Subject: v2.2.15 released In-Reply-To: References: <96FB5E7D-DFC2-410E-8827-78961029EB72@iki.fi> <5BB39377-634E-48DC-965F-11DAD33D45AA@iki.fi> <544B90A2.80006@gedalya.net> Message-ID: <544C0A81.6050507@gedalya.net> On 10/25/2014 11:43 AM, Timo Sirainen wrote: > On 25 Oct 2014, at 04:59, Gedalya wrote: > >>>> Also I have one minor issue to report. dovecot broke API from 2.2.13 to 2.2.14 but it only provides version macros for the first two components of the version number. This has caused a small upgrade problem for the antispam plugin which is in a separate package (dovecot-antispam.) Was that addressed in 2.2.15? >>> I only remember an ABI problem with antispam. Recompiling fixed that AFAIK. (And no Dovecot version guarantees ABI compatibility.) Is there some API problem also? >> https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=765943 > Oh, it uses the really old way to do things. In v1.1+ T_BEGIN { .. } T_END should have been used instead. Patch attached. > > OK, it's not working as it is. This little bit seems like a typo: - t_pop(); + } T_POP; Gives me: pipe.c:315:4: error: ?T_POP? undeclared (first use in this function) } T_POP; I tried T_END and I still get: pipe.c: In function ?backend_handle_mail?: pipe.c:314:2: error: label at end of compound statement out: ^ I got it to compile, see the attached. I don't really know C -------------- next part -------------- A non-text attachment was scrubbed... Name: antispam.diff Type: text/x-patch Size: 6371 bytes Desc: not available URL: From tss at iki.fi Sat Oct 25 21:05:06 2014 From: tss at iki.fi (Timo Sirainen) Date: Sat, 25 Oct 2014 14:05:06 -0700 Subject: Segfault in pigeonhole tests with v2.2.15 but not in 2.2.14 In-Reply-To: References: <96FB5E7D-DFC2-410E-8827-78961029EB72@iki.fi> Message-ID: <7E14D885-1E8E-4601-91D1-C99E7EAFEB4D@iki.fi> On 25 Oct 2014, at 10:13, Wolfgang.Friebel at desy.de wrote: > On Fri, 24 Oct 2014, Timo Sirainen wrote: > >> http://dovecot.org/releases/2.2/dovecot-2.2.15.tar.gz >> http://dovecot.org/releases/2.2/dovecot-2.2.15.tar.gz.sig >> > > When building an rpm with dovecot 2.2.15. one test in the pigeonhole-0.4.3 test suite causes a segmentation fault: Yeah. http://hg.rename-it.nl/dovecot-2.2-pigeonhole/rev/15b2910b145c fixes it. I was considering also if I should change this to Dovecot and make yet another v2.2.16 release, but maybe it's ok to require a new Pigeonhole. Stephan hopefully releases 0.4.4 soon. From tss at iki.fi Sat Oct 25 21:06:22 2014 From: tss at iki.fi (Timo Sirainen) Date: Sat, 25 Oct 2014 14:06:22 -0700 Subject: imap-postlogin and doveadm In-Reply-To: <20141025191623.GA23@alf.uib.no> References: <20141025191623.GA23@alf.uib.no> Message-ID: <9B9F098D-3CD5-4992-8B11-3C441065DB03@iki.fi> On 25 Oct 2014, at 12:16, Hans Morten Kind wrote: > We are configuring location= running a bash-script during imap-postlogin > setting $MAIL in $USERDB_KEYS, as described in wiki/PostLoginScripting.txt > This works fine. > > However, running a command like 'dovadm index [-u user] folder' > only works for users with settings that match the default in mail_location= > > Would it be possible to make the location available for doveadm > in a similar way, either with command line arguments or in the > enviroment? doveadm -o mail=/somewhere Or in general -o key=value overrides settings. From tss at iki.fi Sat Oct 25 21:08:39 2014 From: tss at iki.fi (Timo Sirainen) Date: Sat, 25 Oct 2014 14:08:39 -0700 Subject: master: Error: service(log): command startup failed, throttling for 2 secs In-Reply-To: <2A5C41C2-0AA3-49A8-8C0B-55CE83F27B40@iki.fi> References: <544B9540.1060604@thelounge.net> <544BC8EE.6080208@thelounge.net> <544BCE50.4060207@thelounge.net> <2A5C41C2-0AA3-49A8-8C0B-55CE83F27B40@iki.fi> Message-ID: On 25 Oct 2014, at 09:42, Timo Sirainen wrote: > On 25 Oct 2014, at 09:22, Reindl Harald wrote: > >>>>>> master: Error: service(log): command startup failed, throttling for 2 secs > > Oh, "restart", not "start". That makes more sense, yes. I'll see about fixing it, but it's harmless anyway. http://hg.dovecot.org/dovecot-2.2/rev/d35288713625 probably fixes this? From sca at andreasschulze.de Sat Oct 25 21:14:15 2014 From: sca at andreasschulze.de (A. Schulze) Date: Sat, 25 Oct 2014 23:14:15 +0200 Subject: Dovecote 1.2.17 poodle In-Reply-To: Message-ID: <20141025231415.Horde.Szd6akClFrYLzeZ4SQ145A1@horde.andreasschulze.de> Marc Rantanen: > Hi, how do I protect dovecot 1.2.17 against poodle? I just looked into the sourcecode. looks like there was an option "ssl_protocols" in dovecot.conf. ( check: dovecot -a | grep ssl_protocols ) then you should be able to set "ssl_protocols = !SSLv2 !SSLv3" restart and check: openssl s_client -connect $dovecot_host:imaps -tls1 should work while openssl s_client -connect $dovecot_host:imaps -ssl3 should not (or use pop3s) Also if you could recompile from source then you may test the following patch. At a first glance it should only avoid dovecot connect to a next dovecot via SSLv3 Index: src/lib-ssl-iostream/iostream-openssl-context.c =================================================================== --- src.orig/lib-ssl-iostream/iostream-openssl-context.c 2014-10-25 22:59:28.000000000 +0200 +++ src/lib-ssl-iostream/iostream-openssl-context.c 2014-10-25 23:00:12.000000000 +0200 @@ -358,7 +358,7 @@ /* enable all SSL workarounds, except empty fragments as it makes SSL more vulnerable against attacks */ - SSL_CTX_set_options(ctx->ssl_ctx, SSL_OP_NO_SSLv2 | + SSL_CTX_set_options(ctx->ssl_ctx, (SSL_OP_NO_SSLv2 | SSL_OP_NO_SSLv3) | (SSL_OP_ALL & ~SSL_OP_DONT_INSERT_EMPTY_FRAGMENTS)); if (SSL_CTX_need_tmp_RSA(ctx->ssl_ctx)) SSL_CTX_set_tmp_rsa_callback(ctx->ssl_ctx, ssl_gen_rsa_key); Index: src/login-common/ssl-proxy-openssl.c =================================================================== --- src.orig/login-common/ssl-proxy-openssl.c 2014-10-25 23:00:36.000000000 +0200 +++ src/login-common/ssl-proxy-openssl.c 2014-10-25 23:02:19.000000000 +0200 @@ -973,8 +973,8 @@ /* enable all SSL workarounds, except empty fragments as it makes SSL more vulnerable against attacks */ - SSL_CTX_set_options(ssl_ctx, SSL_OP_ALL & - ~SSL_OP_DONT_INSERT_EMPTY_FRAGMENTS); + SSL_CTX_set_options(ctx->ssl_ctx, (SSL_OP_NO_SSLv2 | SSL_OP_NO_SSLv3) | + (SSL_OP_ALL & ~SSL_OP_DONT_INSERT_EMPTY_FRAGMENTS)); #ifdef SSL_MODE_RELEASE_BUFFERS SSL_CTX_set_mode(ssl_ctx, SSL_MODE_RELEASE_BUFFERS); From h.reindl at thelounge.net Sat Oct 25 21:43:07 2014 From: h.reindl at thelounge.net (Reindl Harald) Date: Sat, 25 Oct 2014 23:43:07 +0200 Subject: master: Error: service(log): command startup failed, throttling for 2 secs In-Reply-To: References: <544B9540.1060604@thelounge.net> <544BC8EE.6080208@thelounge.net> <544BCE50.4060207@thelounge.net> <2A5C41C2-0AA3-49A8-8C0B-55CE83F27B40@iki.fi> Message-ID: <544C196B.70209@thelounge.net> Am 25.10.2014 um 23:08 schrieb Timo Sirainen: > On 25 Oct 2014, at 09:42, Timo Sirainen wrote: > >> On 25 Oct 2014, at 09:22, Reindl Harald wrote: >> >>>>>>> master: Error: service(log): command startup failed, throttling for 2 secs >> >> Oh, "restart", not "start". That makes more sense, yes. I'll see about fixing it, but it's harmless anyway. > > http://hg.dovecot.org/dovecot-2.2/rev/d35288713625 probably fixes this? indeed i wonder how there can be a difference between start/restart since systemd kills the whole service cgroup with all processes and so how does the new startup know anyting about a previous run? however, the message disappears with the patch [root at srv-rhsoft:~]$ cat messages Oct 25 23:41:13 srv-rhsoft systemd: Stopping Dovecot IMAP/POP3 Proxy... Oct 25 23:41:14 srv-rhsoft systemd: Starting Dovecot IMAP/POP3 Proxy... Oct 25 23:41:14 srv-rhsoft systemd: Started Dovecot IMAP/POP3 Proxy. [root at srv-rhsoft:~]$ cat maillog Oct 25 23:41:13 srv-rhsoft dovecot: master: Warning: Killed with signal 15 (by pid=1 uid=0 code=kill) Oct 25 23:41:13 srv-rhsoft dovecot: log: Warning: Killed with signal 15 (by pid=1 uid=0 code=kill) Oct 25 23:41:14 srv-rhsoft dovecot: master: Dovecot v2.2.15 starting up for imap (core dumps disabled) -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 181 bytes Desc: OpenPGP digital signature URL: From Kind at adm.uib.no Sat Oct 25 21:44:25 2014 From: Kind at adm.uib.no (Hans Morten Kind) Date: Sat, 25 Oct 2014 23:44:25 +0200 Subject: imap-postlogin and doveadm In-Reply-To: <9B9F098D-3CD5-4992-8B11-3C441065DB03@iki.fi> References: <20141025191623.GA23@alf.uib.no> <9B9F098D-3CD5-4992-8B11-3C441065DB03@iki.fi> Message-ID: <20141025214425.GC23@alf.uib.no> On Sat, Oct 25, 2014 at 02:06:22PM -0700, Timo Sirainen wrote: > doveadm -o mail=/somewhere > > Or in general -o key=value overrides settings. I'm impressed - again! hmk From r at sys4.de Sun Oct 26 12:28:00 2014 From: r at sys4.de (Ralf Hildebrandt) Date: Sun, 26 Oct 2014 13:28:00 +0100 Subject: An easy fix for "dovecot.map.index corrupted: map_uid=xxxx refcount too low"? Message-ID: <20141026122800.GA23003@sys4.de> Is there an easy way of "fixing" these? Oct 26 13:24:52 imap(account at domain): Error: mdbox map /var/mail/domain/account/mdbox/storage/dovecot.map.index corrupted: map_uid=2700 refcount too low (dovecot 2.1.17) -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From stephan at rename-it.nl Sun Oct 26 14:17:58 2014 From: stephan at rename-it.nl (Stephan Bosch) Date: Sun, 26 Oct 2014 15:17:58 +0100 Subject: Sieve: carry global variables from sieve_before to user sieve scripts In-Reply-To: <544BAAC2.1000503@strike.wu.ac.at> References: <5444DA70.5080402@strike.wu.ac.at> <544BAAC2.1000503@strike.wu.ac.at> Message-ID: <544D0296.5000709@rename-it.nl> On 10/25/2014 3:50 PM, Alexander 'Leo' Bergolth wrote: > On 20.10.2014 11:48, Alexander 'Leo' Bergolth wrote: >> Is there a way to initialize global variables with default values in >> sieve_before scripts that can be used in the sieve_default script or in >> user scripts? > > OK. I guess that's currently not possible. You're right. The global variable namespace is strictly limited to the tree of scripts created by the the "include" extension. No variables are shared between scripts executed in the multiscript sequence (http://tools.ietf.org/html/draft-degener-sieve-multiscript-00#section-4). > So maybe it is possible to take another approach: > Instead of executing sieve_before scripts and sieve_default side by > side, maybe it is feasible to set the "before-script" as sieve_default > and include the default personal user script from there if it exists? > That way global variable inheritance should work, shouldn't it? > A bit ugly, but I guess it would work. > Did anyone try this approach? Any caveats? Any security implications? > One big issue with this is that the user can choose not to include the script. Regards, Stephan. From alandaluz at gmail.com Mon Oct 27 04:52:45 2014 From: alandaluz at gmail.com (Cassidy Larson) Date: Sun, 26 Oct 2014 22:52:45 -0600 Subject: doveadm throws Panic: file dsync-mailbox-tree-fill.c: line 65 Message-ID: Running 2.2.15 on FreeBSD 10.0. Forcing replication with: doveadm replicator replicate -f user at host.com on one user that I've seen some syslogs show up to see what's going on. Other users are fine. When I run the above command on the one user it produces a core dump. See below for syslog output and full backtrace: syslog output: Oct 26 22:44:09 d3cstorage dovecot: dsync-server(user at host.com): Panic: file dsync-mailbox-tree-fill.c: line 65 (dsync_mailbox_tree_get_selectable): assertion failed: (status_r->uidvalidity != 0) Oct 26 22:44:09 d3cstorage dovecot: dsync-server(user at host.com): Fatal: master: service(doveadm): child 67571 killed with signal 6 (core dumped) Oct 26 22:44:09 d3cstorage kernel: pid 67571 (doveadm-server), uid 127: exited on signal 6 (core dumped) bt full: #0 0x0000000040f73e1a in kill () from /lib/libc.so.7 #1 0x0000000040f72ac9 in abort () from /lib/libc.so.7 #2 0x0000000040bd6fa4 in default_fatal_handler () from /usr/local/lib/dovecot/libdovecot.so.0 #3 0x0000000040bd7ca1 in i_set_failure_internal () from /usr/local/lib/dovecot/libdovecot.so.0 #4 0x0000000040bd7249 in i_panic () from /usr/local/lib/dovecot/libdovecot.so.0 #5 0x0000000000428014 in dsync_mailbox_tree_fill () #6 0x000000000041e0e6 in dsync_brain_mailbox_trees_init () #7 0x000000000041bb27 in dsync_brain_run () #8 0x000000000041b41f in dsync_brain_master_init () #9 0x000000000042ac54 in dsync_ibc_init_stream () #10 0x0000000040be9443 in io_loop_call_io () from /usr/local/lib/dovecot/libdovecot.so.0 #11 0x0000000040beaafd in io_loop_handler_run_internal () from /usr/local/lib/dovecot/libdovecot.so.0 #12 0x0000000040be9688 in io_loop_run () from /usr/local/lib/dovecot/libdovecot.so.0 #13 0x000000000040ec49 in doveadm_dsync_main () #14 0x0000000000410fe9 in doveadm_mail_single_user () #15 0x000000000041a89c in client_connection_create () #16 0x0000000040be9443 in io_loop_call_io () from /usr/local/lib/dovecot/libdovecot.so.0 #17 0x0000000040beaafd in io_loop_handler_run_internal () from /usr/local/lib/dovecot/libdovecot.so.0 #18 0x0000000040be9688 in io_loop_run () from /usr/local/lib/dovecot/libdovecot.so.0 #19 0x0000000040b90a58 in master_service_run () from /usr/local/lib/dovecot/libdovecot.so.0 #20 0x000000000041ae15 in main () Config snippets: service doveadm { drop_priv_before_exec = yes inet_listener { port = 12345 } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { group = mailsys mode = 0666 user = mailsys } unix_listener replicator { group = mailsys mode = 0666 user = mailsys } } Anything else I can provide? Thanks! Cassidy From mtrainer at cloud-free.com Mon Oct 27 07:29:57 2014 From: mtrainer at cloud-free.com (mtrainer at cloud-free.com) Date: Mon, 27 Oct 2014 15:29:57 +0800 Subject: Error renaming folders with spaces In-Reply-To: References: Message-ID: <14a6ae9a6afd15b293fdfbee99dd0891@cloud-free.com> On 24.10.2014 14:46, Steffen Kaiser wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > On Fri, 24 Oct 2014, mtrainer at cloud-free.com [2]wrote: > >> I am getting frequent errors of the form below. In most cases the path has spaces in it. Oct 24 07:27:08 mailstore03 dovecot: imap(sam at userdomain.com.au [1]): Error: rename(/home8/rs7-username/mail/xyzmortgages.com.au/sam/.Valuations - ABC, /home8/rs7-username/mail/xyzmortgages.com.au/sam/.Valuations - ABC/Subfolder) failed: Invalid argument Any ideas what is causing these errors? mail_location = maildir:~/ > > the "/Subfolder" part looks erroreously for me. > > Your setup does not support slashes in mailbox names. > > - -- > Steffen Kaiser > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1.4.11 (GNU/Linux) > > iQEVAwUBVEn14Xz1H7kL/d9rAQKJKAf+Nt6gOPEspAlFiTqC4GiP8UTGBO4YbvRv > C2EdDdFVO3zDpgmu7rNwnjVRvWtIYCQ3535O08J2aQznXcVT75HAEdl2o6YJh5QL > B8/Wz/u3+WCXLvtfyC0WqpJzqE58+fNg9PyOg88R+FgPBBvy6VcNcuJGlsl7/dRN > FbviVWvszUjw6fWC+DaH/fL+CPyPxPA0GemLfPSmPNe91jZlK5nOt0ga7DSczFjI > jSRw35ZeJxuH3d+d0+IOVveEEEBySodT2fecUOYvURwSViaaFOk/tBm5nxAylB8h > SP9yi042dDGIfMnniEGvcWJdUg9seHkHpAqZ65FGZilOHdMXqvzfIw== > =dbjl > -----END PGP SIGNATURE----- Thanks for the response. I did some testing and the error messages I get from Outlook vary and are not very helpful. If I try to rename a folder from test to test/2 I get an error "Server bug: Internal error occurred". I I try renaming a folder "test 1" to "test 1/ 2" I get an error "NONEXISTENT: Mailbox doesn't exist : INBOX.test 1". Is there any way I can support the '/' character with my configuration without changing the format of all my mailboxes? Thanks Murray Links: ------ [1] mailto:sam at userdomain.com.au [2] mailto:mtrainer at cloud-free.com From skdovecot at smail.inf.fh-brs.de Mon Oct 27 09:09:35 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Mon, 27 Oct 2014 10:09:35 +0100 (CET) Subject: Error renaming folders with spaces In-Reply-To: <14a6ae9a6afd15b293fdfbee99dd0891@cloud-free.com> References: <14a6ae9a6afd15b293fdfbee99dd0891@cloud-free.com> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Mon, 27 Oct 2014, mtrainer at cloud-free.com wrote: >>> I am getting frequent errors of > the form below. In most cases the path has spaces in it. Oct 24 07:27:08 > mailstore03 dovecot: imap(sam at userdomain.com.au [1]): Error: > rename(/home8/rs7-username/mail/xyzmortgages.com.au/sam/.Valuations - > ABC, /home8/rs7-username/mail/xyzmortgages.com.au/sam/.Valuations - > ABC/Subfolder) failed: Invalid argument Any ideas what is causing these > errors? mail_location = maildir:~/ >> >> the "/Subfolder" part looks > erroreously for me. >> >> Your setup does not support slashes in mailbox > names. > > Thanks for the response. I did some testing > and the error messages I get from Outlook vary and are not very helpful. > If I try to rename a folder from test to test/2 I get an error "Server > bug: Internal error occurred". I I try renaming a folder "test 1" to > "test 1/ 2" I get an error "NONEXISTENT: Mailbox doesn't exist : > INBOX.test 1". Is there any way I can support the '/' character with my > configuration without changing the format of all my mailboxes? Check out: http://wiki2.dovecot.org/Plugins/Listescape but search the list archive for problems with it. I do not use it myself. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBVE4Lz3z1H7kL/d9rAQKqZwf/TsIyWlEmLoUxx+hQksxmnUxL8WEHYtGM X/KB81LRfr8LMIi68OwkpJhFm8h+IxwSt8+fju+GIji3hTh5TBAyOa0q2Eni2Y0M D5lmKzxtiZbp1uQAFlRIagllnqr+by0B0qn7c6pQwYNcUgMgzcNWD1g/h7T0RWaX qtDufNoWjSJ51b3gg56Ks8+mSUfCxz1REd09qLgTQT7nuubIkClxxxdwOkcrZrHM vqjyA9d/YAoaRU51axRd8E8/3DY8SywtBAgyV4PzB7CRkQMK1NJyS2nYtkA0ZBCn VYNbPtczToOKDIBn6eZKapbWwNapYv4MihVkl/vVEnweW7W2hpJlgA== =JGmD -----END PGP SIGNATURE----- From robers at tutech.de Mon Oct 27 14:22:10 2014 From: robers at tutech.de (Thomas Robers) Date: Mon, 27 Oct 2014 15:22:10 +0100 Subject: Dovecot 2.2.14 and per user \Seen flags Message-ID: <544E5512.9010505@tutech.de> Hello, I have a Dovecot Installation Version 2.2.14 on CentOS 6.5 with shared folder. UserA shares his INBOX to user UserB. I activated "per user \Seen flags" with location = maildir:%%h/Maildir:INDEX=%h/shared/%%u:CONTROL=%h/shared/%%u:INDEXPVT=%h/shared I think the INDEXPVT setting activates this setting, right? I activated this setting when there were already several accounts in use. Before we used shared \Seen flags. But this setting doesn't work on my system. For example UserB marks several Messages as read in a shared INBOX from UserA and erverything seems alright but then suddenly all seen Messages are marked as unread again and I see the following error message in the log file: Oct 27 14:40:48 mail dovecot: imap(UserB at tutech.de): Error: /export/home/imap/UserB at tutech.de /shared/.INBOX/dovecot.index.pvt reset, view is now inconsistent Oct 27 14:40:48 mail dovecot: imap(UserB at tutech.de): Disconnected: BUG: Unknown internal error in=1020 out=2757 My Dovecot configuration is: root at mail:~# doveconf -n # 2.2.14: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-431.29.2.el6.x86_64 x86_64 CentOS release 6.5 (Final) ext4 auth_master_user_separator = * auth_mechanisms = plain login auth_verbose = yes disable_plaintext_auth = no mail_debug = yes mail_location = maildir:/export/home/imap/%Lu/Maildir mail_plugins = acl zlib managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave duplicate mbox_write_locks = fcntl namespace { hidden = no ignore_on_failure = no inbox = no list = children location = maildir:%%h/Maildir:INDEX=%h/shared/%%u:CONTROL=%h/shared/%%u:INDEXPVT=%h/shared prefix = shared/%%u/ separator = / subscriptions = yes type = shared } namespace inbox { hidden = no inbox = yes list = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = INBOX/ separator = / type = private } passdb { args = /etc/dovecot/master-users driver = passwd-file master = yes } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile:/etc/dovecot/global-acls:cache_secs=300 acl_shared_dict = file:/export/home/shared-db/shared-mailboxes mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size zlib_save = gz zlib_save_level = 6 } protocols = imap pop3 lmtp sieve service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } unix_listener auth-userdb { group = vmail mode = 0660 user = vmail } } service imap-login { process_limit = 500 process_min_avail = 20 } service lmtp { inet_listener lmtp { address = 127.0.0.1 port = 24 } } ssl = required ssl_cert = First of all: doveconf -n # 2.2.9: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.7 ext4 auth_mechanisms = plain login disable_plaintext_auth = no mail_debug = yes mail_gid = vmail mail_location = maildir:/home/vmail/domains/%d/%n mail_plugins = " quota" mail_temp_dir = /var/tmp mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave spamtest spamtestplus namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = INBOX. separator = . } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename quota = maildir:User quota sieve = ~/.dovecot.sieve sieve_default = /var/lib/dovecot/sieve/default.sieve sieve_dir = ~/sieve sieve_extensions = +spamtest +spamtestplus +relational +comparator-i;ascii-numeric sieve_global_dir = /var/lib/dovecot/sieve/global/ } protocols = " imap sieve pop3" service auth { unix_listener auth-userdb { user = vmail } } service imap-login { inet_listener imap { address = * port = 143 } inet_listener imaps { address = * port = 993 ssl = yes } } service managesieve-login { inet_listener sieve { address = 127.0.0.1 port = 4190 } } service pop3-login { inet_listener pop3 { address = * port = 110 } inet_listener pop3s { address = * port = 995 ssl = yes } } ssl_cert = References: <544E5512.9010505@tutech.de> Message-ID: <474F29B6-4FB6-4025-B58A-C32BAF4D50E9@iki.fi> On 27 Oct 2014, at 07:22, Thomas Robers wrote: > Hello, > > I have a Dovecot Installation Version 2.2.14 on CentOS 6.5 with shared folder. > UserA shares his INBOX to user UserB. I activated "per user \Seen flags" with > > location = maildir:%%h/Maildir:INDEX=%h/shared/%%u:CONTROL=%h/shared/%%u:INDEXPVT=%h/shared location = maildir:%%h/Maildir:INDEXPVT=%h/shared/%%u From tss at iki.fi Tue Oct 28 00:12:38 2014 From: tss at iki.fi (Timo Sirainen) Date: Mon, 27 Oct 2014 17:12:38 -0700 Subject: An easy fix for "dovecot.map.index corrupted: map_uid=xxxx refcount too low"? In-Reply-To: <20141026122800.GA23003@sys4.de> References: <20141026122800.GA23003@sys4.de> Message-ID: On 26 Oct 2014, at 05:28, Ralf Hildebrandt wrote: > Is there an easy way of "fixing" these? > > Oct 26 13:24:52 imap(account at domain): Error: mdbox map /var/mail/domain/account/mdbox/storage/dovecot.map.index corrupted: map_uid=2700 refcount too low > (dovecot 2.1.17) If they don't fix themselves .. I think the easiest is to access the mailbox with a newer Dovecot version (you could build v2.2 to /tmp/dovecot or something). For example read the mailbox with doveadm. From tss at iki.fi Tue Oct 28 00:15:29 2014 From: tss at iki.fi (Timo Sirainen) Date: Mon, 27 Oct 2014 17:15:29 -0700 Subject: doveadm throws Panic: file dsync-mailbox-tree-fill.c: line 65 In-Reply-To: References: Message-ID: On 26 Oct 2014, at 21:52, Cassidy Larson wrote: > Running 2.2.15 on FreeBSD 10.0. > > Forcing replication with: doveadm replicator replicate -f user at host.com > on one user that I've seen some syslogs show up to see what's going on. > Other users are fine. > > When I run the above command on the one user it produces a core dump. See > below for syslog output and full backtrace: > > syslog output: > Oct 26 22:44:09 d3cstorage dovecot: dsync-server(user at host.com): Panic: > file dsync-mailbox-tree-fill.c: line 65 > (dsync_mailbox_tree_get_selectable): assertion failed: > (status_r->uidvalidity != 0) What mailbox format are you using? What's the output of: doveadm mailbox status -u user at host.com 'uidvalidity uidnext' '*' Is there one with uidvalidity=0 value? That shouldn't be happening. From 576709166 at qq.com Mon Oct 27 03:03:01 2014 From: 576709166 at qq.com (=?ISO-8859-1?B?NTc2NzA5MTY2?=) Date: Mon, 27 Oct 2014 11:03:01 +0800 Subject: how to migration exchange'mail to dovecot? Message-ID: hi : i want to migration all users's mails of exchange server to our dovecot:but i don't know how to do this ? i know that exchange server can put users's mails to file.pst , but i don't know hwo to convent file.pst to file.eml . please help thanks ! From stephan at rename-it.nl Tue Oct 28 01:14:53 2014 From: stephan at rename-it.nl (Stephan Bosch) Date: Tue, 28 Oct 2014 02:14:53 +0100 Subject: Released Pigeonhole v0.4.4 for Dovecot v2.2.15. Message-ID: <544EEE0D.7010507@rename-it.nl> Hello Dovecot users, It's been about 5 months since the last Pigeonhole release, so it is high time for a new one. However, the main reason to make a release now is the fact that Dovecot v2.2.15 has one change that causes problems with the previous release of Pigeonhole. Unlike recent earlier releases, this release has a few big new features. Most notably, I implemented a generic Sieve script storage framework. This means that it is now relatively easy to implement a storage driver to retrieve Sieve scripts from a location other than the file system. An important effect of this new implementation is that these alternative storage locations can also be used with sieve_before/sieve_after. Also, storing Sieve scripts there using ManageSieve is also possible, provided that the driver provides an implementation. I used the new framework to implement an LDAP storage driver. However, it is read-only, which means that it doesn't currently provide ManageSieve support. Several bugs were fixed. The most nasty ones were related to the doveadm-sieve plugin (which is one of the reasons why this release took so long). The new script storage driver framework entailed large changes in this plugin, so many of these problems were addressed implicitly. Hopefully, all problems are solved now. Changelog v0.4.4: * Added support for Japanese mail addresses with dots at non-standard places in localpart. * Changed handling of ENOSPACE into a normal temporary failure and added handling of ENOQUOTA as a user error. * Restructured result execution, so that all actions which involve mail storage are always committed before all others. + Implemented support for generic Sieve storages. Using alternative storages now also possible for sieve_before/sieve_after. + Implemented storage driver for retrieving Sieve scripts from LDAP. This currently cannot be used with ManageSieve. + Implemented sieve_redirect_envelope_from setting, which allows configuring the envelope sender of redirected messages. - Fixed handling of mail storage errors occurring while evaluating the input message. - managesieve-login: - Removed bogus ALERT response code returned for AUTHENTICATE command. - Fixed handling of invalid initial response argument to AUTHENTICATE command. - Fixed handling of stream errors in lexical scanner. - Fixed handling of SMTP errors. Permanent and temporary errors were mixed up. - Fixed several problems reported by CLang 3.4. - duplicate extension: Fixed erroneous compile error about conflicting tags when `:handle' argument was used last. - relational extension: Fixed error handling of `:value' match. - editheader extension: Fixed header unfolding and header iteration. - mailbox extension: Fixed the `:create' tag, which erroneously subscribed an existing folder. - extprograms plugin: Fixed handling of error codes. - doveadm-sieve plugin: Fixed several bugs. Synchronization of symbolic link in the file storage should now also work properly. The release is available as follows: http://pigeonhole.dovecot.org/releases/2.2/dovecot-2.2-pigeonhole-0.4.4.tar.gz http://pigeonhole.dovecot.org/releases/2.2/dovecot-2.2-pigeonhole-0.4.4.tar.gz.sig Refer to http://pigeonhole.dovecot.org and the Dovecot v2.x wiki for more information. Have fun testing this new release and don't hesitate to notify me when there are any problems. Regards, -- Stephan Bosch stephan at rename-it.nl From alandaluz at gmail.com Tue Oct 28 02:38:31 2014 From: alandaluz at gmail.com (Cassidy Larson) Date: Mon, 27 Oct 2014 20:38:31 -0600 Subject: doveadm throws Panic: file dsync-mailbox-tree-fill.c: line 65 In-Reply-To: References: Message-ID: > > What mailbox format are you using? What's the output of: > > Using sdbox > doveadm mailbox status -u user at host.com 'uidvalidity uidnext' '*' > > There is one folder with uidvalidity=0: Trash uidnext=696 uidvalidity=1169866046 Notes uidnext=1 uidvalidity=1406044590 Sent Messages uidnext=112 uidvalidity=1169866046 Drafts uidnext=62 uidvalidity=1169866046 INBOX/my pictures/Nelson uidnext=1 uidvalidity=1406044592 INBOX/my pictures/Orlando uidnext=1 uidvalidity=1406044593 INBOX/my pictures/Rexbutg uidnext=1 uidvalidity=1412469718 INBOX/my pictures/Jared uidnext=1 uidvalidity=0 Deleted Messages uidnext=474 uidvalidity=1406044591 Deleted Items uidnext=2354 uidvalidity=1396558447 Sent Items uidnext=312 uidvalidity=1396558446 Junk uidnext=1 uidvalidity=1241816596 Junk E-mail uidnext=269 uidvalidity=1396558448 INBOX uidnext=38973 uidvalidity=1168294174 > Is there one with uidvalidity=0 value? That shouldn't be happening. > > Thanks. From alandaluz at gmail.com Tue Oct 28 03:05:44 2014 From: alandaluz at gmail.com (Cassidy Larson) Date: Mon, 27 Oct 2014 21:05:44 -0600 Subject: dsync-server throwing Resource temporarily available Message-ID: Running 2.2.15 on FreeBSD 10.0 with two back end storage boxes using TCP to sync. Seeing a couple of users that always seem to be throwing these kind of errors in the logs: dovecot: dsync-server(user at host.com): Error: write(/var/run/dovecot/replicator-doveadm) failed: Resource temporarily unavailable Just wondering what's the proper course of action to fix it? Thanks. From tss at iki.fi Tue Oct 28 03:43:28 2014 From: tss at iki.fi (Timo Sirainen) Date: Mon, 27 Oct 2014 20:43:28 -0700 Subject: doveadm throws Panic: file dsync-mailbox-tree-fill.c: line 65 In-Reply-To: References: Message-ID: On 27 Oct 2014, at 19:38, Cassidy Larson wrote: > > > What mailbox format are you using? What's the output of: > > > Using sdbox > > doveadm mailbox status -u user at host.com 'uidvalidity uidnext' '*' > > > There is one folder with uidvalidity=0: > > INBOX/my pictures/Jared uidnext=1 uidvalidity=0 I guess this fixes it? doveadm -u user at domain force-resync 'INBOX/my pictures/Jared' I guess I should make it happen automatically though. From tss at iki.fi Tue Oct 28 03:46:25 2014 From: tss at iki.fi (Timo Sirainen) Date: Mon, 27 Oct 2014 20:46:25 -0700 Subject: dsync-server throwing Resource temporarily available In-Reply-To: References: Message-ID: On 27 Oct 2014, at 20:05, Cassidy Larson wrote: > Running 2.2.15 on FreeBSD 10.0 with two back end storage boxes using TCP to > sync. > > Seeing a couple of users that always seem to be throwing these kind of > errors in the logs: > > dovecot: dsync-server(user at host.com): Error: > write(/var/run/dovecot/replicator-doveadm) failed: Resource temporarily > unavailable > > Just wondering what's the proper course of action to fix it? This: http://hg.dovecot.org/dovecot-2.2/rev/8a91b47d5a46 From alandaluz at gmail.com Tue Oct 28 04:18:55 2014 From: alandaluz at gmail.com (Cassidy Larson) Date: Mon, 27 Oct 2014 22:18:55 -0600 Subject: doveadm throws Panic: file dsync-mailbox-tree-fill.c: line 65 In-Reply-To: References: Message-ID: Found another user with an issue. They have an ?undefined/INBOX? folder on one of the storage servers but not the other. I assumed it was a problem with replication at one time or another? This causes this core dump: Oct 27 22:10:10 tdcstorage dovecot: dsync-server(user at host.com): Fatal: master: service(doveadm): child 9773 killed with signal 6 (core not dumped - set service doveadm { drop_priv_before_exec=yes }) Oct 27 22:10:24 tdcstorage dovecot: dsync-local(user at host.com): Panic: file dsync-mailbox-tree-sync.c: line 406 (sync_rename_node_to_temp): assertion failed: (strcmp(old_name, "INBOX") != 0) The backtrace shows: #0 0x0000000040f73e1a in kill () from /lib/libc.so.7 #1 0x0000000040f72ac9 in abort () from /lib/libc.so.7 #2 0x0000000040bd6f74 in default_fatal_handler () from /usr/local/lib/dovecot/libdovecot.so.0 #3 0x0000000040bd7c71 in i_set_failure_internal () from /usr/local/lib/dovecot/libdovecot.so.0 #4 0x0000000040bd7219 in i_panic () from /usr/local/lib/dovecot/libdovecot.so.0 #5 0x000000000042a421 in dsync_mailbox_trees_sync_deinit () #6 0x0000000000429ce9 in dsync_mailbox_trees_sync_deinit () #7 0x00000000004288f7 in dsync_mailbox_trees_sync_init () #8 0x000000000042816e in dsync_mailbox_trees_sync_init () #9 0x000000000041eaca in dsync_brain_recv_mailbox_tree_deletes () #10 0x000000000041bc82 in dsync_brain_run () #11 0x000000000041b45a in dsync_brain_master_init () #12 0x000000000042ac54 in dsync_ibc_init_stream () #13 0x0000000040be9413 in io_loop_call_io () from /usr/local/lib/dovecot/libdovecot.so.0 #14 0x0000000040beaacd in io_loop_handler_run_internal () from /usr/local/lib/dovecot/libdovecot.so.0 #15 0x0000000040be9658 in io_loop_run () from /usr/local/lib/dovecot/libdovecot.so.0 #16 0x000000000040fc46 in doveadm_dsync_main () #17 0x0000000000410fe9 in doveadm_mail_single_user () #18 0x000000000041a89c in client_connection_create () #19 0x0000000040be9413 in io_loop_call_io () from /usr/local/lib/dovecot/libdovecot.so.0 #20 0x0000000040beaacd in io_loop_handler_run_internal () from /usr/local/lib/dovecot/libdovecot.so.0 #21 0x0000000040be9658 in io_loop_run () from /usr/local/lib/dovecot/libdovecot.so.0 #22 0x0000000040b90a28 in master_service_run () from /usr/local/lib/dovecot/libdovecot.so.0 #23 0x000000000041ae15 in main () Where?d the ?undefined? folders come from? Any easy way to work around them, or is it a manual thing? Thanks. On Mon, Oct 27, 2014 at 9:43 PM, Timo Sirainen wrote: > On 27 Oct 2014, at 19:38, Cassidy Larson wrote: > > > >> What mailbox format are you using? What's the output of: >> >> > Using sdbox > > >> doveadm mailbox status -u user at host.com 'uidvalidity uidnext' '*' >> >> > There is one folder with uidvalidity=0: > > INBOX/my pictures/Jared uidnext=1 uidvalidity=0 > > > I guess this fixes it? > > doveadm -u user at domain force-resync 'INBOX/my pictures/Jared' > > I guess I should make it happen automatically though. > > From mtrainer at cloud-free.com Tue Oct 28 04:19:15 2014 From: mtrainer at cloud-free.com (mtrainer at cloud-free.com) Date: Tue, 28 Oct 2014 12:19:15 +0800 Subject: Error renaming folders with spaces In-Reply-To: References: <14a6ae9a6afd15b293fdfbee99dd0891@cloud-free.com> Message-ID: On 2014-10-27 17:09, Steffen Kaiser wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > On Mon, 27 Oct 2014, mtrainer at cloud-free.comwrote: > I am getting frequent errors of the form below. In most cases the path has spaces in it. Oct 24 07:27:08 mailstore03 dovecot: imap(sam at userdomain.com.au[1]): Error: rename(/home8/rs7-username/mail/xyzmortgages.com.au/sam/.Valuations - ABC, /home8/rs7-username/mail/xyzmortgages.com.au/sam/.Valuations - ABC/Subfolder) failed: Invalid argument Any ideas what is causing these errors? mail_location = maildir:~/ > the "/Subfolder" part looks erroreously for me. > Your setup does not support slashes in mailbox names. Thanks for the response. I did some testing and the error messages I get from Outlook vary and are not very helpful. If I try to rename a folder from test to test/2 I get an error "Server bug: Internal error occurred". I I try renaming a folder "test 1" to "test 1/ 2" I get an error "NONEXISTENT: Mailbox doesn't exist : INBOX.test 1". Is there any way I can support the '/' character with my configuration without changing the format of all my mailboxes? Check out: http://wiki2.dovecot.org/Plugins/Listescape [1] but search the list archive for problems with it. I do not use it myself. Thanks, I will test it out and see if it solves my issue. Murray Links: ------ [1] http://wiki2.dovecot.org/Plugins/Listescape From me at junc.eu Tue Oct 28 04:47:07 2014 From: me at junc.eu (Benny Pedersen) Date: Tue, 28 Oct 2014 05:47:07 +0100 Subject: how to migration exchange'mail to dovecot? In-Reply-To: References: Message-ID: <14955142d10.280b.d475fad7b14312f5d8424e35e39f7512@junc.eu> On October 27, 2014 4:03:01 AM 576709166 <576709166 at qq.com> wrote: > i know that exchange server can put users's mails to file.pst , but i > don't know hwo to convent file.pst to file.eml . You should stop fokusing on microsoft precompiled problems, if exchange can be used in imap protocol then simply use imapsync to get mails synced over to new server Check if your distro have imapsync, else ask how to use dsync with dovecot > please help thanks ! users is generic helpfull here without ever write please From rs at sys4.de Tue Oct 28 07:38:00 2014 From: rs at sys4.de (Robert Schetterer) Date: Tue, 28 Oct 2014 08:38:00 +0100 Subject: Released Pigeonhole v0.4.4 for Dovecot v2.2.15. In-Reply-To: <544EEE0D.7010507@rename-it.nl> References: <544EEE0D.7010507@rename-it.nl> Message-ID: <544F47D8.9080406@sys4.de> Am 28.10.2014 um 02:14 schrieb Stephan Bosch: > + Implemented sieve_redirect_envelope_from setting, which allows > configuring the envelope sender of redirected messages. Hi Stephan, i am very impressed do you have some simple example for this feature thx for coding ! Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From skdovecot at smail.inf.fh-brs.de Tue Oct 28 07:41:08 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Tue, 28 Oct 2014 08:41:08 +0100 (CET) Subject: dovecot ldap quota In-Reply-To: <544EA196.100@klez.it> References: <544EA196.100@klez.it> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Mon, 27 Oct 2014, Mirko ML wrote: > plugin { > quota = maildir:User quota > } > > grep -v '^ *\(#.*\)\?$' dovecot-ldap.conf.ext > user_attrs = quota=quota_rule=*:bytes=%$ > > And at the end the problem that i see on log: > > I cant understand this 2 line: > > Oct 27 20:42:36 mail dovecot: imap(ops at klez.it): Debug: Quota rule: root=User quota mailbox=* bytes=20971520 messages=0 > > Oct 27 20:42:36 mail dovecot: imap(ops at klez.it): Error: user ops at klez.it: Initialization failed: Failed to initialize quota: Invalid quota root quota: Invalid rule *:bytes=20971520S: Invalid rule limit value 'bytes=20971520S': Unknown unit: S > > This is a situation that I want to migrate from courier to dovecot.. > I see this post http://y6.gl/nnheTd that seems to have my problem. What value is in the LDAP attribute, with our without the pending 'S'? http://wiki2.dovecot.org/Quota/Configuration says: "All of these support also b/k/M/G/T/% suffixes." (No "S" here.) and: "Backend-specific configuration currently is used only with Maildir++ quota backend. It means you can have the quota in Maildir++ format (e.g. "10000000S")." Which I interprete as: If the quote is read from Maildir storage. You read the quota from LDAP, hence, the 2nd statement does not apply. If you have a "S" suffix in LDAP, remove it. You could patch Dovecot to accept the "S" suffix like "B", see src/plugins/quota/quota-util.c in function quota_limit_parse(). Maybe, ask the Dovecot development team for an enhancement. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBVE9IlXz1H7kL/d9rAQJKSgf6Aiinsm3Q2o3AodUG7OPFt9lUyrCirGdC LRmO9R83V4+N8bkJRLVZYUO0pRStVk0RUKzrko8ixXKp62qYkZmU8pP+rzGcFt6T NbfDNRoBNo3iHQ7nhYY0772XOvIgN2ne1KFhCFp6UxOgQFSjUlAqAV1pZ4LVgVHF 2815TK5Uugeiz4BWVYsb4F4lU6k7K2yEemTSTwe/gaYNxyUZdqmDOujbSnfYX4cd Uv4ujk9yeFDZ7jqCJvWNI9yPau1zdJ0vp/f7u6U1pOqeDUYcj2d7Q8W+SPaHvmNz +kw65HmP8YrwbbCdLOZOeqmSz5PoGQ4CdWXUrpLPhhmH7xkBrxGAjA== =OJvT -----END PGP SIGNATURE----- From stephan at rename-it.nl Tue Oct 28 08:08:18 2014 From: stephan at rename-it.nl (Stephan Bosch) Date: Tue, 28 Oct 2014 09:08:18 +0100 Subject: Released Pigeonhole v0.4.4 for Dovecot v2.2.15. In-Reply-To: <544F47D8.9080406@sys4.de> References: <544EEE0D.7010507@rename-it.nl> <544F47D8.9080406@sys4.de> Message-ID: <544F4EF2.9080901@rename-it.nl> On 10/28/2014 8:38 AM, Robert Schetterer wrote: > Am 28.10.2014 um 02:14 schrieb Stephan Bosch: >> + Implemented sieve_redirect_envelope_from setting, which allows >> configuring the envelope sender of redirected messages. > Hi Stephan, i am very impressed > do you have some simple example for this feature > thx for coding ! http://hg.rename-it.nl/dovecot-2.2-pigeonhole/file/0.4.4/INSTALL#l211 Regards, Stephan. From ops at klez.it Tue Oct 28 08:43:51 2014 From: ops at klez.it (Mirko ML) Date: Tue, 28 Oct 2014 09:43:51 +0100 Subject: dovecot ldap quota In-Reply-To: References: <544EA196.100@klez.it> Message-ID: <544F5747.7020104@klez.it> Il 28/10/2014 08:41, Steffen Kaiser ha scritto: [...] Thanks a lot for the answer. > What value is in the LDAP attribute, with our without the pending 'S'? The value in LDAP is WITH the pending S, because at the moment we have a "courier situation" and the quota value need the S. We want to migrate some domain to dovecot to use sieve, but we cant change the value in LDAP. > > http://wiki2.dovecot.org/Quota/Configuration says: > "All of these support also b/k/M/G/T/% suffixes." (No "S" here.) and: > > "Backend-specific configuration currently is used only with Maildir++ > quota backend. It means you can have the quota in Maildir++ format (e.g. > "10000000S")." Which I interprete as: If the quote is read from Maildir > storage. Probably you are right, but why root quota are correct? (without S at the end) If I change the value in LDAP the root quota follow this change > > You read the quota from LDAP, hence, the 2nd statement does not apply. > > If you have a "S" suffix in LDAP, remove it. see above :) > > You could patch Dovecot to accept the "S" suffix like "B", see > src/plugins/quota/quota-util.c in function quota_limit_parse(). This could be a good idea. > > Maybe, ask the Dovecot development team for an enhancement. This is a better idea, that can help migration from courier -- Ciao Mirko From toni at solu.fi Tue Oct 28 11:28:58 2014 From: toni at solu.fi (Toni Mattila) Date: Tue, 28 Oct 2014 13:28:58 +0200 Subject: dovecot ldap quota In-Reply-To: <544F5747.7020104@klez.it> References: <544EA196.100@klez.it> <544F5747.7020104@klez.it> Message-ID: <544F7DFA.9070706@solu.fi> Hi, On 28.10.2014 10:43, Mirko ML wrote: >> What value is in the LDAP attribute, with our without the pending 'S'? > The value in LDAP is WITH the pending S, because at the moment we have a > "courier situation" and the quota value need the S. > We want to migrate some domain to dovecot to use sieve, but we cant > change the value in LDAP. I ran into this issue as well while trying to use dict-quota but userdb is vpopmail that only gives out maildirsize style quotas. So would be nice if dovecot could out of the box handle that S as bytes. Cheers, Toni From lista at xdrv.co.uk Tue Oct 28 11:48:16 2014 From: lista at xdrv.co.uk (James) Date: Tue, 28 Oct 2014 11:48:16 +0000 Subject: Pigeonhole 0.4.4 error with no sieve rules Message-ID: <544F8280.4090002@xdrv.co.uk> I have built and installed Pigeonhole 0.4.4 with Dovecot 2.2.15. For users with no sieve at all I am getting an error on delivery. Delivery is from exim via lmtp. Syslog: Oct 28 11:03:50 mailhost dovecot: [ID 583609 mail.crit] lmtp(18915): Fatal: master: service(lmtp): child 18915 killed with signal 11 (core not dumped - set service lmtp { drop_priv_before_exec=yes }) There is no global sieve script because there is no global sieve rule. Where an account has sieve rules delivery works as expected. To make it work again I've gone back to 2.2.15 with 0.4.3. James. From stephan at rename-it.nl Tue Oct 28 13:31:12 2014 From: stephan at rename-it.nl (Stephan Bosch) Date: Tue, 28 Oct 2014 14:31:12 +0100 Subject: Pigeonhole 0.4.4 error with no sieve rules In-Reply-To: <544F8280.4090002@xdrv.co.uk> References: <544F8280.4090002@xdrv.co.uk> Message-ID: <544F9AA0.4060800@rename-it.nl> James schreef op 28-10-2014 12:48: > I have built and installed Pigeonhole 0.4.4 with Dovecot 2.2.15. For > users with no sieve at all I am getting an error on delivery. Delivery > is from exim via lmtp. > > Syslog: > Oct 28 11:03:50 mailhost dovecot: [ID 583609 mail.crit] lmtp(18915): > Fatal: master: service(lmtp): child 18915 killed with signal 11 (core > not dumped - set service lmtp { drop_priv_before_exec=yes }) > > > There is no global sieve script because there is no global sieve rule. > Where an account has sieve rules delivery works as expected. > To make it work again I've gone back to 2.2.15 with 0.4.3. Hmm, I cannot reproduce this here. Do you have `dovecot -n` output for me? LMTP logs with mail_debug=yes would be good too. Regards, Stephan. From listas at michelazzo.com.br Tue Oct 28 13:46:17 2014 From: listas at michelazzo.com.br (Paulino Michelazzo) Date: Tue, 28 Oct 2014 14:46:17 +0100 Subject: Namespaces (or another way) to put messages in a different drive Message-ID: <9B798C7C-584C-40A5-B1E6-A17CA6DEDDC6@michelazzo.com.br> Hello people, I have a situation where I need to create a mailbox for clients where they put old messages (> 1year) but I would like to create this mailbox in a different disk. I have a server with the mailboxes and a storage mapped using NFS just to create those mailboxes for old messages. I was trying to namespaces but every time that I make the configurations, the authentication system stop and the clients can?t log in. I really don?t know if this is the best approach for my situation (mailbox with old emails in a storage) and, if namespaces can solve it. The infos that I have are: Dovecot version 2.1.7 mailboxes: Namespace configs: namespace { type = private separator = / prefix = #location defaults to mail_location. inbox = yes } namespace { type = private separator / prefix = storage/ location = /mnt/exibstor/%u inbox = no hidden = no list = yes } If someone knows how can I do that, I really appreciate it. Best regards, Paulino Michelazzo From stephan at rename-it.nl Tue Oct 28 13:58:34 2014 From: stephan at rename-it.nl (Stephan Bosch) Date: Tue, 28 Oct 2014 14:58:34 +0100 Subject: Pigeonhole 0.4.4 error with no sieve rules In-Reply-To: <544F9AA0.4060800@rename-it.nl> References: <544F8280.4090002@xdrv.co.uk> <544F9AA0.4060800@rename-it.nl> Message-ID: <544FA10A.9000106@rename-it.nl> Stephan Bosch schreef op 28-10-2014 14:31: > James schreef op 28-10-2014 12:48: >> I have built and installed Pigeonhole 0.4.4 with Dovecot 2.2.15. For >> users with no sieve at all I am getting an error on delivery. >> Delivery is from exim via lmtp. >> >> Syslog: >> Oct 28 11:03:50 mailhost dovecot: [ID 583609 mail.crit] lmtp(18915): >> Fatal: master: service(lmtp): child 18915 killed with signal 11 (core >> not dumped - set service lmtp { drop_priv_before_exec=yes }) >> >> >> There is no global sieve script because there is no global sieve rule. >> Where an account has sieve rules delivery works as expected. >> To make it work again I've gone back to 2.2.15 with 0.4.3. > > Hmm, I cannot reproduce this here. > > Do you have `dovecot -n` output for me? > > LMTP logs with mail_debug=yes would be good too. Oh, of course a gdb backtrace (e.g. from a core dump) would be most useful: http://www.dovecot.org/bugreport.html Regards, Stephan. From lista at xdrv.co.uk Tue Oct 28 13:59:41 2014 From: lista at xdrv.co.uk (James) Date: Tue, 28 Oct 2014 13:59:41 +0000 Subject: Pigeonhole 0.4.4 error with no sieve rules In-Reply-To: <544F9AA0.4060800@rename-it.nl> References: <544F8280.4090002@xdrv.co.uk> <544F9AA0.4060800@rename-it.nl> Message-ID: <544FA14D.3000506@xdrv.co.uk> On 28/10/2014 13:31, Stephan Bosch wrote: >> I have built and installed Pigeonhole 0.4.4 with Dovecot 2.2.15. For >> users with no sieve at all I am getting an error on delivery. Delivery >> is from exim via lmtp. >> >> Syslog: >> Oct 28 11:03:50 mailhost dovecot: [ID 583609 mail.crit] lmtp(18915): >> Fatal: master: service(lmtp): child 18915 killed with signal 11 (core >> not dumped - set service lmtp { drop_priv_before_exec=yes } ... > Do you have `dovecot -n` output for me? "dovecot -n" with mild edits, the personal paths are in capitals: # 2.2.15: /etc/opt/XXXX/dovecot/dovecot.conf # OS: SunOS 5.10 i86pc auth_mechanisms = plain login digest-md5 cram-md5 base_dir = /var/opt/XXXX/dovecot/ lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes login_trusted_networks = 192.168.1.0/24 111.222.333.444/24 mail_gid = vmail mail_home = /PATH/TO/STORE/%d/%n mail_location = maildir:/PATH/TO/STORE/%d/%n/Maildir mail_max_userip_connections = 20 mail_uid = vmail mailbox_idle_check_interval = 10 secs managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave duplicate passdb { args = /etc/opt/XXXX/dovecot/dovecot-sql.conf driver = sql } plugin { fts_autoindex = yes quota = maildir:User quota quota_rule = *:storage=1G quota_rule2 = Trash:storage=+10% quota_warning = storage=90%% quota-warning 90 %u quota_warning2 = storage=95%% quota-warning 95 %u quota_warning3 = storage=99%% quota-warning 99 %u sieve = /PATH/TO/STORE/%d/%n/dovecot.sieve sieve_dir = /PATH/TO/STORE/%d/%n/sieve } protocols = imap lmtp sieve service auth { unix_listener auth-client { mode = 0660 } unix_listener auth-master { mode = 0600 } user = root } service lmtp { group = vmail unix_listener lmtp { mode = 0666 } user = vmail } service quota-warning { executable = script /etc/opt/XXXX/dovecot/quota-warning user = vmail } ssl_cert = LMTP logs with mail_debug=yes would be good too. From syslog with the syslog identity prefixes and dates removed, personal paths replaced with capitals: sieve: include: sieve_global is not set; it is currently not possible to include `:global' scripts. vOFIJHGAT1TlPAAAs831Jw: sieve: file storage: Using script storage path: /PATH/TO/STORE/DOMAIN/NAME/sieve vOFIJHGAT1TlPAAAs831Jw: sieve: file storage: Using active Sieve script path: /PATH/TO/STORE/DOMAIN/NAME/dovecot.sieve vOFIJHGAT1TlPAAAs831Jw: sieve: file storage: Relative path to sieve storage in active link: sieve/ vOFIJHGAT1TlPAAAs831Jw: sieve: file storage: Using script storage path: /PATH/TO/STORE/DOMAIN/NAME/dovecot.sieve lmtp(NAME at DOMAIN): Debug: vOFIJHGAT1TlPAAAs831Jw: sieve: file script: File `/PATH/TO/STORE/DOMAIN/NAME/dovecot.sieve' not found Thank you for your interest. James. From lista at xdrv.co.uk Tue Oct 28 14:02:23 2014 From: lista at xdrv.co.uk (James) Date: Tue, 28 Oct 2014 14:02:23 +0000 Subject: Pigeonhole 0.4.4 error with no sieve rules In-Reply-To: <544FA10A.9000106@rename-it.nl> References: <544F8280.4090002@xdrv.co.uk> <544F9AA0.4060800@rename-it.nl> <544FA10A.9000106@rename-it.nl> Message-ID: <544FA1EF.7080100@xdrv.co.uk> On 28/10/2014 13:58, Stephan Bosch wrote: >>> Oct 28 11:03:50 mailhost dovecot: [ID 583609 mail.crit] lmtp(18915): >>> Fatal: master: service(lmtp): child 18915 killed with signal 11 (core >>> not dumped - set service lmtp { drop_priv_before_exec=yes }) ... > Oh, of course a gdb backtrace (e.g. from a core dump) would be most useful: "core not dumped". James. From stephan at rename-it.nl Tue Oct 28 14:17:09 2014 From: stephan at rename-it.nl (Stephan Bosch) Date: Tue, 28 Oct 2014 15:17:09 +0100 Subject: Pigeonhole 0.4.4 error with no sieve rules In-Reply-To: <544FA1EF.7080100@xdrv.co.uk> References: <544F8280.4090002@xdrv.co.uk> <544F9AA0.4060800@rename-it.nl> <544FA10A.9000106@rename-it.nl> <544FA1EF.7080100@xdrv.co.uk> Message-ID: <544FA565.4090500@rename-it.nl> James schreef op 28-10-2014 15:02: > On 28/10/2014 13:58, Stephan Bosch wrote: > >>>> Oct 28 11:03:50 mailhost dovecot: [ID 583609 mail.crit] lmtp(18915): >>>> Fatal: master: service(lmtp): child 18915 killed with signal 11 (core >>>> not dumped - set service lmtp { drop_priv_before_exec=yes }) > ... >> Oh, of course a gdb backtrace (e.g. from a core dump) would be most >> useful: > > "core not dumped". This link provides hints on how to get a core dump: http://www.dovecot.org/bugreport.html Regards, Stephan. From stephan at rename-it.nl Tue Oct 28 14:19:04 2014 From: stephan at rename-it.nl (Stephan Bosch) Date: Tue, 28 Oct 2014 15:19:04 +0100 Subject: Pigeonhole 0.4.4 error with no sieve rules In-Reply-To: <544FA565.4090500@rename-it.nl> References: <544F8280.4090002@xdrv.co.uk> <544F9AA0.4060800@rename-it.nl> <544FA10A.9000106@rename-it.nl> <544FA1EF.7080100@xdrv.co.uk> <544FA565.4090500@rename-it.nl> Message-ID: <544FA5D8.1000307@rename-it.nl> Stephan Bosch schreef op 28-10-2014 15:17: > James schreef op 28-10-2014 15:02: >> On 28/10/2014 13:58, Stephan Bosch wrote: >> >>>>> Oct 28 11:03:50 mailhost dovecot: [ID 583609 mail.crit] lmtp(18915): >>>>> Fatal: master: service(lmtp): child 18915 killed with signal 11 (core >>>>> not dumped - set service lmtp { drop_priv_before_exec=yes }) >> ... >>> Oh, of course a gdb backtrace (e.g. from a core dump) would be most >>> useful: >> >> "core not dumped". > > This link provides hints on how to get a core dump: > > http://www.dovecot.org/bugreport.html Oh, and the error ^^ gives a good hint as well. Regards, Stephan. From ops at klez.it Tue Oct 28 16:24:37 2014 From: ops at klez.it (Mirko ML) Date: Tue, 28 Oct 2014 17:24:37 +0100 Subject: maildir++ quota support on dovecot Message-ID: <544FC345.9080507@klez.it> Some information about maildir++ that I have read: http://www.inter7.com/courierimap/README.maildirquota.html http://wiki2.dovecot.org/Quota/Maildir When I have to deliver a message with an MDA I can use dovecot-lda. If I have enabled "quota = maildir:User quota" I am pretty sure that in the mailbox on file system I find a file named "maildirsize" maildirsize on top contain something like this "xxxxxxxxxxS" that specifies the SIZE quota in bytes. LDA could delivery the message only when the SIZE written in mailbox is less than the SIZE defined by mail admin. "Each member of the list consists of an integer followed by a letter, specifying the nature of the quota. Currently defined quota types are 'S' - total size of all messages, and 'C' - the maximum count of messages in the maildir. For example, 10000000S,1000C specifies a quota of 10,000,000 bytes or 1,000 messages, whichever comes first." For this reason the value in bytes defined for the user must have S at the end. At the moment quota-maildir.c contains a control for S or C so I can find this in log: Quota rule: root=User quota mailbox=* bytes=20971520 messages=0 But quota-util.c do not contains a control for C and S, so probably the support of maildir++ format is not complete. Please let me know if I am wrong. -- Ciao Mirko From lista at xdrv.co.uk Tue Oct 28 19:48:58 2014 From: lista at xdrv.co.uk (James) Date: Tue, 28 Oct 2014 19:48:58 +0000 Subject: Pigeonhole 0.4.4 error with no sieve rules In-Reply-To: <544FA5D8.1000307@rename-it.nl> References: <544F8280.4090002@xdrv.co.uk> <544F9AA0.4060800@rename-it.nl> <544FA10A.9000106@rename-it.nl> <544FA1EF.7080100@xdrv.co.uk> <544FA565.4090500@rename-it.nl> <544FA5D8.1000307@rename-it.nl> Message-ID: <544FF32A.9000401@xdrv.co.uk> On 28/10/2014 14:19, Stephan Bosch wrote: > Stephan Bosch schreef op 28-10-2014 15:17: >>>> Oh, of course a gdb backtrace (e.g. from a core dump) would be most >>>> useful: >>> >>> "core not dumped". >> >> This link provides hints on how to get a core dump: >> >> http://www.dovecot.org/bugreport.html > > Oh, and the error ^^ gives a good hint as well. Not understanding the message I assumed it was a just a statement and not an instruction. OK, after a short delay while I rebuild with symbol tables, here is a dbx trace (I don't have gdb built/installed): $ dbx /opt/XXXX/libexec/dovecot/lmtp core ... (dbx) where [1] strlen(0x0), at 0xfee7645c [2] _ndoprnt(0xfe8657dc, 0x80476ac, 0x80475d0, 0x0), at 0xfeed1bbe [3] vsnprintf(0x806de30, 0x11b, 0xfe8657cc, 0x80476ac), at 0xfeed4d7f =>[4] t_noalloc_strdup_vprintf(format = (nil), args = 0x80476ac, size_r = 0x804764c) (optimized), at 0xfedddbd0 (line ~122) in "strfuncs.c" [5] p_strdup_vprintf(pool = 0xfee1f8e8, format = 0xfe8657cc "Sieve script `%s' not found", args = 0x80476ac) (optimized), at 0xfedddc96 (line ~146) in "strfuncs.c" [6] i_strdup_vprintf(format = 0xfe8657cc "Sieve script `%s' not found", args = 0x80476ac) (optimized), at 0xfeda6bd9 (line ~50) in "imem.c" [7] sieve_script_set_error(script = 0x80b0f40, error = SIEVE_ERROR_NOT_FOUND, fmt = 0xfe8657cc "Sieve script `%s' not found", ... = , ...) (optimized), at 0xfe793bd7 (line ~555) in "sieve-script.c" [8] sieve_file_script_handle_error(fscript = 0x80b0f40, path = 0x80b0c38 "/PATH/TO/STORE/DOMAIN/NAME/dovecot.sieve", error_r = 0x8047898) (optimized), at 0xfe7e3350 (line ~65) in "sieve-file-script.c" [9] sieve_file_script_open(script = 0x80b0f40, error_r = 0x8047898) (optimized), at 0xfe7e3bbf (line ~346) in "sieve-file-script.c" [10] sieve_script_open(script = 0x80b0f40, error_r = (nil)) (optimized), at 0xfe792f48 (line ~174) in "sieve-script.c" [11] sieve_file_script_open_from_path(fstorage = 0x80b0730, path = 0x80b0850 "/PATH/TO/STORE/DOMAIN/NAME/dovecot.sieve", scriptname = (nil), error_r = (nil)) (optimized), at 0xfe7e375f (line ~233) in "sieve-file-script.c" [12] sieve_file_storage_active_script_open(storage = 0x80b0730) (optimized), at 0xfe7e674f (line ~288) in "sieve-file-storage-active.c" [13] sieve_storage_active_script_open(storage = 0x80b0730, error_r = 0x8047940) (optimized), at 0xfe795d06 (line ~657) in "sieve-storage.c" [14] lda_sieve_find_scripts(srctx = 0x8047990) (optimized), at 0xfe893774 (line ~668) in "lda-sieve-plugin.c" [15] lda_sieve_deliver_mail(mdctx = 0x8047a80, storage_r = 0x8047a78) (optimized), at 0xfe89432b (line ~983) in "lda-sieve-plugin.c" [16] mail_deliver(ctx = 0x8047a80, storage_r = 0x8047a78) (optimized), at 0xfee39d47 (line ~400) in "mail-deliver.c" [17] client_deliver(client = 0x807c780, rcpt = 0x807d230, src_mail = 0x80a3cb8, session = 0x80a84c8) (optimized), at 0x8058ee2 (line ~697) in "commands.c" [18] client_deliver_next(client = 0x807c780, src_mail = 0x80a3cb8, session = 0x80a84c8) (optimized), at 0x80590c6 (line ~741) in "commands.c" [19] client_input_data_write_local(client = 0x807c780, input = 0x808bd98) (optimized), at 0x80593d5 (line ~835) in "commands.c" [20] client_input_data_write(client = 0x807c780) (optimized), at 0x80598e6 (line ~947) in "commands.c" [21] client_input_data_handle(client = 0x807c780) (optimized), at 0x8059c42 (line ~1041) in "commands.c" [22] client_input_data(client = 0x807c780) (optimized), at 0x8059cc2 (line ~1050) in "commands.c" [23] io_loop_call_io(io = 0x807d158) (optimized), at 0xfedb9a89 (line ~498) in "ioloop.c" [24] io_loop_handler_run_internal(ioloop = 0x8075c50) (optimized), at 0xfedbb849 (line ~211) in "ioloop-poll.c" [25] io_loop_handler_run(ioloop = 0x8075c50) (optimized), at 0xfedb9bfe (line ~545) in "ioloop.c" [26] io_loop_run(ioloop = 0x8075c50) (optimized), at 0xfedb9b4d (line ~522) in "ioloop.c" [27] master_service_run(service = 0x8075790, callback = 0x8054c80 = &`lmtp`main.c`client_connected(struct master_service_connection *conn)) (optimized), at 0xfed18587 (line ~566) in "master-service.c" [28] main(argc = 1, argv = 0x8047d84) (optimized), at 0x8054f8d (line ~122) in "main.c" Sorry but I've not had time to analyse it, a task for the morning. James. From soko.tica at gmail.com Tue Oct 28 20:05:38 2014 From: soko.tica at gmail.com (soko.tica) Date: Tue, 28 Oct 2014 21:05:38 +0100 Subject: basic configuratio error Message-ID: Hello list, After many hours I still fail to configure properly dovecot as the LDA with opensmtpd, for system users only. I don't want pop at all, jus lmtp and imap, but still haven't stripped it. Here is the info, thanks in advance for your response: ===== # doveconf -n # 2.2.14: /etc/dovecot/dovecot.conf # OS: OpenBSD 5.6 i386 auth_verbose = yes auth_verbose_passwords = yes disable_plaintext_auth = no first_valid_uid = 1000 hostname = imap.home.lan imap_client_workarounds = delay-newmail tb-extra-mailbox-sep tb-lsub-flags lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes lda_original_recipient_header = X-Original-To mail_debug = yes mail_location = maildir:~/Maildir managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave duplicate mbox_write_locks = fcntl mmap_disable = yes namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = bsdauth } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } pop3_client_workarounds = outlook-no-nuls oe-ns-eoh postmaster_address = postmaster at mileva.home.lan protocols = imap pop3 lmtp sieve service auth-worker { user = root } service auth { unix_listener auth-userdb { group = _dovenull mode = 0666 user = _dovenull } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 0 service_count = 1 } service imap { process_limit = 1024 } service lmtp { unix_listener lmtp { mode = 0666 } } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } ssl_cert = References: <544F8280.4090002@xdrv.co.uk> <544F9AA0.4060800@rename-it.nl> <544FA10A.9000106@rename-it.nl> <544FA1EF.7080100@xdrv.co.uk> <544FA565.4090500@rename-it.nl> <544FA5D8.1000307@rename-it.nl> <544FF32A.9000401@xdrv.co.uk> Message-ID: <54500D0B.3040101@rename-it.nl> On 10/28/2014 8:48 PM, James wrote: > On 28/10/2014 14:19, Stephan Bosch wrote: >> Stephan Bosch schreef op 28-10-2014 15:17: > >>>>> Oh, of course a gdb backtrace (e.g. from a core dump) would be most >>>>> useful: >>>> >>>> "core not dumped". >>> >>> This link provides hints on how to get a core dump: >>> >>> http://www.dovecot.org/bugreport.html >> >> Oh, and the error ^^ gives a good hint as well. > > Not understanding the message I assumed it was a just a statement and > not an instruction. > > OK, after a short delay while I rebuild with symbol tables, here is a > dbx trace (I don't have gdb built/installed): It is a SunOS system, so that is probably the reason why I cannot reproduce this bug here. If I remember correctly, the SunOS's printf doesn't like NULL as a %s parameter, so the following fix may help: http://hg.rename-it.nl/dovecot-2.2-pigeonhole/rev/6afd6d927f40 > Sorry but I've not had time to analyse it, a task for the morning. No problem. Regards, Stephan. From Kind at adm.uib.no Tue Oct 28 22:05:11 2014 From: Kind at adm.uib.no (Hans Morten Kind) Date: Tue, 28 Oct 2014 23:05:11 +0100 Subject: Pigeonhole 0.4.4 error with no sieve rules In-Reply-To: <544F8280.4090002@xdrv.co.uk> References: <544F8280.4090002@xdrv.co.uk> Message-ID: <20141028220511.GA5130@alf.uib.no> On Tue, Oct 28, 2014 at 11:48:16AM +0000, James wrote: > Syslog: > Oct 28 11:03:50 mailhost dovecot: [ID 583609 mail.crit] lmtp(18915): > Fatal: master: service(lmtp): child 18915 killed with signal 11 (core > not dumped - set service lmtp { drop_priv_before_exec=yes }) For Solaris, please look into 'man coreadm' If you would like to inspect your coredumps, you will have to to something like this. Ensure that you have some space for /var/core or whereever you would like to place them. mkdir /var/core chmod 700 /var/core coreadm -g /var/core/core.%f.%p coreadm -e process coreadm -e global hmk From pch at myzel.net Tue Oct 28 22:48:27 2014 From: pch at myzel.net (Peter Chiochetti) Date: Tue, 28 Oct 2014 23:48:27 +0100 Subject: basic configuratio error In-Reply-To: References: Message-ID: <54501D3B.8010008@myzel.net> Am 2014-10-28 um 21:05 schrieb soko.tica: > > After many hours I still fail to configure properly dovecot as the LDA with > opensmtpd, for system users only. > I don't want pop at all, jus lmtp and imap, but still haven't stripped it. > Here is the info, thanks in advance for your response: [?] > pipe() failed: Too many open files > failed: Too many open files > open(/var/dovecot/login-master-notifya57a2b8821460734) failed: Too > many open files > safe_mkstemp(/var/dovecot/login-master-notify) failed: Too many open > files > failed: Too many open files > failed: Too many open files > failed: Too many open files > pipe() failed: Too many open files > failed: Too many open files [?] This looks like you hit a system limit. I am left wondering why anything works at all on the system. Your best bet: install from the ports collection, try to run without any change in configuration. See if it works. Change a little, see if if it works. Rinse, repeat. -- peter From bind at enas.net Wed Oct 29 07:37:38 2014 From: bind at enas.net (Urban Loesch) Date: Wed, 29 Oct 2014 08:37:38 +0100 Subject: Panic: file istream-qp-decoder.c Message-ID: <54509942.9060505@enas.net> Hi, I'm running Dovecot EE Version with Debian Squeeze. Version info: ii dovecot-ee-core 1:2.2.13.31-1 secure mail server that supports mbox, maildir, dbox and mdbox mailboxes ii dovecot-ee-dbg 1:2.2.13.31-1 debug symbols for Dovecot ii dovecot-ee-imapd 1:2.2.13.31-1 secure IMAP server that supports mbox, maildir, dbox and mdbox mailboxes ii dovecot-ee-lmtpd 1:2.2.13.31-1 secure LMTP server for Dovecot ii dovecot-ee-managesieved 0.4.3-7 secure ManageSieve server for Dovecot ii dovecot-ee-mysql 1:2.2.13.31-1 MySQL support for Dovecot ii dovecot-ee-pop3d 1:2.2.13.31-1 secure POP3 server that supports mbox, maildir, dbox and mdbox mailboxes ii dovecot-ee-sieve 0.4.3-7 sieve filters support for Dovecot Yesterday I got the following errors in the error log: Oct 28 18:29:05 mailstore dovecot: imap(user at domain.com pid:37052 session:<0K7g+34GIwDD/vzI>): Panic: file istream-qp-decoder.c: line 102 (i_stream_qp_decoder_read): assertion failed: (ret < 0) Oct 28 18:29:05 mailstore dovecot: imap(user at domain.com pid:37052 session:<0K7g+34GIwDD/vzI>): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x6d75a) [0x7f9bcee0275a] -> /usr/lib/dovecot/libdovecot.so.0(+0x6d7d6) [0x7f9bcee027d6] -> /usr/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f9bcedba5bf] -> /usr/lib/dovecot/libdovecot.so.0(+0x5a86c) [0x7f9bcedef86c] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read+0x63) [0x7f9bcee0b533] -> /usr/lib/dovecot/libdovecot.so.0(+0x7bc5c) [0x7f9bcee10c5c] -> /usr/lib/dovecot/libdovecot.so.0(+0x7c0c8) [0x7f9bcee110c8] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read+0x63) [0x7f9bcee0b533] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read_data+0x52) [0x7f9bcee0b8a2] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xa44ea) [0x7f9bcf10c4ea] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mail_get_binary_stream+0x135) [0x7f9bcf10c9b5] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_get_binary_stream+0x61) [0x7f9bcf0e34f1] -> /usr/lib/dovecot/libdovecot-storage.so.0(imap_msgpart_open+0xb0) [0x7f9bcf142f20] -> dovecot/imap() [0x41ba26] -> dovecot/imap() [0x419b4a] -> dovecot/imap(imap_fetch_more+0x31) [0x419d81] -> dovecot/imap(cmd_fetch+0x49d) [0x40e88d] -> dovecot/imap(command_exec+0x3d) [0x41813d] -> dovecot/imap() [0x417230] -> dovecot/imap() [0x41731d] -> dovecot/imap(client_handle_input+0x11d) [0x41759d] -> dovecot/imap(client_input+0x6f) [0x41792f] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x4e) [0x7f9bcee12f1e] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xaf) [0x7f9bcee1409f] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x9) [0x7f9bcee12fa9] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f9bcee13038] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f9bcedbf3e3] -> dovecot/imap(main+0x2a7) [0x420e97] Oct 28 18:29:05 mailstore dovecot: imap(user at domain.com pid:37052 session:<0K7g+34GIwDD/vzI>): Fatal: master: service(imap): child 37052 killed with signal 6 (core dumps disabled) Oct 28 18:29:58 mailstore dovecot: imap(user at domain.com pid:38868 session:): Panic: file istream-qp-decoder.c: line 102 (i_stream_qp_decoder_read): assertion failed: (ret < 0) Oct 28 18:29:58 mailstore dovecot: imap(user at domain.com pid:38868 session:): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x6d75a) [0x7f8f7cb9275a] -> /usr/lib/dovecot/libdovecot.so.0(+0x6d7d6) [0x7f8f7cb927d6] -> /usr/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f8f7cb4a5bf] -> /usr/lib/dovecot/libdovecot.so.0(+0x5a86c) [0x7f8f7cb7f86c] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read+0x63) [0x7f8f7cb9b533] -> /usr/lib/dovecot/libdovecot.so.0(+0x7bc5c) [0x7f8f7cba0c5c] -> /usr/lib/dovecot/libdovecot.so.0(+0x7c0c8) [0x7f8f7cba10c8] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read+0x63) [0x7f8f7cb9b533] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read_data+0x52) [0x7f8f7cb9b8a2] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xa44ea) [0x7f8f7ce9c4ea] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mail_get_binary_stream+0x135) [0x7f8f7ce9c9b5] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_get_binary_stream+0x61) [0x7f8f7ce734f1] -> /usr/lib/dovecot/libdovecot-storage.so.0(imap_msgpart_open+0xb0) [0x7f8f7ced2f20] -> dovecot/imap() [0x41ba26] -> dovecot/imap() [0x419b4a] -> dovecot/imap(imap_fetch_more+0x31) [0x419d81] -> dovecot/imap(cmd_fetch+0x49d) [0x40e88d] -> dovecot/imap(command_exec+0x3d) [0x41813d] -> dovecot/imap() [0x417230] -> dovecot/imap() [0x41731d] -> dovecot/imap(client_handle_input+0x11d) [0x41759d] -> dovecot/imap(client_input+0x6f) [0x41792f] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x4e) [0x7f8f7cba2f1e] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xaf) [0x7f8f7cba409f] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x9) [0x7f8f7cba2fa9] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f8f7cba3038] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f8f7cb4f3e3] -> dovecot/imap(main+0x2a7) [0x420e97] Oct 28 18:29:58 mailstore dovecot: imap(user at domain.com pid:38868 session:): Fatal: master: service(imap): child 38868 killed with signal 6 (core dumps disabled) The user uses Horde Webmail 5.2 to access his mailbox and there are about 1300 active session running curently on that server. Many thanks Urban Loesch From robers at tutech.de Wed Oct 29 07:42:08 2014 From: robers at tutech.de (Thomas Robers) Date: Wed, 29 Oct 2014 08:42:08 +0100 Subject: Dovecot 2.2.14 and per user \Seen flags In-Reply-To: <474F29B6-4FB6-4025-B58A-C32BAF4D50E9@iki.fi> References: <544E5512.9010505@tutech.de> <474F29B6-4FB6-4025-B58A-C32BAF4D50E9@iki.fi> Message-ID: <54509A50.7010304@tutech.de> Am 28.10.2014 um 01:06 schrieb Timo Sirainen: > On 27 Oct 2014, at 07:22, Thomas Robers wrote: > >> Hello, >> >> I have a Dovecot Installation Version 2.2.14 on CentOS 6.5 with shared folder. >> UserA shares his INBOX to user UserB. I activated "per user \Seen flags" with >> >> location = maildir:%%h/Maildir:INDEX=%h/shared/%%u:CONTROL=%h/shared/%%u:INDEXPVT=%h/shared > > location = maildir:%%h/Maildir:INDEXPVT=%h/shared/%%u > Hello Timo, thank you! Now it works as expected. I could not find any information about it in the wiki (only about public folder). Thanks again! Thomas From lista at xdrv.co.uk Wed Oct 29 11:07:50 2014 From: lista at xdrv.co.uk (James) Date: Wed, 29 Oct 2014 11:07:50 +0000 Subject: Pigeonhole 0.4.4 error with no sieve rules In-Reply-To: <54500D0B.3040101@rename-it.nl> References: <544F8280.4090002@xdrv.co.uk> <544F9AA0.4060800@rename-it.nl> <544FA10A.9000106@rename-it.nl> <544FA1EF.7080100@xdrv.co.uk> <544FA565.4090500@rename-it.nl> <544FA5D8.1000307@rename-it.nl> <544FF32A.9000401@xdrv.co.uk> <54500D0B.3040101@rename-it.nl> Message-ID: <5450CA86.9040803@xdrv.co.uk> On 28/10/2014 21:39, Stephan Bosch wrote: > If I remember correctly, the SunOS's printf > doesn't like NULL as a %s parameter, That is so. > so the following fix may help: > > http://hg.rename-it.nl/dovecot-2.2-pigeonhole/rev/6afd6d927f40 It does. Many thanks for looking at this and creating a solution. James. From pch at myzel.net Wed Oct 29 12:28:26 2014 From: pch at myzel.net (Peter Chiochetti) Date: Wed, 29 Oct 2014 13:28:26 +0100 Subject: Sieve plus addressed mail filtering Message-ID: <5450DD6A.9080005@myzel.net> Today I learned, that to filter incoming plus addressed mail (user+tag@?) I had to deviate from the documentation. There it reads: if envelope :detail "to" "spam"{ fileinto "Spam"; } Instead I had to write: if address :is :detail "To" "tag"{ fileinto "Tagged"; } Dovecot version is 2.2.13-1+bigmichi1~precise+1 -- peter From skdovecot at smail.inf.fh-brs.de Wed Oct 29 12:40:37 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Wed, 29 Oct 2014 13:40:37 +0100 (CET) Subject: Sieve plus addressed mail filtering In-Reply-To: <5450DD6A.9080005@myzel.net> References: <5450DD6A.9080005@myzel.net> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Wed, 29 Oct 2014, Peter Chiochetti wrote: > Today I learned, that to filter incoming plus addressed mail (user+tag@?) I > had to deviate from the documentation. There it reads: > > if envelope :detail "to" "spam"{ ^^ does this quote miss ":is"? > fileinto "Spam"; > } > > Instead I had to write: > > if address :is :detail "To" "tag"{ > fileinto "Tagged"; > } it depends on your way, how to deliver message from MTA to Dovecot, if the envelope information is available at all. How do you do it? - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBVFDgRXz1H7kL/d9rAQIzqggAmZmlsHkG0eY5n60cOBzzIDYM+t0L3d0H esHdP/yHI9uv07R9OPbn696uYXeKe0e0qLfTZtBm4a5GKAXaWbGcpFr8rBaYLbwm jKENlevb5MPO6AkNiETYDmpcZGeMRvhtU63jc9UVeFpRZkCg777Fc6mXWUJw0JOa S8vvM9CJZOfrInYFmvOjiB5RD/Dd6xk5m1JYy/EePAHRE8bt6tfhu12uyEyyX5Gw opJ2y602VTZemyNtRoxDH7hDIULs+5io4pItJWM3Y4TkCyYEQzUARo5bSdCYEHog rKJ7s0/F+WCKfm1aFsUnX60c/3aVDD4QfakbPDV8zPIwT6K8IPb+DQ== =Msv5 -----END PGP SIGNATURE----- From pch at myzel.net Wed Oct 29 12:53:47 2014 From: pch at myzel.net (Peter Chiochetti) Date: Wed, 29 Oct 2014 13:53:47 +0100 Subject: Sieve plus addressed mail filtering In-Reply-To: References: <5450DD6A.9080005@myzel.net> Message-ID: <5450E35B.1060202@myzel.net> Am 2014-10-29 um 13:40 schrieb Steffen Kaiser: > On Wed, 29 Oct 2014, Peter Chiochetti wrote: > >> Today I learned, that to filter incoming plus addressed mail >> (user+tag@?) I had to deviate from the documentation. There it reads: >> >> if envelope :detail "to" "spam"{ > > ^^ does this quote miss ":is"? > >> fileinto "Spam"; >> } This is literally taken from http://wiki2.dovecot.org/Pigeonhole/Sieve/Examples#Plus_Addressed_mail_filtering - adding the :is did not help, IIRC. >> Instead I had to write: >> >> if address :is :detail "To" "tag"{ >> fileinto "Tagged"; >> } > > it depends on your way, how to deliver message from MTA to Dovecot, if > the envelope information is available at all. How do you do it? Mail is pushed to dovecot /deliver/ LDA from /fetchmail/ from a remote proxied dovecot IMAP. -- peter From Kind at adm.uib.no Wed Oct 29 13:03:48 2014 From: Kind at adm.uib.no (Hans Morten Kind) Date: Wed, 29 Oct 2014 14:03:48 +0100 Subject: 2.2.15 Panic in mbox_sync_read_next_mail() Message-ID: <20141029130348.GA1682@alf.uib.no> It might not be a fault in dovecot, as the user is accessing the folder locally with alpine while also running imap-sessions. However it would have been nice with a more graceful action than panic? The panic is preceeded by Error: Next message unexpectedly corrupted in mbox file PATH Panic: file mbox-sync.c: line 152 (mbox_sync_read_next_mail): assertion failed: (sync_ctx->input->v_offset != mail_ctx->mail.from_offset || sync_ctx->input->eof) At #7 in the enclosed backtrace the actual values are sync_ctx->input->v_offset = 564 mail_ctx->mail.from_offset = 564 sync_ctx->input->eof = 0 Some will recommend convertion to maildir, but with 25 years history, thousands of active users and dozens terrabytes of mboxes, we are not even considering it. hmk GNU gdb 6.8 Copyright (C) 2008 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "i386-pc-solaris2.10"... Reading symbols from /datapool/local/dovecot-2.2.15/lib/dovecot/libdovecot-storage.so.0...done. Loaded symbols for /local/dovecot-2.2.15/lib/dovecot/libdovecot-storage.so.0 Reading symbols from /datapool/local/dovecot-2.2.15/lib/dovecot/libdovecot.so.0...done. Loaded symbols for /local/dovecot-2.2.15/lib/dovecot/libdovecot.so.0 Reading symbols from /datapool/local/program/lib/libssl.so.1.0.0...done. Loaded symbols for /local/program/lib/libssl.so.1.0.0 Reading symbols from /datapool/local/program/lib/libcrypto.so.1.0.0...done. Loaded symbols for /local/program/lib/libcrypto.so.1.0.0 Reading symbols from /datapool/local/program/lib/libz.so...done. Loaded symbols for /local/program/lib/libz.so Reading symbols from /lib/libm.so.2...done. Loaded symbols for /lib/libm.so.2 Reading symbols from /datapool/local/program/lib/libiconv.so.2...done. Loaded symbols for /local/program/lib/libiconv.so.2 Reading symbols from /lib/librt.so.1...done. Loaded symbols for /lib/librt.so.1 Reading symbols from /lib/libnsl.so.1...done. Loaded symbols for /lib/libnsl.so.1 Reading symbols from /lib/libsocket.so.1...done. Loaded symbols for /lib/libsocket.so.1 Reading symbols from /lib/libsendfile.so.1...done. Loaded symbols for /lib/libsendfile.so.1 Reading symbols from /lib/libc.so.1...done. Loaded symbols for /lib/libc.so.1 Reading symbols from /lib/libdl.so.1...done. Loaded symbols for /lib/libdl.so.1 Reading symbols from /usr/lib/libz.so...done. Loaded symbols for /usr/lib/libz.so Reading symbols from /lib/libaio.so.1...done. Loaded symbols for /lib/libaio.so.1 Reading symbols from /lib/libmd.so.1...done. Loaded symbols for /lib/libmd.so.1 Reading symbols from /lib/ld.so.1...done. Loaded symbols for /lib/ld.so.1 Core was generated by `dovecot/imap imap-postlogin'. Program terminated with signal 6, Aborted. [New process 86892 ] #0 0xfe80c8e5 in _lwp_kill () from /lib/libc.so.1 (gdb) #0 0xfe80c8e5 in _lwp_kill () from /lib/libc.so.1 No symbol table info available. #1 0xfe807765 in thr_kill () from /lib/libc.so.1 No symbol table info available. #2 0xfe7b376f in raise () from /lib/libc.so.1 No symbol table info available. #3 0xfe7929e1 in abort () from /lib/libc.so.1 No symbol table info available. #4 0xfeda1c82 in default_fatal_finish (type=LOG_TYPE_PANIC, status=0) at failures.c:152 backtrace = 0x8093260 "0xfeda2b9f -> 0xfeda1e9b -> 0xfee9f57a -> 0xfeea207c -> 0xfeea37e9 -> 0xfeea4363 -> 0xfeea45cd -> 0xfeea477d -> 0xfeecb356 -> 0x8074b45 -> 0x805eeda -> 0x805f463 -> 0x806aad1 -> 0x8069a41 -> 0x8069d26"... #5 0xfeda2b9f in i_internal_fatal_handler (ctx=0x80474e0, format=0xfef4c588 "file %s: line %d (%s): assertion failed: (%s)", args=0x8047504 "????\230") at failures.c:152 status = 0 #6 0xfeda1e9b in i_panic (format=0xfef4c588 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:152 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0, timestamp_usecs = 0} args = 0x8047504 "????\230" #7 0xfee9f57a in mbox_sync_read_next_mail (sync_ctx=0x8047794, mail_ctx=0x804760c) at ../../../../src/lib/array.h:158 __FUNCTION__ = "mbox_sync_read_next_mail" #8 0xfeea207c in mbox_sync_loop (sync_ctx=0x8047794, mail_ctx=0x804760c, partial=false) at ../../../../src/lib/array.h:158 rec = (const struct mail_index_record *) 0x0 uid = 0 messages_count = 66 offset = 564 ret = 1 expunged = false skipped_mails = true uids_broken = false #9 0xfeea37e9 in mbox_sync_do (sync_ctx=0x8047794, flags=0) at ../../../../src/lib/array.h:158 mbox_hdr = (struct mbox_index_header *) 0x80b4a20 mail_ctx = {sync_ctx = 0x8047794, mail = {uid = 0, idx_seq = 0, keywords = {arr = { buffer = 0x0, element_size = 0}, v = 0x0, v_modifiable = 0x0}, flags = 32 ' ', uid_broken = 0, expunged = 0, pseudo = 0, status_broken = 0, xstatus_broken = 0, from_offset = 564, body_size = 0, offset = 564, space = 0}, seq = 2, hdr_offset = 564, body_offset = 564, header_first_change = 4294967295, header_last_change = 0, header = 0x809c758, hdr_md5_sum = "?\035\214?\217\000?\004?\200\t\230??B~", content_length = 18446744073709551615, hdr_pos = {4294967295, 4294967295, 4294967295, 4294967295, 4294967295}, parsed_uid = 0, last_uid_updated_value = 0, last_uid_value_start_pos = 0, have_eoh = 0, need_rewrite = 0, seen_imapbase = 0, updated = 0, recent = 0, dirty = 0, imapbase_rewrite = 0, imapbase_updated = 0} st = (const struct stat *) 0x80c0060 i = 0 ret = 52 partial = 1 #10 0xfeea4363 in mbox_sync_int (mbox=0x80b4868, flags=0, lock_id=0x8047988) at ../../../../src/lib/array.h:158 index_sync_ctx = (struct mail_index_sync_ctx *) 0x80b62e0 sync_view = (struct mail_index_view *) 0x80b6320 trans = (struct mail_index_transaction *) 0x80c5890 sync_ctx = {mbox = 0x80b4868, flags = 0, input = 0x80c0180, file_input = 0x80c0040, write_fd = 12, orig_mtime = 1414582020, orig_atime = 1414582021, orig_size = 3843471, last_stat = { st_dev = 47513605, st_pad1 = {0, 0, 0}, st_ino = 17869, st_mode = 33152, st_nlink = 1, st_uid = 22671, st_gid = 4601, st_rdev = 4294967295, st_pad2 = {0, 0}, st_size = 3843471, st_atim = {tv_sec = 1414582021, tv_nsec = 353242309}, st_mtim = {tv_sec = 1414582020, tv_nsec = 0}, st_ctim = {tv_sec = 1414582021, tv_nsec = 352990278}, st_blksize = 131072, st_blocks = 7693, st_fstype = "zfs", '\0' , st_pad4 = {0, 0, 0, 0, 0, 0, 0, 0}}, index_sync_ctx = 0x80b62e0, sync_view = 0x80b6320, t = 0x80c5890, reset_hdr = { major_version = 0 '\0', minor_version = 0 '\0', base_header_size = 0, header_size = 0, record_size = 0, compat_flags = 0 '\0', unused = "\000\000", indexid = 0, flags = 0, uid_validity = 0, next_uid = 0, messages_count = 0, unused_old_recent_messages_count = 0, seen_messages_count = 0, deleted_messages_count = 0, first_recent_uid = 0, first_unseen_uid_lowwater = 0, first_deleted_uid_lowwater = 0, log_file_seq = 0, log_file_tail_offset = 0, log_file_head_offset = 0, unused_old_sync_size = 0, unused_old_sync_stamp = 0, day_stamp = 0, day_first_uid = {0, 0, 0, 0, 0, 0, 0, 0}}, hdr = 0x80c5b68, header = 0x809c758, from_line = 0x809c6b8, base_uid_validity = 1353318516, base_uid_last = 144140, base_uid_last_offset = 250, mails = {arr = {buffer = 0x809c640, element_size = 52}, v = 0x809c640, v_modifiable = 0x809c640}, sync_changes = 0x80ab998, mail_keyword_pool = 0x80bf220, saved_keywords_pool = 0x80bcbe0, prev_msg_uid = 0, next_uid = 144141, idx_next_uid = 144141, seq = 2, idx_seq = 1, need_space_seq = 0, last_nonrecent_uid = 0, expunged_space = 0, space_diff = 0, dest_first_mail = 0, first_mail_crlf_expunged = 0, keep_recent = 0, readonly = 0, delay_writes = 1, renumber_uids = 0, moved_offsets = 0, ext_modified = 0, index_reset = 0, errors = 0} sync_flags = MAIL_INDEX_SYNC_FLAG_DROP_RECENT ret = 1 changed = 1 delay_writes = true readonly = false __FUNCTION__ = "mbox_sync_int" #11 0xfeea45cd in mbox_sync (mbox=0x80b4868, flags=0) at ../../../../src/lib/array.h:158 lock_id = 47 ret = 134957840 __FUNCTION__ = "mbox_sync" #12 0xfeea477d in mbox_storage_sync_init (box=0x80b4868, flags=0) at ../../../../src/lib/array.h:158 mbox = (struct mbox_mailbox *) 0x80b4868 mbox_sync_flags = 0 ret = 0 #13 0xfeecb356 in mailbox_sync_init (box=0x80b4868, flags=0) at ../../src/lib/array.h:197 _data_stack_cur_id = 4 ctx = (struct mailbox_sync_context *) 0x0 #14 0x08074b45 in imap_sync_init (client=0x80b1850, box=0x80b4868, imap_flags=0, flags=0) at ../../src/lib/array.h:158 ctx = (struct imap_sync_context *) 0x80b61b0 __FUNCTION__ = "imap_sync_init" #15 0x0805eeda in idle_sync_now (box=0x80b4868, ctx=0x80b20e0) at cmd-idle.c:74 __FUNCTION__ = "idle_sync_now" #16 0x0805f463 in cmd_idle (cmd=0x80b2058) at cmd-idle.c:74 client = (struct client *) 0x80b1850 ctx = (struct cmd_idle_context *) 0x80b20e0 #17 0x0806aad1 in command_exec (cmd=0x80b2058) at imap-commands.c:101 hook = (const struct command_hook *) 0x809c078 ret = 8 #18 0x08069a41 in client_command_input (cmd=0x80b2058) at imap-client.c:130 client = (struct client *) 0x80b1850 command = (struct command *) 0x3 __FUNCTION__ = "client_command_input" #19 0x08069d26 in client_command_input (cmd=0x80b2058) at imap-client.c:130 client = (struct client *) 0x80b1850 command = (struct command *) 0x809d3cc __FUNCTION__ = "client_command_input" #20 0x08069e29 in client_handle_next_command (client=0x80b1850, remove_io_r=0x8047b9d) at imap-client.c:130 No locals. #21 0x08069ec6 in client_handle_input (client=0x80b1850) at imap-client.c:130 _data_stack_cur_id = 3 ret = 10 remove_io = false handled_commands = false __FUNCTION__ = "client_handle_input" #22 0x0806a04f in client_input (client=0x80b1850) at imap-client.c:130 cmd = (struct client_command_context *) 0x80aaa44 output = (struct ostream *) 0x80abea8 bytes = 10 __FUNCTION__ = "client_input" #23 0xfedbb235 in io_loop_call_io (io=0x80abf10) at ioloop.c:28 ioloop = (struct ioloop *) 0x809bfc0 t_id = 2 __FUNCTION__ = "io_loop_call_io" #24 0xfedbc994 in io_loop_handler_run_internal (ioloop=0x809bfc0) at ioloop-poll.c:96 ctx = (struct ioloop_handler_context *) 0x809cab0 pollfd = (struct pollfd *) 0x809e148 tv = {tv_sec = 1799, tv_usec = 999001} io = (struct io_file *) 0x80abf10 msecs = 1800000 ret = 0 call = true #25 0xfedbb3ce in io_loop_handler_run (ioloop=0x809bfc0) at ioloop.c:28 No locals. #26 0xfedbb325 in io_loop_run (ioloop=0x809bfc0) at ioloop.c:28 __FUNCTION__ = "io_loop_run" #27 0xfed41dc1 in master_service_run (service=0x809bf08, callback=0x807724a ) at master-service.c:75 No locals. #28 0x080775e7 in main (argc=2, argv=0x809bd18) at main.c:72 set_roots = {0x8093080, 0x0} login_set = {auth_socket_path = 0x8093188 "?1\t\b", postlogin_socket_path = 0x80931c0 "", postlogin_timeout_secs = 60, callback = 0x8076fbe , failure_callback = 0x80771cd , request_auth_token = 1} service_flags = MASTER_SERVICE_FLAG_KEEP_CONFIG_OPEN storage_service_flags = MAIL_STORAGE_SERVICE_FLAG_DISALLOW_ROOT username = 0x0 c = -1 From phil at dovecot.fi Wed Oct 29 13:07:54 2014 From: phil at dovecot.fi (Phil Carmody) Date: Wed, 29 Oct 2014 15:07:54 +0200 Subject: v2.2.15 released In-Reply-To: <544C0A81.6050507@gedalya.net> References: <96FB5E7D-DFC2-410E-8827-78961029EB72@iki.fi> <5BB39377-634E-48DC-965F-11DAD33D45AA@iki.fi> <544B90A2.80006@gedalya.net> <544C0A81.6050507@gedalya.net> Message-ID: <20141029130754.GA2526@phil.dovecot.net> On Sat, Oct 25, 2014 at 04:39:29PM -0400, Gedalya wrote: > On 10/25/2014 11:43 AM, Timo Sirainen wrote: > >On 25 Oct 2014, at 04:59, Gedalya wrote: > > > >>>>Also I have one minor issue to report. dovecot broke API from 2.2.13 to 2.2.14 but it only provides version macros for the first two components of the version number. This has caused a small upgrade problem for the antispam plugin which is in a separate package (dovecot-antispam.) Was that addressed in 2.2.15? > >>>I only remember an ABI problem with antispam. Recompiling fixed that AFAIK. (And no Dovecot version guarantees ABI compatibility.) Is there some API problem also? > >>https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=765943 > >Oh, it uses the really old way to do things. In v1.1+ T_BEGIN { .. } T_END should have been used instead. Patch attached. The header file could admittedly have been a little more persuasive in weaning people off the old interface. However, it was my bad that I didn't consider the old interface may still be in use. Apologies. > OK, it's not working as it is. > > This little bit seems like a typo: > - t_pop(); > + } T_POP; > > Gives me: > > pipe.c:315:4: error: ?T_POP? undeclared (first use in this function) > } T_POP; > > I tried T_END and I still get: > > pipe.c: In function ?backend_handle_mail?: > pipe.c:314:2: error: label at end of compound statement > out: > ^ > > I got it to compile, see the attached. I don't really know C ... > out: > - t_pop(); > + ; > + } T_END; That is the correct fix. C is quirky about labels, you can only label statements, nothing else. As Timo mentioned, the t_push()/t_pop() interface hasn't been the recommended interface since about 2008, so this definitely is the correct way to go. If upstream is out there somewhere, for your patch: Acked-by: Phil Carmody Phil From maegger at ee.ethz.ch Wed Oct 29 13:50:47 2014 From: maegger at ee.ethz.ch (Matthias Egger) Date: Wed, 29 Oct 2014 14:50:47 +0100 Subject: 2.2.15 Panic in mbox_sync_read_next_mail() In-Reply-To: <20141029130348.GA1682@alf.uib.no> References: <20141029130348.GA1682@alf.uib.no> Message-ID: <5450F0B7.2050602@ee.ethz.ch> Interesting. We are expiring the same problem here. But our user is currently traveling in the world and uses our roundcube to access its emails: > The panic is preceeded by > Error: Next message unexpectedly corrupted in mbox file PATH > > Panic: file mbox-sync.c: line 152 (mbox_sync_read_next_mail): assertion failed: > (sync_ctx->input->v_offset != mail_ctx->mail.from_offset || sync_ctx->input->eof) > > At #7 in the enclosed backtrace the actual values are > sync_ctx->input->v_offset = 564 > mail_ctx->mail.from_offset = 564 > sync_ctx->input->eof = 0 I can not attach a gdb output because until yet i could not catch a core dump. Here the last lines from the logfile: Oct 29 07:46:34 SERVER dovecot: [ID 583609 mail.debug] imap(USERNAME): Debug: Namespace : type=private, prefix=Mail/, sep=/, inbox=no, hidden=yes, list=no, subscriptions=yes location=mbox:~/Mail/:INBOX=/var/mail/USERNAME:INDEX=/usr/SERVER/vault2/dovecot/indexes/USERNAME Oct 29 07:46:34 SERVER dovecot: [ID 583609 mail.debug] imap(USERNAME): Debug: fs: root=/home/USERNAME/Mail, index=/usr/SERVER/vault2/dovecot/indexes/USERNAME, indexpvt=, control=, inbox=/var/mail/USERNAME, alt= Oct 29 07:46:34 SERVER dovecot: [ID 583609 mail.info] imap(USERNAME): Disconnected: Logged out in=374 out=60850 Oct 29 07:46:35 SERVER dovecot: [ID 583609 mail.error] imap(USERNAME): Error: Next message unexpectedly corrupted in mbox file /home/USERNAME/Mail/MBOXFILE at 38055772 Oct 29 07:46:35 SERVER dovecot: [ID 583609 mail.crit] imap(USERNAME): Panic: file mbox-sync.c: line 152 (mbox_sync_read_next_mail): assertion failed: (sync_ctx->input->v_offset != mail_ctx->mail.from_offset || sync_ctx->input->eof) Oct 29 07:46:35 SERVER dovecot: [ID 583609 mail.error] imap(USERNAME): Error: Raw backtrace: 0xffffffff7ed89f64 -> 0xffffffff7ed88f10 -> 0xffffffff7ef77a14 -> 0xffffffff7ef78a1c -> 0xffffffff7ef78e98 -> 0xffffffff7ef962d0 -> 0xffffffff7ef96418 -> 0xffffffff7efc2380 -> 0xffffffff7ef9777c -> 0x100021554 -> 0x100013e8c -> 0x100019044 -> 0x100017b18 -> 0x100017ad8 -> 0x100017f3c -> 0x100018188 -> 0xffffffff7ed9c8a4 -> 0xffffffff7ed9d5a0 -> 0xffffffff7ed9c93c -> 0xffffffff7ed9ca0c -> 0xffffffff7ed3c314 -> 0x100024908 -> 0x10000a74c Oct 29 07:46:35 SERVER dovecot: [ID 583609 mail.crit] imap(USERNAME): Fatal: master: service(imap): child 19457 killed with signal 6 (core not dumped - set service imap { drop_priv_before_exec=yes }) I have set the drop_priv_before_exec to yes, i'm just waiting for the user to connect again ;-) Our System is a Solaris 10 and we are also using mbox for more or less the same reason as hmk. As soon as i can catch a coredump i will send a gdb output. Since all other users do not have such a problem i'm wondering what the reason for this could be? corrupt mbox file? Best Regards Matthias -- Matthias Egger ETH Zurich Department of Information Technology maegger at ee.ethz.ch and Electrical Engineering IT Support Group (ISG.EE), ETL/F/24.1 Phone +41 (0)44 632 03 90 Physikstrasse 3, CH-8092 Zurich Fax +41 (0)44 632 11 95 -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4099 bytes Desc: S/MIME Cryptographic Signature URL: From hmoreno at gmv.com Wed Oct 29 15:43:36 2014 From: hmoreno at gmv.com (=?iso-8859-1?Q?H=E9ctor_Moreno_Blanco?=) Date: Wed, 29 Oct 2014 15:43:36 +0000 Subject: different mail location in different namespace Message-ID: Hello everyone, We have Dovecot 2.1.6. With different Namespaces: ... mail_location = maildir:%h/Maildir ... namespace { separator = . prefix = inbox = yes type = private } namespace { inbox = no location = prefix = INBOX. separator = . hidden = yes type = private list = no } namespace { location = maildir:/buzon/archivo/%u/_ARCHIVO prefix = _ARCHIVO. hidden = yes separator = . type = private } We take the attribute "home directory" from the LDAP in the userdb attributes. We would like to modify this attribute for the Namespace ARCHIVO. For example, if a home directory is /buzon/buzon1/11111111, the mail location for ARCHIVO would be /buzon/archivo1/11111111. Is this modification possible without adding another attribute at the LDAP (just editing the attribute)? Thank you very much in advanced. Kind regards. H?ctor Moreno. P Please consider the environment before printing this e-mail. ______________________ This message including any attachments may contain confidential information, according to our Information Security Management System, and intended solely for a specific individual to whom they are addressed. Any unauthorised copy, disclosure or distribution of this message is strictly forbidden. If you have received this transmission in error, please notify the sender immediately and delete it. ______________________ Este mensaje, y en su caso, cualquier fichero anexo al mismo, puede contener informacion clasificada por su emisor como confidencial en el marco de su Sistema de Gestion de Seguridad de la Informacion siendo para uso exclusivo del destinatario, quedando prohibida su divulgacion copia o distribucion a terceros sin la autorizacion expresa del remitente. Si Vd. ha recibido este mensaje erroneamente, se ruega lo notifique al remitente y proceda a su borrado. Gracias por su colaboracion. ______________________ From hanns at hannsmattes.de Wed Oct 29 17:41:16 2014 From: hanns at hannsmattes.de (Hanns Mattes) Date: Wed, 29 Oct 2014 18:41:16 +0100 Subject: Quota reporting Message-ID: <545126BC.4090105@hannsmattes.de> Hi, my main server will be upgraded from Dovecot 1.2something to 2.2. For testing I've installed a setup with postfix, handing malis as a relay via lmtp. So far it's up and running - really nice. AFAICS there's one issue left: Thunderbird and Kmail don't show the quota status. Using doveadm quota the information is shown correctly, even the user-specific values (coming from openldap) are set correctly. I think, I miss something obvious ... (and besides quota - any configuration hint is very welcome) linux:/etc/dovecot # doveconf -n # 2.2.15: /etc/dovecot/dovecot.conf # OS: Linux 3.7.10-1.40-desktop x86_64 openSUSE 12.3 (x86_64) auth_master_user_separator = * auth_mechanisms = plain login digest-md5 cram-md5 apop auth_verbose = yes mail_debug = yes mail_location = maildir:~/Maildir mail_plugins = " quota zlib fts fts_lucene trash" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave duplicate namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = } passdb { args = /etc/dovecot/master-users driver = passwd-file master = yes pass = yes } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { fts_autoindex = yes fts_lucene = whitespace_chars=@. quota = maildir:User quota quota_exceeded_message = Storage quota for this account has been exceeded, please try again later. quota_grace = 100M quota_rule = *:storage=1000M quota_rule2 = Trash:storage=+10%% quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u quota_warning3 = storage=75%% quota-warning 75 %u sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_max_redirects = 32 trash = /etc/dovecot/dovecot-trash.conf.ext zlib_save = gz zlib_save_level = 6 } postmaster_address = admin at 93er.net protocols = imap pop3 lmtp sieve service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service lmtp { inet_listener lmtp { address = 127.0.0.1 port = 24 } user = vmail } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh user = vmail } ssl_cert = Hey guys! I've been googling without success. Do anyone know if there is a way to track last login of a smtp authentication? I've tried without success using: service auth { executable = auth lastlogin unix_listener auth-userdb { } unix_listener /var/spool/postfix/private/auth { mode = 0660 group = postfix } } service lastlogin { executable = script-login -d /usr/local/bin/lastlogin.sh unix_listener lastlogin { user = $default_internal_user mode = 0666 } } From bernd.kuhls at t-online.de Wed Oct 29 20:00:48 2014 From: bernd.kuhls at t-online.de (Bernd Kuhls) Date: Wed, 29 Oct 2014 21:00:48 +0100 Subject: [Pigeonhole] Problem compiling latest snapshot Message-ID: Hi, http://hg.rename-it.nl/dovecot-2.2-pigeonhole/rev/a1e57385b267 added the use of update-version.sh, but this file and is-tagged.py are not included in Pigeonhole, only in Dovecot sourcecode. Therefore pigeonhole- version.h is not generated during compilation leading to a compile error: ../../../../src/lib-sieve/sieve-config.h:8:32: fatal error: pigeonhole- version.h: No such file or directory #include "pigeonhole-version.h" Regards, Bernd From soko.tica at gmail.com Wed Oct 29 20:30:19 2014 From: soko.tica at gmail.com (soko.tica) Date: Wed, 29 Oct 2014 21:30:19 +0100 Subject: basic configuratio error In-Reply-To: <54501D3B.8010008@myzel.net> References: <54501D3B.8010008@myzel.net> Message-ID: There is no point in installing from ports, its' a fresh openbsd -current install and dovecot from the packages. The error was because I was starting dovecot from the command line (with -F argument), while it started without problems once I tried as a boot service. On Tue, Oct 28, 2014 at 11:48 PM, Peter Chiochetti wrote: > Am 2014-10-28 um 21:05 schrieb soko.tica: > >> >> After many hours I still fail to configure properly dovecot as the LDA >> with >> opensmtpd, for system users only. >> I don't want pop at all, jus lmtp and imap, but still haven't stripped it. >> Here is the info, thanks in advance for your response: >> > > [?] > > pipe() failed: Too many open files >> failed: Too many open files >> open(/var/dovecot/login-master-notifya57a2b8821460734) failed: Too >> many open files >> safe_mkstemp(/var/dovecot/login-master-notify) failed: Too many open >> files >> failed: Too many open files >> failed: Too many open files >> failed: Too many open files >> pipe() failed: Too many open files >> failed: Too many open files >> > > [?] > > This looks like you hit a system limit. I am left wondering why anything > works at all on the system. > > Your best bet: install from the ports collection, try to run without any > change in configuration. See if it works. Change a little, see if if it > works. Rinse, repeat. > > -- > peter > From stephan at rename-it.nl Wed Oct 29 20:40:01 2014 From: stephan at rename-it.nl (Stephan Bosch) Date: Wed, 29 Oct 2014 21:40:01 +0100 Subject: [Pigeonhole] Problem compiling latest snapshot In-Reply-To: References: Message-ID: <545150A1.8040002@rename-it.nl> On 10/29/2014 9:00 PM, Bernd Kuhls wrote: > Hi, > > http://hg.rename-it.nl/dovecot-2.2-pigeonhole/rev/a1e57385b267 > > added the use of update-version.sh, but this file and is-tagged.py are not > included in Pigeonhole, only in Dovecot sourcecode. Therefore pigeonhole- > version.h is not generated during compilation leading to a compile error: > > ../../../../src/lib-sieve/sieve-config.h:8:32: fatal error: pigeonhole- > version.h: No such file or directory > #include "pigeonhole-version.h" It was a bit late yesterday... Fixed now. Regards, Stephan. From user+dovecot at localhost.localdomain.org Wed Oct 29 22:16:15 2014 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Wed, 29 Oct 2014 22:16:15 +0000 Subject: smtp lastlogin In-Reply-To: <545129C2.3060102@freedominterface.org> References: <545129C2.3060102@freedominterface.org> Message-ID: <5451672F.9090802@localhost.localdomain.org> On 10/29/2014 05:54 PM, Eduardo Ramos wrote: > Hey guys! > > I've been googling without success. Do anyone know if there is a way to > track last login of a smtp authentication? > > I've tried without success using: > > service auth { > executable = auth lastlogin > unix_listener auth-userdb { > } > > unix_listener /var/spool/postfix/private/auth { > mode = 0660 > group = postfix > } > } > > service lastlogin { > executable = script-login -d /usr/local/bin/lastlogin.sh > unix_listener lastlogin { > user = $default_internal_user > mode = 0666 > } > } > A few months ago I asked Timo via IRC #doveot. His answer was: "no, it is done as mail plugin. smtp would require auth plugin." Regards, Pascal -- The trapper recommends today: c01dcofe.1430223 at localdomain.org From gedalya at gedalya.net Wed Oct 29 22:52:58 2014 From: gedalya at gedalya.net (Gedalya) Date: Wed, 29 Oct 2014 18:52:58 -0400 Subject: smtp lastlogin In-Reply-To: <545129C2.3060102@freedominterface.org> References: <545129C2.3060102@freedominterface.org> Message-ID: <54516FCA.9070100@gedalya.net> I normally do this out of the MTA. In case of postfix I have a policy daemon which I use for customized rate limiting, so I throw in the last login timestamp as well. With exim it would be very easy to do it out of the ACLs. On 10/29/2014 01:54 PM, Eduardo Ramos wrote: > Hey guys! > > I've been googling without success. Do anyone know if there is a way > to track last login of a smtp authentication? > > I've tried without success using: > > service auth { > executable = auth lastlogin > unix_listener auth-userdb { > } > > unix_listener /var/spool/postfix/private/auth { > mode = 0660 > group = postfix > } > } > > service lastlogin { > executable = script-login -d /usr/local/bin/lastlogin.sh > unix_listener lastlogin { > user = $default_internal_user > mode = 0666 > } > } From rs at sys4.de Wed Oct 29 23:31:06 2014 From: rs at sys4.de (Robert Schetterer) Date: Thu, 30 Oct 2014 00:31:06 +0100 Subject: Released Pigeonhole v0.4.4 for Dovecot v2.2.15. / editheader In-Reply-To: <544EEE0D.7010507@rename-it.nl> References: <544EEE0D.7010507@rename-it.nl> Message-ID: <545178BA.1070303@sys4.de> Am 28.10.2014 um 02:14 schrieb Stephan Bosch: > Hello Dovecot users, > > It's been about 5 months since the last Pigeonhole release, so it is > high time for a new one. However, the main reason to make a release now > is the fact that Dovecot v2.2.15 has one change that causes problems > with the previous release of Pigeonhole. > > Unlike recent earlier releases, this release has a few big new features. > Most notably, I implemented a generic Sieve script storage framework. > This means that it is now relatively easy to implement a storage driver > to retrieve Sieve scripts from a location other than the file system. An > important effect of this new implementation is that these alternative > storage locations can also be used with sieve_before/sieve_after. Also, > storing Sieve scripts there using ManageSieve is also possible, provided > that the driver provides an implementation. I used the new framework to > implement an LDAP storage driver. However, it is read-only, which means > that it doesn't currently provide ManageSieve support. > > Several bugs were fixed. The most nasty ones were related to the > doveadm-sieve plugin (which is one of the reasons why this release took > so long). The new script storage driver framework entailed large changes > in this plugin, so many of these problems were addressed implicitly. > Hopefully, all problems are solved now. > > Changelog v0.4.4: > > * Added support for Japanese mail addresses with dots at non-standard > places in localpart. > * Changed handling of ENOSPACE into a normal temporary failure and added > handling of ENOQUOTA as a user error. > * Restructured result execution, so that all actions which involve mail > storage are always committed before all others. > + Implemented support for generic Sieve storages. Using alternative > storages now also possible for sieve_before/sieve_after. > + Implemented storage driver for retrieving Sieve scripts from LDAP. > This currently cannot be used with ManageSieve. > + Implemented sieve_redirect_envelope_from setting, which allows > configuring the envelope sender of redirected messages. > - Fixed handling of mail storage errors occurring while evaluating the > input message. > - managesieve-login: > - Removed bogus ALERT response code returned for AUTHENTICATE > command. > - Fixed handling of invalid initial response argument to AUTHENTICATE > command. > - Fixed handling of stream errors in lexical scanner. > - Fixed handling of SMTP errors. Permanent and temporary errors were > mixed up. > - Fixed several problems reported by CLang 3.4. > - duplicate extension: Fixed erroneous compile error about conflicting > tags when `:handle' argument was used last. > - relational extension: Fixed error handling of `:value' match. > - editheader extension: Fixed header unfolding and header iteration. > - mailbox extension: Fixed the `:create' tag, which erroneously > subscribed an existing folder. > - extprograms plugin: Fixed handling of error codes. > - doveadm-sieve plugin: Fixed several bugs. Synchronization of symbolic > link in the file storage should now also work properly. > > The release is available as follows: > > http://pigeonhole.dovecot.org/releases/2.2/dovecot-2.2-pigeonhole-0.4.4.tar.gz > http://pigeonhole.dovecot.org/releases/2.2/dovecot-2.2-pigeonhole-0.4.4.tar.gz.sig > > Refer to http://pigeonhole.dovecot.org and the Dovecot v2.x wiki for > more information. Have fun testing this new release and don't hesitate > to notify me when there are any problems. > > Regards, > looks like editheader must still be in 90-sieve.conf in my tests sieve_extensions = +editheader Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From stephan at rename-it.nl Thu Oct 30 00:49:20 2014 From: stephan at rename-it.nl (Stephan Bosch) Date: Thu, 30 Oct 2014 01:49:20 +0100 Subject: Released Pigeonhole v0.4.4 for Dovecot v2.2.15. / editheader In-Reply-To: <545178BA.1070303@sys4.de> References: <544EEE0D.7010507@rename-it.nl> <545178BA.1070303@sys4.de> Message-ID: <54518B10.8050003@rename-it.nl> On 10/30/2014 12:31 AM, Robert Schetterer wrote: > Am 28.10.2014 um 02:14 schrieb Stephan Bosch: > > looks like editheader must still be in 90-sieve.conf in my tests > > sieve_extensions = +editheader Yes, but that is not a bug. I am not sure whether there could be setups in which editheader is a security risk. That is why it is not enabled by default. Regards, Stephan. From kop at meme.com Thu Oct 30 03:30:42 2014 From: kop at meme.com (Karl O. Pinc) Date: Wed, 29 Oct 2014 22:30:42 -0500 Subject: Bug in fts (solr?, Maildir?) incorrect last_indexed_uid Message-ID: <1414639842.17739.1@slate> Hi, I thought I should document this. (Dovecot 2.2.9, see config at bottom.) I installed dovecot and then converted a number of mbox mailboxes to Maildir, and had a number of pre-existing Maildir mailboxes. I then installed the debian (wheezy) fts-solar and jetty packages, and tested my inbox using the "telnet localhost imap ... 3 SEARCH text "test" method as described on the dovecot wiki. Everything seemed to work. But when I used balsa to search a mailbox other than my inbox, I got no results. "doveadm dump" on the searched mailbox showed that "last_indexed_uid" to be the last uid of my inbox. Stopping dovecot, deleting out the dovecot-index* files, starting dovecot, and re-running "doveadm dump" showed a non-existant last_indexed_uid -- that is, last_indexed_uid did not show up in the dump output. Using the telnet method above to attempt to search again yielded no results, but this time (I think, I also tried various times with balsa) the last_indexed_uid value was that of the last uid in my trash mailbox. I don't believe I'd yet tried fts on my trash. Using balsa as an imap client the results were very consistent; every Maildir where "doveadm dump" returned no last_indexed_uid value had the last_indexed_uid set to that of the inbox's largest uid. Running "doveadm fts rescan -u foo" fixed the problem. (FWIW, now all the Maildirs seem to have a last_indexed_uid=0.) Regards, Karl Free Software: "You don't pay back, you pay forward." -- Robert A. Heinlein # 2.2.9: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-486 i686 Debian 7.7 default_vsz_limit = 1 G disable_plaintext_auth = no mail_location = maildir:~/Maildir:INBOX=~/Maildir/.inbox mail_plugins = fts fts_solr namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / } namespace unconverted { hidden = no list = yes location = mbox:~/mail prefix = unconverted/ separator = / subscriptions = yes type = private } passdb { driver = pam } plugin { fts = solr fts_autoindex = yes fts_solr = url=http://localhost:8983/solr/ } protocols = " imap" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } ssl = required ssl_cert = References: <544EEE0D.7010507@rename-it.nl> <545178BA.1070303@sys4.de> <54518B10.8050003@rename-it.nl> Message-ID: <5451D83B.4090105@sys4.de> Am 30.10.2014 um 01:49 schrieb Stephan Bosch: > On 10/30/2014 12:31 AM, Robert Schetterer wrote: >> Am 28.10.2014 um 02:14 schrieb Stephan Bosch: >> >> looks like editheader must still be in 90-sieve.conf in my tests >> >> sieve_extensions = +editheader > > Yes, but that is not a bug. I am not sure whether there could be setups > in which editheader is a security risk. That is why it is not enabled by > default. > > Regards, > > Stephan. > > Hi Stephan, please describe security risk, do you mean function manipulate header in general.., or are there other thoughts with it Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From skdovecot at smail.inf.fh-brs.de Thu Oct 30 07:24:31 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Thu, 30 Oct 2014 08:24:31 +0100 (CET) Subject: Quota reporting In-Reply-To: <545126BC.4090105@hannsmattes.de> References: <545126BC.4090105@hannsmattes.de> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Wed, 29 Oct 2014, Hanns Mattes wrote: > AFAICS there's one issue left: Thunderbird and Kmail don't show the > quota status. Using doveadm quota the information is shown correctly, > even the user-specific values (coming from openldap) are set correctly. > > I think, I miss something obvious ... (and besides quota - any > configuration hint is very welcome) > > linux:/etc/dovecot # doveconf -n > protocol imap { > mail_plugins = " quota zlib fts fts_lucene trash quota imap_quota > imap_zlib" > } > Any ideas? Looks like imap_quota is present. However: a) did you reloaded Dovecot after config change? b) in which conf-file did you've configured imap_quota and why quota is mentioned twice? manual test: telnet server 143 *1 login "" *2 GETQUOTAROOT INBOX *3 logout Command 1 should include "QUOTA" in capability string, cmd #2 should return success. If this test succeeds, you have a MUA problem. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBVFHnsHz1H7kL/d9rAQLxiAf/YtZIqMi2y7S7286r/sRUPxmi1af0rL6P HrmXZDl5qayi9Pp0eFIVVkf1srSMflEya2sVUiKQKOxcHXiIa4xjLvky3TV59sP1 g4Kxw1FpaJ2pzFRpZxCjtmqr1+TTNazlG+Aj4pCptHljMlL7H2Jk9b57Gs8ysiTN 9HLFLWMQ/ETO7184Fe4evODirbPFfxxrSp599B3pC0dlE3/Ilce9jgLEGkh3XMWX jNVxtg0DOEmhFh2einvJjEOniJjiAV522uPPsPGgCkMyYZUj/v6Y4PWc0ayEA97Q bF8brGiFDpncQf77Z6kNDYFnfiv4aAhoC/II5DopEV+VthUZAilUiQ== =h43a -----END PGP SIGNATURE----- From skdovecot at smail.inf.fh-brs.de Thu Oct 30 07:41:57 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Thu, 30 Oct 2014 08:41:57 +0100 (CET) Subject: different mail location in different namespace In-Reply-To: References: Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Wed, 29 Oct 2014, H?ctor Moreno Blanco wrote: > We would like to modify this attribute for the Namespace ARCHIVO. > For example, if a home directory is /buzon/buzon1/11111111, the mail location for ARCHIVO would be /buzon/archivo1/11111111. > Is this modification possible without adding another attribute at the LDAP (just editing the attribute)? As far as I know, you cannot alter a value of an LDAP attribute in such sophisticated way. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBVFHrxnz1H7kL/d9rAQKcKggAxw6XqdOymxmiChh9Bgz9c55JL3N44jOe A/j4vVj5ciKleeClUWB2+Ek0ttAwP7R/L31oWw8SHC7xXTrcV5uDBfCYeIxqrqB9 O32swSgiQ+KWZILALmMqgqYLrzUXmNaOsWVVbsf+Uy8R6u1LMf4XtNIT7hPTAkTL 5jTAjRRw1oBEKXJPucCtXLvoZVbDsw5hDBuLz2+UX8S7YJXG4IeFlE3Y/dnkgXRZ KaMYH0GXxS9ghScvr8gY+U14eCRSRDdLMwcbJ38suLWdFlQ52qxVHfg7qyucKTeD 7/P6UZbE+AyKwyd1HkKBt3PVpJwmHX/yyiPKrhbDb4M0Eb51/qXgRw== =OwEj -----END PGP SIGNATURE----- From skdovecot at smail.inf.fh-brs.de Thu Oct 30 07:43:53 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Thu, 30 Oct 2014 08:43:53 +0100 (CET) Subject: Sieve plus addressed mail filtering In-Reply-To: <5450E35B.1060202@myzel.net> References: <5450DD6A.9080005@myzel.net> <5450E35B.1060202@myzel.net> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Wed, 29 Oct 2014, Peter Chiochetti wrote: >>> Instead I had to write: >>> >>> if address :is :detail "To" "tag"{ >>> fileinto "Tagged"; >>> } >> >> it depends on your way, how to deliver message from MTA to Dovecot, if >> the envelope information is available at all. How do you do it? > > Mail is pushed to dovecot /deliver/ LDA from /fetchmail/ from a remote > proxied dovecot IMAP. http://wiki2.dovecot.org/LDA "-a
: Original envelope recipient address (e.g. user+ext at domain), typically same as SMTP's RCPT TO: value. If not specified, it's taken from header specified by lda_original_recipient_header setting (v2.0.3+). If the header doesn't exist either, defaults to same as username. " - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBVFHsOXz1H7kL/d9rAQLVlAgAsEnlnP8L+/q/1ngw6QbCc/rmRGvrVE81 GgbwelerZ303hyA5QGBBkb9vhvjRuOUdAp1q9g4bJ1y8SdexWOdmWOCzk72Z7/PS isdRflM40uSusU4sUX+LN8n8VYEN0fJZ/6H1/CxZQdQsRu27bmhInlevAI8QI5td zDP6jrjTWBOH6SNlsN0H6dMdR7zuTAf1zsm3LOmoZE2VYk/FWORVVJJppv3cgtYe IS7koSW7G2x+cSQAw7c0ptuvAhABNLucTJ1rt77YNCE30Nna/gZHVFaJ1rnMaO/e hfsD6pLrabBIsgv+FyJFujtqPK3u649Wm+hv9Qc75dMi/a/BAFST2A== =QTjD -----END PGP SIGNATURE----- From arekm at maven.pl Thu Oct 30 08:34:36 2014 From: arekm at maven.pl (Arkadiusz =?utf-8?q?Mi=C5=9Bkiewicz?=) Date: Thu, 30 Oct 2014 09:34:36 +0100 Subject: Renaming not supported across conflicting directory - why? Message-ID: <201410300934.36178.arekm@maven.pl> I wonder what is point of checkign file/dir create mode like this? Here it makes problems since some folders have different permissions than others but both are accessible/writable by user. So renaming is possible (as renaming according to unix permissions). Yet dovecot artificially prevents this. /* if we're renaming under another mailbox, require its permissions to be same as ours. */ if (strchr(newname, mailbox_list_get_hierarchy_sep(newlist)) != NULL) { struct mailbox_permissions old_perm, new_perm; mailbox_list_get_permissions(oldlist, oldname, &old_perm); mailbox_list_get_permissions(newlist, newname, &new_perm); if ((new_perm.file_create_mode != old_perm.file_create_mode || new_perm.dir_create_mode != old_perm.dir_create_mode || new_perm.file_create_gid != old_perm.file_create_gid)) { mailbox_list_set_error(oldlist, MAIL_ERROR_NOTPOSSIBLE, "Renaming not supported across conflicting " "directory permissions"); return -1; } } -- Arkadiusz Mi?kiewicz, arekm / ( maven.pl | pld-linux.org ) From hanns at hannsmattes.de Thu Oct 30 08:39:42 2014 From: hanns at hannsmattes.de (Hanns Mattes) Date: Thu, 30 Oct 2014 09:39:42 +0100 Subject: Quota reporting In-Reply-To: References: <545126BC.4090105@hannsmattes.de> Message-ID: <5451F94E.3040609@hannsmattes.de> Hi Am 30.10.2014 um 08:24 schrieb Steffen Kaiser: > [quota not working] > Looks like imap_quota is present. However: > > a) did you reloaded Dovecot after config change? Yes > b) in which conf-file did you've configured imap_quota The Plugin is listed in 20-imap.conf. > and why quota is mentioned twice? Accidentially added in 20-imap.conf after $mail_plugins > > manual test: > > telnet server 143 > *1 login "" Quota is present > *2 GETQUOTAROOT INBOX "OK No quota." So it seems to be a problem with my configuration, not the MUA. Any ideas? Thanks in advance Hanns From hanns at hannsmattes.de Thu Oct 30 09:21:25 2014 From: hanns at hannsmattes.de (Hanns Mattes) Date: Thu, 30 Oct 2014 10:21:25 +0100 Subject: Quota reporting In-Reply-To: <5451F94E.3040609@hannsmattes.de> References: <545126BC.4090105@hannsmattes.de> <5451F94E.3040609@hannsmattes.de> Message-ID: <54520315.5000709@hannsmattes.de> Am 30.10.2014 um 09:39 schrieb Hanns Mattes: > Hi > > Am 30.10.2014 um 08:24 schrieb Steffen Kaiser: >> [quota not working] I've used prefetching with ldap. Turning it off, the quotas are presented correctly. So the problem is somewhere in the prefetch-part of my configuration. Regards Hanns From hanns at hannsmattes.de Thu Oct 30 09:29:21 2014 From: hanns at hannsmattes.de (Hanns Mattes) Date: Thu, 30 Oct 2014 10:29:21 +0100 Subject: Quota reporting In-Reply-To: <54520315.5000709@hannsmattes.de> References: <545126BC.4090105@hannsmattes.de> <5451F94E.3040609@hannsmattes.de> <54520315.5000709@hannsmattes.de> Message-ID: <545204F1.5040501@hannsmattes.de> Hi, answering myself... Am 30.10.2014 um 10:21 schrieb Hanns Mattes: > Am 30.10.2014 um 09:39 schrieb Hanns Mattes: >> Hi >> >> Am 30.10.2014 um 08:24 schrieb Steffen Kaiser: >>> [quota not working] > > I've used prefetching with ldap. Turning it off, the quotas are > presented correctly. So the problem is somewhere in the prefetch-part of > my configuration. Solved. I've missed a "$" in the pass_attrs. Simple Typo... Thanks to everyone Hanns From hmoreno at gmv.com Thu Oct 30 10:13:18 2014 From: hmoreno at gmv.com (=?iso-8859-1?Q?H=E9ctor_Moreno_Blanco?=) Date: Thu, 30 Oct 2014 10:13:18 +0000 Subject: different mail location in different namespace In-Reply-To: References: Message-ID: Thanks for the info Steffen. I think something could be done with custom namespace and a script (as described in the wiki http://wiki2.dovecot.org/MailLocation), but I don't know how. Any idea anyone? Thank you very much in advanced. Kind regards. H?ctor Moreno -----Mensaje original----- De: Steffen Kaiser [mailto:skdovecot at smail.inf.fh-brs.de] Enviado el: jueves, 30 de octubre de 2014 8:42 Para: H?ctor Moreno Blanco CC: dovecot at dovecot.org Asunto: Re: different mail location in different namespace -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Wed, 29 Oct 2014, H?ctor Moreno Blanco wrote: > We would like to modify this attribute for the Namespace ARCHIVO. > For example, if a home directory is /buzon/buzon1/11111111, the mail location for ARCHIVO would be /buzon/archivo1/11111111. > Is this modification possible without adding another attribute at the LDAP (just editing the attribute)? As far as I know, you cannot alter a value of an LDAP attribute in such sophisticated way. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBVFHrxnz1H7kL/d9rAQKcKggAxw6XqdOymxmiChh9Bgz9c55JL3N44jOe A/j4vVj5ciKleeClUWB2+Ek0ttAwP7R/L31oWw8SHC7xXTrcV5uDBfCYeIxqrqB9 O32swSgiQ+KWZILALmMqgqYLrzUXmNaOsWVVbsf+Uy8R6u1LMf4XtNIT7hPTAkTL 5jTAjRRw1oBEKXJPucCtXLvoZVbDsw5hDBuLz2+UX8S7YJXG4IeFlE3Y/dnkgXRZ KaMYH0GXxS9ghScvr8gY+U14eCRSRDdLMwcbJ38suLWdFlQ52qxVHfg7qyucKTeD 7/P6UZbE+AyKwyd1HkKBt3PVpJwmHX/yyiPKrhbDb4M0Eb51/qXgRw== =OwEj -----END PGP SIGNATURE----- P Please consider the environment before printing this e-mail. ______________________ This message including any attachments may contain confidential information, according to our Information Security Management System, and intended solely for a specific individual to whom they are addressed. Any unauthorised copy, disclosure or distribution of this message is strictly forbidden. If you have received this transmission in error, please notify the sender immediately and delete it. ______________________ Este mensaje, y en su caso, cualquier fichero anexo al mismo, puede contener informacion clasificada por su emisor como confidencial en el marco de su Sistema de Gestion de Seguridad de la Informacion siendo para uso exclusivo del destinatario, quedando prohibida su divulgacion copia o distribucion a terceros sin la autorizacion expresa del remitente. Si Vd. ha recibido este mensaje erroneamente, se ruega lo notifique al remitente y proceda a su borrado. Gracias por su colaboracion. ______________________ From jimjag at gmail.com Thu Oct 30 12:50:39 2014 From: jimjag at gmail.com (Jim Jagielski) Date: Thu, 30 Oct 2014 08:50:39 -0400 Subject: vpopmail, open_smtp_relay and non-PLAIN auth mechs Message-ID: I've noticed that if using the vpopmail auth setup, that the roaming-user functionality provided via open_smtp_relay() is only done if the auth mechanism is PLAIN. For example, if the client authenticates via DIGEST-MD5, the open relay file is not updated, as it should be. This is due to the call to open_smtp_relay only being done via vpopmail_verify_plain(). Instead, imo, that call should be done in auth_request_success() in the auth-request.c file, so that it is done however the authentication is done, as long as it is successful. Attached is a patch for 2.2.15. Let me know if attachments are not the preferred method and I'll cut/paste. tia! -- Jim Jagielski -------------- next part -------------- A non-text attachment was scrubbed... Name: dovecot-open_smtp_relay.patch Type: application/octet-stream Size: 2486 bytes Desc: not available URL: From kop at meme.com Thu Oct 30 13:58:17 2014 From: kop at meme.com (Karl O. Pinc) Date: Thu, 30 Oct 2014 08:58:17 -0500 Subject: Bug in fts (solr?, Maildir?) incorrect last_indexed_uid In-Reply-To: <1414639842.17739.1@slate> (from kop@meme.com on Wed Oct 29 22:30:42 2014) Message-ID: <1414677497.23216.6@slate> On 10/29/2014 10:30:42 PM, Karl O. Pinc wrote: > Hi, > > I thought I should document this. It seems reproducible. (2.2.9) I just created a new maildir directory (with mkdir). Moving some messages into it, which I assume triggers the configured auto fts indexing, causes the last_indexed_uid value to be set to the uid of the trash mailbox, which, btw, has the largest uid of any of the mailboxes indexed so far. Note that my reading of the logs is that the trash mailbox was _not_ the mailbox most recently indexed. Regards, Karl Free Software: "You don't pay back, you pay forward." -- Robert A. Heinlein From skdovecot at smail.inf.fh-brs.de Thu Oct 30 14:01:24 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Thu, 30 Oct 2014 15:01:24 +0100 (CET) Subject: different mail location in different namespace In-Reply-To: References: Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Thu, 30 Oct 2014, H?ctor Moreno Blanco wrote: > I think something could be done with custom namespace and a script (as > described in the wiki http://wiki2.dovecot.org/MailLocation), but I > don't know how. Well, if this is really going to work, check out the list archive for environment variables in Pre-Authenticated Sessions or from extra fields in userdbs, that is how you have name namespace/.../location correctly, and then create your script and add: mail_executable = /usr/local/.../script /usr/local/libexec/dovecot/imap But I think v2 requires Post-Login scripts, like so: http://wiki2.dovecot.org/PostLoginScripting See the use of USERDB_KEYS and creation of env vars. > -----Mensaje original----- > De: Steffen Kaiser [mailto:skdovecot at smail.inf.fh-brs.de] > Enviado el: jueves, 30 de octubre de 2014 8:42 > Para: H?ctor Moreno Blanco > CC: dovecot at dovecot.org > Asunto: Re: different mail location in different namespace > > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > On Wed, 29 Oct 2014, H?ctor Moreno Blanco wrote: > >> We would like to modify this attribute for the Namespace ARCHIVO. >> For example, if a home directory is /buzon/buzon1/11111111, the mail location for ARCHIVO would be /buzon/archivo1/11111111. > >> Is this modification possible without adding another attribute at the LDAP (just editing the attribute)? > > As far as I know, you cannot alter a value of an LDAP attribute in such sophisticated way. > > - -- > Steffen Kaiser > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1.4.11 (GNU/Linux) > > iQEVAwUBVFHrxnz1H7kL/d9rAQKcKggAxw6XqdOymxmiChh9Bgz9c55JL3N44jOe > A/j4vVj5ciKleeClUWB2+Ek0ttAwP7R/L31oWw8SHC7xXTrcV5uDBfCYeIxqrqB9 > O32swSgiQ+KWZILALmMqgqYLrzUXmNaOsWVVbsf+Uy8R6u1LMf4XtNIT7hPTAkTL > 5jTAjRRw1oBEKXJPucCtXLvoZVbDsw5hDBuLz2+UX8S7YJXG4IeFlE3Y/dnkgXRZ > KaMYH0GXxS9ghScvr8gY+U14eCRSRDdLMwcbJ38suLWdFlQ52qxVHfg7qyucKTeD > 7/P6UZbE+AyKwyd1HkKBt3PVpJwmHX/yyiPKrhbDb4M0Eb51/qXgRw== > =OwEj > -----END PGP SIGNATURE----- > ---------------Output of GPG------------------ > Decryption of block failed > gpg: Signature made Thu 30 Oct 2014 08:41:58 AM CET using RSA key ID 0BFDDF6B > gpg: BAD signature from "Steffen Kaiser " > > P Please consider the environment before printing this e-mail. > > ______________________ > This message including any attachments may contain confidential > information, according to our Information Security Management System, > and intended solely for a specific individual to whom they are addressed. > Any unauthorised copy, disclosure or distribution of this message > is strictly forbidden. If you have received this transmission in error, > please notify the sender immediately and delete it. > > ______________________ > Este mensaje, y en su caso, cualquier fichero anexo al mismo, > puede contener informacion clasificada por su emisor como confidencial > en el marco de su Sistema de Gestion de Seguridad de la > Informacion siendo para uso exclusivo del destinatario, quedando > prohibida su divulgacion copia o distribucion a terceros sin la > autorizacion expresa del remitente. Si Vd. ha recibido este mensaje > erroneamente, se ruega lo notifique al remitente y proceda a su borrado. > Gracias por su colaboracion. > > ______________________ > > - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBVFJEtHz1H7kL/d9rAQItHggAw3J5ESuGlsfxfQst7jorNa0SejCcdZcZ B52ltUFRUhgLfo+sUGVE+41f9Jt8DdPx3a/IrNtdfh8RMQWol9YXobnL2YapCa8B AikJAC31y82Fd26GbdIDbfq9mvT8d9bRrq7L7L530Ss3ScbhP5SfJ6oeq5Cq4Wy6 RoEK7eHk0TFLo8Fb06nMDelbTL1L83YnKUBMYa8EnFRLWndGT72Qqbg1wPV6FTbD EEodLm0VTNKx/EU7vvBLVBAKzW06W+efbONyimMtW4s8ESYHPvmD5EnunUUctATm YPwCenrEhBZP/uWFX1rR0SCVequ7Nnsx3T8U9FcsCqWNEos4hOuR+g== =jk5v -----END PGP SIGNATURE----- From maegger at ee.ethz.ch Thu Oct 30 14:44:23 2014 From: maegger at ee.ethz.ch (Matthias Egger) Date: Thu, 30 Oct 2014 15:44:23 +0100 Subject: 2.2.15 Panic in mbox_sync_read_next_mail() In-Reply-To: <5450F0B7.2050602@ee.ethz.ch> References: <20141029130348.GA1682@alf.uib.no> <5450F0B7.2050602@ee.ethz.ch> Message-ID: <54524EC7.5010402@ee.ethz.ch> On 10/29/2014 02:50 PM, Matthias Egger wrote: > As soon as i can catch a coredump i will send a gdb output. Okay, here is the gdb ouput i could catch and some more information about the system. System Infos: SunOS HOSTNAME 5.10 Generic_150400-10 sun4u sparc SUNW,Sun-Fire-V440 Logfile Entries: Oct 30 14:27:56 HOSTNAME dovecot: [ID 583609 mail.info] imap-login: Login: user=, method=PLAIN, rip=1.1.1.1, lip=2.2.2.2, mpid=15565, TLS, session= Oct 30 14:27:56 HOSTNAME dovecot: [ID 583609 mail.debug] imap(USERNAME): Debug: Effective uid=3224, gid=320, home=/home/USERNAME Oct 30 14:27:56 HOSTNAME dovecot: [ID 583609 mail.debug] imap(USERNAME): Debug: Namespace : type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mbox:~/Mail/:INBOX=/var/mail/USERNAME:INDEX=/usr/HOSTNAME/vault2/dovecot/indexes/USERNAME Oct 30 14:27:56 HOSTNAME dovecot: [ID 583609 mail.debug] imap(USERNAME): Debug: fs: root=/home/USERNAME/Mail, index=/usr/HOSTNAME/vault2/dovecot/indexes/USERNAME, indexpvt=, control=, inbox=/var/mail/USERNAME, alt= Oct 30 14:27:56 HOSTNAME dovecot: [ID 583609 mail.debug] imap(USERNAME): Debug: Namespace : type=private, prefix=Mail/, sep=/, inbox=no, hidden=yes, list=no, subscriptions=yes location=mbox:~/Mail/:INBOX=/var/mail/USERNAME:INDEX=/usr/HOSTNAME/vault2/dovecot/indexes/USERNAME Oct 30 14:27:56 HOSTNAME dovecot: [ID 583609 mail.debug] imap(USERNAME): Debug: fs: root=/home/USERNAME/Mail, index=/usr/HOSTNAME/vault2/dovecot/indexes/USERNAME, indexpvt=, control=, inbox=/var/mail/USERNAME, alt= Oct 30 14:27:56 HOSTNAME dovecot: [ID 583609 mail.error] imap(USERNAME): Error: Next message unexpectedly corrupted in mbox file /home/USERNAME/Mail/review at 79036384 Oct 30 14:27:56 HOSTNAME dovecot: [ID 583609 mail.crit] imap(USERNAME): Panic: file mbox-sync.c: line 152 (mbox_sync_read_next_mail): assertion failed: (sync_ctx->input->v_offset != mail_ctx->mail.from_offset || sync_ctx->input->eof) Oct 30 14:27:56 HOSTNAME dovecot: [ID 583609 mail.error] imap(USERNAME): Error: Raw backtrace: 0xffffffff7ed89f64 -> 0xffffffff7ed88f10 -> 0xffffffff7ef77a14 -> 0xffffffff7ef78a1c -> 0xffffffff7ef70720 -> 0xffffffff7c10289c -> 0xffffffff7ef96e60 -> 0xffffffff7ef8dd6c -> 0xffffffff7c102758 -> 0xffffffff7ef97130 -> 0xffffffff7ef97250 -> 0x10000c8c8 -> 0x10000ce24 -> 0x100019044 -> 0x100017b18 -> 0x100017ad8 -> 0x100017f3c -> 0x100018188 -> 0xffffffff7ed9c8a4 -> 0xffffffff7ed9d5a0 -> 0xffffffff7ed9c93c -> 0xffffffff7ed9ca0c -> 0xffffffff7ed3c314 -> 0x100024908 -> 0x10000a74c Oct 30 14:27:57 HOSTNAME dovecot: [ID 583609 mail.crit] imap(USERNAME): Fatal: master: service(imap): child 15565 killed with signal 6 (core dumped) GDB Output: GNU gdb (GDB) 7.8.1 Copyright (C) 2014 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "sparc-sun-solaris2.10". Type "show configuration" for configuration details. For bug reporting instructions, please see: . Find the GDB manual and other documentation resources online at: . For help, type "help". Type "apropos word" to search for commands related to "word"... Reading symbols from /usr/pack/dovecot-2.2.15-me/sun4u-sun-solaris2.10/libexec/dovecot/imap...done. [New LWP 1] [Thread debugging using libthread_db enabled] [New Thread 1 (LWP 1)] Core was generated by `dovecot/imap'. Program terminated with signal SIGABRT, Aborted. #0 0xffffffff7cddcb68 in _lwp_kill () from /lib/64/libc.so.1 (gdb) bt full #0 0xffffffff7cddcb68 in _lwp_kill () from /lib/64/libc.so.1 No symbol table info available. #1 0xffffffff7cd74444 in raise () from /lib/64/libc.so.1 No symbol table info available. #2 0xffffffff7cd4c1c8 in abort () from /lib/64/libc.so.1 No symbol table info available. #3 0xffffffff7ed88d7c in default_fatal_finish (type=LOG_TYPE_PANIC, status=0) at failures.c:202 backtrace = 0x100133db0 "0xffffffff7ed89f64 -> 0xffffffff7ed88f10 -> 0xffffffff7ef77a14 -> 0xffffffff7ef78a1c -> 0xffffffff7ef70720 -> 0xffffffff7c10289c -> 0xffffffff7ef96e60 -> 0xffffffff7ef8dd6c -> 0xffffffff7c102758 -> 0x"... #4 0xffffffff7ed89f6c in i_internal_fatal_handler (ctx=0xffffffff7fffe2e0, format=0xffffffff7effba48 "file %s: line %d (%s): assertion failed: (%s)", args=0x0) at failures.c:666 status = 0 #5 0xffffffff7ed88f18 in i_panic (format=0xffffffff7effba48 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:276 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0, timestamp_usecs = 0} #6 0xffffffff7ef77a1c in mbox_sync_do (sync_ctx=0xffffffff7fffe760, flags=(MBOX_SYNC_FORCE_SYNC | MBOX_SYNC_READONLY | unknown: 2147477248)) at mbox-sync.c:1506 seq = 1611168 view = 0xffffffff7eeddcf8 st = 0x0 first_recent_uid = 0 seq2 = 1 mbox_hdr = 0x1 mail_ctx = {sync_ctx = 0xffffffff7fffe760, mail = {uid = 0, idx_seq = 0, keywords = {arr = {buffer = 0x0, element_size = 0}, v = 0x0, v_modifiable = 0x0}, flags = 32 ' ', uid_broken = 0, expunged = 0, pseudo = 0, status_broken = 0, xstatus_broken = 0, from_offset = 558, body_size = 0, offset = 558, space = 0}, seq = 2, hdr_offset = 558, body_offset = 558, header_first_change = 18446744073709551615, header_last_change = 0, header = 0x100140230, hdr_md5_sum = "\324\035\214\331\217\000\262\004\351\200\t\230\354\370B~", content_length = 18446744073709551615, hdr_pos = {18446744073709551615, 18446744073709551615, 18446744073709551615, 18446744073709551615, 18446744073709551615}, parsed_uid = 0, last_uid_updated_value = 0, last_uid_value_start_pos = 0, have_eoh = 0, need_rewrite = 0, seen_imapbase = 0, updated = 0, recent = 0, dirty = 0, imapbase_rewrite = 0, imapbase_updated = 0} st = 0x1001895c8 i = 0 ret = 1389811195 partial = 1389811195 #7 0xffffffff7ef78a24 in mbox_sync (mbox=0x100163a50, flags=(unknown: 0)) at mbox-sync.c:1947 sync_ctx = {mbox = 0x100163a50, flags = (unknown: 0), input = 0x100189750, file_input = 0x1001895a0, write_fd = 16, orig_mtime = 1414623452, orig_atime = 1414675298, orig_size = 80880344, last_stat = { st_dev = 1657857376531, st_ino = 128607, st_mode = 33152, st_nlink = 1, st_uid = 3224, st_gid = 320, st_rdev = 0, st_size = 80880344, st_atim = {tv_sec = 1414675298, tv_nsec = 859380000}, st_mtim = { tv_sec = 1414623452, tv_nsec = 0}, st_ctim = {tv_sec = 1414623453, tv_nsec = 933899000}, st_blksize = 8192, st_blocks = 158080, st_fstype = "nfs", '\000' }, index_sync_ctx = 0x1001855d0, sync_view = 0x100185640, t = 0x100185c40, reset_hdr = {major_version = 0 '\000', minor_version = 0 '\000', base_header_size = 0, header_size = 0, record_size = 0, compat_flags = 0 '\000', unused = "\000\000", indexid = 0, flags = 0, uid_validity = 0, next_uid = 0, messages_count = 0, unused_old_recent_messages_count = 0, seen_messages_count = 0, deleted_messages_count = 0, first_recent_uid = 0, first_unseen_uid_lowwater = 0, first_deleted_uid_lowwater = 0, log_file_seq = 0, log_file_tail_offset = 0, log_file_head_offset = 0, unused_old_sync_size = 0, unused_old_sync_stamp = 0, day_stamp = 0, day_first_uid = {0, 0, 0, 0, 0, 0, 0, 0}}, hdr = 0x100167a90, header = 0x100140230, from_line = 0x1001401e0, base_uid_validity = 1389811195, base_uid_last = 770, base_uid_last_offset = 264, mails = {arr = {buffer = 0x100140280, element_size = 64}, v = 0x100140280, v_modifiable = 0x100140280}, sync_changes = 0x100161130, mail_keyword_pool = 0x1001870d0, saved_keywords_pool = 0x1001872e0, prev_msg_uid = 0, next_uid = 771, idx_next_uid = 744, seq = 2, idx_seq = 1, need_space_seq = 0, last_nonrecent_uid = 0, expunged_space = 0, space_diff = 0, dest_first_mail = 0, first_mail_crlf_expunged = 0, keep_recent = 1, readonly = 0, delay_writes = 1, renumber_uids = 0, moved_offsets = 0, ext_modified = 0, index_reset = 0, errors = 0} sync_flags = (MAIL_INDEX_SYNC_FLAG_DROP_RECENT | MAIL_INDEX_SYNC_FLAG_AVOID_FLAG_UPDATES | MAIL_INDEX_SYNC_FLAG_DELETING_INDEX | MAIL_INDEX_SYNC_FLAG_TRY_DELETING_INDEX | unknown: 640) index_sync_ctx = 0x1001855d0 sync_view = 0x100185640 ret = 1259088 trans = 0x100185c40 changed = 1 delay_writes = true readonly = false lock_id = 3 ret = 1 __FUNCTION__ = "mbox_sync" #8 0xffffffff7ef70728 in mbox_save_begin (_ctx=0x100178880, input=0x100184bc0) at mbox-save.c:317 mbox = 0x100163a50 storage = 0x1001566e0 empty = false ret = 1 mdata = 0x100178890 t = 0x100171ab0 save_flags = 1456720 offset = 18446744069414584321 __FUNCTION__ = "mbox_save_begin" #9 0xffffffff7c1028a4 in notify_save_begin (ctx=0x100178880, input=0x100184bc0) at notify-storage.c:132 lt = 0x10013bf10 lbox = 0x1001640c0 #10 0xffffffff7ef96e68 in mailbox_save_begin (ctx=0xffffffff7fffee30, input=0x100184bc0) at mail-storage.c:2087 _data_stack_cur_id = 5 box = 0x100163a50 ret = 1456720 #11 0xffffffff7ef8dd74 in mail_storage_copy (ctx=0x100178880, mail=0x1001740a0) at mail-copy.c:76 input = 0x100184bc0 #12 0xffffffff7c102760 in notify_copy (ctx=0x100178880, mail=0x1001740a0) at notify-storage.c:108 lt = 0xffffffffffffffff lbox = 0x1001640c0 ret = 1458368 #13 0xffffffff7ef97138 in mailbox_copy (_ctx=0xffffffff7ffff0e0, mail=0x1001740a0) at mail-storage.c:2212 _data_stack_cur_id = 4 ctx = 0x100178880 t = 0x100171ab0 keywords = 0x0 pvt_flags = 0 backend_mail = 0x1001740a0 ret = 2147479776 __FUNCTION__ = "mailbox_copy" #14 0xffffffff7ef97258 in mailbox_move (_ctx=0xffffffff7ffff0e0, mail=0x1001740a0) at mail-storage.c:2234 ctx = 0x100178880 #15 0x000000010000c8d0 in cmd_copy_full (cmd=0x100157ab0, move=true) at cmd-copy.c:67 search_ctx = 0x100173f30 src_trans = 0x100172cf0 srcset_ctx = {str = 0x100133c00, first_uid = 0, last_uid = 4294967295} ret = 1 save_ctx = 0x0 mail = 0x1001740a0 copy_count = 1 src_uidset = 0x100133c00 move = true search_args = 0x1 client = 0x1001572a0 dest_storage = 0x1 destbox = 0x100163a50 t = 0x100171ab0 src_trans = 0x84 search_args = 0x100162a40 messageset = 0x1001514e0 "237752" mailbox = 0x1001514e8 "review" src_uidset = 0x81 sync_flags = (unknown: 0) imap_flags = (unknown: 0) changes = {pool = 0x3132392e3133322e, uid_validity = 892481073, saved_uids = {arr = {buffer = 0x81, element_size = 18446744071544102136}, v = 0x81, v_modifiable = 0x81}, ignored_modseq_changes = 1, changed = false, no_read_perm = 21} copy_count = 8 msg = 0x100171ab0 ret = 1 __FUNCTION__ = "cmd_copy_full" #16 0x000000010000ce2c in cmd_move (cmd=0x100157ab0) at cmd-copy.c:211 No locals. #17 0x000000010001904c in command_exec (cmd=0x100157ab0) at imap-commands.c:158 hook = 0x10013e700 ret = 63 #18 0x0000000100017b20 in client_command_input (cmd=0x100157ab0) at imap-client.c:782 client = 0x1001572a0 command = 0x0 __FUNCTION__ = "client_command_input" #19 0x0000000100017ae0 in client_command_input (cmd=0x100157ab0) at imap-client.c:843 client = 0x1001572a0 command = 0x0 __FUNCTION__ = "client_command_input" #20 0x0000000100017f44 in client_handle_input (client=0x1001572a0) at imap-client.c:880 _data_stack_cur_id = 3 ret = false remove_io = false handled_commands = false __FUNCTION__ = "client_handle_input" #21 0x0000000100018190 in client_input (client=0x1001572a0) at imap-client.c:935 cmd = 0xf1942 output = 0x100151250 bytes = 30 __FUNCTION__ = "client_input" #22 0xffffffff7ed9c8ac in io_loop_call_io (io=0x100143b60) at ioloop.c:498 ioloop = 0x10013cd80 t_id = 2 __FUNCTION__ = "io_loop_call_io" #23 0xffffffff7ed9d5a8 in io_loop_handler_run_internal (ioloop=0x10013cd80) at ioloop-poll.c:211 ctx = 0x10013ce60 pollfd = 0x100142470 tv = {tv_sec = 4, tv_usec = 990294} io = 0x100143b60 ret = 0 call = false #24 0xffffffff7ed9c944 in io_loop_handler_run (ioloop=0x10013cd80) at ioloop.c:545 No locals. #25 0xffffffff7ed9ca14 in io_loop_run (ioloop=0x10013cd80) at ioloop.c:523 __FUNCTION__ = "io_loop_run" #26 0xffffffff7ed3c31c in master_service_run (service=0x10013cc50, callback=0x100024318 ) at master-service.c:566 No locals. #27 0x0000000100024910 in main (argc=1, argv=0xffffffff7ffffca8) at main.c:412 set_roots = {0x10002d5e0 , 0x0} login_set = {auth_socket_path = 0x100133920 "", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x100024054 , failure_callback = 0x1000242bc , request_auth_token = 1} service_flags = (MASTER_SERVICE_FLAG_KEEP_CONFIG_OPEN | MASTER_SERVICE_FLAG_NO_CONFIG_SETTINGS | MASTER_SERVICE_FLAG_UPDATE_PROCTITLE | MASTER_SERVICE_FLAG_USE_SSL_SETTINGS | unknown: 147456) storage_service_flags = MAIL_STORAGE_SERVICE_FLAG_DISALLOW_ROOT username = 0x133400 c = 1297488 Best regards Matthias -- Matthias Egger ETH Zurich Department of Information Technology maegger at ee.ethz.ch and Electrical Engineering IT Support Group (ISG.EE), ETL/F/24.1 Phone +41 (0)44 632 03 90 Physikstrasse 3, CH-8092 Zurich Fax +41 (0)44 632 11 95 -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4099 bytes Desc: S/MIME Cryptographic Signature URL: From Philipp.Faeustlin at uni-hohenheim.de Thu Oct 30 15:28:58 2014 From: Philipp.Faeustlin at uni-hohenheim.de (Philipp Faeustlin) Date: Thu, 30 Oct 2014 16:28:58 +0100 Subject: Bug in the combination of Lazy_expunge and acl plugin Message-ID: <5452593A.6010307@uni-hohenheim.de> Hello Timo, Hello Dovecot Developers, Hello everyone on the list, I think I have some bug, because I haven't found a working configuration till now. I use latest dovecot 2.2.13 from the dovecot-ee repository, with acl and the lazy_expunge plugin. My configuration for shared folders work fine with lazy_expunge disabled. If I enable lazy_expunge and the user (named userA), which I'm testing with, got no shared folders, then lazy_expunge is working as supposed. Now I add some shared folder for example per doveadm: doveadm acl set -u userB at domain.de INBOX user=userA at domain.de lookup read write write-seen write-deleted insert expunge create After that every list command fails with: Fatal: lazy_expunge: Unknown namespace: '.EXPUNGED/' '.EXPUNGED/' is the name for the namespace of lazy_expunge. Easiest way for me to reproduce the error is: doveadm mailbox list -u userA at domain.de which results in: ----------------- Trash Drafts Sent doveadm(userA at domian.de): Fatal: lazy_expunge: Unknown namespace: '.EXPUNGED/' ------------------ I hope someone can confirm this behavior and or give me some hints to get rid of it. Regards Philipp F?ustlin From hmoreno at gmv.com Thu Oct 30 16:25:49 2014 From: hmoreno at gmv.com (=?iso-8859-1?Q?H=E9ctor_Moreno_Blanco?=) Date: Thu, 30 Oct 2014 16:25:49 +0000 Subject: different mail location in different namespace In-Reply-To: References: Message-ID: Hello Steffen, My namespace name is "archivo". ... namespace archivo { location = prefix = _ARCHIVO. hidden = yes separator = . type = private } ... This is my post-login script. I've saved the variable I want in "aux" ($location is correct "maildir:/buzon/archivo5/12345" ) .. location=maildir:$aux ... export USERDB_KEYS="$USERDB_KEYS namespace/archivo/location" exec env "NAMESPACE/ARCHIVO/LOCATION=$location" "$@" ... But when I start session, the namespace doesn't override the mail location with my script, and takes the default one: doveadm(user_id): Debug: Namespace archivo: type=private, prefix=_ARCHIVO., sep=., inbox=no, hidden=yes, list=yes, subscriptions=yes location=maildir:/buzon/buzon5/12345/Maildir Any idea of what I'm doing wrong? Thank you very much. Kind regards. H?ctor Moreno -----Mensaje original----- De: Steffen Kaiser [mailto:skdovecot at smail.inf.fh-brs.de] Enviado el: jueves, 30 de octubre de 2014 15:01 Para: H?ctor Moreno Blanco CC: dovecot at dovecot.org Asunto: RE: different mail location in different namespace -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Thu, 30 Oct 2014, H?ctor Moreno Blanco wrote: > I think something could be done with custom namespace and a script (as > described in the wiki http://wiki2.dovecot.org/MailLocation), but I > don't know how. Well, if this is really going to work, check out the list archive for environment variables in Pre-Authenticated Sessions or from extra fields in userdbs, that is how you have name namespace/.../location correctly, and then create your script and add: mail_executable = /usr/local/.../script /usr/local/libexec/dovecot/imap But I think v2 requires Post-Login scripts, like so: http://wiki2.dovecot.org/PostLoginScripting See the use of USERDB_KEYS and creation of env vars. > -----Mensaje original----- > De: Steffen Kaiser [mailto:skdovecot at smail.inf.fh-brs.de] > Enviado el: jueves, 30 de octubre de 2014 8:42 > Para: H?ctor Moreno Blanco > CC: dovecot at dovecot.org > Asunto: Re: different mail location in different namespace > > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > On Wed, 29 Oct 2014, H?ctor Moreno Blanco wrote: > >> We would like to modify this attribute for the Namespace ARCHIVO. >> For example, if a home directory is /buzon/buzon1/11111111, the mail location for ARCHIVO would be /buzon/archivo1/11111111. > >> Is this modification possible without adding another attribute at the LDAP (just editing the attribute)? > > As far as I know, you cannot alter a value of an LDAP attribute in such sophisticated way. > > - -- > Steffen Kaiser > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1.4.11 (GNU/Linux) > > iQEVAwUBVFHrxnz1H7kL/d9rAQKcKggAxw6XqdOymxmiChh9Bgz9c55JL3N44jOe > A/j4vVj5ciKleeClUWB2+Ek0ttAwP7R/L31oWw8SHC7xXTrcV5uDBfCYeIxqrqB9 > O32swSgiQ+KWZILALmMqgqYLrzUXmNaOsWVVbsf+Uy8R6u1LMf4XtNIT7hPTAkTL > 5jTAjRRw1oBEKXJPucCtXLvoZVbDsw5hDBuLz2+UX8S7YJXG4IeFlE3Y/dnkgXRZ > KaMYH0GXxS9ghScvr8gY+U14eCRSRDdLMwcbJ38suLWdFlQ52qxVHfg7qyucKTeD > 7/P6UZbE+AyKwyd1HkKBt3PVpJwmHX/yyiPKrhbDb4M0Eb51/qXgRw== > =OwEj > -----END PGP SIGNATURE----- > ---------------Output of GPG------------------ Decryption of block > failed > gpg: Signature made Thu 30 Oct 2014 08:41:58 AM CET using RSA key ID > 0BFDDF6B > gpg: BAD signature from "Steffen Kaiser " > > P Please consider the environment before printing this e-mail. > > ______________________ > This message including any attachments may contain confidential > information, according to our Information Security Management System, > and intended solely for a specific individual to whom they are addressed. > Any unauthorised copy, disclosure or distribution of this message is > strictly forbidden. If you have received this transmission in error, > please notify the sender immediately and delete it. > > ______________________ > Este mensaje, y en su caso, cualquier fichero anexo al mismo, puede > contener informacion clasificada por su emisor como confidencial en el > marco de su Sistema de Gestion de Seguridad de la Informacion siendo > para uso exclusivo del destinatario, quedando prohibida su divulgacion > copia o distribucion a terceros sin la autorizacion expresa del > remitente. Si Vd. ha recibido este mensaje erroneamente, se ruega lo > notifique al remitente y proceda a su borrado. > Gracias por su colaboracion. > > ______________________ > > - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBVFJEtHz1H7kL/d9rAQItHggAw3J5ESuGlsfxfQst7jorNa0SejCcdZcZ B52ltUFRUhgLfo+sUGVE+41f9Jt8DdPx3a/IrNtdfh8RMQWol9YXobnL2YapCa8B AikJAC31y82Fd26GbdIDbfq9mvT8d9bRrq7L7L530Ss3ScbhP5SfJ6oeq5Cq4Wy6 RoEK7eHk0TFLo8Fb06nMDelbTL1L83YnKUBMYa8EnFRLWndGT72Qqbg1wPV6FTbD EEodLm0VTNKx/EU7vvBLVBAKzW06W+efbONyimMtW4s8ESYHPvmD5EnunUUctATm YPwCenrEhBZP/uWFX1rR0SCVequ7Nnsx3T8U9FcsCqWNEos4hOuR+g== =jk5v -----END PGP SIGNATURE----- P Please consider the environment before printing this e-mail. ______________________ This message including any attachments may contain confidential information, according to our Information Security Management System, and intended solely for a specific individual to whom they are addressed. Any unauthorised copy, disclosure or distribution of this message is strictly forbidden. If you have received this transmission in error, please notify the sender immediately and delete it. ______________________ Este mensaje, y en su caso, cualquier fichero anexo al mismo, puede contener informacion clasificada por su emisor como confidencial en el marco de su Sistema de Gestion de Seguridad de la Informacion siendo para uso exclusivo del destinatario, quedando prohibida su divulgacion copia o distribucion a terceros sin la autorizacion expresa del remitente. Si Vd. ha recibido este mensaje erroneamente, se ruega lo notifique al remitente y proceda a su borrado. Gracias por su colaboracion. ______________________ From jbehrend at mpifr-bonn.mpg.de Thu Oct 30 16:31:13 2014 From: jbehrend at mpifr-bonn.mpg.de (Jan Behrend) Date: Thu, 30 Oct 2014 17:31:13 +0100 Subject: Question wrt. dovecot replicator In-Reply-To: <1412945143.452.33.camel@jb1.mpifr-bonn.mpg.de> References: <542D1373.9050806@dovecot.fi> <5F20B8B3-0908-41C9-A1C4-1FC08265C503@FreeBSD.org> <1412945143.452.33.camel@jb1.mpifr-bonn.mpg.de> Message-ID: <1414686673.7231.42.camel@jb1.mpifr-bonn.mpg.de> On Fri, 2014-10-10 at 14:45 +0200, Jan Behrend wrote: > On Fri, 2014-10-03 at 23:37 +0200, Remko Lodder wrote: > > >>> How can I determine why there are duplicated emails? > > Same problem here! > > > >>> What kind of messages should I specifically look for? > > >> Look for any errors and warnings in the Dovecot log. You could also enable mail_debug (ref. > > > > >>> Can I set this up for a few selected accounts instead of all accounts like it was currently? To make sure I do not make things worse for others then needs to be :-) > > >>> The service had been disabled for the time being to prevent the other users from getting duplicated emails. > > >> I do not know what kind of userdb you are running, but there is a newish patch that enables per user replication via the > > >> mail_replica setting. It is not yet included in the newest (2.2.13) release of Dovecot, but is available via the enterprise > > >> version. There are no FreeBSD builds for that, though. ref: http://hg.dovecot.org/dovecot-2.2/rev/c1c67bdc8752 > > > > > > my userdb consists of local users (Which are fed through LDAP at the backend). perhaps I can setup a mailAttributes setting or something so that the replica can be > > > set, although I prefer that I have control over that in the config itself :-) > > With the latest Debian jessie version 1:2.2.13-5 you can actually have a > per user mail_replica setting taken from a (LDAP) directory. This keeps > the duplicate mail issue away from other users but a few willing to > test ... > > > For what it?s worth: > > > > replication_dsync_parameters = -f -d -N -l 30 -U > > I read in Peer Heinlein's Dovecot book > http://www.opensourcepress.de/de/produkte/Dovecot/13560/978-3-95539-074-7 > that replicating a public namespace gives you trouble :-(. So keep the > "-N" option away for now. > > However I would like examples for the "-n" and "-x" options, which are > neither given in the wiki nor in the nonexistant man page. > > I think the replication feature is very, very cool, but right now it > gives me a hard time to implement flawlessly ;-) > > Thanks for any help or light shed on this issue ... Found it ;-) http://wiki2.dovecot.org/Tools/Doveadm/Sync All working beautifully now! Cheers Jan -- MAX-PLANCK-INSTITUT fuer Radioastronomie Jan Behrend - Rechenzentrum ---------------------------------------- Auf dem Huegel 69, D-53121 Bonn Tel: +49 (228) 525 359, Fax: +49 (228) 525 229 jbehrend at mpifr-bonn.mpg.de http://www.mpifr-bonn.mpg.de -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/x-pkcs7-signature Size: 6071 bytes Desc: not available URL: From phil at pricom.com.au Tue Oct 28 03:40:11 2014 From: phil at pricom.com.au (Philip Rhoades) Date: Tue, 28 Oct 2014 14:40:11 +1100 Subject: Can someone explain this Sent thread sorting? Message-ID: <7878ec1d673909fa2afeb3fd8752a17c@localhost> People, I attach a screen capture of my RoundCubeMail Sent box - why does the second item on the list, which is a separate reply to the thread above it, get sorted to position 2? By the date, and being a single mail, it should be much further down the screen . . I presume it is because the Subject is the same? Thanks, Phil. -- Philip Rhoades GPO Box 3411 Sydney NSW 2001 Australia E-mail: phil at pricom.com.au -------------- next part -------------- A non-text attachment was scrubbed... Name: RCM_102514_16:33:00.png Type: image/png Size: 43583 bytes Desc: not available URL: From ron at debian.org Thu Oct 30 00:41:23 2014 From: ron at debian.org (Ron) Date: Thu, 30 Oct 2014 11:11:23 +1030 Subject: v2.2.15 released In-Reply-To: <20141029130754.GA2526@phil.dovecot.net> References: <96FB5E7D-DFC2-410E-8827-78961029EB72@iki.fi> <5BB39377-634E-48DC-965F-11DAD33D45AA@iki.fi> <544B90A2.80006@gedalya.net> <544C0A81.6050507@gedalya.net> <20141029130754.GA2526@phil.dovecot.net> Message-ID: <20141030004123.GY8092@hex.shelbyville.oz> Hi Phil, On Wed, Oct 29, 2014 at 03:07:54PM +0200, Phil Carmody wrote: > On Sat, Oct 25, 2014 at 04:39:29PM -0400, Gedalya wrote: > > On 10/25/2014 11:43 AM, Timo Sirainen wrote: > > >On 25 Oct 2014, at 04:59, Gedalya wrote: > > > > > >>>> Also I have one minor issue to report. dovecot broke API from > > >>>> 2.2.13 to 2.2.14 but it only provides version macros for the > > >>>> first two components of the version number. This has caused a > > >>>> small upgrade problem for the antispam plugin which is in a > > >>>> separate package (dovecot-antispam.) Was that addressed in > > >>>> 2.2.15? > > >>> I only remember an ABI problem with antispam. Recompiling fixed > > >>> that AFAIK. (And no Dovecot version guarantees ABI > > >>> compatibility.) Is there some API problem also? > > >> > > >> https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=765943 > > > > > > Oh, it uses the really old way to do things. In v1.1+ T_BEGIN { .. > > > } T_END should have been used instead. Patch attached. > > The header file could admittedly have been a little more persuasive > in weaning people off the old interface. > > However, it was my bad that I didn't consider the old interface may > still be in use. Apologies. Part of the catch here is that the dovecot-antispam code has tried to remain compatible with earlier versions of dovecot too, since there is always going to be some spread of versions in the wild at any given time. But if this just means dropping support for versions < 1.1 now, that might not be such a big deal anymore. The original patch we looked at for this was basically quite simple: http://anonscm.debian.org/cgit/users/ron/dovecot-antispam.git/commit/?id=2aa93d15409f5a47589d264991fd3e8261d34b1b The main catch being dovecot only exports version macros for the MAJOR and MINOR version components, not for the final "patch level" component, so we need to parse the full version string to get that. That wasn't really a problem while the API only changed with a minor version bump, but this change changed that. It would be nice (in the long term) if dovecot itself provided macros that let us avoid what we (and other plugins) are doing here: http://anonscm.debian.org/cgit/users/ron/dovecot-antispam.git/tree/dovecot-version.c > > OK, it's not working as it is. > > > > This little bit seems like a typo: > > - t_pop(); > > + } T_POP; > > > > Gives me: > > > > pipe.c:315:4: error: ?T_POP? undeclared (first use in this function) > > } T_POP; > > > > I tried T_END and I still get: > > > > pipe.c: In function ?backend_handle_mail?: > > pipe.c:314:2: error: label at end of compound statement > > out: > > ^ > > > > I got it to compile, see the attached. I don't really know C > ... > > out: > > - t_pop(); > > + ; > > + } T_END; > > That is the correct fix. C is quirky about labels, you can only label > statements, nothing else. As Timo mentioned, the t_push()/t_pop() > interface hasn't been the recommended interface since about 2008, > so this definitely is the correct way to go. Yeah, or we can just move the label outside the extra brace scope for the couple of places that's a problem here. > If upstream is out there somewhere, for your patch: > Acked-by: Phil Carmody I've added Johannes to the CC for this. Thanks! Ron From 24x7server at 24x7server.net Thu Oct 30 17:44:56 2014 From: 24x7server at 24x7server.net (Rajesh M.) Date: Thu, 30 Oct 2014 23:14:56 +0530 Subject: authentication issues with ipad / mac email client Message-ID: <3789F647E7E347C8B7BC96055B46FF6A.MAI@24x7server.net> hi we are using using qmail toaster with dovecot pop3 and imap client outlook and thunderbird works fine in case of several ipad / mac email clients imap works fine but pop3 logins are not working with 110 port my dovecot config file is given below could somebody help please # Settings for 'stock' qmail-toaster disable_plaintext_auth = no default_login_user = vpopmail mail_max_userip_connections = 50 service imap-login { service_count = 0 client_limit = 256 process_min_avail = 4 vsz_limit = 384M process_limit = 400 } auth_cache_size = 32M auth_cache_ttl = 1800 auth_cache_negative_ttl = 0 auth_mechanisms = plain login digest-md5 cram-md5 auth_username_format = %Lu first_valid_uid = 89 first_valid_gid = 89 log_path = /var/log/dovecot.log login_greeting = ready. mail_plugins = $mail_plugins quota plugin/quota = maildir protocols = imap pop3 ssl_cert = References: <3789F647E7E347C8B7BC96055B46FF6A.MAI@24x7server.net> Message-ID: <54527BF3.6090801@thelounge.net> Am 30.10.2014 um 18:44 schrieb Rajesh M.: > we are using using qmail toaster with dovecot pop3 and imap client > > outlook and thunderbird works fine > > in case of several ipad / mac email clients > imap works fine but pop3 logins are not working with 110 port you have "service imap-login", fine but where is "service pop3-login" i doubt that it has anything to do with mac clients, most likely POP3 don't work at all -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 181 bytes Desc: OpenPGP digital signature URL: From remko at FreeBSD.org Thu Oct 30 18:55:14 2014 From: remko at FreeBSD.org (Remko Lodder) Date: Thu, 30 Oct 2014 19:55:14 +0100 Subject: Question wrt. dovecot replicator In-Reply-To: <1414686673.7231.42.camel@jb1.mpifr-bonn.mpg.de> References: <542D1373.9050806@dovecot.fi> <5F20B8B3-0908-41C9-A1C4-1FC08265C503@FreeBSD.org> <1412945143.452.33.camel@jb1.mpifr-bonn.mpg.de> <1414686673.7231.42.camel@jb1.mpifr-bonn.mpg.de> Message-ID: <6632A93A-1C83-480E-B0B1-CBC788C30863@FreeBSD.org> > On 30 Oct 2014, at 17:31, Jan Behrend wrote: > > On Fri, 2014-10-10 at 14:45 +0200, Jan Behrend wrote: >> On Fri, 2014-10-03 at 23:37 +0200, Remko Lodder wrote: >>>>>> How can I determine why there are duplicated emails? >> >> Same problem here! >> >>>>>> What kind of messages should I specifically look for? >>>>> Look for any errors and warnings in the Dovecot log. You could also enable mail_debug (ref. >> >> >>>>>> Can I set this up for a few selected accounts instead of all accounts like it was currently? To make sure I do not make things worse for others then needs to be :-) >>>>>> The service had been disabled for the time being to prevent the other users from getting duplicated emails. >>>>> I do not know what kind of userdb you are running, but there is a newish patch that enables per user replication via the >>>>> mail_replica setting. It is not yet included in the newest (2.2.13) release of Dovecot, but is available via the enterprise >>>>> version. There are no FreeBSD builds for that, though. ref: http://hg.dovecot.org/dovecot-2.2/rev/c1c67bdc8752 >>>> >>>> my userdb consists of local users (Which are fed through LDAP at the backend). perhaps I can setup a mailAttributes setting or something so that the replica can be >>>> set, although I prefer that I have control over that in the config itself :-) >> >> With the latest Debian jessie version 1:2.2.13-5 you can actually have a >> per user mail_replica setting taken from a (LDAP) directory. This keeps >> the duplicate mail issue away from other users but a few willing to >> test ... >> >>> For what it?s worth: >>> >>> replication_dsync_parameters = -f -d -N -l 30 -U >> >> I read in Peer Heinlein's Dovecot book >> http://www.opensourcepress.de/de/produkte/Dovecot/13560/978-3-95539-074-7 >> that replicating a public namespace gives you trouble :-(. So keep the >> "-N" option away for now. >> >> However I would like examples for the "-n" and "-x" options, which are >> neither given in the wiki nor in the nonexistant man page. >> >> I think the replication feature is very, very cool, but right now it >> gives me a hard time to implement flawlessly ;-) >> >> Thanks for any help or light shed on this issue ... > > Found it ;-) > > http://wiki2.dovecot.org/Tools/Doveadm/Sync > > All working beautifully now! For what it?s worth it is working fine here with debugging enabled. I will upgrade to 2.2.15 and keep testing that to see how that works. Thanks for the help and suggestions so far! Remko > > Cheers Jan > > -- > MAX-PLANCK-INSTITUT fuer Radioastronomie > Jan Behrend - Rechenzentrum > ---------------------------------------- > Auf dem Huegel 69, D-53121 Bonn > Tel: +49 (228) 525 359, Fax: +49 (228) 525 229 > jbehrend at mpifr-bonn.mpg.de http://www.mpifr-bonn.mpg.de > > From stephan at rename-it.nl Thu Oct 30 22:42:50 2014 From: stephan at rename-it.nl (Stephan Bosch) Date: Thu, 30 Oct 2014 23:42:50 +0100 Subject: Released Pigeonhole v0.4.5 for Dovecot v2.2.15. Message-ID: <5452BEEA.8000105@rename-it.nl> Hello Dovecot users, Unfortunately, Pigeonhole v0.4.4 had a rather big issue with error handling and the execution of the implicit keep. This problem presented itself for example when users exceeded their quota. This did not result in the proper rejection message. This is why I quickly release a new version. Changelog v0.4.5: + Added a Pigeonhole version banner to doveconf output. This way, future bug reports will also include Pigeonhole version information. - Fixed handling of implicit keep. Last version erroneously reported that implicit keep succeeded after an earlier failure, while it in fact had failed. Particularly occurred for mailbox quota errors. - Fixed segfault occurring on SunOS systems when there is no active script. The release is available as follows: http://pigeonhole.dovecot.org/releases/2.2/dovecot-2.2-pigeonhole-0.4.5.tar.gz http://pigeonhole.dovecot.org/releases/2.2/dovecot-2.2-pigeonhole-0.4.5.tar.gz.sig Refer to http://pigeonhole.dovecot.org and the Dovecot v2.x wiki for more information. Have fun testing this new release and don't hesitate to notify me when there are any problems. Regards, -- Stephan Bosch stephan at rename-it.nl From user+dovecot at localhost.localdomain.org Thu Oct 30 23:36:51 2014 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Thu, 30 Oct 2014 23:36:51 +0000 Subject: Released Pigeonhole v0.4.5 for Dovecot v2.2.15. In-Reply-To: <5452BEEA.8000105@rename-it.nl> References: <5452BEEA.8000105@rename-it.nl> Message-ID: <5452CB93.8000003@localhost.localdomain.org> On 10/30/2014 10:42 PM, Stephan Bosch wrote: > ? > The release is available as follows: > > http://pigeonhole.dovecot.org/releases/2.2/dovecot-2.2-pigeonhole-0.4.5.tar.gz > http://pigeonhole.dovecot.org/releases/2.2/dovecot-2.2-pigeonhole-0.4.5.tar.gz.sig > > Refer to http://pigeonhole.dovecot.org and the Dovecot v2.x wiki for > more information. Have fun testing this new release and don't hesitate > to notify me when there are any problems. Hi Stephan, I guess there is a problem: In file included from ../../../../src/lib-sieve/sieve-common.h:9:0, from sieve-file-script-sequence.c:9: ../../../../src/lib-sieve/sieve-config.h:8:32: fatal error: pigeonhole-version.h: No such file or directory #include "pigeonhole-version.h" ^ compilation terminated. In file included from ../../../../src/lib-sieve/sieve-common.h:9:0, from ../../../../src/lib-sieve/sieve-binary.h:9, from sieve-file-script.c:10: ../../../../src/lib-sieve/sieve-config.h:8:32: fatal error: pigeonhole-version.h: No such file or directory #include "pigeonhole-version.h" ^ compilation terminated. In file included from ../../../../src/lib-sieve/sieve.h:10:0, from sieve-file-storage.h:10, from sieve-file-storage-save.c:14: ../../../../src/lib-sieve/sieve-config.h:8:32: fatal error: pigeonhole-version.h: No such file or directory #include "pigeonhole-version.h" ^ compilation terminated. In file included from ../../../../src/lib-sieve/sieve.h:10:0, from sieve-file-storage.h:10, from sieve-file-storage-active.c:10: ../../../../src/lib-sieve/sieve-config.h:8:32: fatal error: pigeonhole-version.h: No such file or directory #include "pigeonhole-version.h" ^ compilation terminated. make[5]: *** [sieve-file-script-sequence.lo] Error 1 make[5]: *** Waiting for unfinished jobs.... make[5]: *** [sieve-file-script.lo] Error 1 make[5]: *** [sieve-file-storage-save.lo] Error 1 make[5]: *** [sieve-file-storage-active.lo] Error 1 make[4]: *** [all-recursive] Error 1 make[3]: *** [all-recursive] Error 1 make[2]: *** [all-recursive] Error 1 make[1]: *** [all-recursive] Error 1 make: *** [all] Error 2 ,--[ config.log ]-- | $ ./configure --prefix=/usr/local --build=x86_64-linux-gnu --host=x86_64-linux-gnu --with-dovecot=../dovecot-2.2 --with-managesieve --without-docs | ? | hostname = el-tio | uname -m = x86_64 | uname -r = 3.16-2-amd64 | uname -s = Linux | uname -v = #1 SMP Debian 3.16.3-2 (2014-09-20) `-- ,--[ Makefile ]-- | CC = x86_64-linux-gnu-gcc-4.8 | CCDEPMODE = depmode=gcc3 | CFLAGS = -std=gnu99 -O0 -g3 -ggdb3 -pipe -Wextra -Wunused -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict-aliasing=2 -I$(top_srcdir) | CPP = x86_64-linux-gnu-cpp-4.8 `-- Regards, Pascal -- The trapper recommends today: c01dcofe.1430400 at localdomain.org From stephan at rename-it.nl Fri Oct 31 01:30:33 2014 From: stephan at rename-it.nl (Stephan Bosch) Date: Fri, 31 Oct 2014 02:30:33 +0100 Subject: Released Pigeonhole v0.4.5 for Dovecot v2.2.15. In-Reply-To: <5452CB93.8000003@localhost.localdomain.org> References: <5452BEEA.8000105@rename-it.nl> <5452CB93.8000003@localhost.localdomain.org> Message-ID: <5452E639.80307@rename-it.nl> On 10/31/2014 12:36 AM, Pascal Volk wrote: > On 10/30/2014 10:42 PM, Stephan Bosch wrote: >> ? >> The release is available as follows: >> >> http://pigeonhole.dovecot.org/releases/2.2/dovecot-2.2-pigeonhole-0.4.5.tar.gz >> http://pigeonhole.dovecot.org/releases/2.2/dovecot-2.2-pigeonhole-0.4.5.tar.gz.sig >> >> Refer to http://pigeonhole.dovecot.org and the Dovecot v2.x wiki for >> more information. Have fun testing this new release and don't hesitate >> to notify me when there are any problems. > Hi Stephan, > > I guess there is a problem: This solves it: http://hg.rename-it.nl/dovecot-2.2-pigeonhole/rev/3e924b1b6c5c Wonder if this is bad enough for yet another release. Not a good day. :/ Regards, Stephan. From tss at iki.fi Fri Oct 31 06:33:34 2014 From: tss at iki.fi (Timo Sirainen) Date: Thu, 30 Oct 2014 23:33:34 -0700 Subject: vpopmail, open_smtp_relay and non-PLAIN auth mechs In-Reply-To: References: Message-ID: <1275EAF4-C497-459C-9DFB-F352457D7757@iki.fi> On 30 Oct 2014, at 05:50, Jim Jagielski wrote: > I've noticed that if using the vpopmail auth setup, that the roaming-user > functionality > provided via open_smtp_relay() is only done if the auth mechanism is PLAIN. > For > example, if the client authenticates via DIGEST-MD5, the open relay file is > not updated, as it should be. > > This is due to the call to open_smtp_relay only being done > via vpopmail_verify_plain(). > Instead, imo, that call should be done in auth_request_success() in the > auth-request.c > file, so that it is done however the authentication is done, as long as it > is successful. > > Attached is a patch for 2.2.15. Let me know if attachments are not the > preferred method > and I'll cut/paste. Well, your method works, and I'm not sure if there's really any other way to do it currently.. But I really don't want any vpopmail code outside *db-vpopmail.c, so I think if people want to do this they'll need to patch. And why are people still using pop3/imap-before-smtp instead of SMTP auth that everything supports nowadays? (And in general nowadays I think vpopmail should have been an external plugin since the beginning, but too much trouble for everybody to change it now.) From skdovecot at smail.inf.fh-brs.de Fri Oct 31 07:11:24 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Fri, 31 Oct 2014 08:11:24 +0100 (CET) Subject: Can someone explain this Sent thread sorting? In-Reply-To: <7878ec1d673909fa2afeb3fd8752a17c@localhost> References: <7878ec1d673909fa2afeb3fd8752a17c@localhost> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Tue, 28 Oct 2014, Philip Rhoades wrote: > I attach a screen capture of my RoundCubeMail Sent box - why does the second > item on the list, which is a separate reply to the thread above it, get > sorted to position 2? By the date, and being a single mail, it should be > much further down the screen . . I presume it is because the Subject is the > same? Threading bases on Message-ID, References and In-Reply-To headers. What are they of the messages with similiar looking subject? Of course, some MUAs may take the subject into account, too. Second, you should verify, if Roundcube uses Dovecot for threading. If not, you should ask on a Roundcube list. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBVFM2HHz1H7kL/d9rAQKEwwf+Lt+HY5QpV9zZUOD9lnTvw6MOcQt0pDZ8 CaKHfPX7b9Jth2nfHNyylMG5s8mkmahml9nUZyQIUyS/o1ExeAYQh2avgsG73x4T CIZ74D1jChYwgGZn9icYoI2WixQxWM80B9SilDXigAWoNh47sn3loEWYUyyPewv4 n54uV9nhcpAVuU7PI7JXphPlKhdfaCFVMLxXm74mW91ZaqfL7LHRT75VVCrHS6nh eIC1jV2BuiLNn0vClLk7b796iSNr0YmtGVeciH7trQfQHlEMm6Qkdg/XNSRykXgX iXnZNfsUG3lPOqtCOrgsxxZ7Gx+BYZGwsBymwBYsVz8EeNEKToZ07A== =Yzhi -----END PGP SIGNATURE----- From jimjag at gmail.com Fri Oct 31 10:04:43 2014 From: jimjag at gmail.com (Jim Jagielski) Date: Fri, 31 Oct 2014 06:04:43 -0400 Subject: vpopmail, open_smtp_relay and non-PLAIN auth mechs In-Reply-To: <1275EAF4-C497-459C-9DFB-F352457D7757@iki.fi> References: <1275EAF4-C497-459C-9DFB-F352457D7757@iki.fi> Message-ID: Agreed... Ideally, there would be some sort of post-auth-verified callback that mechanisms could register; that would completely compartmentalize these sorts of things. -- Jim Jagielski On Fri, Oct 31, 2014 at 2:33 AM, Timo Sirainen wrote: > On 30 Oct 2014, at 05:50, Jim Jagielski wrote: > > > I've noticed that if using the vpopmail auth setup, that the roaming-user > > functionality > > provided via open_smtp_relay() is only done if the auth mechanism is > PLAIN. > > For > > example, if the client authenticates via DIGEST-MD5, the open relay file > is > > not updated, as it should be. > > > > This is due to the call to open_smtp_relay only being done > > via vpopmail_verify_plain(). > > Instead, imo, that call should be done in auth_request_success() in the > > auth-request.c > > file, so that it is done however the authentication is done, as long as > it > > is successful. > > > > Attached is a patch for 2.2.15. Let me know if attachments are not the > > preferred method > > and I'll cut/paste. > > Well, your method works, and I'm not sure if there's really any other way > to do it currently.. But I really don't want any vpopmail code outside > *db-vpopmail.c, so I think if people want to do this they'll need to patch. > And why are people still using pop3/imap-before-smtp instead of SMTP auth > that everything supports nowadays? (And in general nowadays I think > vpopmail should have been an external plugin since the beginning, but too > much trouble for everybody to change it now.) > From tlx at leuxner.net Fri Oct 31 10:13:29 2014 From: tlx at leuxner.net (Thomas Leuxner) Date: Fri, 31 Oct 2014 11:13:29 +0100 Subject: Corrupted SSL parameters file in state_dir with HG 267bca7a62fb Message-ID: <20141031101329.GA35348@nihlus.leuxner.net> Hi, with the latest HG 267bca7a62fb the following error started to appear in the logs: Oct 31 09:39:07 nihlus dovecot: master: Dovecot v2.2.15 (267bca7a62fb) starting up for imap, lmtp [...] Oct 31 10:10:52 nihlus dovecot: lmtp(20876): Error: Corrupted SSL parameters file in state_dir: ssl-parameters.dat - disabling SSL 360 Oct 31 10:10:52 nihlus dovecot: lmtp(20876): Error: Couldn't initialize SSL parameters, disabling SSL Oct 31 10:10:52 nihlus dovecot: lmtp(20876): Connect from local This most likely has been introduced with a commit after the previous build installed (aa5dde56424f). I did not find options to disable SSL for LMTP either, as in my setup I'm using a UNIX socket. Regards Thomas -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 198 bytes Desc: Digital signature URL: From tim at bastelfreak.de Fri Oct 31 10:47:51 2014 From: tim at bastelfreak.de (Tim) Date: Fri, 31 Oct 2014 11:47:51 +0100 Subject: Corrupted index cache after migrating from maildir to mdbox In-Reply-To: <543B8B54.8060707@bastelfreak.de> References: <54275AD9.2080900@bastelfreak.de> <542A5626.9090001@bastelfreak.de> <542A76BD.7010409@solu.fi> <542AB304.8030208@bastelfreak.de> <5439DB87.7060206@bastelfreak.de> <40C363C8-FADD-4A89-95C7-C39EA2300FAD@posteo.de> <543B0630.3010203@bastelfreak.de> <04A36D03-B15E-425E-9DDD-C3E04844519D@posteo.de> <543B8B54.8060707@bastelfreak.de> Message-ID: <545368D7.3060509@bastelfreak.de> Hey guys, I'm still getting theses errors while fetching mails via imap: Error: read(/home/vmail/.../mdbox/storage/m.7): FETCH BODY[] for mailbox INBOX UID 1823 got too little data: 284572 vs 47173 Error: Corrupted index cache file /home/vmail/.../mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: Broken virtual size for mail UID 1823 I tried to export them with doveadm fetch. this works fine and doesnt create any errors at all at the loge file. Any further toughts here? Timo maybe? On 13.10.2014 10:20, Tim wrote: > all mails are stored on an xfs filesystem and only the local dovecot > accesses it. Possible to fix the index.cache files? I havn't found > anything suitable in the docs. The doveadm-index commands are only for > the fts plugin I think. > > > On 13.10.2014 02:37, Daniel Parthey wrote: >> Maybe the index is corrupted too and the index.cache is a cached version of the corrupted index? >> >> Are you using NFS with mdbox and accessing one nfs mailbox directory concurrently from several dovecot hosts? >> From kop at meme.com Fri Oct 31 11:58:18 2014 From: kop at meme.com (Karl O. Pinc) Date: Fri, 31 Oct 2014 06:58:18 -0500 Subject: Corrupted index cache after migrating from maildir to mdbox In-Reply-To: <545368D7.3060509@bastelfreak.de> (from tim@bastelfreak.de on Fri Oct 31 05:47:51 2014) Message-ID: <1414756698.6545.3@slate> I was poking around in the code and I think there's only 1 last_indexed_uid in the data structure. I have no clue if this value is used outside of fts but you could poke it with a stick and try the doveadm fts rescan command to reset this to 0. (Sorry if you tried this already. I recently signed up on the list.) I'm seeing last_indexed_uid set to the wrong value (v2.2.9, Subject: Bug in fts (solr?, Maildir?) incorrect last_indexed_uid) in some cases. Your error feels like the same kind of thing. On 10/31/2014 05:47:51 AM, Tim wrote: > Hey guys, > > I'm still getting theses errors while fetching mails via imap: > Error: read(/home/vmail/.../mdbox/storage/m.7): FETCH BODY[] for > mailbox > INBOX UID 1823 got too little data: 284572 vs 47173 > Error: Corrupted index cache file > /home/vmail/.../mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: > Broken virtual size for mail UID 1823 > > I tried to export them with doveadm fetch. this works fine and doesnt > create any errors at all at the loge file. Any further toughts here? > Timo maybe? > > On 13.10.2014 10:20, Tim wrote: > > all mails are stored on an xfs filesystem and only the local > dovecot > > accesses it. Possible to fix the index.cache files? I havn't found > > anything suitable in the docs. The doveadm-index commands are only > for > > the fts plugin I think. > > > > > > On 13.10.2014 02:37, Daniel Parthey wrote: > >> Maybe the index is corrupted too and the index.cache is a cached > version of the corrupted index? > >> > >> Are you using NFS with mdbox and accessing one nfs mailbox > directory concurrently from several dovecot hosts? > >> > > Karl Free Software: "You don't pay back, you pay forward." -- Robert A. Heinlein From teemu.huovila at dovecot.fi Fri Oct 31 14:51:14 2014 From: teemu.huovila at dovecot.fi (Teemu Huovila) Date: Fri, 31 Oct 2014 16:51:14 +0200 Subject: Corrupted SSL parameters file in state_dir with HG 267bca7a62fb In-Reply-To: <20141031101329.GA35348@nihlus.leuxner.net> References: <20141031101329.GA35348@nihlus.leuxner.net> Message-ID: <5453A1E2.3020602@dovecot.fi> On 10/31/2014 12:13 PM, Thomas Leuxner wrote: > Hi, > > with the latest HG 267bca7a62fb the following error started to appear in the logs: > > Oct 31 09:39:07 nihlus dovecot: master: Dovecot v2.2.15 (267bca7a62fb) starting up for imap, lmtp > [...] > Oct 31 10:10:52 nihlus dovecot: lmtp(20876): Error: Corrupted SSL parameters file in state_dir: ssl-parameters.dat - disabling SSL 360 > Oct 31 10:10:52 nihlus dovecot: lmtp(20876): Error: Couldn't initialize SSL parameters, disabling SSL > Oct 31 10:10:52 nihlus dovecot: lmtp(20876): Connect from local > > This most likely has been introduced with a commit after the previous build installed (aa5dde56424f). I did not find options to disable SSL for LMTP either, as in my setup I'm using a UNIX socket. There seems to be an issue with setting a non-default, e.g. 2048, value for ssl_dh_parameters_length. A work around is to revert to the default 1024. Teemu From h.reindl at thelounge.net Fri Oct 31 15:17:03 2014 From: h.reindl at thelounge.net (Reindl Harald) Date: Fri, 31 Oct 2014 16:17:03 +0100 Subject: Corrupted SSL parameters file in state_dir with HG 267bca7a62fb In-Reply-To: <5453A1E2.3020602@dovecot.fi> References: <20141031101329.GA35348@nihlus.leuxner.net> <5453A1E2.3020602@dovecot.fi> Message-ID: <5453A7EF.2030701@thelounge.net> Am 31.10.2014 um 15:51 schrieb Teemu Huovila: > On 10/31/2014 12:13 PM, Thomas Leuxner wrote: >> with the latest HG 267bca7a62fb the following error started to appear in the logs: >> >> Oct 31 09:39:07 nihlus dovecot: master: Dovecot v2.2.15 (267bca7a62fb) starting up for imap, lmtp >> [...] >> Oct 31 10:10:52 nihlus dovecot: lmtp(20876): Error: Corrupted SSL parameters file in state_dir: ssl-parameters.dat - disabling SSL 360 >> Oct 31 10:10:52 nihlus dovecot: lmtp(20876): Error: Couldn't initialize SSL parameters, disabling SSL >> Oct 31 10:10:52 nihlus dovecot: lmtp(20876): Connect from local >> >> This most likely has been introduced with a commit after the previous build installed (aa5dde56424f). I did not find options to disable SSL for LMTP either, as in my setup I'm using a UNIX socket. > There seems to be an issue with setting a non-default, e.g. 2048, value for ssl_dh_parameters_length. A work around is to revert > to the default 1024 what is a joke these days - what is "non-default" in case of 2048? frankly you need at least 3072 for AES128 and 2048 *is default* go out and by a 1024 bit certificate - you won't get it the days of 1024 in context of encryption are gone * httpd can deal for a long time with larger keys and dh-params * openvpn the same Thu Oct 30 16:11:12 2014 Diffie-Hellman initialized with 4096 bit key Thu Oct 30 15:11:24 2014 62.178.103.85:59278 Control Channel: TLSv1, cipher TLSv1/SSLv3 DHE-RSA-AES256-SHA, 4096 bit RSA Thu Oct 30 16:11:24 2014 client/62.178.103.85:59278 Control Channel: TLSv1, cipher TLSv1/SSLv3 DHE-RSA-AES256-SHA, 4096 bit RSA Thu Oct 30 17:11:25 2014 client/62.178.103.85:59278 Control Channel: TLSv1, cipher TLSv1/SSLv3 DHE-RSA-AES256-SHA, 4096 bit RSA -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 181 bytes Desc: OpenPGP digital signature URL: From Kind at adm.uib.no Fri Oct 31 19:02:16 2014 From: Kind at adm.uib.no (Hans Morten Kind) Date: Fri, 31 Oct 2014 20:02:16 +0100 Subject: SSLv3 attack on pop3? Message-ID: <20141031190216.GA2856@alf.uib.no> We turned off SSLv3 support on our pop/imap running dovecot on Oct 16th, we did check that all users where using TLSv1 and there have been no complaints (except one old windows-phone). But at 13:00 UTC today, suddenly strange entries is seen in the logfile: Error: SSL: Stacked error: error:140943F2:SSL routines:SSL3_READ_BYTES:sslv3 alert unexpected message: SSL alert number 10 Followed by: pop3-login: Disconnected (no auth attempts in 2 secs) user=<>, rip= Some 20 ips have been seen so far, all ips are uniq and none have used our server lately. Just one resoved and it's name ends .cn, some lookups with whois leads to the same origin for all. This makes me anxious that some have made some poodle-like thing for pop3? hmk From CMarcus at Media-Brokers.com Fri Oct 31 19:47:33 2014 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Fri, 31 Oct 2014 15:47:33 -0400 Subject: SSLv3 attack on pop3? In-Reply-To: <20141031190216.GA2856@alf.uib.no> References: <20141031190216.GA2856@alf.uib.no> Message-ID: <5453E755.4040701@Media-Brokers.com> On 10/31/2014 3:02 PM, Hans Morten Kind wrote: > We turned off SSLv3 support on our pop/imap running dovecot on Oct 16th, > we did check that all users where using TLSv1 and there have been no > complaints (except one old windows-phone). > > But at 13:00 UTC today, suddenly strange entries is seen in the logfile: > Error: SSL: Stacked error: error:140943F2:SSL routines:SSL3_READ_BYTES:sslv3 > alert unexpected message: SSL alert number 10 > > Followed by: > pop3-login: Disconnected (no auth attempts in 2 secs) user=<>, rip= > > Some 20 ips have been seen so far, all ips are uniq and none have used our > server lately. Just one resoved and it's name ends .cn, some lookups with whois > leads to the same origin for all. > > This makes me anxious that some have made some poodle-like thing for pop3? Can you show full log entries? From Kind at adm.uib.no Fri Oct 31 20:12:09 2014 From: Kind at adm.uib.no (Hans Morten Kind) Date: Fri, 31 Oct 2014 21:12:09 +0100 Subject: SSLv3 attack on pop3? In-Reply-To: <5453E755.4040701@Media-Brokers.com> References: <20141031190216.GA2856@alf.uib.no> <5453E755.4040701@Media-Brokers.com> Message-ID: <20141031201209.GC2856@alf.uib.no> On Fri, Oct 31, 2014 at 03:47:33PM -0400, Charles Marcus wrote: > On 10/31/2014 3:02 PM, Hans Morten Kind wrote: > > This makes me anxious that some have made some poodle-like thing for pop3? > > Can you show full log entries? There is much more to show, but have a peek on port 995 with https://isc.sans.edu/port.html The boost seems to have passed hmk