- dovecot - dovecot.org

NFSv4 delegation
by brd 18 Aug '15

18 Aug '15

hi all, i'm managing a large installation of a dovecot cluster in director + NFS backend architecture and we are moving from NFSv3 to NFSv4. Our NFS server is a Netapp in clustered mode and reading technical specs of NFSv4 delegation feature it seems that enabling delegation in this type of dovecot architecture should bring great benefits: only one backend server access a specific mailbox at a time (even deliveries are managed by director hashing via LMTP) so the getattr rpc calls should decrease significantly while the risk of conflicting delegations is very low (impacting negatively on the benefits obtainable). Can anyone confirm this hypothesis? I've heard that the linux implementation of NFSv4 delegation is mature only for read delegation (and not yet for write delegation): is this true? And, if true, could this fact limit the benefits of activating NFS delegation feature? Best regards -brd

4 11

pop3-login: Disconnected (tried to use disallowed plaintext auth)
by Benjamin Cimerman 18 Aug '15

18 Aug '15

Hi I have problem with dovecot 2.2.10 - plaintext auth without SSL is not working. I'm upgrading old server and want that settings "stay same" as on old server. SSL has to be optional. /var/log/maillog *pop3-login: Disconnected (tried to use disallowed plaintext auth): user=<>, rip=_._._._, lip=_._._._, session=<cxPkm4Ud5gBb7YZ/>* my settings: [root@mail dovecot]# grep ssl * -R -n *conf.d/10-ssl.conf:8:ssl = yes* *conf.d/10-ssl.conf:40:ssl_verify_client_cert = no* *conf.d/10-auth.conf:90:auth_ssl_require_client_cert = no* *dovecot.conf:7:ssl = yes* [root@mail dovecot]# grep plain * -R -n *conf.d/10-auth.conf:11:disable_plaintext_auth = no* *conf.d/10-auth.conf:101:auth_mechanisms = plain login* Thanx you for any help.

1 0

Segfaults after upgrade to Debian Jessie
by Andrew Beverley 18 Aug '15

18 Aug '15

Hi, I've just upgrade from Debian Wheezy to Debian Jessie and am getting: Fatal: master: service(lmtp): child 6761 killed with signal 11 (core dumped) It seems to be something to do with sieve. When I disable that from lmtp then everything works fine. OS: Debian Jessie Dovecot version: 2.2.13 CPU: x86 This is the gdb output: Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". Core was generated by `dovecot/lmtp'. Program terminated with signal SIGSEGV, Segmentation fault. #0 0x00007f8e4c94f626 in sieve_validator_register_command () from /usr/lib/dovecot/libdovecot-sieve.so.0 And dovecot -n # 2.2.13: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 8.1 ext3 auth_mechanisms = plain login dict { sieve = mysql:/etc/dovecot/pigeonhole-sieve.dict } mail_location = maildir:/var/mail/vhosts/%d/%n mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave vnd.dovecot.extdata namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { sieve = dict:proxy::sieve;name=active sieve_dir = ~/sieve sieve_extdata_dict_uri = proxy::sieve sieve_plugins = sieve_extdata } protocols = " imap lmtp sieve" service auth-worker { user = vmail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { mode = 0600 user = vmail } user = dovecot } service dict { unix_listener dict { mode = 0600 user = vmail } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } ssl = required ssl_cert = </etc/ssl/certs/ctrlo.com.pem ssl_key = </etc/ssl/private/ctrlo.com.key userdb { driver = passwd } userdb { args = uid=vmail gid=vmail home=/var/mail/vhosts/%d/%n driver = static } protocol imap { mail_max_userip_connections = 20 } Any ideas? Thanks, Andy

2 16

multiple messages per second to a single mailbox
by Chad M Stewart 18 Aug '15

18 Aug '15

Dovecot 2.2.18 on CentOS 6 I have a pair of servers setup with MySQL, Postfix, and Dovecot. Replication is setup and working between the two dovecot instances. The problem I'm running into is that a single mailbox receives a lot of messages, at times the rate is multiple messages per second. Delivery from Postfix to Dovecot is via tcp based LMTP. When I do 'ps -aef|grep lmtp|wc -l' I get 62 and does not appear to go higher than that. At the moment I have 4500 and 8300 messages queued on two Postfix instances waiting to deliver via LMTP to the same dovecot instance. Deliveries only happen via LMTP and only one of the two nodes actually gets the deliveries. What I'm seeing is very high load on the system (40) and queues building on the Postfix side. Replication is keeping up. Looking at the logs now I see anywhere from 4-7 messages per second delivered to this single mailbox. I would like to increase that rate a lot. These machines are VMs hosted on Xenserver 6.x. I have them setup with 8 vCPUs (2 sockets with 4 cores per socket), the dom0 machines have dual HBA connectors back to a SAN and have 128 CPUs and 256GB of RAM and are not taxed. I added a 2nd virtual disk that is used for storing mailbox data. It is ext4 and has noatime set during mount. /var is also mounted with noatime. The performance graphs in XenCenter show nearly all 8 vCPUs at about 50%, and the writes on the mailbox data disk are about 20%. iostat is showing mostly <5 for await times for the disks, though I do see a 10 now and again. I'm guessing that maybe I'm hitting a mailbox locking issue and not sure how to reduce the contention and thereby increase the delivery rate to this mailbox. -Chad

5 12

Syncing two mail servers?
by Knute Johnson 17 Aug '15

17 Aug '15

I currently have a mail server using Dovecot and sendmail. I was thinking I would like to have a backup of my mail and an additional server in case of hardware failure. Is it possible to run two identical or nearly identical server setups and sync the mail files between them? If it is possible, in general terms how would one go about this? Thanks, -- Knute Johnson

2 2

Re: Duplicate mails with pop3 + dsync replication
by Nikolaos Milas 17 Aug '15

17 Aug '15

On 17/8/2015 2:29 μμ, Wolfgang Hennerbichler wrote: >> I was wondering if the same behavior persists with latest version(s), for example 2.2.18. > I don’t know, I have to deal with the packages that come with my distribution’s repository. > >> >If so, how do you overcome this issue? What is the suggested practice? > All I can say is that it works for me with the above setting and a cron-job that runs every minute which expunges mails for the pop3 users. > Thank you for your reply. I am on CentOS 5 and 6, but I am building RPMs for our test and production servers. I recently built v2.2.18 and I decided to give it a try. (I run it with postfix - also just upgraded to 2.11.6.) The issue seems to not occur any more. I had already tested on two test servers, and I hoped someone could provide independent feedback before I decided to upgrade production servers. However, I now also upgraded our two production servers and things seem to be running smoothly. All the best, Nick

1 0

sieve-filter failure problems
by Jost Krieger 17 Aug '15

17 Aug '15

I use sieve-filter for postprocessing misclassified mail. For false positives I use the following script: require [ "variables", "include", "fileinto" ]; global [ "FORCENOSPAM", "ext", "ext1" ]; set "FORCENOSPAM" "YES"; fileinto "JUNK-PRENOUCE"; if header :matches "Delivered-To" "*+*@*" { set "ext" "${2}"; set "ext1" "${2}"; } include :personal "production"; FORCENOSPAM suppresses the spam handling and the Delivered-To stuff tries to regenerate envelope info. This is my crontab entry: 1-57/4 * * * * cd ~kriegjcb; /usr/local/dovecot/bin/sieve-filter -v -e -W -u kriegjcb -m Spam/U0-failed ~kriegjcb/sieve/nospamfilter.sieve Spam/U0 Most things work fine, but a few of my rules will try to forward mail. This will fail and my idea was I handle this manually from the folder Spam/U0-failed. Unfortunately the mail will arrive there but will also be left in the source folder Spam/U0 and will be processed again every 4 minutes ... This is probably not intentional? Yours Jost Krieger -- | Jost.Krieger+sig(a)ruhr-uni-bochum.de Please help stamp out spam! | | Postmaster, JAPH, resident answer machine at RUB Comp. Center | | Sincere words are not sweet, sweet words are not sincere. | | Lao Tse, Tao Te King 81 |

2 2

Duplicate mails with pop3 + dsync replication
by Wolfgang Hennerbichler 17 Aug '15

17 Aug '15

Hi, When I enable (and it only happens when it is actually running) replication over TCP my users get duplicate mails via pop3. Here’s what happens: * User gets mail * Mail appears in (Maildir) new/ folder on both replicas * user retrieves mail (retr), calls dele. Mail still exists in new/ folder on both replicas. * user runs retr (and gets the duplicate) and dele a second time, the mail is actually removed. If I disable replication this behaviour goes away. I use dovecot from debian stable resources. Any help would _really_ be appreciated. I found one german thread that dealt with the same problem, but no solution for it (http://www.dovecot-buch.de/mailingliste/pop3-fehler-bei-delete-und-dsync-re…) wogri # dovecot --version 2.2.13 # dovecot -n # 2.2.13: /etc/dovecot/dovecot.conf # OS: Linux 3.16.0-4-amd64 x86_64 Debian 8.0 ext4 auth_verbose = yes doveadm_password = XXX first_valid_gid = 113 first_valid_uid = 108 last_valid_gid = 113 last_valid_uid = 108 mail_gid = dovecot mail_location = maildir:/var/mail/%n mail_plugins = quota fts fts_lucene virtual notify replication mail_temp_dir = /var/lib/dovecot/tmp mail_uid = dovecot namespace { list = children location = virtual:/var/mail/%n/virtual prefix = virtual. separator = . } namespace inbox { inbox = yes list = yes location = mailbox "Deleted Messages" { auto = subscribe special_use = \Trash } mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { auto = no special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } [48/4646] mailbox Trash { special_use = \Trash } prefix = separator = . subscriptions = yes type = private } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { default_language = de fts = lucene fts_lucene = whitespace_chars=@. mail_replica = tcp:172.16.1.1:12345 quota = maildir:User quota quota_rule = *:storage=4G quota_rule2 = Trash:storage=+100M quota_rule3 = Spam:ignore quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = /etc/sieve/%n.sieve sieve_default = /etc/sieve/default.sieve sieve_dir = ~/sieve sieve_extensions = +editheader } postmaster_address = postmaster(a)wogri.at protocols = " imap lmtp pop3" service aggregator { fifo_listener replication-notify-fifo { user = dovecot } unix_listener replication-notify { user = dovecot } } service doveadm { inet_listener { port = 12345 } } service imap { process_limit = 1024 } } service lmtp { inet_listener lmtp { address = 127.0.0.1 port = 2003 } user = dovecot } service managesieve-login { inet_listener sieve { port = 4190 } service_count = 1 } service pop3 { process_limit = 1024 } service quota-warning { executable = script /usr/local/sbin/quota-warning.sh unix_listener quota-warning { user = dovecot } user = dovecot } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0600 } } ssl = required ssl_cert = </etc/exim4/server.cert.pem ssl_key = </etc/exim4/server.key.pem userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } protocol lmtp { mail_plugins = quota sieve virtual notify replication } protocol lda { mail_plugins = quota fts fts_lucene virtual notify replication sieve } protocol imap { mail_max_userip_connections = 50 mail_plugins = quota fts fts_lucene virtual notify replication imap_quota }

2 3

sieve and antispam
by Andrew McN 17 Aug '15

17 Aug '15

I have a fairly standard antispam/dspam setup: postfix delivers to dspam, which classifies and tags the mail, and then passes it to postfix which uses sieve to put mail into the appropriate folders based on dspam's classification. I also have the antispam plugin watching mail being moved between folders and re-training dpsam accordingly. If I now add some sieve filter rules which put incoming mail into appropriate folders, possibly overriding what would normally result from dspam's classification, will that be seen by the antispam plugin and used for training dspam? Regards, Andrew McNaughton

2 1

Re: Multidomain / IP Address Setup (Dovevot 2.2.10 on CentOS7 ) is failing: Fatal: Couldn't parse private ssl_key: error:0906D06C:PEM
by Christian Kivalo 16 Aug '15

16 Aug '15

>But can you explain why you use globally: > >ssl_cert = </etc/ssl/dovecot.pem >ssl_key = </etc/ssl/private/dovecot.pem > >and certs for any additional Domain each? > >## >local_name mail.pettijohn-web.com { > ssl_cert = </etc/ssl/mail.pettijohn-web.com.crt > ssl_key = </etc/ssl/private/mail.pettijohn-web.com.key >} >## he configured the top level "default" ssl_{cert,key} as requested by the documentation i may quote myself >from the dovecot ssl wiki page http://wiki2.dovecot.org/SSL/DovecotConfiguration >Multiple SSL certificates >Different certificates per IP and protocol > >[snip] > >Note that you will still need a top-level "default" ssl_key and ssl_cert as well, or you will receive errors. i think, but untested, this default ssl_{cert,key} are used for those clients that don't support SNI (as with apache, which uses the cert of the first site). >I configured it the way you do, but within the default >/etc/dovecot/confd structure but >i had no luck. I testet local_name (SNI), local, local <IPv6> >(dedicated >IPv6 Address but had no lock it should make no difference whether you use one large config file or the conf.d structure. your doveconf -n output would really be helpful regards - c >Configinfo: >1) MTA (Postfix 2.10.1) and MDA (Dovecot 2.2.10) configured on IPv6 >Addresses >2) The MTA and MDA are connected to MariaDB (the default MySQL >replacement on CentOS7 now for virtual domains, users, passwords, >aliaes ect >3) Postfix uses Dovecots SASL Implementation and Postfix and Dovecot >talking via LMTP and UNIX Sockets. > >Details: >### yum info postfix ### >Name : postfix >Arch : x86_64 >Epoche : 2 >Version : 2.10.1 >Release : 6.el7 >Size : 12 M >From : installed > From Source : debian.n-ix.net_centos_7_os_x86_64_ >Summary : Postfix Mail Transport Agent >URL : http://www.postfix.org >License : IBM and GPLv2+ >Description : Postfix is a Mail Transport Agent (MTA), supporting LDAP, > >SMTP AUTH (SASL), TLS > >### yum info dovecot ### >Name : dovecot >Arch : i686 >Epoche : 1 >Version : 2.2.10 >Ausgabe : 4.el7_0.1 >Größe : 3.2 M >Quelle : debian.n-ix.net_centos_7_os_x86_64_ >Summary : Secure imap and pop3 server >URL : http://www.dovecot.org/ >Lizenz : MIT and LGPLv2 >Description : Dovecot is an IMAP server for Linux/UNIX-like systems, >written with security > : primarily in mind. It also contains a small POP3 >server. It supports mail > : in either of maildir or mbox formats. > >Cheers, >Drav

1 0

Multidomain / IP Address Setup (Dovevot 2.2.10 on CentOS7 ) is failing: Fatal: Couldn't parse private ssl_key: error:0906D06C:PEM
by dravion.smith＠gmx.net 16 Aug '15

16 Aug '15

Hi, I want to say hello and here is my big problem ;D Iam trying to archive a Postfix/Dovecot 2.2.10 CentOS7 Multidomain Setup with multiple (valid StartSSL Certs), but iam only able to run a single Domain Cert server only. ps: I need a multiple domainssetup for every customer and it is not an option for me redirecting any email to a single domain server. I really need this setup working. IMHO: I think it SELinux could interfere with multiple Certs in diffrent folders (it is activated in CentOs7 by default and is needed by other apps) Ok, here is my logfile data: systemctl start postfix.service [OK] systemctl start dovecot.service [OK] /var/log/messages *systemd: Stopping Dovecot IMAP/POP3 email server... *systemd: Starting Dovecot IMAP/POP3 email server... *systemd: Started Dovecot IMAP/POP3 email server. /var/log/maillog *dovecot: master: Dovecot v2.2.10 starting up for imap, pop3, lmtp (core dumps disabled) ### This works (Thunderbird, Outlook 2013, Opera Mail ect.) #### local mydomain01.tld { protocol imap { ssl_cert = </etc/ssl/domains/mydomain.tld/imap/imap.mydomain02.tld.crt.pem ssl_key = </etc/ssl/domains/mydomain.tld/imap/imap.mydomain02.tld.key.pem } } ### this 10-ssl.conf ### --- FAILS (the error occurs after an email client accesses IMAP Folders) local mydomain01.tld { protocol imap { ssl_cert = </etc/ssl/domains/mydomain.tld/imap/imap.mydomain02.tld.crt.pem ssl_key = </etc/ssl/domains/mydomain.tld/imap/imap.mydomain02.tld.key.pem } } local mydomain02.tld { protocol imap { ssl_cert = </etc/ssl/domains/mydomain.tld/imap/imap.mydomain02.tld.crt.pem ssl_key = </etc/ssl/domains/mydomain.tld/imap/imap.mydomain02.tld.key.pem } } /var/log/mailog ### Error log ### Aug 14 12:50:38 matrix dovecot: imap-login: Fatal: Couldn't parse private ssl_key: error:0906D06C:PEM routines:PEM_read_bio:no start line: Aug 14 12:50:38 matrix dovecot: master: Error: service(imap-login): command startup failed, throttling for 60 secs I really dont know why a single domain is no problem but if i enable multiple domains dovecots start with any error, even if i set debug verbose leven to extrem high but if i access dovecot with Thunderbird my server loggile explodes with something like this Couldn't parse private ssl_key: error:0906D06C:PEM but the certs are 100% valid and checked over and over again. Any help is greatly appreciated! Greetings, Dravion

4 12

ipv4 imap not accepting connections in mixed ipv4/ipv6
by djk 15 Aug '15

15 Aug '15

I have two installations of dovecot 2.18, apart from the necessary changes to allow them to replicate amongst themselves the configs are identical. Both are running Ubuntu 14.04 and are kept up to date. One is running 64bit and the other 32 bit (for historical reasons). Both have ipv4 and ipv6 addresses. The 64 bit installation allows access on port 143 and 993 on both ipv4 and ipv6. The 32 bit installation does not allow access on 143 on ipv4, but allows ipv4/ipv6 on 993. Both installations happily allow connections to any other ports that dovecot might be using on both ipv4/ipv6, as well as everything else that is running (on other ports) on those machines. There are firewalls, but no warning messages. Switching firewalls off makes no difference. Tcpdump shows the SYN packets arriving on the (correct) interface. Any suggestions? Dirk

1 0

IMAP folder separator issue
by Alex 15 Aug '15

15 Aug '15

Hi, I'm using dovecot-2.2.18 on fedora22 and having a problem with Thunderbird. I reported this problem some time ago, and received some tips, but no solution that's worked. I'm now trying to fix this in earnest, and having problems. The problem is sub-folders are created with a caret in them, instead of a new folder below the parent folder. So instead of folder/sub-folder, folder^sub-folder is created. I'm using mbox folders, and it worked under previous versions of fedora and dovecot. I believe it has to do with the separator character that's used, based on this wiki page: http://wiki2.dovecot.org/Plugins/Listescape The problem is that those instructions cause errors: Aug 14 20:00:01 orion dovecot: pop3(cerberus): Error: User initialization failed: namespace configuration error: Duplicate namespace prefix: "" Aug 14 20:00:01 orion dovecot: pop3(cerberus): Error: Invalid user settings. Refer to server log for more information. I've also had to change the "namespace private" to "namespace { type=private }" as that's apparently a deprecated syntax. Perhaps there's an updated page with more instruction and correct information? I'm unsure where this duplicate namespace is that it's talking about... I've included my doveconf output below, in hopes someone can help. I should also point out that "separator = $" is quoted in the original doveconf.conf but apparently doveconf doesn't properly print it. # 2.2.18: /etc/dovecot/dovecot.conf # OS: Linux 4.0.7-300.fc22.x86_64 x86_64 Fedora release 22 (Twenty Two) default_client_limit = 2000 mail_gid = mail mail_location = mbox:~/mail:INBOX=/var/spool/mail/%u mail_plugins = " listescape" mail_privileged_group = mail mbox_write_locks = fcntl namespace { inbox = yes location = prefix = separator = $ type = private } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } passdb { driver = pam } protocols = imap pop3 service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service imap-login { inet_listener imap { port = 0 } inet_listener imaps { port = 993 } process_min_avail = 20 service_count = 0 } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { address = 192.168.1.100 port = 995 } } ssl_ca = </etc/pki/dovecot/certs/ca-bundle.pem ssl_cert = </etc/pki/dovecot/certs/orion-2015.pem ssl_key = </etc/pki/dovecot/certs/orion-2015.key userdb { driver = passwd } userdb { driver = passwd }

2 1

backing up email / saving maildir on external hard drives
by Kevin Laurie 15 Aug '15

15 Aug '15

Hello, Yesterday I tried to back up a 40GB maildir . I tried to move the maildir from home to external HDD but failed. Decided then to compress it(which took several hours). Now changing the disk format from FAT to exFAT to allow the transfer for the large compressed file. How does one back up emails on a external drive? Some advice would be greatly appreciated.

7 12

need help debugging deleted mails
by Vu Ngoc VU 13 Aug '15

13 Aug '15

hello, one of our users complained about the fact that he doesn't receive some messages (randomly) that his teamates have. Grepping for the message-ID in the mail.log, I can see lmtp says it is saved : Aug 12 15:23:23 imap-01 dovecot: lmtp(4943, johndoe(a)example.net) fFuCO09Hy1VPEwAA2t/0+w: sieve: vsize= msgid=<037e01d0d502$0e3687d0$2aa39770$(a)example.net>: stored mail into mailbox 'INBOX' The only difference with others recipients is the 'sieve:... stored mail' instead of 'saved mail to' when there is no sieve. But when he asked me, the message was no more in his maildir (I checked with doveadm search). As we have checked and disabled all the filters in his MUA and on the server (sieve) and this issue still continue, I did mkdir a dovecot.rawlog inside his home. With the help of rawlog, I can see that the message can be found in a .out file (by grepping the Message-ID). And by reading this .out log raw log, the entire message were sent to the client. So I guess that : * the message was written to disk * it was sent to the MUA But I need your help because I don't get how this message disappear from his maildir. My assumptions was that the client must do some commands like : * STORE the \Deleted flag to this message UID * and then, later do EXPUNGE but I did : * grep -i expunge * 20150812* => no match * grep -iE '\+flags .*\\deleted' => a few matches but not with the appropriate UID snippet from the 20150812-133858-13317.in file: 8nk1 UID FETCH 208209 (UID FLAGS RFC822.SIZE BODY.PEEK[HEADER] INTERNALDATE) p7uv IDLE DONE 6yk3 NOOP 83g6 IDLE DONE yhbd UID FETCH 208209 (UID FLAGS BODY.PEEK[]) fy16 IDLE DONE snippet from the 20150812-133858-13317.out file: * 56295 FETCH (UID 208209) wn2p OK Fetch completed. * 56295 FETCH (UID 208209 FLAGS (\Deleted \Seen \Recent) RFC822.SIZE 17138 INTERNALDATE "12-Aug-2015 15:23:22 +0200" BODY[HEADER] {2836} Considering these points: * I cannot find any match with 208209 early in raw logs * I don't see any expunge for the whole day * I've grepped for \Deleted (insensitive) and didn't find matching like a interval of messages UID. What did I miss to find out how/when the message got \Deleted flag and was removed from his maildir? A few about my setup : * system is ubuntu 14.04 inside OpenVZ containers (Proxmox) * dovecot version is 2.2.9 from Ubuntu packages * 2 director with Internet and local ip addresses * 2 backends with only local addresses * these dovecot access storage servers by NFSv3 (that's why we have director) * imap/lmtp are proxied Thanks a lot for reading, I'm really disappointed about this problem. For the moment, I'll delete his script even if all rules are disabled (via roundcube, and I checked the rule is commented in the file). And also I'll try to watch what happens with inotify on the storage server.

4 6

backing up IMAP server on a hard drive
by Kevin Laurie 13 Aug '15

13 Aug '15

Hi, I am trying to back up my IMAP server to a hard drive. Later I intend to extract all mails for attachments. What do you reckon is the best too to perform this ? Imapsync or Thunderbird (or something else, please recommend) One problem I am having with imapsync is the setting for host2 (being a localhost computer). How does one set a parameter for host2 being a desktop computer. Thanks Kevin

3 6

Error when reading attachment - one byte overhead?
by Ачилов Рашид Нурмухамед ович 13 Aug '15

13 Aug '15

After converting maildir to mdbox mail periodically obtained these messages: Aug 13 11:22:27 mailsrv dovecot: imap(user-aaa): Error: read(/usr/share/smbusers/user-aaa/mail/attachments/a0/8e/a08e3e63e11aae3f37020bdca0da7d-7b39ab07ea73ba559d450000dec08558[base64:18 b/l]) failed: Stream is larger than expected (434427 > 434426, eof=1) Aug 13 11:22:27 mailsrv dovecot: imap(user-aaa): Error: read(attachments-connector(/usr/share/smbusers/user-aaa/mail/storage/m.23)) failed: read(/usr/share/smbusers/user-aaa/mail/attachments/a0/8e/a08e3e63e11aae3f37020bdca0da7d-7b39ab07ea73ba559d450000dec08558[base64:18 b/l]) failed: Stream is larger than expected (434427 > 434426, eof=1) (FETCH BODY[] for mailbox Разное полезное/Для памяти UID 20) Aug 13 11:22:27 mailsrv dovecot: imap(user-aaa): Disconnected: FETCH read() failed in=16923 out=497431 How to correct it? Conversion was did with 2.2.8 version, next will installed 2.2.18. -- С Уважением. Ачилов Рашид Нурмухамедович (AchilovRN(a)granch.ru) Главный специалист по защите информации ООО НПФ "Гранч", тел: +7 (383) 233-35-12, доб. 107

1 0

SiS does not work
by Ачилов Рашид Нурмухамед ович 13 Aug '15

13 Aug '15

How do you do. I have tried to use SiS to deduplicate attachments in mail storage. Unsuccesful. When goes mail with reasonable size, and SiS try to start, I have receive error, when this mail must be delivered for group of receivers (i.e. through aliases). Below is error log, valuable parts of mail addresses masked by X and Y chars Aug 6 16:11:12 mailsrv dovecot: lmtp(xxxxx): AL1SNrkyw1VPBAAABJcpmA: msgid=<2015080614471325760993(a)chinacoalchem.com> (from zsy(a)chinacoalchem.com) saved mail to INBOX This receiver has received mail. But next one does not. And to receive I must restart _sendmail_ (not dovecot!). I must restart sendmail as many times as there were recipients in envelope. Aug 6 16:11:12 mailsrv dovecot: lmtp(yyyy): Error: read(/usr/share/smbusers/xxxxx/mail/attachments /e4/3d/e43db6e8af6fb1df4a08f9c1f3f31e93e61781c4c1d2395e04dd96a583aa-01bd5236b932c3554f04000004972998[base64 :19 b/l]) failed: Stream is smaller than expected (0 < 4080128) Aug 6 16:11:12 mailsrv dovecot: lmtp(yyyy): Error: read(attachments-connector(/usr/share/smbusers/xxxxx/mail/storage/m.35)) failed: read(/usr/share/smbusers/xxxxx/mail/attachments/e4/3d/e43db6e8af6f b1df4a08f9c1f3f31e93e61781c4c1d2395e04dd96a583aa-01bd5236b932c3554f04000004972998[base64:19 b/l]) failed: Stream is smaller than expected (0 < 4080128) Aug 6 16:11:12 mailsrv dovecot: lmtp(yyyy): Error: copy: i_stream_read(attachments-connector(/usr/share/smbusers/xxxxx/mail/storage/m.35)) failed: read(/usr/share/smbusers/xxxxx/mail/attachments/e4/ 3d/e43db6e8af6fb1df4a08f9c1f3f31e93e61781c4c1d2395e04dd96a583aa-01bd5236b932c3554f04000004972998[base64:19 b/l]) failed: Stream is smaller than expected (0 < 4080128) Aug 6 16:11:12 mailsrv dovecot: lmtp(yyyy): Error: read(attachments-connector(/usr/share/smbusers/xxxxx/mail/storage/m.35)) failed: read(/usr/share/smbusers/xxxxx/mail/attachments/e4/3d/e43db6e8af6f b1df4a08f9c1f3f31e93e61781c4c1d2395e04dd96a583aa-01bd5236b932c3554f04000004972998[base64:19 b/l]) failed: Stream is smaller than expected (0 < 4080128) (uid=0, box=INBOX) Aug 6 16:11:12 mailsrv dovecot: lmtp(yyyy): AL1SNrkyw1VPBAAABJcpmA: msgid=<2015080614471325760993(a)chinacoalchem.com> (from zsy(a)chinacoalchem.com) save failed to INBOX: Internal error occurred. Refer to server log for more information. [2015-08-06 16:11:12] Why LMTP, when try to deliver mail to local user yyyy tries to look up into a home directory of local user xxxxx? All these and similar home directories has a 'mail' subdir, which keeps mail and rights on this subdir is 0700. To avoid this completely misunderstood occassion, I have temporary set mail_attachment_min_size to 2048kb - but now I cannot receive advantage from SiS. -- С Уважением. Ачилов Рашид Нурмухамедович (AchilovRN(a)granch.ru) Главный специалист по защите информации ООО НПФ "Гранч", тел: +7 (383) 233-35-12, доб. 107

2 2

userdb / user map with director
by Will Yardley 10 Aug '15

10 Aug '15

This is with dovecot-ee 2.2.18.2 on RHEL6.... To handle backend and frontend on same machine, I'm using the following hack, as previously outlined here: [in director instance config] passdb { # See thread ending in: # http://dovecot.org/pipermail/dovecot/2012-June/083817.html # for why this has to be sql instead of 'static' driver = sql args = /etc/dovecot/dovecot-sql.conf } [in /etc/dovecot/dovecot-sql.conf] driver = sqlite connect = /etc/dovecot/empty.db password_query = select 'y' as proxy, \ NULL as password, \ 'y' as nopassword, \ case '%a' \ when '110' then '10110' \ when '995' then '10110' \ when '143' then '10143' \ when '993' then '10143' end \ as port; This works, but I was getting a failure on usernames, since director instance didn't have a userdb. So I tried the following: [in config] passdb { driver = sql args = /etc/dovecot/dovecot-sql.conf } userdb { driver = prefetch } and appended the following to the SQL query: password_query = select '%u' AS user, \ Then I see the following error in the log when I try to run the map "Trying to iterate users, but userdbs don't support it" and doveadm -i director director map returns: Error: User listing returned failure Error: user listing failed [...] I'm sure I'm missing something obvious, so is there an easy fix to make this mapping work? w

1 0

Dovecot sends "OK Logged in" with empty tag
by Simon Thelen 10 Aug '15

10 Aug '15

Hello, I'm currently writing my own IMAP client and testing it against Dovecot, and when doing PLAIN AUTH Dovecot sends the "OK Logged in" with an empty tag at the start. I tried reproducing the conversation with netcat, but Dovecot sends a correctly tagged OK at the end of the AUTH so I assume it's timing related. I've attached pcap dumps of the TCP conversation in both situations as well as the output of dovecot -n. Side Note: Why does Dovecot send the updated capabilities before OK'ing the authentication? Seems strange to me as the client can't assume that the authentication proceeded successfully until it actually receives the OK so it has to assume that those capabilities are pre login. -- Simon Thelen

1 1

Using a separate passdb per service
by Gerry 10 Aug '15

10 Aug '15

Situation: one front-facing server running Dovecot as IMAP/POP3/ ManageSieve proxy, a mixture of IMAP servers (Dovecot, Exchange, ...) in the back-end. Dovecot's passdb does lookups against MySQL which contains a simple user/host mapping, the actual authentication happens on the back-end IMAP servers. The configuration is more or less as described here: http://wiki2.dovecot.org/PasswordDatabase/ExtraFields/Proxy Now I would like to add a Postfix instance on the front-facing server which listens on the submission port and authenticates users via SASL using the local Dovecot's UNIX socket. The idea being that a user only needs to remember one single hostname, one username and one password for all mail-related services. The problem is that Dovecot is operating in proxy mode, which means that the password_query returns NULL as the password and explicitly returns a field "nopasswd" containing "Y". Thus, users can not authenticate against the UNIX socket. What I think I want to do is convince Dovecot to use one passdb for the imap/pop3/managesieve services and different one for the "auth" service. The configuration snippet below doesn't work, but it should illustrate what I want to achieve: > protocols = imap pop3 sieve > > service auth { > passdb sql { > driver = sql > args = /etc/dovecot/mysql-auth-sasl.conf.ext > } > > unix_listener /var/spool/postfix/private/auth { > user = postfix > group = postfix > mode = 0666 > } > } > > # IMAP/POP3/ManageSieve auth against MySQL > passdb sql { > driver = sql > args = /etc/dovecot/mysql-auth-default.conf.ext > } Example mysql-auth-sasl.conf.ext > driver = mysql > connect = host=127.0.0.1 dbname=mail user=mail password=somethingrandom > password_query = SELECT password AS password FROM users WHERE login = '%u' Example mysql-auth-default.conf.ext: > driver = mysql > connect = host=127.0.0.1 dbname=mail user=mail password=somethingrandom > password_query = SELECT NULL AS password, 'Y' as nopassword, host, 'Y' AS proxy FROM users WHERE login = '%u' Any pointers? Gerry

3 4

How to import an mbox to an existing user as a new mailbox
by Paul Hoffman 09 Aug '15

09 Aug '15

Greetings. I have a bunch of mbox files that I want to import to an existing user, each into a new mailbox. That is, I want to import the file project1.mbox to user Foo, into a newly-created mailbox called "Project 1". Is there a dovecot tool to do this on the server? --Paul Hoffman

4 10

Trying to back
by Kevin Laurie 09 Aug '15

09 Aug '15

Hi, I am trying to backup multiple mail accounts by using imapsync and Dovecot on my local machine. I am using maildir as a mail storage format and currently have the following setting on my local machine :- mail_location = maildir:~/Maildir I am afraid that if I imapsync multiple accounts they will all get stored in the same location. Is there a way to seperate the accounts based on the email address? Appreciate if someone could advise. Thanks! Kevin

3 3

2.2.18: Mailbox INBOX sync: mailbox_delete failed: INBOX can't be deleted.
by Dale Gallagher 08 Aug '15

08 Aug '15

Hello I have 2.2.18 built with: ./configure \ --prefix="$prefix" \ --bindir="$prefix/bin" \ --sbindir="$prefix/bin" \ --sysconfdir="/etc" \ --with-storages="maildir,imapc,pop3c" \ --without-vpopmail \ --without-ldap I'm attempting to sync (backup) from another Dovecot server running version 2.0.21: Both servers don't have no explicit namespaces configured and both are using the Maildir storage plugin. doveadm -Dv -o imapc_user=remote_user -o imapc_host=source.host -o imapc_port=993 -o imapc_ssl=imaps -o imapc_password=remote_pass -o imapc_features="rfc822.size fetch-headers" backup -R -u local_user imapc: All seems to go well, showing local and remote mailbox syncing without errors, then finally: dsync(mcg): Debug: brain M: Deleting mailbox 'INBOX' (GUID 59023c2a911dc255842b0000d09efc50): UIDVALIDITY changed (1355416734 -> 1438784913) dsync(mcg): Error: Mailbox INBOX sync: mailbox_delete failed: INBOX can't be deleted. No mail is synced to the local server (2.2.18) after this error halts execution. What should I be looking for, in terms of possible causes of this error? I've tried syncing on a completely fresh mailbox, which hasn't been accessed by a mail client and the same error occurs. I've seen similar reports of this error before, without clear solutions / suggestions. Help would be greatly appreciated. Thanks

1 2

opening a maildir ?
by Kevin Laurie 07 Aug '15

07 Aug '15

Hello, I have a maildir on my Ubuntu PC. I used imapsync + dovecot to copy all my emails on it. What would be a convenient way to access all the emails ( I want to go through and download all attachments). So a tool with some GUI will be nice. Appreciate if someone could help here. Thanks Kevin

2 1