- dovecot - dovecot.org

[Dovecot] Multiple Patitions with with mdbox
by Peer Heinlein 09 Nov '11

09 Nov '11

Having > 10 TByte mailstore filesystem-checks takes too much time. At the moment we have four different partitions, but I don't like to set symlinks or LDAP-flags to sort customers and their domains to there individual mount-point. I'd like to work with mdbox:/mail/%d/%n to calculate the path automatically. How do you handle >> 10 TB mailstore? I'm very interested in the feature "alternative mailstore" with mdbox, because that makes it very easy to use at least TWO filesystems without any tricky configuration. I think I'd love to have <n> alternative mailstores. Why does dbox doesn't look for its m.*-files in more then two directorys? Sure, looking in 4 directorys would lead to four disc operations, but maybe it could be very helpful. Peer -- Heinlein Professional Linux Support GmbH Linux: Akademie - Support - Hosting http://www.heinlein-support.de Tel: 030/405051-42 Fax: 030/405051-19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin

3 2

[Dovecot] another sizeof tweak
by Mike Abbott 08 Nov '11

08 Nov '11

Line 776 of dovecot-2.0.15/src/lib-storage/index/maildir/maildir-sync-index.c reads: memcmp(old_rec, &new_rec, sizeof(old_rec)) != 0) { Should that be sizeof(*old_rec)?

2 2

[Dovecot] Dovecot alias and mailbox problem
by Jeroen Grusewski 08 Nov '11

08 Nov '11

Hi All, My Postfix / Dovecot / MySQL is running fine but I have the following issue: When I create the following mailboxes test(a)example.com and test1(a)example.com it is working fine. I can create an alias test2(a)examples.com => test1(a)example.com that is also working without a problem, only when I create test(a)example.com => test1(a)example.com email is only delivered to test1@.... instead to both test@.... and test1@.... I believe it is properly just a setting but please help me out here ! Let me know if you need any more information before I post configs etc. Best regards, Jeroen

2 1

[Dovecot] dsync and zlib
by Peer Heinlein 08 Nov '11

08 Nov '11

Will dsync also use zlib-compression when copying mails from one side to another? Wouldn't this be a good way to compress existing mails? http://wiki2.dovecot.org/Plugins/Zlib says, there's no way to do that. But dsync should respect the zlib-Plugin... Peer -- Heinlein Professional Linux Support GmbH Linux: Akademie - Support - Hosting http://www.heinlein-support.de Tel: 030/405051-42 Fax: 030/405051-19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin

2 1

[Dovecot] Failing to share folders when listescape is enabled (2.0.14)
by mailing lists 08 Nov '11

08 Nov '11

Hello, How I can share a folder with dots when the listescape plugin is enabled? In this example user001 is sharing two foders named "docs-abc" and "docs-a.b.c" to user002. The first folder (without dots) is seen by user002 but the second is not found by dovecot because it search a system folder named ".docs-a.b.c" but the system folder is ".docs-a\2eb\2ec" Nov 8 11:03:52 imap2 dovecot: imap(user002): Debug: acl vfile: file /var/virtual-maildir/user001/.docs-a.b.c/dovecot-acl not found drwx------ 2 vmail vmail 4096 2011-11-08 10:54 cur drwx------ 5 vmail vmail 4096 2011-11-08 10:57 .docs-a\2eb\2ec drwx------ 5 vmail vmail 4096 2011-11-08 10:57 .docs-abc -rw------- 1 vmail vmail 20 2011-11-08 10:57 dovecot-acl-list -rw------- 1 vmail vmail 248 2011-11-08 10:55 dovecot.index.log -rw------- 1 vmail vmail 96 2011-11-08 10:54 dovecot.mailbox.log -rw------- 1 vmail vmail 51 2011-11-08 10:55 dovecot-uidlist -rw------- 1 vmail vmail 8 2011-11-08 10:57 dovecot-uidvalidity -r--r--r-- 1 vmail vmail 0 2011-11-08 10:54 dovecot-uidvalidity.4eb8fc5b drwx------ 5 vmail vmail 4096 2011-11-08 10:57 .Drafts -rw------- 1 vmail vmail 15 2011-11-08 10:54 maildirsize drwx------ 2 vmail vmail 4096 2011-11-08 10:54 new drwx------ 5 vmail vmail 4096 2011-11-08 10:54 .Sent drwx------ 5 vmail vmail 4096 2011-11-08 10:54 .Spam -rw------- 1 vmail vmail 23 2011-11-08 10:54 subscriptions drwx------ 2 vmail vmail 4096 2011-11-08 10:54 tmp drwx------ 5 vmail vmail 4096 2011-11-08 10:54 .Trash # cat /var/virtual-maildir/user001/subscriptions Trash Sent Drafts Spam docs-abc docs-a\2eb\2ec # telnet localhost 143 Trying ::1... Connected to localhost. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN] Dovecot ready. . login user001 XXXXX . OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS QUOTA ACL RIGHTS=texk] Logged in . create docs-abc . OK Create completed. . create docs-a.b.c . OK Create completed. . setacl docs-abc user002 lrsw . OK Setacl complete. . setacl docs-a.b.c user002 lrsw . OK Setacl complete. . subscribe docs-abc . OK Subscribe completed. . subscribe docs-a.b.c . OK Subscribe completed. . logout * BYE Logging out . OK Logout completed. Connection closed by foreign host. # telnet localhost 143 Trying ::1... Connected to localhost. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN] Dovecot ready. . login user002 XXXXXX . OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS QUOTA ACL RIGHTS=texk] Logged in . subscribe shared/user001/docs-abc . OK Subscribe completed. . subscribe shared/user001/docs-a.b.c . NO Mailbox doesn't exist: shared/user001/docs-a.b.c . logout * BYE Logging out . OK Logout completed. Connection closed by foreign host. /-----------------/ # dovecot -n # 2.0.14: /etc/dovecot/dovecot.conf # OS: Linux 2.6.34.7-0.7-xen x86_64 openSUSE 11.3 (x86_64) auth_debug = yes auth_verbose = yes base_dir = /var/run/dovecot/ dict { expire = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no doveadm_proxy_port = 24244 doveadm_socket_path = localhost:24244 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_debug = yes mail_fsync = always mail_gid = 5000 mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = acl quota notify expire listescape mail_uid = 5000 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date mmap_disable = yes namespace { inbox = yes list = yes location = prefix = separator = / subscriptions = yes type = private } namespace { list = children location = maildir:/var/virtual-maildir/%%n:INDEX=~/shared.%%n prefix = shared/%%n/ separator = / subscriptions = no type = shared } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile acl_shared_dict = file:/var/maildir/vol00/shared-mailboxes autocreate = Trash autocreate2 = Sent autocreate3 = Drafts autocreate4 = Spam autosubscribe = Trash autosubscribe2 = Sent autosubscribe3 = Drafts autosubscribe4 = Spam expire = Trash expire2 = Trash/* expire5 = Spam expire6 = Spam/* expire_dict = proxy::expire mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename flag_change append mail_log_fields = uid box msgid from subject size vsize flags mail_plugins = " mail_log notify" quota = maildir:Quota quota_exceeded_message = Quota limit reached quota_rule2 = Trash:storage=+50M quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=90%% quota-warning 90 %u sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } service auth { unix_listener auth-userdb { group = vmail mode = 0600 user = vmail } } service dict { unix_listener dict { group = vmail mode = 0600 user = vmail } } service doveadm { inet_listener { port = 24244 } } service lmtp { inet_listener lmtp { port = 24 } unix_listener lmtp { group = vmail mode = 0666 user = vmail } } service pop3-login { inet_listener pop3 { port = 110 } } service quota-warning { executable = script /etc/dovecot/quota-warning.sh unix_listener quota-warning { user = vmail } } ssl = no userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } verbose_proctitle = yes protocol lmtp { mail_plugins = acl quota notify expire listescape sieve } protocol lda { mail_plugins = acl quota notify expire listescape sieve } protocol imap { mail_max_userip_connections = 100 mail_plugins = acl quota notify expire listescape imap_acl autocreate imap_quota } protocol pop3 { pop3_uidl_format = %v-%u } local 10.1.245.101/28/28 { doveadm_password = secret }

2 1

[Dovecot] Attachements with SIS : shauld all the same files share the same inode ?
by Yann Dupont 08 Nov '11

08 Nov '11

Hello. I configured SIS , and all seems to work well, but I noticed something strange : For exemple, this attachement : 6e/2d# ls -al 6e2df299* | sort -n 104 instance of -rw------- 104 vmail vmail 346584 16 oct. 17:47 6e2df299fa96daec9b4735d07c494046429be4d6-ffd0d1xxxx The files are hardlinked, so it seems ok, but I also see 9 others files in the same directory : -rw------- 1 vmail vmail 346584 16 oct. 17:47 6e2df299fa96daec9b4735d07c494046429be4d6-0519df2a94fc9a4e1f4100008a6b99b6 -rw------- 1 vmail vmail 346584 16 oct. 17:47 6e2df299fa96daec9b4735d07c494046429be4d6-1790b92994fc9a4e1a4100008a6b99b6 as you can see, same prefix, If I compare them with diff, they are all the same files. ls -i show that 104 have the same inode, as expected, and the 9 remaining files have different inodes. I expected all the files share the same inodes. Is there something wrong here ? My setup is debian squeeze + auto packages from http://xi.rename-it.nl/debian/ dovecot is 2:2.0.15-0~auto+21 thanks, -- Yann Dupont - Service IRTS, DSI Université de Nantes Tel : 02.53.48.49.20 - Mail/Jabber : Yann.Dupont(a)univ-nantes.fr

2 2

[Dovecot] How to define ldap connection idle
by Aliet Santiesteban Sifontes 08 Nov '11

08 Nov '11

I'm having a problem with dovecot ldap connection when ldap server is in another firewall zone, firewall kills the ldap connection after a determined period of inactivity, this is good from the firewall point of view but is bad for dovecot because it never knows the connections has been dropped, this creates longs timeouts in dovecot and finally it reconnects, meanwhile many users fails to authenticate, I have seen this kind of post in the list for a while but can't find a solution for it, so my question is how to define a idle ldap time in dovecot so it can reconnect before the firewall has dropped the connection or just close the connection under inactivity so when a user authenticate doesn't fails for a while until dovecot detects that the connection has hanged. Is this a feature request or there is already a configuration for this??? Thank's in advance and congrats tu Timo for this great app.

2 4

[Dovecot] POP3/IMAPv4 CRAM-MD5 Authentication failed.(Re-post)
by Yuuichi Ikeda (SKLC) 07 Nov '11

07 Nov '11

Hi, I'm Yuuichi Ikeda from Japan User. OS:Solaris 10 9/10 s10x_u9wos_14a X86 Mem:8GB HDD:3TB gcc:gcc (GCC) 4.1.2 gcc-prefix:/unsupported/gcc Dovecot Version:2.0.15 configure:./configure --prefix=/opt/dovecot_2 --sysconfdir=/opt/dovecot_2/conf --mandir=/opt/man --enable-shared --with-mysql --with-zlib --with-sqlite --with-sql=plugin --with-ssldir=/opt/openssl --with-rundir=/var/run --with-libiconv-prefix=/opt/libiconv Dovecot Configuration > # 2.0.15: /opt/dovecot_2/conf/dovecot/dovecot.conf > # OS: SunOS 5.10 i86pc > auth_debug = yes > auth_mechanisms = cram-md5 > auth_ssl_require_client_cert = yes > auth_ssl_username_from_cert = yes > auth_verbose = yes > base_dir = /var/run/dovecot/ > doveadm_worker_count = 10 > log_path = /var/log/dovecot/dovecot.log > login_greeting = ready. > login_trusted_networks = 192.168.1.0/24 > mail_location = maildir:~/Maildir > passdb { > driver = pam > } > passdb { > args = /opt/dovecot_2/conf/dovecot/passwd > driver = passwd-file > } > plugin { > acl = vfile:/opt/dovecot_2/conf/dovecot/global-acls:cache_secs=300 > acl_shared_dict = file:/var/lib/dovecot/shared-mailboxes > } > protocols = imap pop3 > service auth { > executable = /opt/dovecot_2/libexec/dovecot/auth > unix_listener /var/spool/postfix/private/auth { > mode = 0666 > } > } > service imap-login { > executable = /opt/dovecot_2/libexec/dovecot/rawlog /opt/dovecot_2/libexec/dovecot/imap-login > inet_listener imap { > port = 143 > ssl = no > } > inet_listener imaps { > port = 993 > ssl = yes > } > } > service imap { > executable = /opt/dovecot_2/libexec/dovecot/rawlog /opt/dovecot_2/libexec/dovecot/imap > } > service lmtp { > unix_listener lmtp { > mode = 0666 > } > } > service pop3-login { > executable = /opt/dovecot_2/libexec/dovecot/rawlog /opt/dovecot_2/libexec/dovecot/pop3-login > inet_listener pop3 { > port = 110 > ssl = no > } > inet_listener pop3s { > port = 995 > ssl = yes > } > } > service pop3 { > executable = /opt/dovecot_2/libexec/dovecot/rawlog /opt/dovecot_2/libexec/dovecot/pop3 > } > ssl_ca = </opt/dovecot_2/conf/dovecot/ca-c.pem > ssl_cert = </opt/dovecot_2/conf/dovecot/ns-c.pem > ssl_key = </opt/dovecot_2/conf/dovecot/ns-p.pem > ssl_verify_client_cert = yes > userdb { > args = blocking=yes > driver = passwd > } > protocol imap { > imap_logout_format = bytes=%i/%o > imap_max_line_length = 64 k > mail_max_userip_connections = 10 > mail_plugins = > } > protocol lda { > hostname = mailsv.sklc.co.jp > info_log_path = /var/log/dovecot/deliver.log > log_path = /var/log/dovecot/deliver.log > mail_plugins = > postmaster_address = postmaster(a)sklc.co.jp > sendmail_path = /usr/lib/sendmail > } > protocol lmtp { > mail_plugins = > } > protocol pop3 { > mail_plugins = > pop3_save_uidl = yes > pop3_uidl_format = %v-%u > } If it attests by connecting by POP3 or IMAPv4, the following messages will be displayed and attestation will go wrong. > Nov 07 23:12:40 auth: Debug: auth client connected (pid=20018) > Nov 07 23:12:40 auth: Debug: client in: AUTH 1 CRAM-MD5 service=pop3 secured no-penalty lip=192.168.1.1 rip=192.168.1.110 lport=110 rport=57054 > Nov 07 23:12:40 auth: Info: CRAM-MD5(?,192.168.1.110): Client didn't present valid SSL certificate > Nov 07 23:12:40 auth: Debug: client out: FAIL 1 reason=Client didn't present valid SSL certificate > Nov 07 23:12:40 pop3-login: Info: Aborted login (cert required, client didn't start TLS): method=CRAM-MD5, rip=192.168.1.110, lip=192.168.1.1, secured > Nov 07 23:16:32 auth: Debug: auth client connected (pid=20126) > Nov 07 23:16:32 auth: Debug: client in: AUTH 1 CRAM-MD5 service=imap secured no-penalty lip=192.168.1.1 rip=192.168.1.1 lport=143 rport=58734 > Nov 07 23:16:32 auth: Info: CRAM-MD5(?,192.168.1.1): Client didn't present valid SSL certificate > Nov 07 23:16:32 auth: Debug: client out: FAIL 1 reason=Client didn't present valid SSL certificate > Nov 07 23:16:32 imap-login: Info: Aborted login (cert required, client didn't start TLS): method=CRAM-MD5, rip=192.168.1.1, lip=192.168.1.1, secured What will you do and will become like this? If some people know ways of coping, please let me know. ============================================================= Information-system part. Sankei-Koumuten Co.,Ltd. Yuuichi Ikeda Mail:yuichi@sklc.co.jp Tel.+81-3-3623-6474 Fax.+81-3-3623-6475 Our company promotes "Team minus 6 percent" jus, Hatena Joined member. LPIC-2 Certified. =============================================================

2 1

[Dovecot] Accessing a strange mailbox
by Micah Anderson 07 Nov '11

07 Nov '11

I have a user who has a mailbox called: A----->B It seemed to work in courier fine, they managed to create it, and there are mails in it. However, dovecot is not letting the user access it, the IMAP server gives an error. I tried to rename it but I would also get an error: # doveadm mailbox rename A-----\>B AtoB doveadm(root): Error: Can't rename mailbox A----->B to AtoB: Mailbox doesn't exist: A----->B # doveadm mailbox rename A----->B AtoB doveadm(root): Error: Can't rename mailbox A----- to AtoB: Mailbox doesn't exist: A----- # doveadm mailbox rename 'A----->B' AtoB doveadm(root): Error: Can't rename mailbox A----->B to AtoB: Mailbox doesn't exist: A----->B # doveadm mailbox rename "A----->B" AtoB doveadm(root): Error: Can't rename mailbox A----->B to AtoB: Mailbox doesn't exist: A----->B # How can I deal with this mailbox (using mdbox here)? Thanks! --

3 2

[Dovecot] Problems with password verification on a BSD box against PAM
by Michael Schinhammer 07 Nov '11

07 Nov '11

Spam detection software, running on the system "ns.089.at", has identified this incoming email as possible spam. The original message has been attached to this so you can view it (if it isn't spam) or label similar future email. If you have any questions, see The administrator of that system for details. Content preview: Hi ML, i want to use my local users database on my Freebsd 8.2 box and got the following error in the maillog. The password is ok and it working on the console. i can establish the ssl connection after login "a login ux password" the error occures i cant login. [...] Content analysis details: (6.2 points, 5.0 required) pts rule name description ---- ---------------------- -------------------------------------------------- 0.2 MR_NOT_ATTRIBUTED_IP Beta rule: an non-attributed IPv4 found in headers 0.6 J_CHICKENPOX_65 BODY: 6alpha-pock-5alpha 0.6 J_CHICKENPOX_73 BODY: 7alpha-pock-3alpha 1.3 RDNS_NONE Delivered to internal network by a host with no rDNS 0.0 NO_RDNS2 Sending MTA has no reverse DNS 3.5 TO_NO_BRKTS_DIRECT To: misformatted and direct-to-MX

1 0

[Dovecot] Converting from 1.12 to 2.0 questions about mail location?
by Knute Johnson 06 Nov '11

06 Nov '11

I'm building a new server and using a newer version of ubuntu server that uses Dovecot 2.0. I thought I would like to use Maildir instead of the mbox that was used in the previous server. What do I have to do to convert my mbox mail to Maildir? Or should I just use mbox and copy it over :-)? Thanks, -- Knute Johnson

2 1

[Dovecot] Safely restoring backups
by Micah Anderson 05 Nov '11

05 Nov '11

I'm trying to determine what the best way to restore mail with mdbox is. Restoring using maildir was trivial, I just used rsync --ignore-existing which wrote any mails that were removed and didn't touch things that already existed[1]. With mdbox things have become more complicated, and I haven't found a way to restore mail that doesn't result in many message duplicates. My backup setup is simple, I'm doing daily rsync backups of user's mailstores, as well as weekly backups, so I end up having on my backup server daily.1, daily.2, daily.3, daily.4, weekly.1, weekly.2... each containing the entire contents of the user's mdbox. The different restore methods I've tried are: 1. I tried rsyncing the different backup directories back to the mail storage host, and then doing: 'dsync -R backup -u $user mdbox:/path/to/to/daily.1/mdbox'[2] 'dsync -R backup -u $user mdbox:/path/to/to/daily.2/mdbox' This works ok, but it gives duplicates of every mail that already exists for every daily/weekly I dsync. This is what the rsync --ignore-existing avoided. This is particularly annoying if I restore the weekly, and multiple daily directories, because then you get a copy for every one you restore. I had thought that the individual message's GIDs would keep them from being duplicated? 2. I also tried to use 'doveadm import' in two different ways. The first way I created a 'restored_from_backups' folder and then import each of the daily.#, weekly.# mdboxes into their own subfolder within that folder, for example: 'doveadm import -u $username mdbox:/path/to/daily.1/mdbox restored_from_backups/daily1 all' 'doveadm import -u $username mdbox:/path/to/daily.2/mdbox restored_from_backups/daily2 all' ... etc. I then go through and subscribe the new folders[3] and the user ends up with a folder structure like this: restored_from_backups/ daily.1/ INBOX Trash folder1 folder2 daily.2 INBOX Trash folder1 folder2 etc. This works fine, except that it results in the user having a entire duplicate copies of their mailbox for each daily/weekly that I restore. That will quickly bring people over quota. 3. I also tried to use 'doveadm import' to import all the different directories all into the same restored_from_backups directory, so there are no subdirectories for each daily/weekly under restored_from_backups, like so: 'doveadm mailbox create -u $user -s restored_from_backups' 'doveadm -v -D import -u $user mdbox:/path/to/daily.1/mdbox restored_from_backups all' I then go through and subscribe the folders[3]. Using this method, the 'restored_from_backups' mailbox is created, and populated with the folders. The only problem with this method is the same as method #1: for every backup I restore, mails are duplicated. Is there a way I can restore things from backup and avoid duplicates? Is there another method I should try? thanks for any ideas, pointers, suggestions for improvement, etc. micah 1. this would of course bring back mails that were deleted, but that was fine as the user could deal with that. 2. yes, I know I could setup dsync on the backup server, and use dsync directly to pull the mails from there, but this is complicated in my situation due to how the backupserver works. 3. why doesn't doveadm import have a -s option to subscribe? --

2 1

[Dovecot] Newbie Question/Feature Request
by Michael Papet 05 Nov '11

05 Nov '11

Hi, I'm working on a plugin for qpsmtpd (a perl smtp frontend) that delivers mail via dovecot's LDA. I can only get mail delivered by writing the email to file, then calling 'deliver -d someone -f someone-else < /path/to/temp/email' All good, expected behavior. A perl snippet: local $/=undef; open FH, "< ./demo.mail"; my $stringified = <FH>; # this is roughly equivalent to how other LDA queues work. close FH; open (CMD_OUT, " /usr/lib/dovecot/deliver -f somedude\(a)someplace.com -d anotherdude\(a)destination.dom $stringified |"); my $test = <CMD_OUT>; print $test; The above code errors out because the expected behavior is $stringified is supposed to be a file name. It would be great if deliver could be fed the email as a string so I don't have to add a step of writing to file. Or, maybe there's an undocumented method? Thanks. mpapet

2 1

[Dovecot] dsync with quotas
by Micah Anderson 05 Nov '11

05 Nov '11

I have been working on converting people from courier maildir -> dovecot mdbox and during some of the dsync runs I'm seeing the quota_exceeded_message be printed as an Error: dsync(<user>): Error: Can't save message to mailbox INBOX: You are over quota. To avoid losing mail, immediately empty your Trash and Sent folders and \ delete emails with large attachments. dsync(<user>): Info: INBOX: Couldn't keep all uids^M Its possible the user was over quota on the originating courier side, but I would still like to migrate their mail proprely to mdbox, but it seems like being over quota is inhibiting that. Are the quota calculations including both the maildir files as well as the converted mdbox files, resulting in a double counting? I'm not entirely sure if the messages above indicate that the migration failed for that user or not, so I've been manually increasing their quota, then redoing the dsync mirror until it works properly. I wonder if it would be better if I turned off quota entirely during migration so I don't run into this problem? thanks, micah --

2 2

[Dovecot] Group ACL
by Daniel L. Miller 05 Nov '11

05 Nov '11

Using Dovecot 2.0, LDAP userdb & passdb, with prefetch: hosts = myhost.mydomain dn = cn=x,cn=y dnpass = xyz123 auth_bind = yes auth_bind_userdn = uid=%n,ou=users,dc=x ldap_version = 3 base = ou=Users, dc=x user_attrs = =home=/var/mail/%d/%n, \ =mail=mdbox:/var/mail/%d/%n/mdbox, \ =uid=vmail, \ =gid=mail user_filter = (&(objectClass=inetOrgPerson)(mail=%u)) pass_attrs = mail=user, \ userPassword=password, \ =userdb_home=/var/mail/%d/%n, \ =userdb_mail=mdbox:/var/mail/%d/%n/mdbox, \ =userdb_uid=vmail, \ =userdb_gid=mail, \ =userdb_acl_groups='allshared' pass_filter = (&(objectClass=inetOrgPerson)(mail=%u)) iterate_attrs = mail=user iterate_filter = (&(objectClass=inetOrgPerson)(mail=*)) default_pass_scheme = plain I have added permissions for "$allshared" to a mailbox's Inbox. It does not appear in the shared folders list. Other mailboxes, with explicit permission for a given username, work fine. What am I doing wrong? -- Daniel

2 1

Re: [Dovecot] Dot Lock timestmap, users disconnections from roundcube
by Maria Arrea 05 Nov '11

05 Nov '11

Timo, we are not using NFS, we use remote iSCSI volumes with ext4. Regards Maria ----- Original Message ----- From: Timo Sirainen Sent: 11/04/11 09:59 PM To: Maria Arrea Subject: Re: [Dovecot] Dot Lock timestmap, users disconnections from roundcube On Thu, 2011-11-03 at 10:54 +0100, Maria Arrea wrote: > Hello. > > We are running dovecot 2.0.13 with mdbox+zlib on RHEL 5.7 x64, ext4. We use NTP. Indexes are in a iSCSI raid 10, mailboxes in raid5. No NFS. We have detected that sometimes all users get disconnected from roundcube at the same time. In dovecot logs we hundreds of lines like this: > > Nov 3 09:23:07 buzon dovecot: imap(mcrivero@mydomain): Warning: Created dotlock file's timestamp is different than current time (1320308587 vs 1320308542): /buzones/mydomain/03/67/mcrivero/subscriptions I did several fixes related to this, but they were already in v2.0.10. Note the time difference of 45 seconds. > Nov 3 09:23:07 buzon dovecot: imap(mcrivero@mydomain): Connection closed bytes=0/295 The dotlock warning isn't related to this. My guess: NFS was being extremely slow here, some operation took 45 seconds and Roundcube decided to abort before that. The "timestamp is different" check doesn't work 100% correctly if the filesystem operations take more than a second.

2 1

[Dovecot] Bad creation timestamp of migrated mails (maildir format)?
by Lukas Weiß 05 Nov '11

05 Nov '11

Hello everybody, ive just switched to dovecot imap because dbmail i used before is not developed any further and sql storage is difficult to backup. Ive done that, by setting up dovecot with maildir format and copy mails from old dbmail to new dovecot imap server with my mail client (thunderbird). Unfortunately migrating to dovecot brought me some problems with my Android K9 Mail client: Sync with IMAP-Server shows me only the oldest mails. I think the problem is, that K9 only fetches the newest mails (25) from the server (to save memory etc). Which mail is "new" is probably determined by creation timestamp of the email-files in my mailbox, which was copied newest first on migration from dbmail to dovecot. So the older mails have the newer creation timestamp on file system. Do you have any suggestions how to fix that problem? Maybe migrate to dbox mailbox format? BTW: New mails show up correctly, as the creation timestamp is new. Thanks Lukas

3 6

[Dovecot] fts-lucene vs SEARCH header Re: 2.1: problems compiling fts-lucene - CLucene git version necessary?
by Lutz Preßler 05 Nov '11

05 Nov '11

On Tue, 20 Sep 2011, Lutz Preßler wrote: > On Mo, 19 Sep 2011, Timo Sirainen wrote: > > > On Sun, 2011-09-18 at 13:27 +0200, Lutz Preßler wrote: > > > Hello, > > > On So, 11 Sep 2011, Timo Sirainen wrote: > > > dovecot: imap(...): Error: fts_lucene: default_language set, but Dovecot built without stemmer support > > > > Fixed: http://hg.dovecot.org/dovecot-2.1/rev/02c84406c661 > Without stemmer support it works nicely now though. Next problem :-) side effect: my test setup (some commits ago) with fts = lucene in plugin section (ftps_lucene plugin without stemmer support): SEARCH header is not working (empty result sets, no logging). Tested in different circumstances (and also happening with virtual folders). Simply disable fts option (while module is still loaded) or use fts=sqat to have header search working correctly again. Lutz

2 1

[Dovecot] dovecot: 2011-11-04 16:58:01 Error: IMAP(<user>): FETCH for mailbox Trash UID 42022 got too little data: 90900 vs 1529791
by Noah 05 Nov '11

05 Nov '11

Hi there I keep getting the following errors scrolling in my dovecot logs. I am wondering how I can nail down what is creating that problem. dovecot: 2011-11-04 16:58:01 Error: IMAP(<usr>): FETCH for mailbox Trash UID 42022 got too little data: 90900 vs 1529791 also I have a trash folder with over 100k messages in mbox format. I am wondering if migrating to Maildir format would make it easier and quicker for dovecot to index my mail. I am getting these types of errors from time to time. dovecot: 2011-10-30 20:32:58 Error: IMAP(<user>): Timeout while waiting for lock for transaction log file /home/<user>/mail/.imap/INBOX/dovecot.index.log Cheers, Noah

2 1

[Dovecot] [PATCH] Use SSL_MODE_RELEASE_BUFFERS if available to keep memory usage low
by Cristian Rodríguez 05 Nov '11

05 Nov '11

# HG changeset patch # User Cristian Rodríguez <crrodriguez(a)opensuse.org> # Date 1318533592 10800 # Node ID c15d6befe20082009cb40926afa208ab4b684818 # Parent 962df5d9413a4a0fcc68aacc1df0dca7a44a0240 Use SSL_MODE_RELEASE_BUFFERS if available to keep memory usage low. diff -r 962df5d9413a -r c15d6befe200 src/login-common/ssl-proxy-openssl.c --- a/src/login-common/ssl-proxy-openssl.c Wed Oct 12 17:16:10 2011 +0300 +++ b/src/login-common/ssl-proxy-openssl.c Thu Oct 13 16:19:52 2011 -0300 @@ -925,6 +925,9 @@ STACK_OF(X509_NAME) *xnames = NULL; SSL_CTX_set_options(ssl_ctx, SSL_OP_ALL | SSL_OP_NO_SSLv2); +#ifdef SSL_MODE_RELEASE_BUFFERS + SSL_CTX_set_mode(ssl_ctx, SSL_MODE_RELEASE_BUFFERS); +#endif if (*set->ssl_ca != '\0') { /* set trusted CA certs */ store = SSL_CTX_get_cert_store(ssl_ctx);

2 1

Re: [Dovecot] lmtp performance
by Juan Carlos Sanchez 04 Nov '11

04 Nov '11

A particular reply (not to the list) has told me to try: " Add to service lmtp: process_min_avail = 20 " And yes, it works (unless for me), so I want to share it with everybody. Have not exactly measured performance but this morning have seen over 1400 messages/minute with lmtp under heavy load. What the "process_min_avail = 20" in service lmtp (or anywhere else) exactly imply? cannot find a reference in wiki2 . I suppose it means than 20 lmtp processes are always open waiting for new connections and so reducing startup latency, isn't it? Thank you. > > On Mon, Oct 17, 2011 at 6:06 AM, Juan Carlos Sanchez > <juancarlos.sanchez(a)upm.es <mailto:juancarlos.sanchez@upm.es>> wrote: > > Hello: > > In the process of migration from version 1.2 to 2.0 have tried to > use lmtp instead of lda as delivery agent. > > But unfortunately througput we get is poor with lmtp compared to lda. > In peak times with lda we are able to deliver over 1800 > messages/minute (high I/O but not affecting service) but if we > switch to lmtp cannot deliver more than 300 mess/minute (very low > I/O). > > This is enough for normal work but low under heavy load > (distribution lists messages sometimes stay queued for 4 hours > before deliver). > > We have arround 50000 boxes and use postfix as MTA > > How to increase lmtp performance? > > > dovecot config for lda and lmtp: > > protocol lda { > auth_socket_path = /usr/local/var/run/dovecot/auth-master > info_log_path = /var/log/mail/dovecot_deliver.log > log_path = /var/log/mail/dovecot_deliver.log > mail_plugins = quota sieve zlib > postmaster_address = postmaster(a)upm.es <mailto:postmaster@upm.es> > sendmail_path = /usr/lib/sendmail > } > > protocol lmtp { > info_log_path = /var/log/mail/dovecot_deliver.log > log_path = /var/log/mail/dovecot_deliver.log > mail_plugins = quota sieve zlib > postmaster_address = postmaster(a)upm.es <mailto:postmaster@upm.es> > sendmail_path = /usr/lib/sendmail > } > > In postfix I have: > > mailbox_transport = lmtp:unix:private/dovecot-lmtp > > > > Thanks in advance. > > -- > > ------------------------------------------------------ > Juan Carlos Sanchez Hernandez > Universidad Politecnica de Madrid > ------------------------------------------------------ > > > -- ------------------------------------------------------ Juan Carlos Sanchez Hernandez Universidad Politecnica de Madrid ------------------------------------------------------

3 2

[Dovecot] imap proxy for Gmail
by Jumping Mouse 04 Nov '11

04 Nov '11

Hello, b I have a situation were I want to be able to give teachers access to their Google apps for education email through Squirrelmail. The network that they are on blocks gmail. I am able to get Squirrelmail to communicate with Gmail via imap. I am looking at getting persistant imap connections to improve the user experience. I have looked at IMAPPROXY but this application is not compatible with the gmail imaps (ssl-encrypted imap over port 993). I recall reading somewhere that Dovecot has a built in imapproxy that could be used for this. Can someone please point me to documentation or other information on how I might achieve the above stated goal? Thanks, Kafriki

3 2

[Dovecot] Proxy and Virtual IMAP Folders
by Pedro Paixao 04 Nov '11

04 Nov '11

Hi all I am a newbie to dovecot and I would like some help clarifying a feature to determine if I can use it in my project. Is is posible to use the virtual plugin, in a IMAP proxy configuration, in a way that the virtual plugin searches messages on the real server? Here's my scenario: [Client]----[Dovecot Proxy]-----[Real Imap Server] Client connects to Dovecot Proxy and gets all the folders that are on the Real Imap Server, plus some virtual ones (generated by Dovecot Proxy) that search for messages on the real server. In my config the Dovecot Proxy has no email messages, real folders, or local delivery. I would like to thank you in advance for ant help and support. All the best Pedro

2 1

[Dovecot] doveadm segfaults on TCP connect - version 2.0.15
by ghandidrivesahumvee＠rocketfish.com 04 Nov '11

04 Nov '11

Hi list, I just recently installed Dovecot 2.0.15. Unfortunately, doveadm segfaults when I attempt to connect to the local dovecot instance. When this occurs, my logs show: 2011-10-19T12:31:23-07:00 mail02 dovecot: doveadm: Error: doveadm client not compatible with this server (mixed old and new binaries?) I am using the settings listed on the wiki page http://wiki2.dovecot.org/Director [root@mail02 ~]# /opt/dovecot/bin/doveadm who -a 10.10.5.220:544 Segmentation fault (core dumped) doveconf and gdb output are below. If there is any more information I can provide please let me know. Thanks! [root@mail02 ~]# /opt/dovecot/bin/doveconf -n # 2.0.15: /opt/dovecot-2.0.15/etc/dovecot/dovecot.conf # OS: Linux 2.6.18-194.17.4.el5 x86_64 CentOS release 5.5 (Final) auth_mechanisms = plain login auth_verbose = yes auth_worker_max_count = 60 default_client_limit = 2048 disable_plaintext_auth = no doveadm_proxy_port = 544 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes listen = 10.10.5.220, 127.0.0.1 lmtp_save_to_detail_mailbox = yes mail_fsync = always mail_log_prefix = "%r mpid=%p %s(%u): " mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = " notify mail_log" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mmap_disable = yes passdb { args = /opt/dovecot/etc/dovecot/conf.d/dovecot-sql.conf.ext driver = sql } plugin { mail_log_events = delete expunge mailbox_delete mail_log_fields = msgid box from mail_log_group_events = yes sieve = ~/MainSieve sieve_before = /storage03/sieve/before/ sieve_dir = ~/sieve sieve_max_actions = 32 sieve_max_redirects = 4 sieve_max_script_size = 2M } quota_full_tempfail = yes service anvil { client_limit = 2000 } service auth { client_limit = 7000 unix_listener /var/spool/postfix/private/auth { mode = 0600 user = postfix } unix_listener auth-userdb { group = mailowner mode = 0600 user = mailowner } } service doveadm { inet_listener { port = 544 } } service imap-login { inet_listener imap { port = 143 } process_min_avail = 4 service_count = 0 vsz_limit = 128 M } service imap {%0

5 6

[Dovecot] Rewrite the ostream output method, to save messages in another directory.
by Alex Baule 04 Nov '11

04 Nov '11

Hi Timo, I Trying to integrate my antispam with dovecot, using the imap folder to do certain actions. I Do almost every thing, but i have some problems saving the message. Explaining this function, i try to use a imap folder like a "collector folder", the user append a message from outside (ie another imap or pop message) to this folder, and i don't want to copy this message, i need to redirect it to another folder outside from user's maildir. Well, i try to base it in zlib plugin, with was the o_stream_create_gz(). Inside the o_stream_create_gz has the Output, it's a copy from the original output. I Try to replace this output, with another one, that i try to create to another location, without sucessfull. struct ostream * o_stream_create_X_list(struct ostream *output, struct istream *input, const char *type) { struct emexis_ostream *X_stream; struct ostream *new_output; int fd; fd = open("/tmp/email",O_WRONLY); new_output = o_stream_create_fd_file(fd, 0, TRUE); o_stream_cork(new_output); emexis_stream = i_new(struct emexis_ostream, 1); emexis_stream->ostream.sendv = o_stream_X_sendv; emexis_stream->ostream.flush = o_stream_X_flush; emexis_stream->ostream.iostream.close = o_stream_X_close; emexis_stream->output = new_output; emexis_stream->input = input; o_stream_ref(new_output); return o_stream_create(&X_stream->ostream); } With this new o_stream, i got this error. Oct 27 15:14:24 brc dovecot: imap(alex(a)exemplo.com.br): Error: o_stream_send_istream(/storage/gss/emexis/messages/ exemplo.com.br/alex/Maildir/.Emexis.Ext-Blacklist/tmp/1319735664.M568409P30815.brc) failed: Bad file descriptor Oct 27 15:14:24 brc dovecot: imap(alex(a)exemplo.com.br): Error: o_stream_flush(/storage/gss/emexis/messages/ exemplo.com.br/alex/Maildir/.Emexis.Ext-Blacklist/tmp/1319735664.M568409P30815.brc) failed: Bad file descriptor Oct 27 15:14:24 brc dovecot: imap(alex(a)exemplo.com.br): Error: write(/storage/gss/emexis/messages/ exemplo.com.br/alex/Maildir/.Emexis.Ext-Blacklist/tmp/1319735664.M568409P30815.brc) failed: Bad file descriptor There is something wrong Timo ? Like missing something or i need to rewrite another funcion ? Tks !!!

2 1