- dovecot - dovecot.org

[Dovecot] FTS indexing
by Ralf Hildebrandt 11 Sep '12

11 Sep '12

I'm reacreating all FTS indices on all my users' INBOX folders: mkdir ~%s/Maildir/lucene-indexes && chown %s:users ~%s/Maildir/lucene-indexes doveadm index -u %s -q INBOX In "ps auxwww" I'm seeing this: tbudkevy 29186 3.7 0.0 6616 3056 ? S 18:11 0:15 dovecot/indexer-worker [tschuetz INBOX] how can a dovecot/indexer-worker actually access the INBOX of the user "tschuetz" (where "tbudkevy" doesn't have access, due to the different UID)...? Should ~%s/Maildir/lucene-indexes be filled after having run the command sequence for all users? -- Ralf Hildebrandt Geschäftsbereich IT | Abteilung Netzwerk Charité - Universitätsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt(a)charite.de | http://www.charite.de

2 5

[Dovecot] Quota less mailbox with mdbox
by Héctor Moreno Blanco 11 Sep '12

11 Sep '12

Good morning everyone, I have a little doubt about setting a quotaless mailbox with mdbox. Currently we have dovecot 2.0.10 with Maildir as mailbox system. We want to migrate to mdbox. The migration is simple and easy, but there are some configuration settings we cannot set to work properly. In our dovecot with Maildir we have the namespace INBOX with certain quota and another one without quota. This is working like a charm. Dovecot.conf: ... namespace { separator = . prefix = inbox = yes type = private } namespace { inbox = no location = prefix = INBOX. separator = . hidden = yes type = private list = no } namespace { location = maildir:%h/Maildir/_backup prefix = _backup. separator = . type = private } ... plugin/quota = maildir:_backup:ns= ... Dovecot-ldap.conf: ... pass_filter = (&(objectClass=qmailUser)(uid=%u)(accountActive=TRUE)) pass_attrs = uid=user,userPassword=password, mailQuotaSize=quota_rule=*:bytes=%$ user_attrs = mailMessageStore=home, mailQuotaSize=quota_rule=*:bytes=%$ user_filter = (&(objectClass=qmailUser)(|(mailAlternateAddress=%u)(mail=%u)(uid=%u))(accountActive=TRUE)) ... When migrated to mdbox and changing the configuration, we don't know how to get it work. We have also tried to follow the instructions from the wiki of dovecot2 without success. Could anyone give us a clue please? If additional information is needed, please let me know. Thank you very much in advanced. Kind regards. ________________________________ [Descripción: C:\Documents and Settings\hhmb\Datos de programa\Microsoft\Firmas\logo_gmv.gif] Héctor Moreno Blanco División de Seguridad e Infraestructuras / Security and Infrastructures Division GMV Isaac Newton, 11 P.T.M. Tres Cantos E-28760 Madrid Tel. +34 91 807 21 00 Fax +34 91 807 21 99 www.gmv.com <http://www.gmv.com/> [Descripción: C:\Documents and Settings\hhmb\Datos de programa\Microsoft\Firmas\icon_blog.gif]<http://www.gmv.com/b2_gmv> [Descripción: C:\Documents and Settings\hhmb\Datos de programa\Microsoft\Firmas\icon_facebook.gif]<http://www.facebook.com/infoGMV> [Descripción: C:\Documents and Settings\hhmb\Datos de programa\Microsoft\Firmas\icon_twitter.gif]<http://www.twitter.com/infoGMV_es> [Descripción: C:\Documents and Settings\hhmb\Datos de programa\Microsoft\Firmas\icon_youtube.gif]<http://www.youtube.com/infoGMV> P Please consider the environment before printing this e-mail. ______________________ This message including any attachments may contain confidential information, according to our Information Security Management System, and intended solely for a specific individual to whom they are addressed. Any unauthorised copy, disclosure or distribution of this message is strictly forbidden. If you have received this transmission in error, please notify the sender immediately and delete it. ______________________ Este mensaje, y en su caso, cualquier fichero anexo al mismo, puede contener informacion clasificada por su emisor como confidencial en el marco de su Sistema de Gestion de Seguridad de la Informacion siendo para uso exclusivo del destinatario, quedando prohibida su divulgacion copia o distribucion a terceros sin la autorizacion expresa del remitente. Si Vd. ha recibido este mensaje erroneamente, se ruega lo notifique al remitente y proceda a su borrado. Gracias por su colaboracion. ______________________

3 2

[Dovecot] Memory leak by getting the virtual size of a IMAP folder
by Dafan Zhai 11 Sep '12

11 Sep '12

Hi everyone, I am writing a dovecot statistic plugin, which calls the 'mailbox_get_metadata' function with MAILBOX_METADATA_VIRTUAL_SIZE as the 2nd parameter. enum mailbox_status_items metadata_items = MAILBOX_METADATA_VIRTUAL_SIZE; struct mailbox_metadata metadata; mailbox_get_metadata(mailbox, metadata_items, &metadata); but Valgrind finds a memory leak when this function is called: ---------------------------------------------------snip-------------------------------------------------------------- ==10304== 12,288 bytes in 3 blocks are definitely lost in loss record 74 of 76 ==10304== at 0x40222A4: calloc (in /usr/lib/valgrind/vgpreload_memcheck-x86-linux.so) ==10304== by 0x416EE9F: block_alloc (mempool-alloconly.c:237) ==10304== by 0x416F16C: pool_alloconly_create (mempool-alloconly.c:140) ==10304== by 0x409C07D: mail_search_build_init (mail-search-build.c:187) ==10304== by 0x40C77F1: index_mailbox_get_metadata (index-status.c:200) ==10304== by 0x4067102: maildir_mailbox_get_metadata (maildir-storage.c:486) ==10304== by 0x409F78B: mailbox_get_metadata (mail-storage.c:1298) ==10304== by 0x490492D: mailbox_status_update (statistic-plugin.c:310) ==10304== by 0x4904E2E: statistic_mail_save (statistic-plugin.c:426) ==10304== by 0x41A054D: notify_contexts_mail_save (notify-plugin.c:61) ==10304== by 0x41A104F: notify_save_finish (notify-storage.c:143) ==10304== by 0x409EE94: mailbox_save_finish (mail-storage.c:1673) ---------------------------------------------------snip-------------------------------------------------------------- I have looked into the source code, and found that from the 'mail_search_build_init' function call in lib-storage/index/index-status.c:200 a pool is created, but the pool is not freed in the mailbox_search_deinit function call in lib-storage/index/index-status.c:218. This may be the reason of the memory leak. But I do not know how to free the pool. It seems to me that doveadm is having the same memory leak because it is using 'mail_search_build_init' too. ---------------------------------------------------snip-------------------------------------------------------------- # valgrind --leak-check=full doveadm mailbox status -u testuser1 vsize INBOX ==10457== Memcheck, a memory error detector ==10457== Copyright (C) 2002-2010, and GNU GPL'd, by Julian Seward et al. ==10457== Using Valgrind-3.6.1 and LibVEX; rerun with -h for copyright info ==10457== Command: doveadm mailbox status -u testuser1 vsize INBOX ==10457== INBOX vsize=41643319 ==10457== ==10457== HEAP SUMMARY: ==10457== in use at exit: 4,356 bytes in 3 blocks ==10457== total heap usage: 440 allocs, 437 frees, 539,124 bytes allocated ==10457== ==10457== 4,096 bytes in 1 blocks are definitely lost in loss record 3 of 3 ==10457== at 0x40222A4: calloc (in /usr/lib/valgrind/vgpreload_memcheck-x86-linux.so) ==10457== by 0x41AEE9F: ??? (in /usr/lib/dovecot/libdovecot.so.0.0.0) ==10457== by 0x41AF16C: pool_alloconly_create (in /usr/lib/dovecot/libdovecot.so.0.0.0) ==10457== by 0x40DC07D: mail_search_build_init (in /usr/lib/dovecot/libdovecot-storage.so.0.0.0) ==10457== by 0x8057EB8: doveadm_mail_mailbox_search_args_build (in /usr/bin/doveadm) ==10457== by 0x805855A: ??? (in /usr/bin/doveadm) ==10457== by 0x8053A7B: doveadm_mail_single_user (in /usr/bin/doveadm) ==10457== by 0x8053D2B: ??? (in /usr/bin/doveadm) ==10457== by 0x80541CF: doveadm_mail_try_run (in /usr/bin/doveadm) ==10457== by 0x805B863: main (in /usr/bin/doveadm) ==10457== ==10457== LEAK SUMMARY: ==10457== definitely lost: 4,096 bytes in 1 blocks ==10457== indirectly lost: 0 bytes in 0 blocks ==10457== possibly lost: 0 bytes in 0 blocks ==10457== still reachable: 260 bytes in 2 blocks ==10457== suppressed: 0 bytes in 0 blocks ==10457== Reachable blocks (those to which a pointer was found) are not shown. ==10457== To see them, rerun with: --leak-check=full --show-reachable=yes ==10457== ==10457== For counts of detected and suppressed errors, rerun with: -v ==10457== ERROR SUMMARY: 1 errors from 1 contexts (suppressed: 122 from 35) ---------------------------------------------------snip-------------------------------------------------------------- Dovecot version: 2.1.9 OS: Linux 3.0.30-dist i686 maildir:~/Maildir:LAYOUT=fs:INBOX=~/Maildir/INBOX I have applied the following patches from the dovecot 2.1 branch fixing memory leaks: http://hg.dovecot.org/dovecot-2.1/rev/7bdbca7b0913 http://hg.dovecot.org/dovecot-2.1/rev/963482677c0b It would be nice if you could give me some hints how I can address this issue? Thanks in advance! Greetings, Dafan

2 2

[Dovecot] dovecot proxy ssl-parameter from database?
by Daniel Funke 11 Sep '12

11 Sep '12

Hi List, I want to migrate my IMAP-users from an old Courier-IMAP-Server to a new dovecot-Server. The old server supports IMAP without and with TLS. The new one only with TLS. To users should be migrated one by one with changing some client parameters. To leave the servername of the imap server I want to use the dovecot proxy during migration. the proxy uses a sql db to look for the old or new host for every user. So far all works fine. My question is the TLS or noTLS connection from the client to the proxy. How can I make the ssl-parameter user-dependant? clients to the old courier server should work without or with tls through the proxy and clients to the new dovecot server should only work WITH TLS between Client and proxy. (After migration of all clients the proxy should be switched off an all clients connect directly to the dovecot server.) I tried with http://wiki2.dovecot.org/UserDatabase/ExtraFields and returned a field "userdb_ssl" ("required" for host dovecot, "yes" for host courier). But it doesn't work. A migrated user can still login without tls to the proxy and the dovecot backend. Any ideas? Daniel Here is my doveconf -n # 2.1.9: /opt/dovecot/etc/dovecot/dovecot.conf doveconf: Warning: service anvil { client_limit=1000 } is lower than required under max. load (1503) # OS: Linux 2.6.32-279.2.1.el6.x86_64 x86_64 CentOS release 6.3 (Final) auth_mechanisms = plain login default_process_limit = 500 disable_plaintext_auth = no listen = * managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave passdb { args = /opt/dovecot/etc/dovecot/sql.conf driver = sql } protocols = imap pop3 service imap-login { inet_listener imaps { port = 0 } } service pop3-login { inet_listener pop3s { port = 0 } } ssl_cert = </etc/pki/tls/certs/server.crt ssl_key = </etc/pki/tls/private/server.key userdb { driver = prefetch } verbose_proctitle = yes

2 1

[Dovecot] Alerts when process limits are met
by David Anderson 11 Sep '12

11 Sep '12

Hi, I've not found the answer to this question anywhere - please forgive me if I overlooked. I'd like to be able to be automatically alerted if process limits are hit (e.g. max POP3 logins). Is there a way that I can configure a script to be run, in the same way that I can with quota warnings? I can of course use logwatch, but this alerts me the next day, and logwatch can be noisy and it's easy to overlook. My motivation: for some reason my POP3 listener was hanging, and I had to restart dovecot (this is 2.0.9). But I was not aware - the process was still there, it was accepting connections (but not doing anything useful with them) and was actually managing to log the fact that the process limit was being hit (as more and more connections came in). If I could have been alerted I could have restarted dovecot earlier. Many thanks, David -- WordShell - WordPress fast from the CLI - www.wordshell.net

3 2

[Dovecot] ACL MySQL dict: to_user==from_user entries
by Roland Rosenfeld 11 Sep '12

11 Sep '12

Hi! We run dovecot 2.1.6 with ACL support and MySQL dict for shared/shared-boxes/user/$to/$from. When a user does a SETACL (via IMAP) to himself he is added as $to and $from to the MySQL dict. Se for example this IMAP conversation: 5 GETACL INBOX * ACL "INBOX" "user@domain" lrwstipekxacd 5 OK Getacl completed. 6 SETACL INBOX user@domain lrwstipekxacd 6 OK Setacl complete. 7 GETACL INBOX * ACL "INBOX" "user@domain" akxeilprwtscd 7 OK Getacl completed. As you can see, user@domain sets the ACL of his INBOX to the same value it was set before (reading it from the server after this idempotent write changed the order but none of the flags). But after "SETACL INBOX user@domain lrwstipekxacd" I see a new entry in my imap_acl_shares table where to_user and from_user both contain the value "user@domain". As far as I can see, this entry does not make much sense in the database, because every user should be able so see its own folders. But adding this line may blow up the database especially according to the full table scan problem for acl dict rebuild mentioned in http://www.dovecot.org/list/dovecot/2012-August/067548.html. Does it make sense to run a daily cron job, that removes all entries with from_user=to_user or may this cause other inconsistencies? If you need to have a look at my complete setup, it's in http://www.dovecot.org/list/dovecot/2012-July/067130.html, so I don't have to clone this here. Tschoeeee Roland

2 1

[Dovecot] imap_idle_notify_interval
by Andreas Meyer 11 Sep '12

11 Sep '12

Hi! I want to change the imap_idle_notify_interval t0 29 minutes and have edited the 20-imap.conf with imap_idle_notify_interval = 29 mins and restarted the server. doveconf -n shows me this: .... protocol imap { imap_idle_notify_interval = 29 mins mail_max_userip_connections = 10 mail_plugins = " quota imap_quota autocreate" } .... doveconf |grep idle shows me the following output: default_idle_kill = 1 mins imap_idle_notify_interval = 2 mins mailbox_idle_check_interval = 30 secs idle_kill = 0 idle_kill = 4294967295 secs idle_kill = 0 idle_kill = 0 idle_kill = 0 idle_kill = 0 idle_kill = 4294967295 secs idle_kill = 0 idle_kill = 0 idle_kill = 0 idle_kill = 0 idle_kill = 0 idle_kill = 0 idle_kill = 0 idle_kill = 0 idle_kill = 4294967295 secs idle_kill = 0 idle_kill = 0 idle_kill = 0 idle_kill = 0 idle_kill = 4294967295 secs idle_kill = 0 idle_kill = 4294967295 secs imap_idle_notify_interval = 29 mins I see two line of imap_idle_notify_interval. What is the right one? Greetings Andreas

2 2

[Dovecot] Is it possible to save only some messages compressed to mdbox? (2.1.6)
by Jost Krieger 11 Sep '12

11 Sep '12

I'm trying to save some messages as compressed (via zlib plugin) and it doesn't seem to work. Here's a log line (I'm logging to stderr): d k 1345467448.705591500 1345467448.705596500 1345467448.974808500 1650 <XXXXXXXXXXXXXXXXXXXXXXXXXX(a)YYY.ruhr-uni-bochum.de> local.jost.krieger+hirn(a)ruhr-uni-bochum.de 10909 80 Extra: -o plugin/zlib_save_level=9 -o plugin/zlib_save=bz2 lda(kriegjcb): Info: msgid=<20120820125728.58CC9172B6C(a)c2-4-7.noc.ruhr-uni-bochum.de>: saved mail to Hirn-2012-08 did 0+0+1 This probably doesn't make much sense to anyone except the last line but 1. It is a somewhat complicated qmail/maildrop/dovecot setup, which works for the standard cases. The Extra gets interpolated into the lda command and this works because an incorrect option blows up the delivery. The mails arrive uncompressed. So here's the questions: 1. Is it possible to have compressed/uncompressed mails mixed in an mdbox? 2. Will it work via "-o" in lda delivery? I tried to find out in the source but found it hard to see which options are pulled in when. Thanks Jost Krieger -- | Helft Spam ausrotten! HTML in Mail ist unhöflich. | | Postmaster, JAPH, manchmal Wahrsager am RZ der RUB | | Wahre Worte sind nicht gefällig, gefällige Worte sind nicht wahr.| | Lao Tse, Tao Te King 81 |

2 2

Re: [Dovecot] ChgrpNoPerm issue
by Joseph Tam 11 Sep '12

11 Sep '12

Robert JR <roundcube222(a)alaadin.org> writes: > The problem is /var/mail (Owner is > useraccount and the group us mail) , and here comes the problem > Dovecot > keeps trying to chown the imap folder inside the homedirectory with > user:mail account and since > And this is the reason of error that appears > in my log file. Dovecot is trying to keep the permission of your index caches consistent with that of your mailbox it indexes. The INBOX index cache is kept in your user's mail directory (as per your default settings), although you can change that location. > The option mail_access_groups=mail solve the problem.. > but I read it is not secure.. > With my current configutation, users login > with imap to read mail , can they use > any the mail_access_groups=mail > and read other poeple mail ? Yes, that's the security problem. > does my configutation > is a shard mailbox > and could be unsecure.. Could not parse your question/comment. > why didnot have > this issue with uw-imapd? and why dovecot try to chown the .imap > folder > with the mail group ? uw-imapd was not as picky. The extra consideration for group ownership is so that shared access to mailbox files, and their associated index caches, remain consistent. For example, if you shared a mailbox among your colleagues in group "staff" and the mailbox has group=staff,perm=g+rw, then the index caches will inherit those permissions, and members of group staff can access mailbox and indices alike. [You later write ...] > Sep 9 11:22:30 dovecot: pop3(r): Error: > fchown(/home/r/.imap/INBOX/dovecot.index.log.newlock, -1, 12(mail)) > failed: Operation not permitted (egid=501(r), group based on > /var/mail/r) > > i know that chmod 0600 /var/mail , will solve the problem > and i will no longer receive the above errors again You also have to make sure that autocreated INBOXs (i.e. a brand new account) does not start out with anything other than 0600. You may have to use dovecot's LDA or twist your LDA's arm to create mailboxes that way. I guess you can also avoid these errors by using memory indices, but you forego the advantages of persistent indices. > But my question is > that incase i did not set chmod /var/mail 0600, can i ignore such > errors, is these errors harmful ? if this errors keep coming and i > ignored them would this cause mbx corruption .. please advise No, you can't ignore these errors. They will break IMAP access to those mailboxes (as you will find out). Joseph Tam <jtam.home(a)gmail.com>

1 0

[Dovecot] precise reading of plugin deleted to trash
by ml 10 Sep '12

10 Sep '12

hello timo and other dev after a precise reading of plugin deleted to trash it appears to me like things more varariables are declared NULL in the code. it appears to me as being possible to achieve actions even if messages with the same id appears several times in different INBOX when it is the exact order of things -- http://pgp.mit.edu:11371/pks/lookup?op=get&search=0xC2626742 gpg --keyserver pgp.mit.edu --recv-key C2626742 http://about.me/fakessh http://urlshort.eu fakessh @ http://gplus.to/sshfake http://gplus.to/sshswilting http://gplus.to/john.swilting https://lists.fakessh.eu/mailman/ This list is moderated by me, but all applications will be accepted provided they receive a note of presentation

1 0

[Dovecot] Chown ChgrpNoPerm problem
by Robert JR 10 Sep '12

10 Sep '12

Hello, I just have a one simple question. my logs has the following entries Sep 9 02:48:10 dovecot: pop3(r): Error: fchown(/home/r/mail/.imap/INBOX/dovecot.index.log.newlock, -1, 12(mail)) failed: Operation not permitted (egid=501(r), group based on /var/mail/r) Sep 9 11:22:30 dovecot: pop3(r): Error: fchown(/home/r/.imap/INBOX/dovecot.index.log.newlock, -1, 12(mail)) failed: Operation not permitted (egid=501(r), group based on /var/mail/r) i know that chmod 0600 /var/mail , will solve the problem and i will no longer receive the above errors again But my question is that incase i did not set chmod /var/mail 0600, can i ignore such errors, is these errors harmful ? if this errors keep coming and i ignored them would this cause mbx corruption .. please advise My dovecot conf is disable_plaintext_auth = no mail_debug = yes mail_location = mbox:~/mymail:INBOX=/var/mail/%u mbox_write_locks = fcntl passdb { driver = pam } ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { driver = passwd } protocol pop3 { pop3_uidl_format = %08Xu%08Xv } Thanks. Robert

1 0

[Dovecot] ChgrpNoPerm issue
by Robert JR 09 Sep '12

09 Sep '12

I have dovecot version 2.0.9 I am confused about this article http://wiki2.dovecot.org/Errors/ChgrpNoPerm my mail_location = mbox:~/mymail:INBOX=/var/mail/%u So my inbox is at var/mail/ and my imap folder is /home/user/mymail The problem is /var/mail (Owner is useraccount and the group us mail) , and here comes the problem Dovecot keeps trying to chown the imap folder inside the homedirectory with user:mail account and since And this is the reason of error that appears in my log file. The option mail_access_groups=mail solve the problem.. but I read it is not secure.. With my current configutation, users login with imap to read mail , can they use any the mail_access_groups=mail and read other poeple mail ? does my configutation is a shard mailbox and could be unsecure.. my main quesion , for my current configuration , can i use mail_access_groups=mail safely or can some user use this to read other people mail ? attached my configuration. why didnot have this issue with uw-imapd? and why dovecot try to chown the .imap folder with the mail group ? dovecot -n output is # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-279.2.1.el6.x86_64 x86_64 CentOS release 6.3 (Final) disable_plaintext_auth = no mail_debug = yes mail_location = mbox:~/mymail:INBOX=/var/mail/%u mbox_write_locks = fcntl passdb { driver = pam } ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { driver = passwd } protocol pop3 { pop3_uidl_format = %08Xu%08Xv } [ Robert

1 0

[Dovecot] Sieve command line tool status for Refiltering
by Dieter Knopf 09 Sep '12

09 Sep '12

Hello, is there any update about the sieve command line tool? I really need some way to refilter my mails without loosings flags and without moving all messages in a different folder. This is possible with procmail via direct access to the file system without the need of getmail. Thanks

3 5

[Dovecot] Auth worker max line size
by Emmanuel Dreyfus 09 Sep '12

09 Sep '12

Hello I have been playing with some exotic authentication scheme with Dovecot and PAM. That involves sending really large base64 encoded data as the IMAP password, and I have hit a line limit in Dovecot, with AUTH_WORKER_MAX_LINE_LENGTH set to 1024. This limit is especially frustrating since other parts of the software use much larger limits: MAX_INBUF_SIZE 4096 MAX_IMAP_LINE 8192 AUTH_CLIENT_MAX_LINE_LENGTH 8192 I had to make the patch attached below to get my authentication working. I can live with this local patch, but given the much more liberal limits of MAX_INBUF_SIZE at 4096 makes we wonder if this 1024 limit on AUTH_WORKER_MAX_LINE_LENGTH could not be a bug. Or is there a security concern at using more than 1kB? Opinions? (please Cc: me, I'm not subscribed ot the list) --- src/auth/auth-worker-client.h.orig 2009-06-23 18:32:15.000000000 +0200 +++ src/auth/auth-worker-client.h 2009-06-23 18:32:33.000000000 +0200 @@ -1,8 +1,8 @@ #ifndef AUTH_WORKER_CLIENT_H #define AUTH_WORKER_CLIENT_H -#define AUTH_WORKER_MAX_LINE_LENGTH 1024 +#define AUTH_WORKER_MAX_LINE_LENGTH 4096 struct auth_worker_client *auth_worker_client_create(struct auth *auth, int fd); void auth_worker_client_destroy(struct auth_worker_client **client); void auth_worker_client_unref(struct auth_worker_client **client); -- Emmanuel Dreyfus manu(a)netbsd.org

3 5

[Dovecot] Vpopmail Dynamic Authentication Module
by Eric Sisolak 08 Sep '12

08 Sep '12

Hello, We currently use qmail with vpopmail for e-mail and are looking to switch from courier-imap to dovecot for IMAP on our RedHat EL 5 systems. Our goal is to use the dovecot RPM supplied by RH (v1.0.7) if at all possible. We can do this if we are able to dynamically load the vpopmail auth module. The wiki (http://wiki.dovecot.org/CompilingSource) notes that this should be possible: Dovecot can also dynamically load authentication modules from the $prefix/lib/dovecot/auth/ directory. Binary packages builders should use them for authentication modules which require external libraries (e. g. LDAP and vpopmail). There is no standard way to build them as modules currently, but something like this should work: gcc -shared -fPIC -DHAVE_CONFIG_H -DUSERDB_VPOPMAIL -DPASSDB_VPOPMAIL \-I../.. -I../lib userdb-vpopmail.c passdb-vpopmail.c -o vpopmail.so \-lvpopmail I had to modify the command to build the module, but was able to successfully build it: gcc -shared -fPIC -DHAVE_CONFIG_H -DUSERDB_VPOPMAIL -DPASSDB_VPOPMAIL -I../.. -I../lib -I/home/vpopmail/include -I/home/vpopmail/lib userdb-vpopmail.c passdb-vpopmail.c -o vpopmail.so -L/home/vpopmail/lib/libvpopmail.a I am unable to get the module to load properly. Dovecot built with --with-vpopmail works perfectly. When I start dovecot and it tries to load the module it reports: Aug 23 16:48:18 ctd-nix1 dovecot: Dovecot v1.0.7 starting up Aug 23 16:48:18 ctd-nix1 dovecot: auth(default): dlopen(/usr/lib64/dovecot/auth/vpopmail.so) failed: /usr/lib64/dovecot/auth/vpopmail.so: undefined symbol: vclose Aug 23 16:48:18 ctd-nix1 dovecot: auth(default): dlsym(passdb_vpopmail) failed: dovecot-auth: undefined symbol: passdb_vpopmail Aug 23 16:48:18 ctd-nix1 dovecot: auth(default): Unknown passdb driver 'vpopmail' (typo, or Dovecot was built without support for it? Check with dovecot --build-options) Aug 23 16:48:18 ctd-nix1 dovecot: Auth process died too early - shutting down Sometimes instead the last line is replaced with: Aug 23 15:02:45 ctd-nix1 dovecot: child 5412 (auth) returned error 89 Thanks! Eric

2 2

[Dovecot] problem about pop3 using dovecot
by bmalik 08 Sep '12

08 Sep '12

I upgraded dovecot from 1.1 to 2.1.8 pop3/imap works but i have a problem. i use pop3 protocol on outlook 2010 for my account. and i set keep my mails on the server for 5 days or until i delete them. These settings were working old dovecot1.1. But when i upgraded it to 2.1.8. if i even delete a mail from outlook the server doesn't delete or old mails are not deleted. what can be the problem ? thanks -- View this message in context: http://dovecot.2317879.n4.nabble.com/problem-about-pop3-using-dovecot-tp373… Sent from the Dovecot mailing list archive at Nabble.com.

4 7

Re: [Dovecot] about postlogin in dovecot2
by Joseph Tam 07 Sep '12

07 Sep '12

<bmalik(a)ihlas.net.tr> writes: > where do i have to locate the passwd-file in dovecot2 For what purpose? Master user? Password/user lookup? passdb { driver = passwd-file master = yes args = /anywhere/you/want/master-users pass = yes } passdb { driver = passwd-file args = /anywhere/you/want/passwd } userdb { driver = passwd-file args = /anywhere/you/want/passwd } Joseph Tam <jtam.home(a)gmail.com>

4 7

[Dovecot] Disconnect users for a distinct period of time?
by Michael Grimm 07 Sep '12

07 Sep '12

Hi -- Today, I've learned who to disable incoming mail delivery to dovecot (accepted by postfix), temporarily. Now, I would like to know if there is a way to make a "doveadm kick -A" a permanent disconnect until one would allow reconnects, again? This should be done *without* shutting down dovecot or *extensive* re-configuration. A "doveadm block -u <joe> -m 'sorry: running maintenance, please, come back later'" alike tool/funtionality would be ideal. Background: I would like to avoid any modification of my user's maildirs by a running dovecot server while modifying maildir formats, mdbox_rotate_size setting, and alike, where I would need doveadm/dsnyc access to userdb. (I know there a ways to achieve this without downtimes, and I have already done so.) I just want to be sure that I haven't overseen such a tool/functionality in the documentation. Did I or didn't I? Thanks and regards, Michael

3 2

[Dovecot] pop3 migration
by TeTeHacko 07 Sep '12

07 Sep '12

Hi, I have problems with pop3 migration, the server disconect the dovesync when fetching mails after 5 minutes with this error in server log: xx.xx.xx.xx [28F4] 11:54:05 <<< RETR 6548 xx.xx.xx.xx [28F4] 11:54:05 >>> +OK 47522 octets xx.xx.xx.xx [28F4] 11:54:05 <<< RETR 6549 xx.xx.xx.xx [28F4] 11:54:05 >>> +OK 355289 octets xx.xx.xx.xx [28F4] 11:54:05 <<< RETR 6550 xx.xx.xx.xx [28F4] 11:54:05 >>> +OK 9638 octets xx.xx.xx.xx [28F4] 11:54:05 <<< RETR 6551 xx.xx.xx.xx [28F4] 11:54:05 >>> +OK 2188 octets xx.xx.xx.xx [28F4] 11:59:05 >>> -ERR Command unrecognized: "" xx.xx.xx.xx [28F4] 11:59:05 *** <info(a)istan.cz> 6551 477693894 00:12:55 ERROR xx.xx.xx.xx [28F4] 11:59:05 Disconnected and this in dovecot log: dsync(info(a)istan.cz): Debug: imapc(mail.stable.cz:143): Authenticated successfully dsync(info(a)istan.cz): Debug: pop3c(mail.stable.cz): Looking up IP address dsync(info(a)istan.cz): Debug: pop3c(mail.stable.cz): Connecting to 88.86.120.212:110 dsync(info(a)istan.cz): Debug: pop3c(mail.stable.cz): Authenticating as info(a)istan.cz dsync(info(a)istan.cz): Error: pop3c(mail.stable.cz): Server disconnected unexpectedly dsync(info(a)istan.cz): Error: pop3_migration: Failed to get header for msg 1: Disconnected dsync(info(a)istan.cz): Error: pop3_migration: Failed to get header for msg 2: Disconnected dsync(info(a)istan.cz): Error: pop3_migration: Failed to get header for msg 3: Disconnected dsync(info(a)istan.cz): Error: pop3_migration: Failed to get header for msg 4: Disconnected is there any timeout in dovecot for 300s? can anybody point me where may be some problem? This error occurs everytime i test it and the mail box has cca 2GB, on small mailboxes is no problem, i try this patch: http://hg.dovecot.org/dovecot-2.1/rev/ab6a4455b27d on dovecot version 2.1.7 but the problem isn't solved. Thanks for help Tomas Herceg

2 2

[Dovecot] dsync mirror and sieve ?
by Xavier Beaudouin 07 Sep '12

07 Sep '12

Hi there, I am currently doing some extensive test with dsync, but it appear that : dsync -u <user> maildir:/path/to/new/Maildir doesn't seems to sync sieves rules. Is there a good way to sync sieves as well ? :p Regards, Xavier

2 1

Re: [Dovecot] Removing specific entry in user/auth cache
by Joseph Tam 07 Sep '12

07 Sep '12

Francisco Wagner C. Freire <wgrcunha(a)gmail.com> writes: > On Wed, Jun 27, 2012 at 9:24 AM, Timo Sirainen <tss(a)iki.fi> wrote: > >> On 27.6.2012, at 14.10, Angel L. Mateo wrote: >> >>> We have dovecot configured with auth cache. Is there any way to >> remove a specific entry (not all) from this cache? >> >> Nope. What do you need it for? > > I dont known about Angel, but for me is useful because sometimes i need to > deactivate smtp/imap/pop access from accounts, or change their home after > storage migration, and removing a specific record i can use a long time > cache. I'm not sure that the auth cache holds that information, but I think you can at least invalidate a particular auth cache entry by 1) Changing the user password (and save the previous hash) 2) Authenticate using the new credentials (and invalidate the auth cache entry). For example, you can just do a manual connection on your dovecot server x login someuser newpassword This will replace the cache entry with a new one. 3) When you are ready to put the account back online, change the password back to the original. A password mismatch forces a resync to your authentication system which will restore the auth cache. Joseph Tam <jtam.home(a)gmail.com>

4 8

[Dovecot] Managesieve segfault with dovecot 2.1.8
by Daniel Parthey 07 Sep '12

07 Sep '12

Hi, I'm getting segfaults and unexpected disconnects from managesieve server, when the Thunderbird SIEVE extension tries to validate SIEVE scripts agains Pidgeonhole in Dovecot 2.1.8. The extension says: "Server terminated unexpectedly the connection, click on reconnect to try again." It can be reproduced by simply calling CHECKSCRIPT followed by a string: mail01:~# telnet 127.0.0.1 19200 Trying 127.0.0.1... Connected to 127.0.0.1. Escape character is '^]'. "IMPLEMENTATION" "Sieve" "SIEVE" "fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave" "NOTIFY" "mailto" "SASL" "PLAIN" "VERSION" "1.0" OK "Mailbox" AUTHENTICATE "PLAIN" "AGRwYXJ0aGV5QGV4YW1wbGUub3JnAGRwYXJ0aGV5" OK "Logged in." CHECKSCRIPT {6+} abcdef Connection closed by foreign host. The server interrupts the connection and the logs show the following: # dovecot.log Sep 7 01:40:46 dovecot: mailbox: mail: managesieve(dparthey(a)example.org): Fatal: master: service(managesieve): child 31356 killed with signal 11 (core dumped) # kern.log Sep 7 01:40:46 kernel: [1417105.954609] managesieve[31356]: segfault at 0 ip 00007f1c415c4876 sp 00007fffb3731f88 error 4 in libc-2.11.1.so[7f1c41543000+17a000] Here is the backtrace: mail01:~# gdb /usr/lib/dovecot/managesieve /var/tmp/core.managesieve.31356 Core was generated by `dovecot-mailbox/managesieve'. Program terminated with signal 11, Segmentation fault. #0 0x00007f1c415c4876 in ?? () from /lib/libc.so.6 (gdb) bt full #0 0x00007f1c415c4876 in ?? () from /lib/libc.so.6 No symbol table info available. #1 0x000000000040b1c3 in sieve_storage_save_will_activate (ctx=0x257f1a0) at sieve-storage-save.c:328 _data_stack_cur_id = 4 scriptname = 0x25400ae "default.sieve" ret = <value optimized out> #2 0x00000000004065b0 in cmd_putscript_finish_parsing (cmd=0x2575cb8) at cmd-putscript.c:206 ehandler = <value optimized out> cpflags = <value optimized out> sbin = <value optimized out> errors = <value optimized out> _data_stack_cur_id = 0 script = <value optimized out> client = 0x2575c30 ctx = 0x2578180 args = 0x254bc68 ret = <value optimized out> #3 0x0000000000406838 in cmd_putscript_continue_script (cmd=0x2575cb8) at cmd-putscript.c:423 all_written = <value optimized out> client = 0x2575c30 ctx = 0x2578180 size = 39279968 #4 0x0000000000406caf in client_input_putscript (context=0x2575c30) at cmd-putscript.c:84 cmd = 0x2575cb8 __FUNCTION__ = "client_input_putscript" #5 0x00007f1c41d1d3e6 in io_loop_call_io (io=0x2575fd0) at ioloop.c:379 ioloop = 0x2548680 t_id = 2 #6 0x00007f1c41d1e46f in io_loop_handler_run (ioloop=<value optimized out>) at ioloop-epoll.c:213 ctx = 0x25489f0 event = 0x2548a60 list = 0x2576020 io = 0x0 tv = {tv_sec = 18, tv_usec = 988469} msecs = <value optimized out> ret = <value optimized out> i = 0 call = false #7 0x00007f1c41d1d388 in io_loop_run (ioloop=0x2548680) at ioloop.c:398 No locals. #8 0x00007f1c41d09653 in master_service_run (service=0x2548530, callback=0x25400ae) at master-service.c:543 No locals. #9 0x00000000004096ce in main (argc=1, argv=0x2548370) at main.c:308 set_roots = {0x610d60, 0x0} login_set = {auth_socket_path = 0x2540088 "/var/run/dovecot/auth-master", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x409810 <login_client_connected>, failure_callback = 0x409290 <login_client_failed>} service_flags = <value optimized out> storage_service_flags = MAIL_STORAGE_SERVICE_FLAG_DISALLOW_ROOT username = 0x0 c = <value optimized out> Regards Daniel -- https://plus.google.com/103021802792276734820

2 1

[Dovecot] thunderbird not connecting
by cc young 07 Sep '12

07 Sep '12

cannot get TB to recognize either pop3/s or imap/s server can connect just fine with: openssl s_client -connect ms1.myserver.net:993 . login ... but trying with TB /var/log/mail.log gets: dovecot: pop3-login: Aborted login (no auth attempts): rip=223.205.150.234, lip=xxx.xx.xx.xx dovecot: imap-login: Aborted login (no auth attempts): rip=223.205.150.234, lip=xxx.xx.xx.xx -- View this message in context: http://dovecot.2317879.n4.nabble.com/thunderbird-not-connecting-tp37389.html Sent from the Dovecot mailing list archive at Nabble.com.

6 8

[Dovecot] dovecotadm error
by Michael 07 Sep '12

07 Sep '12

When I use the following command: doveadm expunge -A mailbox Junk savedbefore 28d I get: doveadm(root): Error: User listing returned failure In the mail log file it says: dovecot: auth-worker(18549): Error: sql: Iterate query failed: Table 'system.users' doesn't exist (using built-in default iterate_query: SELECT username, domain FROM users) However this is setup: dovecot-sql.conf: iterate_query = SELECT username AS user FROM accounts though I have had to comment the following from dovecot.conf: #iteratedb { # args = /usr/local/etc/dovecot/dovecot-sql.conf # driver = sql #} because it errors on dovecot start up. I have already spent a bit of time on the Dovecot website and Google trying to find an answer. I want to get the expires plugin working. Any leads please? dovecot -n # 2.1.9: /usr/local/etc/dovecot/dovecot.conf # OS: Linux 2.6.29.6-rt24-smp i686 Slackware 13.1.0 auth_master_user_separator = * auth_mechanisms = plain login dict { expire = mysql:/usr/local/etc/dovecot/dovecot-dict-expire.conf quotadict = mysql:/usr/local/etc/dovecot/dovecot-dict-sql.conf } disable_plaintext_auth = no first_valid_gid = 1000 first_valid_uid = 1000 mail_access_groups = dovecot mail_location = Maildir:%h/Maildir mail_plugins = " expire" mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf driver = sql } plugin { autocreate = Drafts autocreate2 = Junk autocreate3 = Sent autocreate4 = Trash autosubscribe = Drafts autosubscribe2 = Junk autosubscribe3 = Sent autosubscribe4 = Trash expire = Junk expire_dict = proxy::expire quota = dict:user::proxy::quotadict sieve = %h/.dovecot.sieve sieve_before = /var/lib/dovecot/sieve/before.sieve sieve_dir = %h/sieve sieve_global_dir = /var/lib/dovecot/sieve/global/ } protocols = imap pop3 sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } user = root } service dict { unix_listener dict { group = dovecot mode = 0660 } } service imap-login { inet_listener imap { address = DELETED } } service managesieve-login { executable = /usr/local/libexec/dovecot/managesieve-login } service managesieve { executable = /usr/local/libexec/dovecot/managesieve } ssl_cert = </etc/ssl/private/DELETED.pem ssl_key = </etc/ssl/private/DELETED.pem userdb { args = /usr/local/etc/dovecot/dovecot-sql.lda.conf driver = sql } userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf driver = sql } protocol imap { mail_plugins = autocreate quota imap_quota zlib imap_zlib } protocol pop3 { mail_plugins = quota } protocol lda { hostname = DELETED mail_plugins = quota sieve postmaster_address = DELETED sendmail_path = /usr/sbin/sendmail } protocol sieve { mail_debug = yes }

2 1

[Dovecot] different userdb and/or passdb for lmtp and pop3/imap?
by Gábor Lénárt 06 Sep '12

06 Sep '12

Dear All, I have a bit complex question about ldap based user/passdb with some twists caused by the LDAP schema I have to use. It's complex for me at least, since it's my first time to try to setup any dovecot install which is more than a "trivial" thing eg for some unix system users. What I'd like to do: Users are stored in LDAP with the following schema: storageMailUid: contains user's uid in x@z format, and it CAN be different than mail address. This value is used to login (pop3/imap) and to get the maildir path (well, home) in the form of /mailstorage/z/x/ regardless of the value of the "mail" attribute. If @z part is missing (I mean the user supplied login, not the LDAP!), some default value (example.com) should be treated (I guess that's easy: auth_default_realm may be enough, isn't it). It is NOT possible to login via pop3/imap with mail, only with storageMailUid! This storageMailUid can specify a string which is not even an existing mail address, of course. mail: contains user's mail address, or even mail addresses (there can be more mail addresses - more mail ldap attributes - for a single ldap entry). This attribute cannot be used for pop3/imap login, neither it counts to resolve the maildir path, it only counts when a mail is received: the location of the user's maildir must be got from storageMailUid. storageMailQuota: it contains the quota value (in bytes) for the given user, which should be enforced on receiving mail, or by using IMAP (not counting the Trash folder which is a fixed size for all users and it must be handled outside of this). All user maildirs have the same fixed unix UID/GID, which is not stored in LDAP, but must be configured statically. "Home directory" of the user is also not stored in LDAP, it must be got from storageMailUid LDAP parameter. Mails are received via LMTP only. I'd like to use prefetchdb to minimalize the amount of LDAP lookups (however I can live without that). I am unsure if auth_bind is OK, or it should not be used, currently I'd like to play with auth_bind, since it worked before on other servers well. I'm totally lost with the user_attrs/pass_attrs to create this kind of configuration. In case of static userdb, it was easy to set up: passdb { args = /etc/dovecot/dovecot-ldap-passdb.conf driver = ldap } userdb { args = uid=vmail gid=vmail home=/mailstorage/%Ld/%Ln driver = static } With this, pop3/imap worked (quota was not of the scope yet, though), however lmtp is not ("passdb doesn't support lookups, can't verify user's existence" which is odd for me, as userdb does not support it in my opinion). Please, give some suggestion how to set up userdb and passdb to support this configuration which works with the described scenario. I should also set iterate_filter and iterate_attrs I guess, so some doveadm commands can work then (-A stuffs, I guess). I am also not sure if auth service should be used or not (I mean extra configuration related): since I want LMTP not LDA, I guessed I don't need it, but I am not sure. I am also confused, because on receiving a mail (via LMTP) different kind of LDAP lookup is needed: then mail must be searched, but it's storageMailUid based lookup in case of pop3 or imap login ... Is it possible to give different userdb/passdb for lmtp and pop3/imap? In theory it's even possible to have x(a)example.com as mail and y(a)example.com as storageMailUid for one user, and the opposite for the another, so lookups cannot be done together for mail and storageMailUid. The LDAP schema/rest of the system works this way, not an option to change. Any help is greatly welcomed. Thanks a lot in advance, Gábor

1 1