- dovecot - dovecot.org

[Dovecot] replace istream and unref the old one...
by Alex Baule 20 Sep '10

20 Sep '10

I Build a plugin, that do some stuffs with a email. To get the input istream, i use the "get_stream" function, like zlib does. I create a concat_stream, with the full_input[3]; struct istream *full_input[3]; //this like zlib input = imail->data.stream; //first input, using the input full_input[0] = i_stream_create_header_filter(input, HEADER_FILTER_EXCLUDE | HEADER_FILTER_NO_CR, exclude_headers, 1, filter_callback, imail); // second input from another file. full_input[1] = i_stream_create_fd(fd1, 0, TRUE); // finish the input full_input[2] = NULL; // recreating the stream imail->data.stream = i_stream_create_concat(full_input); //unref the old one. i_stream_unref(&input); return index_mail_init_stream(imail, hdr_size, body_size, stream_r); I do like zlib, but i got this errors in LOG. I Think it's because something in the unref, but o don't know what. Sep 20 10:48:04 brc dovecot: imap(alex(a)exemplo.com.br): Panic: file index-mail.c: line 1150 (index_mail_close): assertion failed: (!mail->data.destroying_stream) Sep 20 10:48:04 brc dovecot: imap(alex(a)exemplo.com.br): Error: Raw backtrace: /opt/addons/lib/dovecot/libdovecot.so.0 [0xb76201ee] -> /opt/addons/lib/dovecot/libdovecot.so.0 [0xb7620245] -> /opt/addons/lib/dovecot/libdovecot.so.0 [0xb761f8a6] -> /opt/addons/lib/dovecot/libdovecot-storage.so.0 [0xb76b568f] -> /opt/addons/lib/dovecot/libdovecot-storage.so.0(index_mail_free+0x25) [0xb76b7425] -> /opt/addons/lib/dovecot/libdovecot-storage.so.0(mail_free+0x12) [0xb76704b2] -> dovecot/imap(imap_fetch_deinit+0x89) [0x80583e9] -> dovecot/imap [0x805034d] -> dovecot/imap(cmd_fetch+0x45a) [0x805086a] -> dovecot/imap(cmd_uid+0x7f) [0x805514f] -> dovecot/imap [0x8055e8c] -> dovecot/imap [0x8055f3b] -> dovecot/imap(client_handle_input+0x3f) [0x805608f] -> dovecot/imap(client_input+0x5f) [0x8056a4f] -> /opt/addons/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x130) [0xb762cab0] -> /opt/addons/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0xb762b658] -> /opt/addons/lib/dovecot/libdovecot.so.0(master_service_run+0x2a) Sep 20 10:48:04 brc dovecot: master: Error: service(imap): child 11719 killed with signal 6 (core dumps disabled) Some One can help me ??

2 1

[Dovecot] Dovecot 2.0.3
by Matthias Quernheim 20 Sep '10

20 Sep '10

I upgraded today to from 1.2.12 to Dovecot 2.0.3 with the dbox format. I just figured out there are still mail in some users directories with the maildir format. These mail are not displayed at all. Nether with roundcube nor with Thunderbird. How could I convert the remaining maildir mails to dbox? Thanks Matthias

3 2

[Dovecot] send HUP when rotating log?
by LEVAI Daniel 20 Sep '10

20 Sep '10

Hi! Is it necessary for Dovecot2 to send it a SIGHUP when I rotate its log files? I'm asking because then I must turn off the 'shutdown_clients' option, because then every user gets disconnected while rotating the logs. Daniel -- LÉVAI Dániel PGP key ID = 0x83B63A8F Key fingerprint = DBEC C66B A47A DFA2 792D 650C C69B BE4C 83B6 3A8F

2 1

[Dovecot] Change in delivery directory during 2.0.2->2.0.3 upgrade
by Jeffrey Rice 19 Sep '10

19 Sep '10

In upgrading from 2.0.2 to 2.0.3, Dovecot deliver has started putting new emails into user@host/.user@host/new instead of user@host/new. This change was reversed by downgrading to 2.0.2, so it's due to the minor version change. Has anyone else seen this? dovecot.conf follows: # 2.0.0: /etc/dovecot/dovecot.conf # OS: Linux 2.6.27.2-xenU i686 Debian 5.0.5 ext3 auth_mechanisms = plain cram-md5 login digest-md5 dotlock_use_excl = yes login_greeting = IMAP ready. mail_fsync = never mail_location = maildir:/home/vmail/%u passdb { args = /etc/dovecot/dovecot-mysql.cnf driver = sql } plugin { auth_socket_path = /var/run/dovecot/auth-master sieve_global_path = /home/vmail/sieve/global.sieve } service auth { unix_listener /var/run/dovecot/auth-master { group = vmail mode = 0600 user = vmail } unix_listener /var/spool/postfix/private/dovecot-auth-client { group = postfix mode = 0660 user = postfix } user = root } service imap-login { client_limit = 256 process_limit = 128 process_min_avail = 4 service_count = 0 user = dovecot } service imap { vsz_limit = 70 } service pop3-login { client_limit = 256 process_limit = 128 process_min_avail = 4 service_count = 0 user = dovecot } service pop3 { vsz_limit = 70 } ssl_cert = </etc/dovecot/ssl/certs/dovecot_cert.pem ssl_cipher_list = ALL:!LOW ssl_key = </etc/dovecot/ssl/private/dovecot_key.pem userdb { driver = passwd } userdb { args = uid=5000 gid=5000 home=/home/vmail/%u driver = static } protocol imap { mail_plugin_dir = /usr/local/lib/dovecot/imap mail_plugins = } protocol lda { auth_socket_path = /var/run/dovecot/auth-master info_log_path = /home/vmail/dovecot-deliver.log log_path = /home/vmail/dovecot-deliver.log mail_plugins = sieve postmaster_address = postmaster(a)finity.org } deliver is invoked in postfix's master.cf using: dovecot unix - n n - - pipe flags=DRhu user=vmail:vmail argv=/usr/local/libexec/dovecot/deliver -f ${sender} -d ${recipient} -- Jeffrey Rice<jeffrice(a)finity.org>

3 3

[Dovecot] dovecot-2.0.3 : Am I missing anything here ?
by Dennis Clarke 18 Sep '10

18 Sep '10

I'm just asking if there is anything else that needs to be added at all. I seem to have everything linked in from soup to nuts but I want to be sure that a basic or essential feature is not being overlooked for forgotten : [titan] elfdump -d .libs/auth | grep NEED [0] NEEDED 0x3084 libdovecot.so.0 [1] NEEDED 0x3055 libpam.so.1 [2] NEEDED 0x306a libpthread.so.1 [3] NEEDED 0x3094 libkrb5.so.3 [4] NEEDED 0x30a1 libk5crypto.so.3 [5] NEEDED 0x30b2 libcom_err.so.3 [6] NEEDED 0x30c2 libldap-2.4.so.2 [7] NEEDED 0x30d3 libsasl2.so.2 [8] NEEDED 0x30e1 libgssapi_krb5.so.2 [9] NEEDED 0x30f5 libssl.so.0.9.8 [10] NEEDED 0x3105 libcrypto.so.0.9.8 [11] NEEDED 0x3118 liblber-2.4.so.2 [12] NEEDED 0x3129 libresolv.so.2 [13] NEEDED 0x3138 libgen.so.1 [14] NEEDED 0x3144 libpq.so.5 [15] NEEDED 0x314f libsqlite3.so.0 [16] NEEDED 0x315f libz.so [17] NEEDED 0x3167 libdl.so.1 [18] NEEDED 0x3172 libnsl.so.1 [19] NEEDED 0x317e libsocket.so.1 [20] NEEDED 0x318d libintl.so.8 [21] NEEDED 0x319a libiconv.so.2 [22] NEEDED 0x307a libc.so.1 [23] NEEDED 0x31a8 librt.so.1 [24] NEEDED 0x31b3 libmysqlclient.so.16 [35] VERNEED 0x8057770 [36] VERNEEDNUM 0x3 [titan] [titan] ldd .libs/auth libdovecot.so.0 => (file not found) libpam.so.1 => /usr/lib/libpam.so.1 libpthread.so.1 => /usr/lib/libpthread.so.1 libkrb5.so.3 => /opt/csw/lib/libkrb5.so.3 libk5crypto.so.3 => /opt/csw/lib/libk5crypto.so.3 libcom_err.so.3 => /opt/csw/lib/libcom_err.so.3 libldap-2.4.so.2 => /opt/csw/lib/libldap-2.4.so.2 libsasl2.so.2 => /opt/csw/lib/libsasl2.so.2 libgssapi_krb5.so.2 => /opt/csw/lib/libgssapi_krb5.so.2 libssl.so.0.9.8 => /opt/csw/lib/libssl.so.0.9.8 libcrypto.so.0.9.8 => /opt/csw/lib/libcrypto.so.0.9.8 liblber-2.4.so.2 => /opt/csw/lib/liblber-2.4.so.2 libresolv.so.2 => /usr/lib/libresolv.so.2 libgen.so.1 => /usr/lib/libgen.so.1 libpq.so.5 => /opt/csw/postgresql83/lib/i386/libpq.so.5 libsqlite3.so.0 => /opt/csw/lib/libsqlite3.so.0 libz.so => /opt/csw/lib/libz.so libdl.so.1 => /usr/lib/libdl.so.1 libnsl.so.1 => /usr/lib/libnsl.so.1 libsocket.so.1 => /usr/lib/libsocket.so.1 libintl.so.8 => /opt/csw/lib/libintl.so.8 libiconv.so.2 => /opt/csw/lib/libiconv.so.2 libc.so.1 => /usr/lib/libc.so.1 librt.so.1 => /usr/lib/librt.so.1 libmysqlclient.so.16 => /opt/csw/mysql51/lib/i386/mysql/libmysqlclient.so.16 libcmd.so.1 => /usr/lib/libcmd.so.1 libkrb5support.so.0 => /opt/csw/lib/libkrb5support.so.0 libintl.so.1 => /usr/lib/libintl.so.1 libgcc_s.so.1 => /opt/csw/lib/libgcc_s.so.1 libmp.so.2 => /usr/lib/libmp.so.2 libaio.so.1 => /usr/lib/libaio.so.1 libm.so.1 => /usr/lib/libm.so.1 libthread.so.1 => /usr/lib/libthread.so.1 That looks to be a massive list. I'm always worried that some "feature" is being forgotten by me. Any thoughts from the gurus ? -- Dennis

1 0

[Dovecot] mbox vs maildir
by Jim Pazarena 18 Sep '10

18 Sep '10

I've had clients 'request' nested folders, and it would seem that maildir is designed with that ability while with mbox it is difficult and.or impossible to implement (nested can be achieved; but not nested AND populated in each nest level). My question is, is one format 'better' than the other? It would take a fair bit of time to convert my system to maildir and I would want to feel comfortable that this would be a true 'upgrade' in abilities, rather than simply a change to accommodate nested folders. Thanks,

2 1

[Dovecot] moving 1.2.13 system to another hard drive
by Paul Scott 18 Sep '10

18 Sep '10

Hi, I am not very experienced with Dovecot (1,2,13) installed on Debian sid. I have just set up a new system on a new hard drive on the same computer. fetchmail is correctly putting mail in /var/mail/<username>. I have copied my entire Maildir directory from the old hard drive. I have made what changes I understood to dovecot.conf. Dovecot was working on the other drive even though I'm not completely sure how I got it working before. Any ideas for debugging this certainly simple problem for some of you. TIA, Paul Scott

3 4

[Dovecot] Maildir premission denied
by Omer Ahmed 18 Sep '10

18 Sep '10

Hi Sirs,I am using ubuntu OS, with dovecot and postfix, I can send emails receive email but not access them. I have the errorSep 17 21:21:31 myserver-name dovecot: POP3(virtualuser(a)mydomain.tld): stat(/var/mail/virtualuser(a)mydomain.tld) failed: Permission denied (euid=1001(upload) egid=1001(upload) missing +x permI don't know why it is using euid 1001, my var/mail folder uid:gid is 500:500and here are my settings:# 1.1.11: /etc/dovecot/dovecot.conf# OS: Linux 2.6.31-14-server x86_64 Ubuntu 9.10 ext3log_timestamp: %Y-%m-%d %H:%M:%Sprotocols: imap imaps pop3 pop3sdisable_plaintext_auth: nologin_dir: /var/run/dovecot/loginlogin_executable(default): /usr/lib/dovecot/imap-loginlogin_executable(imap): /usr/lib/dovecot/imap-loginlogin_executable(pop3): /usr/lib/dovecot/pop3-loginmail_privileged_group: mailmail_uid: 500mail_gid: 500mail_location: Maildir:/var/mail/%umail_executable(default): /usr/lib/dovecot/imapmail_executable(imap): /usr/lib/dovecot/imapmail_executable(pop3): /usr/lib/dovecot/pop3mail_plugin_dir(default): /usr/lib/dovecot/modules/imapmail_plugin_dir(imap): /usr/lib/dovecot/modules/imapmail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3auth default: passdb: driver: pam passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: passwd userdb: driver: sql args: /etc/dovecot/dovecot-sql.conf Waiting for ur life saving replies

2 1

[Dovecot] Too stupid for sieve (former maildrop user)
by Dieter Knopf 18 Sep '10

18 Sep '10

Hello, I just migrated from Postfix/Courier/Maildrop to Postfix/Dovecot/Deliver/Sieve and don't unterstand the right syntax for sieve :( I searched and found many small examples and many links to the RFC, but nothing was usefull for me (or i didn't unterstand it) I installed the latest Dovecot-Sieve (hg). Examples from my maildrop config: # Filter FROM if($E =~ /name(a)domain1\.tld/) { to "$M/.Friends.Name1/" } # Filter FROM with OR if($E =~ /name1(a)domain1\.tld/ || $E =~ /name2(a)domain2\.tld/) { to "$M/.Friends.Name2/" } # Filter Mailinglists if (/^List-Id: .*<sylpheed\.sraoss\.jp>/) { to "$M/.ML.Sylpheed/" } # Filter FROM AND SUBJECT if($E =~ /fname(a)domain.tld/ && /^Subject: *foooooo/) { to "$M/.foo/" } # Filter TO if (hasaddr("name(a)domain.tld")) { to "$M/.foo/" } # Or something like this: if($E =~ /.*(a)facebookmail\.com/) { if (/^Subject: .*invited you to join the group/) { to "$M/.Facebook.Invites.Groups/" } if (/^Subject: .*invited you to the event/) { to "$M/.Facebook.Invites.Events/" } } $E was a shortcut for (adressmatching): ADDR=getaddr($MATCH) E=`echo $ADDR | sed 's/^M//'` $M was the path to the maildir, like /home/vmail/domain.tld/name Is that possible? Or is maildrop simple more powerful? Thank you :-) Dieter

3 11

[Dovecot] default ACL - in namespace's mail root directory ?
by Per Jessen 17 Sep '10

17 Sep '10

I have a namespace like this: namespace { type = private separator = / prefix = location = maildir:/var/ferrari/users/%d/%n:INDEX=/var/ferrari/indexes/3/4/%u:CONTROL=/var/ferrari/indexes/3/4/%u inbox = no list = yes subscriptions = yes } Where do I store "dovecot-acl" as the default ACL ? /Per Jessen, Zürich

3 8

Re: [Dovecot] dsync crash
by Timo Sirainen 17 Sep '10

17 Sep '10

On Wed, 2010-09-15 at 18:34 +0400, Василий Шоков wrote: > > namespace { > hidden = no > inbox = yes > location = maildir:~/mail/inbox/:INDEX=/var/dovecot_index/%u/inbox > prefix = .INBOX. Uh. Does this really work with IMAP clients? A namespace prefix must not start with hierarchy separator. My guess is that the crash happens because of it. I think I'll add code to give an error if it's tried.

2 8

[Dovecot] dsync to move from 1.2 to 2.0
by Daniel L. Miller 17 Sep '10

17 Sep '10

I'm not certain of the correct syntax for this - and I'm reluctant to risk my live data by experimenting. I've setup a 2.0.2 server on a virtual machine, and I want to copy a live account over to it for testing. Not that it should matter, but the 1.2 machine is using maildir and I want to give sdbox a try on 2.0.2. I'm assuming (dangerous, I know) I should run dsync on the new 2.0.2 machine, and connect remotely to the 1.2. If it matters, my usernames are complete mail addresses, i.e. myname(a)mydomain.com, and are stored as /var/mail/domain/name/Maildir. Does dsync perform an imap connection to the remote server to pull the mails? Or am I confusing this with imapsync? -- Daniel

2 1

[Dovecot] Processes remaining
by Andreas Kossack 17 Sep '10

17 Sep '10

Hi all, on my system ("AIX 6.1" 64bit) after "doveadm stop" there are some processes still alive: vmail 3997878 1 0 16:54:26 - 0:00 dovecot/imap dovenull 4915236 1 0 16:54:26 - 0:00 dovecot/imap-login root 6029330 1 0 16:54:20 - 0:00 dovecot/ssl-params root 6553702 1 0 16:52:01 - 0:00 dovecot/log vmail 6881392 1 0 16:54:21 - 0:00 dovecot/imap dovecot 7078140 1 0 16:52:23 - 0:00 dovecot/auth dovenull 7733396 1 0 16:54:20 - 0:00 dovecot/imap-login root 7864502 1 0 16:54:21 - 0:00 dovecot/auth -w root 9240650 1 0 16:54:20 - 0:00 dovecot/config dovecot 12189718 1 0 16:52:01 - 0:00 dovecot/anvil After some minutes I can see less than before: root 6029330 1 0 16:54:20 - 0:00 dovecot/ssl-params root 6553702 1 0 16:52:01 - 0:00 dovecot/log dovecot 12189718 1 0 16:52:01 - 0:00 dovecot/anvil But these seem to be permanent. Restarting dovecot there is an error sometimes logged: Sep 9 17:08:17 Buckow local3:err|error dovecot: master: Error: service(auth): Socket already exists: /var/run/dovecot/auth-login And - some restarts later: root 3997884 1 0 17:07:21 - 0:00 dovecot/ssl-params root 6029330 1 0 16:54:20 - 0:00 dovecot/ssl-params root 6226004 13172840 0 17:14:04 - 0:00 dovecot/config root 6553702 1 0 16:52:01 - 0:00 dovecot/log dovecot 6881398 1 0 17:06:13 - 0:00 dovecot/anvil root 7733432 13172840 0 17:14:04 - 0:00 dovecot/log root 7864522 1 0 17:06:13 - 0:00 dovecot/log dovecot 7995430 13172840 0 17:14:04 - 0:00 dovecot/anvil dovecot 9240682 1 0 17:11:20 - 0:00 dovecot/anvil root 9306298 1 0 17:13:28 - 0:00 dovecot/ssl-params root 9371814 1 0 17:11:20 - 0:00 dovecot/log dovecot 12189718 1 0 16:52:01 - 0:00 dovecot/anvil root 13172840 1 0 17:14:04 - 0:00 /usr/sbin/dovecot What's wrong? -- Kind regards / Mit freundlichen Grüßen A. Kossack _______________________________________________________________________________ Andreas Kossack Andreas.Kossack(a)TU-Cottbus.De BTU Cottbus, Brandenburg, Germany, Walther-Pauer-Str.2, 03046 Cottbus http://wwwca.telesec.de/cgi-bin/caservice/Common/InstallRoot/DT-Root-CA-2.d… _______________________________________________________________________________ Diese Nachricht wurde aus 100% wiederverwerteten Elektronen erstellt. _______________________________________________________________________________

2 5

[Dovecot] sent-mail
by dhottinger＠harrisonburg.k12.va.us 17 Sep '10

17 Sep '10

Im trying to nail down an issue with some users sent-mail. I have had a few users complaining that their emails are not being copied to their sent-mail folder. Im not sure how widespread it is, mainly because most people dont check their sent-mail. Im running Dovecot version 1.0.7, and yes I know its outdated, but I have had zero problems thus far. Im grepping through my logfiles and dont see any error messages to indicate that there are any issues anywhere on the mailserver. Has anyone else seen any issues with sent-mail not being copied? If checked permissions on the folders and they look correct. thanks, ddh -- Dwayne Hottinger Network Administrator Harrisonburg City Public Schools "Everything should be made as simple as possible, but not simpler." -- Albert Einstein "The hottest places in Hell are reserved for those who, in times of moral crisis, preserved their neutrality." -- Dante

3 4

[Dovecot] dsync - how to speed up
by Burckhard Schmidt 17 Sep '10

17 Sep '10

Hi, I have converted some mbox mailboxes to maildir. Inbox and folders had been cpopied before into a separate directories "old-home" and old-inbox onto the new server (dovecot 2.0.2. with fix hg.dovecot.org/dovecot-2.0/rev/14a6e526900d) dsync -v -u user mirror mbox:/old-homehome/~user:INBOX=/old-inbox/user It works but it lasts "very long" time. For one mailbox with 2,4 Gb and nearly 200.000 emails it lasts 100 minutes. I would like to migrate 1.500 Gb - not possible in that way I think. Are there any possibilities making it faster? May be not to generate indices, ..., which could be done later during a first access by the user? Is it possible to run several dsync commands at the same time, of course each one for a different user? (Ressources cpu and I/O system are available.) -- Mit freundlichen Gruessen --- Burckhard Schmidt

2 1

[Dovecot] fts plugin - purpose of get_last_uid() ?
by Per Jessen 17 Sep '10

17 Sep '10

It looks like the uid returned is only used as an indication of whether the maildir is fully indexed or not, is that correct? In my setup, the index is built externally and will _always_ be up-to-date. Getting the last uid would mean running a query, which, whilst inexpensive, seems unnecessary if my understanding of the purpose of get_last_uid() is correct. thanks Per Jessen, Zürich

2 4

[Dovecot] fts_squat hanging on some messages
by Henning Rohlfs 17 Sep '10

17 Sep '10

Hello, I recently upgraded to dovecot 2.0.2 (on gentoo ~amd64) and now fts_squat's index building seems to hang for some of my mailboxes. The imap process gets stuck at 100% cpu usage and dovecot.index.search is never touched. I traced the problem to a message (attached) for one of the problematic mailboxes. Also attached are a full backtrace and the output of dovecot -n. The problem is reproducible: step 1) /usr/libexec/dovecot/imap step 2) . select Junk step 3) . search body sometext

2 2

[Dovecot] Can solaris sendmail use dovecot lda
by Jürgen Obermann 17 Sep '10

17 Sep '10

Hello, on a Solaris 9 system with dovecot 1.2.14 installed I want to replace the sendmail local delivery agent 'mail.local' with the dovcot LDA. The wiki page http://wiki.dovecot.org/LDA/Sendmail did not really help me, because there are only linux specific tipps I am not able to apply to solaris sendmail.cf. So how can I tell solaris sendmail to use dovecots LDA instead of mail.local? Greetings, Jürgen Obermann -- Hochschulrechenzentrum der | Mail: Juergen.Obermann(a)hrz.uni-giessen.de Justus-Liebig-Universitaet | WWW: http://www.uni-giessen.de/obermann/ Heinrich-Buff-Ring 44 | Tel: 0641-99-13054 (0641-99-13001) D-35392 Giessen, Germany | Fax: 0641-99-13009 ---------------------------------------------------------------- This message was sent using IMP, the Internet Messaging Program.

2 1

[Dovecot] dsync: mbox to maildir
by Burckhard Schmidt 17 Sep '10

17 Sep '10

Hello, I started converting INBOX and folder from mbox to maildir. The old folders comming from Dovecot 1.0.13 with a mail_location mbox:%h:INBOX=/inbox/%u. The new instalation on a different server is Dovecot 2.0.1, mail-location maildir:~/maildir:INDEX=/addons/index/%u: CONTROL=~/control:LAYOUT=fs No user has logged in before. I have copied tho old Inbox and folders into /mailstore1/import-inbox and /mailstore1/import-home to the new server. my dsync command dsync -v -u account mirror mbox:/mailstore1/import-home/~account:INBOX=/mailstore1/import-inbox/account This works fine. But there are some problems too: 1. autocreate The plugin autocreate = AutoCleanSpam is activated for lda and imap. There is no user with such folder. dsync ceates two: dsync(account): Info: AutoCleanSpam: only in source dsync(account): Info: AutoCleanSpam: only in dest I saw AutoCleanSpam and AutoCleanSpam_73fc7f01efa3804cb4290000b68194d6, both empty. I deletet it with doveadm mailbox delete -u account -s "AutoCleanSpam_73fc7f01efa3804cb4290000b68194d6" Furthermore I have had before autocreate = Sent ( and some more) If the user has such a folder then again two folders are created, "Sent" which is empty and "Sent_any characters" like above. This folder contains the emails of the old folder Sent. 2. missing skip_broken_mailboxes, skip_dotdirs dsync reports errors like Error: Failed to sync mailbox xyz: Mailbox isn't a valid mbox file After a few minutes dsync stops. Or a file like .mlbxlsttmp causes the same error. I remembered my tests with convert-tool (dovecot-V1.2.12) and could use skip_broken_mailboxes skip_dotdirs. That was fine and I'm missing it. I will have to convert several thousands of users. May be I have to clean their folders before? 3. empty folder I have seen some empty folders. These have not been generated by dsync. Some user could missing them? On ballance dsync converts 10 Gb of mbox to maildir successfully. -- Regards - Burckhard Schmidt

2 2

[Dovecot] (Single instance) attachment storage
by Timo Sirainen 17 Sep '10

17 Sep '10

Now that v2.0.0 is only waiting for people to report bugs (and me to figure out how to fix them), I've finally had time to start doing what I actually came here (Portugal Telecom/SAPO) to do. :) The idea is to have dbox and mdbox support saving attachments (or MIME parts in general) to separate files, which with some magic gives a possibility to do single instance attachment storage. Comments welcome. Reading attachments ------------------- dbox metadata would contain entries like (this is a wrapped single line entry): X1442 2742784 94/b2/01f34a9def84372a440d7a103a159ac6c9fd752b 2744378 27423 27/c8/a1dccc34d0aaa40e413b449a18810f600b4ae77b So the format is: "X" 1*(<offset> <byte count> <link path>) So when reading a dbox message body, it's read as: offset=0: <first 1442 bytes from dbox body> offset=1442: <next 2742784 bytes from external file> offset=2744226: <next 152 bytes from dbox body> offset=2744378: <next 27423 bytes from external file> offset=2744378 27423: <the rest from dbox body> This is all done internally by creating a single istream that lazily opens the external files only when data is actually tried to be read from that part of the message. The link paths don't have to be in any specific format. In future perhaps it can recognize different formats (even http:// urls and such). Saving attachments separately ----------------------------- Message MIME structure is being parsed while message is saved. After each MIME part's headers are parsed, it's determined if this part should be stored into attachment storage. By default it only checks that the MIME part isn't multipart/* (because then its child parts would contain attachments). Plugins can also override this. For example they could try to determine if the commonly used clients/webmail always downloads and shows the MIME part when opening the mail (text/*, inline images, etc). dbox_attachment_min_size specifies the minimum MIME part size that can be saved as an attachment. Anything smaller than that will be stored normally. While reading a potential attachment MIME part body, it's first buffered into memory until the min. size is reached. After that the attachment file is actually created and buffer flushed to it. Each attachment filename contains a global UID part, so that no two (even identical) attachments will ever contain the same filename. But there can be multiple attachment storages in different mount points, and each one could be configured to do deduplication internally. So identical attachments should somehow be stored to same storage. This is done by taking a hash of the body and using a part of it as the path to the file. For example: mail_location = dbox:~/dbox:ATTACHMENTS=/attachments/$/$ Each $ would be expanded to 8 bits of the hash in hex (00..ff). So the full path to an attachment could look like: /attachments/04/f1/5ddf4d05177b3b4c7a7600008c4a11c1 Sysadmin can then create /attachment/00..ff as symlinks to different storages. Hashing problems ---------------- Some problematic design decisions: 1) Hash is taken from hardcoded first n kB vs. first dbox_attachment_min_size bytes? + With first n kB, dbox_attachment_min_size can be changed without causing duplication of attachments, otherwise after the change the same attachment could get a hash to a different storage than before the change. - If n kB is larger than dbox_attachment_min_size, it uses more memory. - If n kB is determined to be too small to get uniform attachment distribution to different storages, it can't be changed without recompiling. 2) Hash is taken from first n bytes vs. everything? + First n bytes are already read to memory anyway and can be hashed efficiently. The attachment file can be created without wasting extra memory or disk I/O. If everything is hashed, the whole attachment has to be first stored to memory or to a temporary file and from there written to final storage. - With first n bytes it's possible for an attacker to generate lots of different large attachments that begin with the same bytes and then overflow a single storage. If everything is hashed with a secure hash function and a system-specific secret random value is added to the hash, this attack isn't possible. I'm thinking that even though taking a hash of everything is the least efficient option, it's the safest option. It's pretty much guaranteed to give a uniform distribution across all storages, even against intentional attacks. Also the worse performance isn't probably that noticeable, especially assuming a system where local disk isn't used for storing mails, and the temporary files would be created there. Single instance storage ----------------------- All of the above assumes that if you want a single instance storage, you'll need to enable it in your storage. Now, what if you can't do that? I've been planning on making all index/dbox code to use an abstracted out simple filesystem API rather than using POSIX directly. This work can be started by making the attachment reading/writing code use the FS API and then create a single instance storage FS plugin. The plugin would work like: open(ha/sh/hash-guid): The destination storage is in ha/sh/ directory, so a new temp file can be created under it. The hash is part of the filename to make unlink() easier to handle. Since the hash is already known at open() time, look up if hashes/<hash> file exists. If it does, open it. write(): Write to the temp file. If hashes/ file is open, do a byte-by-byte comparison of the inputs. If there's a mismatch, close the hashes/ file and mark it as unusable. finish(): a) If hashes/ file is still open and it's at EOF, link() it to our final destination filename and delete the temp file. If link() fails with ENOENT (it was just expunged), goto b. If link() fails with EMLINK (too many links), goto c. b) If hashes/ file didn't exist, link() the temp file to the hash and rename() it to the destination file. c) If the hashed file existed but wasn't the same, or if link() failed with EMLINK, link() our temp file to a second temp file and rename() it over the hashes/ file and goto a. unlink(): If hashes/<hash> has the same inode as our file and the link count is 2, unlink() the hash file. After that unlink() our file. One alternative to avoid using <hash> as part of the filename would be for unlink() to read the file and recalculate its hash, but that would waste disk I/O. Another possibility would to be to not unlink() the hashes/ files immediately, but rather let some nightly cronjob to stat() through all of the files and unlink() the ones that have link count=1. This could be wastefully inefficient though. Yet another possibility would be for the plugin to internally calculate the hash and write it somewhere. If it's at the beginning of the file, it could be read from there with some extra disk I/O. But is it worth it?.. Extra features -------------- The attachment files begin with an extensible header. This allows a couple of extra features to reduce disk space: 1) The attachment could be compressed (header contains compressed-flag) 2) If base64 attachment is in a standardized form that can be 100% reliably converted back to its original form, it could be stored decoded and then encoded back to original on the fly. It would be nice if it was also possible to compress (and decompress) attachments after they were already stored. This would be possible, but it would require finding all the links to the message and recreating them to point to the new message. (Simply overwriting the file in place would require there are no readers at the same time, and that's not easy to guarantee, except if Dovecot was entirely stopped. I also considered some symlinking schemes but they seemed too complex and they'd also waste inodes and performance.) Code status ----------- Initial version of the attachment reading/writing code is already done and works (lacks some error handling and probably performance optimizations). The SIS plugin code is also started and should be working soon. This code is very isolated and can't cause any destabilization unless it's enabled, so I'm thinking about just adding it to v2.0 as soon as it works, although the config file comments should indicate that it's still considered unstable.

5 31

[Dovecot] Dovecot upgrades break Blackberry instant email (BIS)
by interfaSys sàrl 17 Sep '10

17 Sep '10

Hello, Just like when upgrading to 1.2, upgrading to 2.0.1 confuses RIM's BIS servers and users don't have instant email anymore on their Blackberrys. Under normal conditions, the BIS servers keep one open connection per email account with Dovecot. They're using IMAP IDLE to monitor changes and push them to devices very quickly. After an upgrade, all changes. The BIS servers can't maintain an idling connection anymore, they just poll the Dovecot server when they feel like it (every 2-15 minutes). There is one way to fix this on the devices: The users have to re-create the email account. I don't find this very convenient and was wondering if there was something that could be done on the Dovecot side? Last time it happened, I tried clearing the indexes and resetting file permissions, but nothing helped. Cheers, Olivier

5 14

[Dovecot] SSL stops working after server upgrade
by "Ing. Daniel Rozsnyó" 17 Sep '10

17 Sep '10

Hello, after an upgrade of the dovecot server, I can not use SSL connections. Can you help me solving the issue? When googling for the error, there is an opinion that the client is broken (in my case Thunderbird, 3.1.3), but I rather see the issue in the server, because I was upgrading my gentoo box by hand, and the secure imap stopped to work after that. Is there a more verbose SSL logging than the default verbose ssl = yes? It's output is attached below. Also, maybe only a configuration detail is missing, since with this version of dovecot, the configuration files were broken into several smaller files, but for my first look they contained the options I had used before. Thanks. Sep 16 23:12:25 [dovecot] master: Dovecot v2.0.2 starting up (core dumps disabled) Sep 16 23:12:29 [dovecot] imap-login: Warning: SSL: where=0x10, ret=1: before/accept initialization [192.168.77.202] Sep 16 23:12:29 [dovecot] imap-login: Warning: SSL: where=0x2001, ret=1: before/accept initialization [192.168.77.202] Sep 16 23:12:29 [dovecot] imap-login: Warning: SSL: where=0x2002, ret=-1: SSLv2/v3 read client hello A [192.168.77.202] Sep 16 23:12:29 [dovecot] imap-login: Warning: SSL: where=0x2001, ret=1: SSLv3 read client hello A [192.168.77.202] Sep 16 23:12:29 [dovecot] imap-login: Warning: SSL: where=0x2001, ret=1: SSLv3 write server hello A [192.168.77.202] Sep 16 23:12:29 [dovecot] imap-login: Warning: SSL: where=0x2001, ret=1: SSLv3 write certificate A [192.168.77.202] Sep 16 23:12:29 [dovecot] imap-login: Warning: SSL: where=0x2001, ret=1: SSLv3 write key exchange A [192.168.77.202] Sep 16 23:12:29 [dovecot] imap-login: Warning: SSL: where=0x2001, ret=1: SSLv3 write server done A [192.168.77.202] Sep 16 23:12:29 [dovecot] imap-login: Warning: SSL: where=0x2001, ret=1: SSLv3 flush data [192.168.77.202] Sep 16 23:12:29 [dovecot] imap-login: Warning: SSL: where=0x2002, ret=-1: SSLv3 read client certificate A [192.168.77.202] - Last output repeated twice - Sep 16 23:12:30 [dovecot] imap-login: Warning: SSL alert: where=0x4004, ret=554: fatal bad certificate [192.168.77.202] Sep 16 23:12:30 [dovecot] imap-login: Warning: SSL failed: where=0x2002: SSLv3 read client certificate A [192.168.77.202] Sep 16 23:12:30 [dovecot] imap-login: Disconnected (no auth attempts): rip=192.168.77.202, lip=192.168.77.201, mpid=0, TLS handshaking: SSL_accept() failed: error:14094412:SSL routines:SSL3_READ_BYTES:sslv3 alert bad certificate: SSL alert number 42

2 2

[Dovecot] [DC2.x ]pop3-login seg faults when compiled with gcc 4.5.2 and gold
by interfaSys sàrl 17 Sep '10

17 Sep '10

Hello, On FreeBSD, Dovecot 2.0.1 compiles fine with gcc45 and the other services have no problem, but even without any optimizations (CFLAGS) at all, pop3-login seg faults when a user tries to connect to Dovecot using POP3. As this is not the only application that has a problem with the latest version of gcc (mod_php), there may be nothing that can be done on the Dovecot side, but I thought I would mention it, in case it was due to some bug in the pop3-login code. Cheers, Olivier

2 12

[Dovecot] imap processing spinning on the CPU
by Daniel J. Luke 17 Sep '10

17 Sep '10

Version: 2.0.2 OS: Mac OS X 10.5.8 IMAP Client: Apple Mail.app on 10.5.8 Since upgrading to 2.0.2 I've noticed one user ends up with 4-5 imap processes all using as much CPU as they can get. I know of one other person who is seeing this on a FreeBSD server (that person moved back to dovecot 1.2 which 'solved' the problem there). I didn't notice anything in the list archive about this, but maybe I missed it. (gdb) bt full #0 0x9534c2a8 in memchr () No symbol table info available. #1 0x001ef220 in parse_next_body_to_boundary () No symbol table info available. #2 0x001f02a8 in message_parser_parse_next_block () No symbol table info available. #3 0x0013c1cc in index_mail_cache_parse_continue () No symbol table info available. #4 0x0015c634 in mbox_save_body () No symbol table info available. #5 0x0015ca14 in mbox_save_continue () No symbol table info available. #6 0x000ecc58 in mail_storage_copy () No symbol table info available. #7 0x000f5b80 in mailbox_copy () No symbol table info available. #8 0x00003a10 in cmd_copy (cmd=0x80e820) at cmd-copy.c:66 search_ctx = (struct mail_search_context *) 0x403900 src_trans = (struct mailbox_transaction_context *) 0x403230 srcset_ctx = { str = 0x282d0, first_uid = 0, last_uid = 4294967295 } save_ctx = (struct mail_save_context *) 0x0 mail = (struct mail *) 0x81bc20 src_uidset = (string_t *) 0x282d0 copy_count_r = (unsigned int *) Cannot access memory at address 0x0 -- Daniel J. Luke +========================================================+ | *---------------- dluke(a)geeklair.net ----------------* | | *-------------- http://www.geeklair.net -------------* | +========================================================+ | Opinions expressed are mine and do not necessarily | | reflect the opinions of my employer. | +========================================================+

3 3

[Dovecot] Moving from MBOX to Maildir or DBox ?
by Frank Bonnet 16 Sep '10

16 Sep '10

Hello Actually we use MBOX format for all our IMAP access but users complain they cannot create subfolders in imap folders, of course they cannot because of MBOX format ... I need gurus advices on changing mailbox format Maildir of Dbox ? What would be the safest way to go ? Note : we extensively use Thunderbird here. Thanks

4 3

[Dovecot] dovecot as exchange server?
by Jacek Osiecki 16 Sep '10

16 Sep '10

Hi, This might be a stupid question, since my knowledge about Exchange is really poor... Since I've got iPhone, I have noticed that IMAP mailbox support is quite crippled in this device - in comparison to Exchange mailboxes... As I assume that it would be easier to convince Bill Gates to install linux than to convince Steve Jobs to change anything in his "perfect phone", I started searching for something that could serve emails similarly to Exchange. Since gmail provides Exchange access, and they definitely don't run a single huge MS Exchange server, I assume that it is somehow possible to implement Exchange protocols - or am I wrong? So, finally - if it is possible to use Exchange protocol, would there be any plans for implementing it in dovecot? Best regards, -- Jacek Osiecki joshua(a)ceti.pl GG:3828944

6 8

[Dovecot] dsync mirror duplicates problem
by Waldemar W. 16 Sep '10

16 Sep '10

Im trying to sync 2 mailserver with dsync mirror functionality. Problem occurs when mails arrive in the same folder on both sides then dsync sometimes runs into problems and duplicates that entrys on both side(2mails then with same content). After running again the same happens again(now 4 mails with same content on every side). And then duplicates this mails on both sides on every run :( Anyone with same problem or is something that could cause this? I tried dsync with and without -f option but no change. Im running dovecot 2.0.1 together with dovecot sieve (latest hg version). thanks, Waldemar

2 3

[Dovecot] Dovecot2 and mdbox problem
by Michael Grosseck 16 Sep '10

16 Sep '10

Hello, I've just installed Dovecot from the http://xi.rename-it.nl/debian/ repository. But I have a problem with the mdbox Format. When the home folder is empty Dovecot should create the folder structure if the first mail arrived or the user logs in the first time. But I get following error: Sep 16 12:30:41 smtp dovecot: lmtp(31244): Connect from local Sep 16 12:30:41 smtp dovecot: lmtp(31244, info(a)example.de) Error: file_dotlock_open() failed with file /var/mail/es030107p1/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.log: No such file or directory Sep 16 12:30:41 smtp dovecot: lmtp(31244, info(a)example.de) Error: Opening INBOX failed: Mailbox doesn't exist: INBOX Sep 16 12:30:41 smtp dovecot: lmtp(31244, info(a)example.de) 0ZQgDbkNkkwMegAA00WXAw: msgid=<20100916123041.4781A4F4138(a)smtp.example.de>: save failed to INBOX: Mailbox doesn't exist: INBOX Sep 16 12:30:41 smtp dovecot: lmtp(31244, info(a)example.de) Error: BUG: Saving failed to unknown storage Sep 16 12:30:41 smtp dovecot: lmtp(31244): Disconnect from local: Client quit Also if I try to create a mailbox by hand I get a similar error. doveadm(info(a)example.de): Error: file_dotlock_open() failed with file /var/mail/es030107p1/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.log: No such file or directory doveadm(info(a)example.de): Error: Can't create mailbox INBOX: Internal error occurred. Refer to server log for more information. [2010-09-16 14:07:42] If I now create the dbox-Mails directory and the dovecot.index.log by hand and make a doveadm -v force-resync -u info(a)example.de INBOX everthing is alright. Also I can not create a new IMAP-folder with Thunderbird. It seems Dovecot forgets to create the dbox-Mails directory and the dovecot.index.log file. Now my config: # 2.0.2 (eb5adb193064): /etc/dovecot/dovecot.conf # OS: Linux 2.6.26-2-xen-amd64 x86_64 Debian 5.0.6 auth_debug = yes auth_debug_passwords = yes auth_mechanisms = plain login auth_verbose = yes auth_verbose_passwords = plain base_dir = /var/run/dovecot/ disable_plaintext_auth = no first_valid_gid = 10000 first_valid_uid = 10000 last_valid_gid = 10000 last_valid_uid = 10000 login_greeting = Webfixx Dovecot ready. mail_debug = yes mail_gid = vmail mail_location = mdbox:%h/mdbox mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } postmaster_address = liox(a)elso.mine.nu service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0600 user = vmail } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } user = vmail } ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql }

2 2

[Dovecot] Execution of external commands from Pigeonhole sieve
by Andrés Yacopino 16 Sep '10

16 Sep '10

Does anybody knows if there are some method to call an externall command from sieve? Is xexec plugin is what i am looking for? Is it avaiable for Dovecot 1.2? __ <http://wiki.dovecot.org/Plugins/xexec>I am using dovecot 1.2 and sieve 0.1.17. I want to call ripmime from sieve to save attchments from mails in a user account. Thanks for your feedback, Greetings, -- Andrés Fernando Yacopino

2 1

[Dovecot] Deliver/LDA, no data in the logs, even with debug set (dovecot + qmail-ldap), and sieve issue
by Mohit Chawla 16 Sep '10

16 Sep '10

Hi, I am trying to integrate sieve with qmail-ldap. I can't get it to work, and deliver isn't logging anything to the log files (or syslog, if selected). Hence I have got no way to diagnose the problem. Any help appreciated. *root@debtwo:~# dovecot --version* 1.2.13 *root@debtwo:~# dovecot -n* # 1.2.13: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-3-686 i686 Debian squeeze/sid log_path: /dev/stderr protocols: imap imaps pop3 pop3s login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login mail_privileged_group: mail mail_location: maildir:~/Maildir mbox_write_locks: fcntl dotlock mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 lda: postmaster_address: mirko(a)deb.vm hostname: debtwo.deb.vm sendmail_path: /usr/lib/sendmail mail_plugins: sieve mail_plugin_dir: /usr/lib/dovecot/modules/lda log_path: /var/log/ldaone.log info_log_path: /var/log/ldatwo.log debug: yes auth default: passdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf userdb: driver: prefetch userdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf plugin: sieve: ~/.dovecot.sieve *root@debtwo:~# grep -v '^ *$#.*$\?$' /etc/dovecot/dovecot-ldap.conf* hosts = debtwo.deb.vm uris = ldap://debtwo.deb.vm ldaps://debtwo.deb.vm dn = cn=admin,dc=deb,dc=vm dnpass = secret auth_bind = yes ldap_version = 3 base = ou=People,dc=deb,dc=vm scope = subtree user_attrs = homeDirectory=home,uidNumber=uid,gidNumber=gid user_filter = (&(objectClass=posixAccount)(uid=%u)) pass_attrs = uid=user,userPassword=password,\ homeDirectory=userdb_home,uidNumber=userdb_uid,gidNumber=userdb_gid user_attrs = homeDirectory=home, uidNumber=uid, gidNumber=gid * root@debtwo:~# cat /home/mirko/.dovecot.sieve * require ["reject"]; reject "blah"; * root@debtwo:~# ls -l /var/log/lda** -rw-rw-rw- 1 root root 0 Sep 16 16:49 /var/log/ldaone.log -rw-rw-rw- 1 root root 0 Sep 16 16:49 /var/log/ldatwo.log

2 4

[Dovecot] dovecot 2.02 expire stopped working
by Robert Schetterer 16 Sep '10

16 Sep '10

Hi Timo, the expire plugin suddenly stopped working ( updating from betas ), no problem found in the logs doveadm expunge -A mailbox Trash savedbefore 1m works as expected i have no idea why nothing gets logged only loading the plugin is shown -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria

1 1

[Dovecot] Problems with dovecot-2.0.2+dovecot-2.0-pigeonhole-0.2.0
by Jose Luis Faria 16 Sep '10

16 Sep '10

Hello, I have installed the dovecot-2.0.2 and dovecot-2.0-pigeonhole-0.2.0 but if I try to use sieve I get this error. I can't find any help in documentation. Any ideas? thanks ----------------------- /usr/local/sbin/dovecot start doveadm(root): Error: dlopen(/usr/local/lib/dovecot /lib90_sieve_plugin.so) failed: /usr/local/lib/dovecot/libdovecot-sieve.so.0: undefined symbol: mail_deliver_save_open /usr/local/sbin/dovecot -n # 2.0.2: /usr/local/etc/dovecot/dovecot.conf # OS: Linux 2.6.9-42.0.2.ELsmp x86_64 CentOS release 4.3 (Final) auth_verbose = yes base_dir = /var/run/dovecot/ default_login_user = nobody disable_plaintext_auth = no info_log_path = /var/qmail/log/dovecot/mail.log listen = * log_path = /var/qmail/log/dovecot/dovecot.log mail_debug = yes mail_location = maildir:~/Maildir mail_plugins = sieve managesieve_notify_capability = mailto managesieve_sieve_capability = comparator-i;octet comparator-i;ascii-casemap fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } service imap-login { inet_listener imap { port = 10143 } inet_listener imaps { port = 10993 ssl = yes } } service pop3-login { inet_listener pop3 { port = 10110 } inet_listener pop3s { port = 10995 ssl = yes } } userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } protocol lda { auth_socket_path = /var/run/dovecot/auth-master info_log_path = /var/qmail/log/dovecot/dovecot-deliver.log log_path = /var/qmail/log/dovecot/dovecot-deliver.log mail_plugins = $mail_plugins postmaster_address = postmaster(a)example.tld } protocol lmtp { mail_plugins = $mail_plugins } -- :) cumprimentos ---------------------- José Luís Faria Network Eng./Administrador de Sistemas Departamento de Informática Universidade do Minho Braga, Portugal

3 3

[Dovecot] Expire Mysql backend
by Paweł Madej 16 Sep '10

16 Sep '10

Hello, Is it possible to make expire plugin get per user number of days to expire emails in trash? for example user1 trash 14d user2 trash 30d user3 trash 0d - disable -- Paweł Madej

4 8

[Dovecot] SIS
by Daniel L. Miller 16 Sep '10

16 Sep '10

Is SIS for dbox included in the 2.0.2 sources? Or only via Mercurial? -- Daniel

2 1

[Dovecot] Sieve problems - compiled script does not get updated
by aditsu 16 Sep '10

16 Sep '10

Hi, I'm using Dovecot 1.1.7 with sieve and managesieve, and Thunderbird with the sieve plugin (0.1.10). Sieve filters are generally working, but I noticed a situation where a script wrongly remains in effect. Here's how to reproduce the problem: - write 2 sieve scripts (in Thunderbird), say A and B, triggered by different things - activate script A and send an email that triggers it (so that it gets compiled) - change the active script to B (by clicking its "active" icon in the list) - send an email that triggers B; it will not work - send an email that triggers A; it will still work The only way I found to fix it is to hunt down the corresponding .dovecot.sievec file and delete it (the .dovecot.sieve symlink gets updated correctly, but .dovecot.sievec doesn't). After deleting it, the correct script is compiled and executed. Is this problem fixed in a newer version of dovecot? Thanks Adrian -- View this message in context: http://old.nabble.com/Sieve-problems---compiled-script-does-not-get-updated… Sent from the Dovecot mailing list archive at Nabble.com.

2 2

[Dovecot] sieve rules quiestion (deduplicate e-mails)
by Vasiliy G Tolstov 16 Sep '10

16 Sep '10

Hello. I'm successful use sieve for filtering e-mail from various subscriptions. But if i have subscription for 2 or more mailing lists and user write email to list1(a)xxx.org and list2(a)yyy.org by REPLY TO ALL or make a CC header, i'm recieve email twice, if i reply in some list to user and user REPLY TO ALL - i'm recieve email 3 times :) How can i'm eliminate this duplications? For example i want to recive all emails, but put only one in subscription folder. And other silently discard.... And second question is - i have many subsections to mailing lists, sieve rules looks like this: elsif header :contains "List-Id" ["cfe-dev.cs.uiuc.edu"] { fileinto "Subscriptions/Clang"; } elsif header :contains "List-Id" ["jabberd2-lists.xiaoka.com"] { fileinto "Subscriptions/Jabberd2"; } elsif header :contains "List-Id" ["chef.lists.opscode.com"] { fileinto "Subscriptions/Chef"; } elsif header :contains "List-Id" ["help-cfengine.cfengine.org"] { fileinto "Subscriptions/Cfengine"; } # rule:[Exherbo] elsif header :contains "List-Id" ["exherbo-dev.lists.exherbo.org","exherbo-commits.lists.exherbo.org"] { fileinto "Subscriptions/Exherbo"; } # rule:[Php] elsif header :contains "List-Id" ["highload-php-ru.googlegroups.com","highload-php-en.googlegroups.com"] { fileinto "Subscriptions/Php"; } # rule:[Btrfs] elsif header :contains ["List-Id"] ["linux-btrfs.vger.kernel.org"] { fileinto "Subscriptions/Btrfs"; How can i minimize this rules and save desired functionality? -- Vasiliy G Tolstov <v.tolstov(a)selfip.ru> Selfip.Ru

1 0

[Dovecot] Compiling Dovecot 2.0.2 on Solaris 10 SPARC - libssl.so.1.0.0: open failed
by Edward Carraro 16 Sep '10

16 Sep '10

I'm trying to compile the source for Dovecot 2.0.2 on a Solaris 10 SPARC machine. > uname -a SunOS ommtca013 5.10 Generic_138888-07 sun4v sparc SUNW,Sun-Blade-T6300 Solaris > cat /etc/release Solaris 10 10/08 s10s_u6wos_07b SPARC I've installed the following binaries from sunfreeware for dovecot 1.1 to use with 2.0.2 gcc-3.4.6-sol10-sparc-local ncurses-5.7-sol10-sparc-local libiconv-1.13.1-sol10-sparc-local libintl-3.4.0-sol10-sparc-local nano-2.2.5-sol10-sparc-local gmp-4.2.1-sol10-sparc-local coreutils-8.5-sol10-sparc-local libtool-2.2.6b-sol10-sparc-local openssl-1.0.0a-sol10-sparc-local db-4.7.25.NC-sol10-sparc-local sasl-2.1.21-sol10-sparc-local openldap-2.4.22-sol10-sparc-local zlib-1.2.5-sol10-sparc-local mysql-5.0.67-sol10-sparc-local bzip2-1.0.5-sol10-sparc-local libnet-1.1.2.1-sol10-sparc-local readline-5.2-sol10-sparc-local postgresql-8.4.4-sol10-sparc-local When I compile using: > ./configure --with-ldap or > CPPFLAGS="-I/usr/local/ssl/include" LDFLAGS="-L/usr/local/ssl/lib -ldl" ./configure --with-ldap or > CPPFLAGS="-I/usr/local/ssl/include" LDFLAGS="-L/usr/local/ssl/lib -ldl" ./configure --with-ldap --with-ssl I get the following error when starting up dovecot: Sep 15 11:34:16 master: Error: service(ssl-params): child 12239 killed with signal 9 Sep 15 11:34:16 master: Error: service(ssl-params): command startup failed, throttling Sep 15 11:34:16 ssl-params: Error: ld.so.1: ssl-params: fatal: libssl.so.1.0.0: open failed: No such file or directory libssl.so.1.0.0 exists in /usr/local/ssl/lib... which is what I've passed in LDFLAGS What parameters am I suppose to pass to configure?

4 6

[Dovecot] Migrating mail from mbox to maildir using dovecot
by Donny Brooks 15 Sep '10

15 Sep '10

Hello, Currently our mail server is setup to use postfix and dovecot, which is fine except it is setup to use mbox format mail. That and procmail as we need to move to sieve but that is a different issue. I have searched until blue in the face and cannot find a 100% working solution that doesn't require alot of manual interaction to move the mail boxes from mbox to maildir. I have tried the mb2md.pl stuff but with over 150+ users that can get tedious having to log in as each one of them to migrate them. I also tried the convert plugin located here: http://wiki.dovecot.org/Plugins/Convert but it kept erroring about not able to convert the box and exiting. We have approx 200GB of mail total that needs to be migrated. Maybe I am just simply missing something but is there a way that we can migrate all the users with minimal end user interaction and minimal administration time? We need this done asap as our backups are killing us with the large mbox style files. Thanks in advance for any and all input to this. -- Donny B.

5 9

[Dovecot] Authentication with lower case username ONLY
by Leander S. 15 Sep '10

15 Sep '10

Hi, how do you guys force your users to authenticate with lower case letters ONLY? Or convert it? Is there a SASL Option to force that - or are you using scripts i.e. a bash script in combination with the command "tr" ... or a third solution I didn't think of yet? I'm using Postfix / Dovecot combination. Postfix is told to use Dovecots SASL Service to authenticate it's users. For my outgoing eMails I already wrote a script with tr which forms upercase usernames to lowercase ones ... but it's not enough. SpamAssassin is still confused and writes uppercase letters in it's Database etc. ... So that's why I'm looking for a more universal solution. P.S. I would basically prefer a convertation - but I would also be fine with a forced lower case auth system. Thanks & Regards

5 6

[Dovecot] v2.0.0 released
by Timo Sirainen 15 Sep '10

15 Sep '10

http://dovecot.org/releases/2.0/dovecot-2.0.0.tar.gz http://dovecot.org/releases/2.0/dovecot-2.0.0.tar.gz.sig As promised last Friday, here's the v2.0.0 release finally. I'm cautiously optimistic that v2.0.1 won't (have to) be released for a few weeks, since there was quite a lot of testing and fixing going on in the RC stage. Remember to read http://wiki2.dovecot.org/Upgrading/2.0 before upgrading from v1.x. Although there is automatic config conversion, it can't handle everything, so reserve some extra time for upgrading. If you find an upgrade problem that isn't listed on the wiki page, please add it there or email Dovecot mailing list about it. Pigeonhole Sieve and ManageSieve support can now be installed without patching Dovecot. Unfortunately there isn't a Pigeonhole release yet for v2.0, but its Mercurial code tree should be quite stable. See http://wiki2.dovecot.org/Pigeonhole There are no changes since v2.0.rc6. The largest changes since v1.2 are: * Dovecot uses two system users for internal purposes now by default: dovenull and dovecot. You need to create the dovenull user or change default_login_user setting. * Global ACLs are now looked up using namespace prefixes. For example if you previously had INBOX. namespace prefix and a global ACL for "INBOX.Sent", it's now looked up from "INBOX.Sent" file instead of "Sent" as before. * Maildir: File permissions are no longer based on dovecot-shared file, but the mailbox directory. + Redesigned master process. It's now more modular and there is less code running as root. + Configuration supports now per-local/remote ip/network settings. + dsync utility does a two-way mailbox synchronization. + LMTP server and proxying. + Added mdbox (multi-dbox) mail storage backend. + doveadm utility can be used to do all kinds of administration functions. Old dovecotpw and *view utilities now exist in its subcommands. + imap and pop3 processes can now handle multiple connections. + IMAP: COMPRESS=DEFLATE is supported by imap_zlib plugin + director service helps NFS installations to redirect users always to same server to avoid corruption

8 12

[Dovecot] dsync crash
by Василий Шоков 15 Sep '10

15 Sep '10

Hello, When I run dsync -u v.shokov -Dv mirror sdbox:/dsync/v.shokov first time, process halting. On second time I receive this error: dsync(root): Debug: auth input: v.shokov system_groups_user=v.shokov uid=10000 gid=100 home=/home/v.shokov dsync(root): Debug: Effective uid=10000, gid=100, home=/home/v.shokov dsync(root): Debug: Namespace : type=private, prefix=, sep=., inbox=no, hidden=yes, list=yes, subscriptions=yes location=maildir:/home/v.shokov/mail:INDEX=/var/dovecot_index/v.shokov dsync(root): Debug: maildir++: root=/home/v.shokov/mail, index=/var/dovecot_index/v.shokov, control=, inbox= dsync(root): Debug: Namespace : type=private, prefix=.INBOX., sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:~/mail/inbox/:INDEX=/var/dovecot_index/v.shokov/inbox dsync(root): Debug: maildir++: root=/home/v.shokov/mail/inbox, index=/var/dovecot_index/v.shokov/inbox, control=, inbox=/home/v.shokov/mail/inbox dsync(root): Debug: Effective uid=10000, gid=100, home=/home/v.shokov dsync(root): Debug: Namespace : type=private, prefix=, sep=., inbox=no, hidden=yes, list=yes, subscriptions=yes location=sdbox:/dsync/v.shokov dsync(root): Debug: fs: root=/dsync/v.shokov, index=, control=, inbox= dsync(root): Debug: Namespace : type=private, prefix=.INBOX., sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:~/mail/inbox/:INDEX=/var/dovecot_index/v.shokov/inbox dsync(root): Debug: maildir++: root=/home/v.shokov/mail/inbox, index=/var/dovecot_index/v.shokov/inbox, control=, inbox=/home/v.shokov/mail/inbox dsync(v.shokov): Debug: Namespace : Using permissions from /home/v.shokov/mail: mode=0700 gid=-1 dsync(v.shokov): Debug: Namespace : Using permissions from /dsync/v.shokov: mode=0777 gid=-1 dsync(v.shokov): Panic: file mailbox-list-fs.c: line 150 (fs_list_get_path): assertion failed: (mailbox_list_is_valid_pattern(_list, name)) dsync(v.shokov): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0 [0x224ae0] -> /usr/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x45) [0x224bd5] -> /usr/lib/dovecot/libdovecot.so.0 [0x224168] -> /usr/lib/dovecot/libdovecot-storage.so.0 [0x181866] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_list_get_path+0x1d) [0x14d9bd] -> /usr/lib/dovecot/libdovecot-storage.so.0 [0x182724] -> /usr/lib/dovecot/libdovecot-storage.so.0(fs_list_iter_next+0x42) [0x182262] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_list_iter_next+0x12) [0x14da42] -> /usr/lib/dovecot/libdovecot-storage.so.0 [0x14ec7f] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_list_iter_next+0x12) [0x14da42] -> dsync [0x80580a6] -> dsync [0x804ed08] -> dsync(dsync_brain_sync+0x447) [0x804e067] -> dsync [0x804ef29] -> dsync(dsync_brain_sync+0x3f6) [0x804e016] -> dsync(dsync_brain_sync_all+0x18) [0x804ec08] -> dsync(main+0x52b) [0x804d06b] -> /lib/libc.so.6(__libc_start_main+0xe0) [0x2e8f90] -> dsync [0x804c951] My Dovecot version is 2.0.2. My config file is: # 2.0.2: /etc/dovecot/dovecot.conf # OS: Linux 2.6.23.15-80.0.120asp i686 Fedora release 7 (Moonshine) disable_plaintext_auth = no dotlock_use_excl = yes listen = 10.62.1.250 lock_method = dotlock log_path = /var/log/dovecot.log mail_fsync = never mail_location = maildir:/home/%u/mail:INDEX=/var/dovecot_index/%u mmap_disable = yes namespace { hidden = yes location = prefix = separator = . type = private } namespace { hidden = no inbox = yes location = maildir:~/mail/inbox/:INDEX=/var/dovecot_index/%u/inbox prefix = .INBOX. separator = . type = private } passdb { driver = pam } plugin { acl = vfile:/etc/dovecot-acls } service auth { user = root } service imap-login { client_limit = 1000 inet_listener imaps { address = * } process_limit = 256 process_min_avail = 4 service_count = 0 user = dovecot } service pop3-login { client_limit = 3 inet_listener pop3s { address = * } process_limit = 10 process_min_avail = 1 service_count = 1 user = dovecot } ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { driver = passwd } protocol imap { imap_client_workarounds = delay-newmail mail_plugin_dir = /usr/lib/dovecot mail_plugins = acl } protocol lda { postmaster_address = root(a)rittal.ru } Kind regards, Vasiliy Shokov

1 0

[Dovecot] sieve is broken in the latest revision
by interfaSys sàrl 15 Sep '10

15 Sep '10

All the sudden messages filtered by sieve are delivered to folders named after the recipient instead of sticking to the rules and delivering the messages to the INBOX. Is this an intended change? Instead of Maildir/.INBOX it goes to Maildir/.user(a)domain.com Cheers, Olivier

3 6

[Dovecot] autogen.sh fails
by interfaSys sàrl 15 Sep '10

15 Sep '10

autogen.sh fails on FreeBSD 8.1 m4 1.4.15 autoconf 2.67 Here is the error message: libtoolize: Consider adding `AC_CONFIG_MACRO_DIR([m4])' to configure.in and libtoolize: rerunning libtoolize, to keep the correct libtool macros in-tree. libtoolize: Consider adding `-I m4' to ACLOCAL_AMFLAGS in Makefile.am. configure:20543: error: possibly undefined macro: AS_MESSAGE_LOG_FDdnl If this token and others are legitimate, please use m4_pattern_allow. See the Autoconf documentation. Cheers, Olivier

2 2

[Dovecot] Dsync error, Targer mailbox already exists
by Henrique Fernandes 14 Sep '10

14 Sep '10

Hey, why i am getting this error ? dsync(user(a)example.com): Error: Can't rename mailbox VoIP_08300a224c41694c0d0f000020ce4ec5 to VoIP: Target mailbox already exists It happens when i run dsync twice, but it should do only changes right ? dovecot 2.0 I am traying to convert all my user mboc to maildir so i made an script to help. The enveriment: Have dovecot looking into file conf and in mysql. Mysql over rides file conf. in file have mail_location mbox:path:INBOX:path2 so i run this comand: dsync -v -u user(a)domain.com mirror maildir:~/mail/ I run this command to all user in my server, about 8000 After the first dsync it will take a while, but dovecot is still running and looking at mail_location to mbox. So now, i run again dsync, but now i thought it would do only changes, email that arrived while i was converting, but is not doing this and i am getting that stuff, so i get duplicated mailbox. Anyway, my ideia after this second sync that should be much faster i would change in mysql to mail_location maildir:~/mail/ And from now on this user would receive mail to maildir location, and i would run now the dsync but now reversed. like this: dsync -v -u user(a)domain.com mirror mbox:/pathl:INBOX=path And it should be working now right ? Without any down time ? Does any one have a better ideia about how to sync this mails without down time ? Thanks for all! But the bigs quest here is about the error: dsync(user(a)example.com): Error: Can't rename mailbox VoIP_08300a224c41694c0d0f000020ce4ec5 to VoIP: Target mailbox already exists Any one ? []'sf.rique

2 3

[Dovecot] quota dict play nice with existing tables
by Miha Vrhovnik 14 Sep '10

14 Sep '10

Hi, I'm trying to set Dovecot 2.0 with postgresql dict. It's kind of working but not as I'd like to. Dovecot expects to get a dedicated table for quota management. When I've run *doveadm quota recalc -A* I've noticed in the logs that Dovecot tries to run DELETE statements. Fortunately it didn't succeed as I've only given it SELECT and UPDATE permissions on the fields that it needs. I'd like to configure it, in UPDATE only mode as rows already exist and there is no need to issue any other statement. Regards, Miha -- It's time to get rid of your current e-mail client ... ... and start using si.Mail. It's small & free. ( http://www.simail.si/ )

2 5

[Dovecot] need help with shared mailboxes
by alex 14 Sep '10

14 Sep '10

I have some problems with setting shared mailboxes . I use dovecot 1.2.11 with following namespaces : mail_location: maildir:~ namespace: type: private separator: . inbox: yes list: yes subscriptions: yes namespace: type: private separator: . prefix: INBOX. hidden: yes list: no subscriptions: yes namespace: type: shared separator: . prefix: shared.%%n. location: maildir:/home/sites/%d/mail/%%n/Maildir/ list: children plugin: acl: vfile acl_shared_dict: proxy::acl dict: acl: mysql:/usr/local/etc/dovecot-share-sql.conf In the private namespace I use to have only INBOX. space because I have migrate from courier and I ahave problemes with duplicate folders. The disk structure looks like : /home/sites/domain.tld/mail/user(withoutdomain)/Maildir What I'am trying to do is to give access to a user (user2(a)domain.tld) some other user mailbox (user1(a)domain.tld) in the /home/sites/domain.tld/mail/user1/Maildir I have created a file dovecot-acl with : owner lrwstipekxa user=user2(a)domain.tld rl - in the dovecot-share-sql.conf I have : connect = host=/var/lib/mysql/mysql.sock dbname=xxxx user=xxx password=postfixpass map { pattern = shared/shared-boxes/user/$to/$from table = user_shares value_field = dummy fields { from_user = $from to_user = $to } } and in the user_share table : +-------------------+------------------+-------+ | from_user | to_user | dummy | +-------------------+------------------+-------+ | user1(a)myhost.ro | user2(a)domain.tld | 1 | | user1 | user2 | 1 | +-------------------+------------------+-------+ (not sure what I need %n or %u) Now , in TB under the user2 , if I check subscribe , under the shared, I have a INBOX folder that is always check but nothing else. From what I understand I suppose to see user1 folders and I think it is something wrong with my config (namespaces, paths). If someone have succeeded to configure dovecot with shared mailboxes and namespaces that use . as separator please help me. Alex.

2 10

[Dovecot] DC 2.0.2 | Panic: file istream-crlf.c: line 101
by interfaSys sàrl 14 Sep '10

14 Sep '10

There is a new error showing up in my logs Sep 14 11:04:57 lda(user(a)domain.com): Panic: file istream-crlf.c: line 101 (i_stream_crlf_read_crlf): assertion failed: (src == ptr + 1) It seems to only happen with one account Cheers, Olivier

2 1

[Dovecot] dspam + dovecot LDA
by Paweł Madej 14 Sep '10

14 Sep '10

Hello, Is there any possibility to make dspam transport validated emails directly to dovecot LDA? for now I use such schema: postfix > dspam > postfix > dovecot LDA but wanted to not return emails to postfix. I've found that such configuration is possible with dspam+ cyrus IMAP. Documentation of dovecot is great but I haven't found such solution. Thanks in advance for any help. -- Greets Paweł Madej Poland

3 4

[Dovecot] weird dovecot+outlook problem
by Per Jessen 14 Sep '10

14 Sep '10

I have some per-user, read-only mailboxes that I'm auto-subscribing users to. With Thunderbird I have no problems, but with Outlook, the contents of the 'To:' column is not shown until a user actually retrieves the mail. Does this ring a bell with anyone? /Per Jessen, Zürich

2 2

[Dovecot] fts plugin for xapian ?
by Per Jessen 14 Sep '10

14 Sep '10

I have googled it some, and found a couple of references, but nothing specific - has anyone already started work on such a plugin? /Per Jessen, Zürich

2 1