- dovecot - dovecot.org

[Dovecot] imapdir still a configuration option?
by Kurt Mosiejczuk 03 Apr '12

03 Apr '12

I've been looking at moving an old IMAPdir-based solution to dovecot. I came across references that dovecot (to my pleasant surprise) added imapdir support in 1.1. However, in trying 2.0.13 (from an OpenBSD package) things start okay, but I see in the logs: "Initialization failed: Initializing mail storage from mail_location setting failed: Unknown mail storage driver imapdir" Poking around in the sources, I still see lots of references to imapdir, but see very little in the documentation. Is IMAPdir still supported in 2.0.x (or even 2.1.x)? I'd prefer not to have to migrate users via renaming, especially since they like the IMAPdir layout for their own searching. --Kurt

2 2

[Dovecot] Connection queue full on dovecot 2.0.13
by Giovanni Mancuso 03 Apr '12

03 Apr '12

Hi, i have a problem with dovecot 2.0.13. I have one dovecot in Front-end that has only: passdb { driver = static args = proxy=y host=10.0.0.6 nopassword=y } In Back-end i have one dovecot that does auth and exports imap/pop3 ports. In dovecot's log of Front-end i see: /Apr 02 14:33:34 imap-login: Info: proxy(//user(a)example.com/ <mailto:amministrazionevendite@pec.gmatica.it>/): started proxying to 10.0.0.6:143: user=<//user(a)example.com/ <mailto:amministrazionevendite@pec.gmatica.it>/>, method=PLAIN, rip=//xx.xx.xx.xx//, lip=xx.xx.xx.xx, TLS Apr 02 14:34:36 imap-login: Info: Disconnected: *Connection queue full *(auth failed, 1 attempts): user=<//user(a)example.com/ <mailto:amministrazionevendite@pec.gmatica.it>/>, method=PLAIN, rip=//xx.xx.xx.xx//, lip=//xx.xx.xx.xx//, TLS/ I see this wiki page: http://wiki2.dovecot.org/LoginProcess but i read: It works by using a number of long running login processes, each handling a number of connections. This loses much of the security benefits of the login process design, because in case of a security hole (in Dovecot or SSL library) the attacker is now able to see other users logging in and steal their passwords, read their mails, etc. Is there another way? Thanks

2 1

[Dovecot] Per-user flags/indexes for shared mailboxes
by Timo Sirainen 03 Apr '12

03 Apr '12

The attached patch adds support for doing e.g.: namespace { type = public prefix = Public/ location = mdbox:/var/lib/public/mdbox:INDEXPVT=~/mdbox/public list = yes } So the private flags are stored in indexes under ~/mdbox/public/, while the shared flags are stored under /var/lib/public/mdbox/. The patch currently hardcodes the shared flags as only MAIL_SEEN. I'm not really sure what would be the best place to configure which flags are private. Perhaps a per-namespace default, but how to configure it per-mailbox? Also per-user keywords aren't currently supported. And it's a little bit annoying that each private flag update must increase the shared modseq for the message, but that can't really be helped. (Alternative would be for each user to have their own private modseqs, which could get difficult.) I'll probably commit this to v2.1 after some more testing.

1 0

[Dovecot] dsync redesign
by Timo Sirainen 03 Apr '12

03 Apr '12

In case anyone is interested in reading (and maybe helping!) with a dsync redesign that's intended to fix all of its current problems, here are some possibly incoherent ramblings about it: http://dovecot.org/tmp/dsync-redesign.txt and even if you don't understand that, here's another document disguising as an algorithm class problem :) If anyone has thoughts on how to solve it, would be great: http://dovecot.org/tmp/dsync-redesign-problem.txt It only deals with saving new messages, not expunges/flag changes/etc, but those should be much simpler.

9 17

[Dovecot] Dovecot 1.2.9. next_uid was lowered
by Müller Lukas 03 Apr '12

03 Apr '12

Hi There A while ago I posted here about a crash of dovecot, that had to do with nfs and was quite certainly due to bad luck. But still one problem persists: We have a Mailbox, that is accessed from multiple users using IMAP. Occasionally all the Emails in the mailbox seem to be missing, when accessing the Mailbox through IMAP, although they're still there on the server. This seems to happen, if the users are accessing the Mailbox on Server1 and at the same time an email gets delivered to the mailbox on server2. Since it happens quite seldom, there must be other conditions or circumstances that have to be met for the problem to occur. Unfortunately I don't know which. Shortly after the mail gets delivered on server2, I get the following errors on server1: mail01 dovecot: IMAP(akzidenz(a)triner.ch): fdatasync(/data/vmail/example.com/user/dovecot-uidlist) failed: Input/output error mail01 dovecot: IMAP(akzidenz(a)triner.ch): /data/vmail/example.com/user/dovecot-uidlist: next_uid was lowered (2143 -> 2142, hdr=2142) The new mail is than missing in the uidlist and as long as no new mail arrives all folders of the mailbox appear to be empty. If a new mail arrives, it will get the uid that should have been given to the pervious mail (the one that caused the error). The previous mail still won't be listed in the uidlist, but everything works as expected. Best regards Lukas Müller Systems Engineer _______________________________________________ NEWMEDIA Südostschweiz Newmedia AG http://www.newmedia.ch<http://www.newmedia.ch/> _______________________________________________ TYPO3 & Drupal - Wir wissen wie. Ihre professionelle Web Agentur in Chur, Ilanz, Glarus und Zürich.

2 1

[Dovecot] setting up ldap for sasl
by jeff donovan 03 Apr '12

03 Apr '12

Greetings im new to the list dovecot --version 2.0.13 ubuntu 11.10 i want to use dovecot to authenticate my ldap users. My local users can authenticate and send email. Using postfix sasl/tls dovecot pam. I have read many docs/tutorials, which all have a plethora of options and information. my file structure is different than most of the documentation. I have ../etc/dovecot.conf which points to. !include_try /usr/share/dovecot/protocols.d/*.protocol !include conf.d/*.conf !include_try local.conf which leads me to /etc/dovecot/conf.d, which is full of config files. All were traditionally located in dovecot.conf in previous versions. im using PAM to authenticate my local system users. I have read that could adjust PAM, to use LDAP. How do I configure dovecot to keep using pam for local users and ldap for remote ? Do i just add the passdb lines dovecot.conf: passdb ldap { args = /etc/dovecot-ldap.conf } userdb prefetch { } # The userdb below is used only by deliver. userdb ldap { args = /etc/dovecot-ldap.conf } dovecot-ldap.conf: pass_attrs = uid=user,userPassword=password, homeDirectory=userdb_home,uidNumber=userdb_uid,gidNumber=userdb_gid # For deliver: user_attrs = homeDirectory=home,uidNumber=uid,gidNumber=gid any assistance would be helpful. -j

1 2

[Dovecot] Dsync automation
by Jitendra Bhaskar 03 Apr '12

03 Apr '12

Hi, I am using dovecot-2.1.3 on centos 5.7. Its running fine. I have two systems for mail server one is for backup. Currently I am running rsync daily. But I want to use dsync. I went through all the http://wiki2.dovecot.org/Tools/Dsync and http://blog.dovecot.org/2012/02/dovecot-clustering-with-dsync-based.htmlbut I couldn't understood how to automatize dsync. Can anybody give me any idea ho to do it ? -- * Thanks & Regards * *Jitendra Kumar Bhaskar* Cell:- +91 7306311531 +91 8102997821

2 1

Re: [Dovecot] Mail migration troubles
by Spyros Tsiolis 02 Apr '12

02 Apr '12

I have a suspicion that, as usual, no one is going to answer my message. Because of the fact that this is a call for help and no-one ever bothers, I 'll just have to re-phrase my question : Here's what I found on the dovecot wiki : imapsync Here's an example of how to run imapsync for a single user: imapsync --syncinternaldates \ --host1 192.168.1.57 --authmech1 LOGIN --user1 leah(a)example.com --password1 secret \ --host2 127.0.0.1 --authmech2 LOGIN --user2 leah(a)example.com --password2 secret It is quite easy to script this for a number of users, assuming you have their passwords. Even if you do not, imapsync also supports logging in as an admin user that has the ability to copy message for sub users, and a variety of other authentication options. Is the above what I need if I migrate mailboxes FROM dovecot TO dovecot ? E.g. in my example, I only copy mailboxes from an old "user(a)domainA.gr" to "user(a)domainB.gr". Is the above all I need ? Is there a native dovecot tool for this or should I just use imapsync ? Thank you again, s. ---- "I merely function as a channel that filters music through the chaos of noise" - Vangelis ----- Original Message ----- > From: Spyros Tsiolis <stsiol(a)yahoo.co.uk> > To: Spyros Tsiolis <stsiol(a)yahoo.co.uk> > Cc: > Sent: Monday, 2 April 2012, 11:24 > Subject: Re: [Dovecot] Mail migration troubles > > Hello again, > > Well, it seems I have trouble with the migration after all. > After the migration and eventhough all folders and messages > are on their respective places, any new mail users get > inside their mailbox cannot be dragged-and-dropped to > their respective folders. > > So, if a user has a folder with my name on it and I send > him an e-mail, the user will try to drag-and-drop that > message to the folder with my name, but the message won't > move. > > Any gurus out there on this ? > Any help would be greatly appreciated. > > spyros > > > > ---- > "I merely function as a channel that filters > music through the chaos of noise" > - Vangelis >

4 9

[Dovecot] strike my last
by Spyros Tsiolis 02 Apr '12

02 Apr '12

strike my last, looks like its a thunderbird issue Apologies... s. ---- "I merely function as a channel that filters music through the chaos of noise" - Vangelis

1 0

[Dovecot] Problem compiling dovecot-antispam on Ubuntu 11.10 using Doveot 2.0.13
by Guillaume Hilt 31 Mar '12

31 Mar '12

Hello, Last dovecot available version on Ubuntu 11.10 AMD64 is dovecot 2.0.13. dovecot-antispam package is compiled for dovecot 2.0.15. So, i'm trying to compile a new dovecot antispam plugin. I followed dovecot wiki but i'm running into this error : Successfully compiled dspam.c (plugin). mailbox.c: In function 'antispam_save_begin': mailbox.c:138:12: error: 'struct mail_save_context' has no member named 'copying_via_save' mailbox.c: In function 'antispam_save_finish': mailbox.c:174:12: error: 'struct mail_save_context' has no member named 'copying_via_save' Failed to compile mailbox.c (plugin)! Any hint please ? Regards, -- Guillaume Hilt

2 2

[Dovecot] Problem managing mbox
by PSTM 31 Mar '12

31 Mar '12

Hello, I have a problem with dovecot. seems that do not erase mail that mail client request to be erased. And I have this errors: > Error: Next message unexpectedly corrupted in mbox file Info: > dovecot-2.1.1-2.0.cf.fc16.i686 > root 5979 0.0 0.1 3208 1260 ? Ss 20:18 0:00 > /usr/sbin/dovecot -F > dovenull 5985 0.0 0.2 7060 2280 ? S 20:18 0:00 > dovecot/imap-login > vmail 5988 0.0 0.1 7888 1848 ? S 20:18 0:00 > dovecot/imap permissions on mail dir: > total 4 > drwxr-xr-x 9 vmail mail 4096 ene 21 21:43 vmail Any suggestion? Regards, -- -- http://www.0pc.eu/

3 2

[Dovecot] Proxying Authentication on both sides
by Andy Dills 30 Mar '12

30 Mar '12

I've recently set up a director proxy environment on my test servers, with the intention of deploying on our cluster soon. One thing I found confusing in the proxying documentation [1] was the first bit about their being two ways to do the authentication...either you have the proxy forward the auth to the real server for authentication, or you have the proxy authenticate it and then login to the real server with a master password. Well, we use /bin/checkpassword authentication which hooks into a variety of subsytems for various specific customer needs, and sometimes we need to know the username AND password of the user in order to determine their home directory information. So, using a master password (which requires the back-end server not getting the user password) is out. However, when we have the front-end server do a static director proxy, the problem is that authentication failures are logged on the back-end server with a source IP of the proxy, and no authentication failure with the client IP address is logged on the proxy. So, fail2ban (which is a MUST these days, at least for us) will not be able to properly filter out the brute force attackers. My solution was an alternative: I authenticate with our /bin/checkpassword on the proxy, which authenticates the user and only at that point returns the proxy=y nopassword=y switch to proxy the connection and forward the authentication. As a result, we get logs on the proxy for failed attempts, and the full username and password is supplied to the back-end server for proper processing. Food for thought in case anybody else is implementing this. Thanks, Andy [1] http://wiki2.dovecot.org/PasswordDatabase/ExtraFields/Proxy --- Andy Dills Xecunet, Inc. www.xecu.net 301-682-9972 ---

2 3

[Dovecot] Multiple instances
by Timo Sirainen 30 Mar '12

30 Mar '12

v2.1 now saves the base_dir and instance_name to /var/lib/dovecot/instances when starting up. If you have for example two instances with names "backend" and "proxy", you can then use: doveadm -i proxy proxy list instead of something like: doveadm -c /etc/dovecot-proxy/dovecot.conf proxy list The same -i parameter works for all dovecot programs. I also added a couple of new doveadm commands: # doveadm instance list path name last used running /var/run/dovecot proxy 2012-02-06 21:41:39 yes # doveadm instance remove proxy It would be possible to add commands to start/shutdown some/all instances using doveadm, but is it all that useful? I'd guess people would have their own init.d scripts anyway doing that. Anything else that could be useful related to this?

2 2

[Dovecot] IMAP to Maildir Migration preserving UIDs?
by Gedalya 30 Mar '12

30 Mar '12

Hello all, I'm facing the need to migrate from a proprietary IMAP server to Dovecot. The migration must be as smooth and transparent as possible. The mailbox format I would want to use is Maildir++. The storage format used by the current server is unknown, and I don't look forward to trying to reverse-engineer it. This leaves me with the option of reading the mailboxes using IMAP. There are tools like offlineimap or mbsync, and they do store the UID and UIDVALIDITY info. The last piece of the puzzle is a process to properly create the dovecot-uidlist and dovecot-uidvalidity files. So far I wasn't able to find anything on this. Are there any tips? Are there any tools available to do this job, or part of it? In either case I need this done, and I'll have to create whatever I can't find available. If there isn't anything out there that I'm yet to become aware of, then I'm looking at creating something like an offlineimap post-processing routine? Any help would be much appreciated. Gedalya

7 33

[Dovecot] Dovecot migration from any IMAP/POP3 server
by Timo Sirainen 30 Mar '12

30 Mar '12

With the latest hg version / upcoming v2.1.4 you can do a perfect migration to Maildir using imapc/pop3c backends: http://wiki2.dovecot.org/Migration/Dsync The main new feature here is the pop3-migration plugin that matches messages from IMAP and POP3 servers together, so that when dsync needs to request POP3 UIDL for some IMAP message it's actually looked up from the POP3 server.

2 1

[Dovecot] newbie: keep getting same emails in mail client
by neuronetv 30 Mar '12

30 Mar '12

dovecot-2.0.9-2.el6_1.1.i686 I've just set up dovecot in centos 6.2 (server install) and finally got it working (kind of). I set up a unix user (not a virtual user) sent a test email to this user but in my mail client I keep getting this test email over and over again. I don't think the fault is with the email client because other emails work fine and never duplicate and I've tweaked the account settings too, so it must be something I've done wrong in the dovecot setup. Here is my dovecot.conf file: # Dovecot configuration file protocols = pop3 imap disable_plaintext_auth = no mail_location = mbox:~/mail:INBOX=/var/spool/mail/unix-username ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem passdb { driver = pam } userdb { driver = passwd } thanks for any pointers. -- View this message in context: http://old.nabble.com/newbie%3A-keep-getting-same-emails-in-mail-client-tp3… Sent from the Dovecot mailing list archive at Nabble.com.

1 0

[Dovecot] SIS and restoring from backups
by Charles Marcus 29 Mar '12

29 Mar '12

On 2012-03-24 7:49 AM, Timo Sirainen <tss(a)iki.fi> wrote: > This is already optionally done in v2.0+dbox. MIME attachments can be > stored in plain binary form if they can be reconstructed back into > their original form. It doesn't break any signed stuff. Hey Timo, Splitting this off into a separate thread... On the question of the existing SIS capability for attachments... have you given any thought as to how to solve the problem of restoring from backups when SIS is used? I was planning on using it initially, until I read on list that restoring from (normal disk-to-disk) backups would not work when SIS was enabled - this is obviously a deal breaker for anyone who relies on backups - which I would think would be almost everyone? Or maybe I misunderstood the problem? -- Best regards, Charles

2 6

[Dovecot] Sieve fileinto and year/month folders.
by Xavier Beaudouin 29 Mar '12

29 Mar '12

Hi there, I am trying to move from lmtpd (lmtpd.sf.net) to dovecot sieve. One thing used by some of powerusers are archiving mail automatically with autocreated folders based on year + month. Is there any good way to make that with sieve... One example require "fileinto"; if address :is ["From", "To"] "dovecot(a)dovecot.org" { fileinto "INBOX.mls.%Y.%m.dovecot"; } This will fill any mails into INBOX.mls.2012.03.dovecot uppon receiving... I don't know if some sieve guru can tell me how to do that... ? Kind regards, Xavier

4 5

[Dovecot] Problem about dovecot Panic
by FABIO FERRARI 29 Mar '12

29 Mar '12

Good morning, we have 2 Redhat Enterprise 5.7 machines, they are a cluster with some mail services in it (postfix and dovecot 2). The version of dovecot is dovecot-2.0.1-1_118.el5 (installed via rpm). >From last week we have this dovecot problem: suddenly dovecot doesn't accept any new connections, the dovecot.log file reports lines like these Mar 15 12:38:54 secchia dovecot: imap: Panic: epoll_ctl(add, 5) failed: Invalid argument Mar 15 12:38:54 secchia dovecot: imap: Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0 [0x36ea436de0] -> /usr/lib64/dovecot/libdovecot.so.0 [0x36ea436e3a] -> /usr/lib64/dovecot/ libdovecot.so.0 [0x36ea4362e8] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handle_add+0x118) [0x36ea441498] -> /usr/lib64/dovecot/libdovecot.so.0(io_add+0x8f) [0x36ea440b7f] -> /usr/li b64/dovecot/libdovecot.so.0(master_service_init_finish+0x1c6) [0x36ea430c16] -> dovecot/imap(main+0x10a) [0x41773a] -> /lib64/libc.so.6(__libc_start_main+0xf4) [0x36ea01d994] -> dovecot/ imap [0x408179] Mar 15 12:38:54 secchia dovecot: master: Error: service(imap): child 14514 killed with signal 6 (core dumps disabled) Mar 15 12:38:54 secchia dovecot: master: Error: service(imap): command startup failed, throttling Mar 15 12:39:50 secchia dovecot: imap-login: Error: master(imap): Auth request timed out (received 0/12 bytes) Mar 15 12:39:51 secchia dovecot: imap-login: Error: master(imap): Auth request timed out (received 0/12 bytes) Mar 15 12:39:51 secchia dovecot: imap-login: Error: master(imap): Auth request timed out (received 0/12 bytes) Mar 15 12:39:52 secchia dovecot: imap-login: Error: net_connect_unix(imap) failed: Resource temporarily unavailable Mar 15 12:39:52 secchia dovecot: imap-login: Error: net_connect_unix(imap) failed: Resource temporarily unavailable Mar 15 12:39:52 secchia dovecot: imap-login: Error: master(imap): Auth request timed out (received 0/12 bytes) Mar 15 12:39:53 secchia dovecot: imap-login: Error: net_connect_unix(imap) failed: Resource temporarily unavailable Mar 15 12:39:53 secchia dovecot: imap-login: Error: net_connect_unix(imap) failed: Resource temporarily unavailable Mar 15 12:39:54 secchia dovecot: imap-login: Error: net_connect_unix(imap) failed: Resource temporarily unavailable Mar 15 12:39:54 secchia dovecot: imap: Error: Login client disconnected too early Mar 15 12:39:54 secchia dovecot: imap: Error: Login client disconnected too early Mar 15 12:39:54 secchia dovecot: imap: Error: Login client disconnected too early Mar 15 12:39:54 secchia dovecot: imap: Error: Login client disconnected too early Mar 15 12:39:55 secchia dovecot: imap: Panic: epoll_ctl(add, 5) failed: Invalid argument and the kern.log file reports Mar 15 12:38:52 secchia kernel: dlm: closing connection to node 1 Mar 15 12:39:04 secchia kernel: lpfc 0000:83:00.0: 1:(0):2753 PLOGI failure DID:010400 Status:x9/x32900 Mar 15 12:39:04 secchia kernel: lpfc 0000:03:00.0: 0:(0):2753 PLOGI failure DID:010400 Status:x9/x32900 Mar 15 12:41:14 secchia kernel: lpfc 0000:03:00.0: 0:(0):2753 PLOGI failure DID:010400 Status:x9/x32900 Mar 15 12:41:15 secchia kernel: lpfc 0000:83:00.0: 1:(0):2753 PLOGI failure DID:010400 Status:x9/x32900 Mar 15 12:42:11 secchia kernel: dlm: got connection from 1 can you help us? thanks in advance Fabio Ferrari

2 1

[Dovecot] dsync is SLOW compared to rsync
by Jeff Gustafson 29 Mar '12

29 Mar '12

Hi all, We are currently using snapshots and rsync to backup a large mail server to a backup mail server. I have been looking into using dsync to replace rsync in hopes that it would make backups more efficient. I decided to test the performance using a single mailbox. Unfortunately dsync seems to run much slower than rsync. Rsync was able to sync the mailbox in 2 seconds. dsync took over a minute. The test was run so that the source and destination are on the same filesystem. We would like to using the new replication system, but that doesn't seem likely since the performance of the underlying dsync is so much slower than rsync. Even with the extra work that dsync is doing I can't believe the difference in performance would be that great. I realize that dsync is actively being worked on and I hope bringing attention to performance issue will provoke some ideas on how to improve it. Here is the output of the tests using dovecot 2.1.3: [root@n24 bu]# du -hs /home/10.0.1.101/1009/users/testuser% domain.com/Maildir/ 517M /home/10.0.1.101/1009/users/testuser%domain.com/Maildir/ [root@n24 bu]# time rsync -va /home/10.0.1.101/1009/users/testuser% domain.com/Maildir/ . sending incremental file list Maildir/ Maildir/dovecot-uidlist [ ... deleted cruft ... ] Maildir/cur/1332387577.M381054P27635.n24,S=14215502,W=14448554:2, Maildir/new/ Maildir/tmp/ sent 540927820 bytes received 1222 bytes 216371616.80 bytes/sec total size is 540855755 speedup is 1.00 real 0m2.677s user 0m3.184s sys 0m1.513s [root@n24 bu]# time dsync backup -u testuser(a)domain.com \ mdbox:/home/bu/testuser real 1m9.519s user 1m7.592s sys 0m1.126s [root@n24 bu]# time dsync backup -u testuser(a)domain.com \ sdbox:/home/bu/testuser2 real 1m2.164s user 1m0.882s sys 0m0.993s [root@n24 bu]#

7 15

[Dovecot] Dovecot 1.2.9 Crash, NFS
by Müller Lukas 29 Mar '12

29 Mar '12

Hi, I'm stuck with a problem we have with dovecot. My suspicion is, that it has to do with accessing the same mailbox/mail stored on a NFS-share from two machines at the same time. setup We have to mail servers running, both run a Ubuntu 10.04, Postfix 2.70 and Dovecot 1.2.9. The mailboxes are stored in maildir format on a NFS-Share. In front of those to mail servers we have a load balancer. Unfortunately it can't be set up to use the same server for each domain, but it uses the same server for the same source-ip for at least 1 hour. Here is the output of dovecot -n: # 1.2.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-33-server x86_64 Ubuntu 10.04.3 LTS nfs log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap imaps pop3 pop3s ssl_ca_file: /etc/ssl/ca-bundle/SSL123_CA_Bundle.pem ssl_cert_file: /etc/ssl/mail.newmedia.ch/mail.newmedia.ch.crt ssl_key_file: /etc/ssl/mail.newmedia.ch/mail.newmedia.ch.key ssl_verify_client_cert: yes disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login mail_max_userip_connections: 25 mail_privileged_group: mail mail_location: maildir:/data/vmail/%d/%n:INDEX=/data/vmail/%d/%n/indexes mmap_disable: yes dotlock_use_excl: no mail_nfs_storage: yes mail_nfs_index: yes mbox_write_locks: fcntl dotlock mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 imap_client_workarounds(default): outlook-idle delay-newmail imap_client_workarounds(imap): outlook-idle delay-newmail imap_client_workarounds(pop3): auth default: passdb: driver: sql args: /etc/dovecot/dovecot-mysql.conf userdb: driver: passwd userdb: driver: sql args: /etc/dovecot/dovecot-mysql.conf plugin: quota: maildir:storage=409600 sieve_global_path: /data/vmail/globalsieverc dict: quotadict: mysql:/etc/dovecot-dict-quota.conf problem the problem happens with a client's mailbox that is used by multiple users. >From time to time he cannot see any Emails in the mailbox, neither with his mail clients (Apple Mail) nor with in the webmail (Roundcube). Around this time I get the following entries in the log files: Mar 6 08:26:31 mail02 dovecot: IMAP(user(a)example.com): fdatasync(/data/vmail/example.com/user/dovecot-uidlist) failed: Input/output error Mar 6 08:42:29 mail02 dovecot: IMAP(user(a)example.com): Maildir /data/vmail/example.com/user: Expunged message reappeared, giving a new UID (old uid=1522, file=1326961561.V15I4d8562M567017.mail02:2,Sad) Mar 6 08:42:29 mail02 dovecot: IMAP(user(a)example.com): Maildir /data/vmail/example.com/user: Expunged message reappeared, giving a new UID (old uid=1523, file=1326705103.V15I90105M613353.mail01:2,Sad) Mar 6 08:42:29 mail02 dovecot: IMAP(user(a)example.com): /data/vmail/example.com/user/dovecot-uidlist: Duplicate file entry at line 4: 1326961561.V15I4d8562M567017.mail02:2,Sad (uid 1522 -> 1598) Mar 6 08:42:29 mail02 dovecot: IMAP(user(a)example.com): /data/vmail/example.com/user/dovecot-uidlist: Duplicate file entry at line 5: 1326705103.V15I90105M613353.mail01:2,Sad (uid 1523 -> 1599) Mar 6 08:42:30 mail02 dovecot: IMAP(user(a)example.com): /data/vmail/example.com/user/dovecot-uidlist: Duplicate file entry at line 4: 1326961561.V15I4d8562M567017.mail02:2,Sad (uid 1522 -> 1598) Mar 6 08:42:30 mail02 dovecot: IMAP(user(a)example.com): /data/vmail/example.com/user/dovecot-uidlist: Duplicate file entry at line 5: 1326705103.V15I90105M613353.mail01:2,Sad (uid 1523 -> 1599) Mar 6 08:42:30 mail02 dovecot: IMAP(user(a)example.com): /data/vmail/example.com/user/dovecot-uidlist: Duplicate file entry at line 4: 1326961561.V15I4d8562M567017.mail02:2,Sad (uid 1522 -> 1598) Mar 6 08:42:30 mail02 dovecot: IMAP(user(a)example.com): /data/vmail/example.com/user/dovecot-uidlist: Duplicate file entry at line 5: 1326705103.V15I90105M613353.mail01:2,Sad (uid 1523 -> 1599) Mar 6 08:42:31 mail02 dovecot: IMAP(user(a)example.com): Maildir /data/vmail/example.com/user: Expunged message reappeared, giving a new UID (old uid=1524, file=1327500903.V15I5722c8M210039.mail01:2,Se) Mar 6 08:42:31 mail02 dovecot: IMAP(user(a)example.com): /data/vmail/example.com/user/dovecot-uidlist: Duplicate file entry at line 6: 1327500903.V15I5722c8M210039.mail01:2,Se (uid 1524 -> 1600) Mar 6 08:42:31 mail02 dovecot: IMAP(user(a)example.com): Panic: file maildir-uidlist.c: line 403 (maildir_uidlist_records_array_delete): assertion failed: (pos != NULL) Mar 6 08:42:31 mail02 dovecot: IMAP(user(a)example.com): Raw backtrace: imap(+0xaeb5a) [0x7f37602b8b5a] -> imap(+0xaebc7) [0x7f37602b8bc7] -> imap(+0xae238) [0x7f37602b8238] -> imap(+0x497d7) [0x7f37602537d7] -> imap(maildir_uidlist_refresh+0x6f2) [0x7f37602545c2] -> imap(+0x4bb06) [0x7f3760255b06] -> imap(maildir_uidlist_sync_init+0x4d) [0x7f376025652d] -> imap(+0x46ed4) [0x7f3760250ed4] -> imap(maildir_storage_sync_init+0x147) [0x7f3760251557] -> imap(imap_sync_init+0x70) [0x7f376023b190] -> imap(+0x2411e) [0x7f376022e11e] -> imap(io_loop_handle_timeouts+0xcc) [0x7f37602c069c] -> imap(io_loop_handler_run+0x60) [0x7f37602c1000] -> imap(io_loop_run+0x18) [0x7f37602c0448] -> imap(main+0x58e) [0x7f376023bc5e] -> /lib/libc.so.6(__libc_start_main+0xfd) [0x7f375f877c4d] -> imap(+0x21979) [0x7f376022b979] Mar 6 08:42:31 mail02 dovecot: dovecot: child 16934 (imap) killed with signal 6 (core dumps disabled) Mar 6 08:42:31 mail02 dovecot: IMAP(user(a)example.com): /data/vmail/example.com/user/dovecot-uidlist: Duplicate file entry at line 6: 1327500903.V15I5722c8M210039.mail01:2,Se (uid 1524 -> 1600) Mar 6 08:42:31 mail02 dovecot: IMAP(user(a)example.com): Panic: file maildir-uidlist.c: line 403 (maildir_uidlist_records_array_delete): assertion failed: (pos != NULL) Mar 6 08:42:31 mail02 dovecot: IMAP(user(a)example.com): Raw backtrace: imap(+0xaeb5a) [0x7ff81b415b5a] -> imap(+0xaebc7) [0x7ff81b415bc7] -> imap(+0xae238) [0x7ff81b415238] -> imap(+0x497d7) [0x7ff81b3b07d7] -> imap(maildir_uidlist_refresh+0x6f2) [0x7ff81b3b15c2] -> imap(maildir_uidlist_sync_init+0x105) [0x7ff81b3b35e5] -> imap(+0x46ed4) [0x7ff81b3aded4] -> imap(maildir_storage_sync_force+0x52) [0x7ff81b3ae392] -> imap(maildir_file_do+0x99) [0x7ff81b3b3cb9] -> imap(+0x4d944) [0x7ff81b3b4944] -> imap(index_mail_set_seq+0x148) [0x7ff81b3c8ed8] -> imap(index_storage_search_next_nonblock+0x162) [0x7ff81b3cd622] -> imap(mailbox_search_next_nonblock+0x20) [0x7ff81b3db2c0] -> imap(mailbox_search_next+0x26) [0x7ff81b3db316] -> imap(imap_fetch_more+0x2bf) [0x7ff81b39295f] -> imap(cmd_fetch+0x36c) [0x7ff81b38a9ec] -> imap(+0x28fad) [0x7ff81b38ffad] -> imap(+0x2908d) [0x7ff81b39008d] -> imap(client_handle_input+0x135) [0x7ff81b3902c5] -> imap(client_input+0x5f) [0x7ff81b390baf] -> imap(io_loop_handler_run+0xbd) [0x7ff81b41e05d] -> imap(io_loop_run+0x18) [0x7ff81b41d448] -> Mar 6 08:42:31 mail02 dovecot: IMAP(user(a)example.com): imap(main+0x58e) [0x7ff81b398c5e] -> /lib/libc.so.6(__libc_start_main+0xfd) [0x7ff81a9d4c4d] -> imap(+0x21979) [0x7ff81b388979] Mar 6 08:42:31 mail02 dovecot: dovecot: child 13712 (imap) killed with signal 6 (core dumps disabled) Mar 6 08:42:31 mail01 dovecot: IMAP(user(a)example.com): /data/vmail/example.com/user/dovecot-uidlist: Duplicate file entry at line 4: 1326961561.V15I4d8562M567017.mail02:2,Sad (uid 1522 -> 1598) Mar 6 08:42:31 mail01 dovecot: IMAP(user(a)example.com): Panic: file maildir-uidlist.c: line 403 (maildir_uidlist_records_array_delete): assertion failed: (pos != NULL) Mar 6 08:42:31 mail01 dovecot: IMAP(user(a)example.com): Raw backtrace: imap(+0xaeb5a) [0x7f4a311fcb5a] -> imap(+0xaebc7) [0x7f4a311fcbc7] -> imap(+0xae238) [0x7f4a311fc238] -> imap(+0x497d7) [0x7f4a311977d7] -> imap(maildir_uidlist_refresh+0x6f2) [0x7f4a311985c2] -> imap(+0x47023) [0x7f4a31195023] -> imap(maildir_storage_sync_init+0x147) [0x7f4a31195557] -> imap(imap_sync_init+0x70) [0x7f4a3117f190] -> imap(+0x2411e) [0x7f4a3117211e] -> imap(+0x64c0e) [0x7f4a311b2c0e] -> imap(io_loop_handle_timeouts+0xcc) [0x7f4a3120469c] -> imap(io_loop_handler_run+0x60) [0x7f4a31205000] -> imap(io_loop_run+0x18) [0x7f4a31204448] -> imap(main+0x58e) [0x7f4a3117fc5e] -> /lib/libc.so.6(__libc_start_main+0xfd) [0x7f4a307bbc4d] -> imap(+0x21979) [0x7f4a3116f979] Mar 6 08:42:31 mail01 dovecot: dovecot: child 24257 (imap) killed with signal 6 (core dumps disabled) Note: the first part is on a mail server, while the smaller second part is on the other one. Unfortunately I'm not able to reproduce this error. My suspicion/speculation what happens is the following: Multiple users are accessing the Mailbox from their offices (all on the same server), one (or more) uses the Webmail or accesses the Mailbox from a different IP. Somehow this leads to problems with Locks on NFS, which leads to the crash. I have no idea how to solve this problem and any help is greatly appreciated. If you need further information, please say so. Mit freundlichen Grüssen Lukas Müller Systems Engineer _______________________________________________ NEWMEDIA Südostschweiz Newmedia AG Kasernenstrasse 1 Postfach 508, CH-7007 Chur http://www.newmedia.ch<http://www.newmedia.ch/> _______________________________________________ TYPO3 & Drupal - Wir wissen wie. Ihre professionelle Web Agentur in Chur, Ilanz, Glarus und Zürich.

2 3

Re: [Dovecot] Many messages clustered around the same date.saved value
by Joseph Tam 29 Mar '12

29 Mar '12

Timo Sirainen wrote: >> However, I noticed a strange thing: querying what would have been >> deleted >> >> doveadm -ftab fetch -A "date.saved" mailbox Trash savedbefore 7d >> >> showed many date.saved values are clustered around the same timestamp, >> even among different user's Trash mailbox. >> ... >> I can't explain why many different users would have messages with the >> same (or closeby) date.saved value. > > Which mailbox format? With Maildir the date.saved is taken from > dovecot.index.cache file, and in some cases that might get dropped. If > it does, then it fallbacks to using the file's ctime. mbox. A further look into this reveals that the clustered date.saved values are the earliest values for every mailbox in the system. This timestamp is close to the time I was testing "doveadm ... -A", so the likely explanation is that I accidentally deleted/updated these values using some variation of doveadm, even though I remember confining my testing to query/search/fetch. This appears to be a case of PEBKAC. These "wrong" values shouldn't cause problems with expunge queries since they err on the side of safety. Thanks for the insight though. Joseph Tam <jtam.home(a)gmail.com>

2 1

[Dovecot] doveadm purge on clusterfs
by Jan-Frode Myklebust 29 Mar '12

29 Mar '12

Since doveadm service proxying apparently doesn't work with dovecot v2.0, we need to find a way to safely run doveadm purge on the host the user is logged into. Would it be OK to run purge in the pop/imap postlogin scripts? We already do a conditional: test /var/log/activemailaccounts/imap/$USER -ot /var/log/activemailaccounts/today then touch /var/log/activemailaccounts/imap/$USER fi so adding a: doveadm purge -u $USER in this section would make it run once every day the users that log in. Does that sound like an OK solution? -jf

2 1

[Dovecot] Dovecot / IMAP / New Mails are not shown unless you open the folder in Outlook
by stonegate 29 Mar '12

29 Mar '12

Hi, i use dovecot 2.1.3 on a gentoo system. Before i installed my new imap server box, everything worked. Now with Dovecot it does not. Problem: When i receive a new email, it does not appear in my Outlook unless i have the IMAP Inbox Folder open (highlighted selection). Sometimes i have new mail in my inbox for over 15 Minutes and i dont realize it unless i click on the inbox folder. Before that problem occured on my old system ( i think it was dovecot as well ) the inbox folder refreshed automatically and i instantly knew when i had new emails. It was kind of like with my exchange account. Does anyone have a clue what might be wrong ? Since i did not re-install outlook or something it cannot be a client thing since no settings changed on the client side. Maybe i have to do something with dovecots config file? I think it should keep the connection to the server open or something. I´d appreciate any kind of help. Thanks alot Stoney Dovecot is capable of the following things: telnet localhost 143 Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE STARTTLS AUTH=PLAIN AUTH=LOGIN] Dovecot ready. Thats my dovecot.conf: # 2.1.3: /etc/dovecot/dovecot.conf # OS: Linux 3.2.1-gentoo-r2 x86_64 Gentoo Base System release 2.0.3 auth_mechanisms = plain login listen = * disable_plaintext_auth = no mail_location = maildir:~/.maildir namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } #passdb { # args = * # driver = pam #} #passdb { # args = /etc/dovecot/dovecot-sql.conf.ext # driver = sql #} passdb { driver = shadow } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } user = root } ssl_cert = </etc/ssl/dovecot/servercert.pem ssl_key = </etc/ssl/dovecot/serverkey.pem userdb { driver = passwd } #userdb { # args = /etc/dovecot/dovecot-sql.conf.ext # driver = sql #} userdb { driver = passwd -- View this message in context: http://old.nabble.com/Dovecot---IMAP---New-Mails-are-not-shown-unless-you-o… Sent from the Dovecot mailing list archive at Nabble.com.

2 1

[Dovecot] zlib_save per namespace/mailbox?
by Lutz Preßler 29 Mar '12

29 Mar '12

Hi, the zlib_save question reminds me of a wish: I think it's not possible to set zlib_save parameter per namespace (or even mailbox). Per namespace would be something for the wish list to get rid of the cron job method to compress archival mailboxes. And maybe an option to add a "Z" flag to compressed maildir message files as recommended in the wiki regarding compress crob job. Lutz

3 2