- dovecot - dovecot.org

[Dovecot] problems with folders in another server
by Jose Luis Faria 18 Nov '10

18 Nov '10

Hello ppl, we are using two servers, with dovecot 2.0.5, Sx and Sy, with: cat dovecot-ldap-ext: ... pass_attrs = uid=user,userPassword=password,=y=proxy,mailHost=host ... When I access server Sx via IMAP I see all my folders. When I access server Sy via IMAP I only see the INBOX. I want to see my IMAP folders independently of the server. any help? -- :) cumprimentos ---------------------- José Luís Faria Network Eng./Administrador de Sistemas Departamento de Informática Universidade do Minho Braga, Portugal

1 0

[Dovecot] Multiple MYSQL hosts as passdb backend
by moody_cz 18 Nov '10

18 Nov '10

Hello, I use mysql as passdb backend for my dovecot 2.0.6 installation. I have 2 mysql 5.0.77 servers with master/slave replication enabled. My goal is to ensure dovecot's ability to provide its services even when one of the mysql hosts are unavailable. Here is my passdb backend conf: passdb { driver = sql args = /etc/dovecot/mysql.conf } and mysql.conf: default_pass_scheme = PLAIN driver = mysql connect = host=10.0.0.3 host=10.0.0.4 dbname=some_database user=some_user password=some_password password_query = some_query Everything works fine as long as 10.0.0.3 is up and running. However, when I shutdown mysql server on 10.0.0.3, dovecot won't even try the other host 10.0.0.4 as it is told to do in the conf. My dovecot verbose log says: Nov 16 14:29:24 auth: Error: mysql: Query failed, retrying: MySQL server has gone away Nov 16 14:29:24 auth: Error: mysql: Connect failed to 10.0.0.3 (some_database): Can't connect to MySQL server on '10.0.0.3' (111) - waiting for 1 seconds before retry Nov 16 14:30:28 auth-worker: Error: mysql: Query timed out (no free connections for 64 secs): some_sql_query Nov 16 14:30:28 auth-worker: Error: sql(mail_user,127.0.0.1): Password query failed: Not connected to database Nov 16 14:30:28 auth: Error: auth worker: Aborted request: Lookup timed out Nov 16 14:30:28 auth: Error: mysql: Connect failed to 10.0.0.3 (some_database): Can't connect to MySQL server on '10.0.0.3' (111) - waiting for 1 seconds before retry Nov 16 14:31:33 pop3-login: Info: Disconnected (auth failed, 1 attempts): user=<mail_user>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured What am I doing wrong? Thanks for reply in advance. -- View this message in context: http://old.nabble.com/Multiple-MYSQL-hosts-as-passdb-backend-tp30234196p302… Sent from the Dovecot mailing list archive at Nabble.com.

2 2

[Dovecot] Debian package init scripts
by Jan Behrend 18 Nov '10

18 Nov '10

Dearest list, I am using dovecot with heartbeat-2 and I noticed that the init scripts in the Debian packages from http://xi.rename-it.nl/debian/ do not conform to the LSB standard: http://refspecs.freestandards.org/LSB_3.1.1/LSB-Core-generic/LSB-Core-gener… E.g. the return code for "program is not running" is not 3. Is there is special reason for this? Cheers Jan -- MAX-PLANCK-INSTITUT fuer Radioastronomie Jan Behrend - Rechenzentrum ---------------------------------------- Auf dem Huegel 69, D-53121 Bonn Tel: +49 (228) 525 359, Fax: +49 (228) 525 229 jbehrend(a)mpifr-bonn.mpg.de http://www.mpifr-bonn.mpg.de

2 1

[Dovecot] add basic systemd support to dovecot
by Christophe Fergeau 17 Nov '10

17 Nov '10

Hi all, In the last days, I've been trying to add support for systemd[1] socket activation to dovecot. The basic idea is that systemd takes care of opening the sockets needed by dovecot to communicate with external processes, and when a connection happens on one of these sockets, systemd spawns dovecot, and then dovecot uses these sockets instead of creating its own sockets. The main reason why I hacked on this was that I wanted to get on-demand startup of dovecot on my home box. WIth the patch attached to this email, I'm now able to do that. The patch includes a dovecot.socket file which should be seen as a sample file, however I'm not sure what is the best way to handle this file (systemd uses it to know which sockets dovecot needs). What I wanted to ask the list for now is if such a patch is wanted, and to get feedback on how things are done in it, and what should be improved in it. [2] and [3] might be useful reading while looking at the patch. Thanks in advance for the feedback! Christophe [1] http://www.freedesktop.org/wiki/Software/systemd [2] http://0pointer.de/public/systemd-man/daemon.html [3] http://0pointer.de/public/systemd-man/sd-daemon.html

2 5

[Dovecot] Ongoing performance issues with 2.0.x
by Ralf Hildebrandt 17 Nov '10

17 Nov '10

Due to the ongoing performance issues with 2.0.x I switched back to 1.2.15 yesterday evening, with no changes to the machine or my users. (I migrated from 1.2.15 to 2.0.x by converting the existing config) Today, we have MUCH LESS load, with the same number of logins/min. I cannot say what exactly causes this immense increase in load, but one observation is that the time spent in system() has now dropped (user and iowait have stayed contant) to a third of the values I was seeing with 2.0.x. This evening I'll post some graphs showing two comparable 24 hour ranges. -- Ralf Hildebrandt Geschäftsbereich IT | Abteilung Netzwerk Charité - Universitätsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt(a)charite.de | http://www.charite.de

12 56

[Dovecot] \Noselect eliciting bug?
by David Ford 17 Nov '10

17 Nov '10

Timo, examine these two simplified sets if you will. This, is a properly working $inbox folder: d /home/david/.maildir /home/david/.maildir/dovecot.* d /home/david/.maildir/cur d /home/david/.maildir/new d /home/david/.maildir/tmp /home/david/.maildir/subscriptions This one is not, $inbox becomes \Noselect: d /home/david/.maildir /home/david/.any-file /home/david/.maildir/dovecot.* d /home/david/.maildir/cur d /home/david/.maildir/new d /home/david/.maildir/tmp /home/david/.maildir/subscriptions i can make directories willy nilly starting with a dot, but a -file- starting with a dot breaks my mailbox. it doesn't affect any other folder, just $inbox 2.0.6

2 1

[Dovecot] Recommended quota backend for a virtual users setup using ldap and sdbox
by Aliet Santiesteban Sifontes 17 Nov '10

17 Nov '10

Just that, wich is the recommended quota backend for sdbox in terms of performance and flexibility running a setup of virtual users with ldap??... thank's in advance...

2 1

[Dovecot] child 23925 killed with signal 6
by Jan Behrend 17 Nov '10

17 Nov '10

Dearest list, just now I migrated a pine user to dovecot. Nothing special so far, but then I saw this in my syslog and the user reported, that he got this error message: MAIL FOLDER "INBOX" CLOSED DUE TO ACCESS ERROR Obviously this problem is related to his local filter rules: If commented out everything works like a charm. The corresponding filter rule looks for a "From"-Line in the email header but the filter string itself is empty. I know this filter rule does not make a lot of sense, but nevertheless it shouldn't crash the imap process. If there is any additional information you need please ask. --- snip --- Nov 16 11:25:07 imap-mgt dovecot: imap(username): Panic: file istream-header-filter.c: line 520 (i_stream_create_header_filter): assertion failed: (ret < 0) Nov 16 11:25:07 imap-mgt dovecot: imap(username): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x3e81b) [0x7f82a3bc381b] -> /usr/lib/dovecot/libdovecot.so.0(+0x3e876) [0x7f82a3bc3876] -> /usr/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f82a3b9dacf] -> /usr/lib/do vecot/libdovecot.so.0(i_stream_create_header_filter+0x27b) [0x7f82a3babf9b] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mail_get_header_stream+0x154) [0x7f82a3e4cf04] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_storage_search_next_nonblock+0x530) [0x7f82a3e4e7 e0] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_search_next_nonblock+0x20) [0x7f82a3e36630] -> dovecot/imap() [0x416284] -> dovecot/imap(imap_search_start+0x106) [0x4166f6] -> dovecot/imap(cmd_search+0xc5) [0x40d535] -> dovecot/imap() [0x41032d] -> dovecot/imap() [0x41040d] -> dovecot/imap(client_handle_input+0x135) [0x410635] -> dovecot/imap(client_input+0x5f) [0x410f5f] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xb5) [0x7f82a3bcf205] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x18) [0x7f82a3bce338] -> /usr/lib /dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f82a3bbd0e3] -> dovecot/imap(main+0x2d1) [0x418f91] -> /lib/libc.so.6(__libc_start_main+0xfd) [0x7f82a3436c4d] -> dovecot/imap() [0x408c39] Nov 16 11:25:07 imap-mgt dovecot: master: Error: service(imap): child 23925 killed with signal 6 (core not dumped) --- snip --- doveconf -n: # 2.0.7 (3aced5ececd7): /etc/dovecot/dovecot.conf # OS: Linux 2.6.26-2-amd64 x86_64 Debian 5.0.6 xfs auth_gssapi_hostname = imap.mpifr-bonn.mpg.de auth_mechanisms = plain login gssapi auth_verbose = yes listen = 134.104.18.77 mail_gid = 40000 mail_location = mdbox:/var/mail/%Ln mail_uid = 40000 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date namespace { inbox = yes location = prefix = separator = . } passdb { args = /etc/dovecot/dovecot-ldap-passdb.conf.ext driver = ldap } plugin { sieve = ~/.dovecot.sieve sieve_after = /home/global-after.sieve sieve_dir = ~/sieve } protocols = imap pop3 lmtp sieve service auth { unix_listener auth-userdb { group = vmail } } service lmtp { inet_listener lmtp { address = 134.104.18.77 port = 24 } } service managesieve-login { inet_listener sieve { address = 134.104.18.77 port = 4190 } } ssl = required ssl_cert = </etc/ssl/certs/imap-server.pem ssl_key = </etc/ssl/private/imap-server.key userdb { args = /etc/dovecot/dovecot-ldap-userdb.conf.ext driver = ldap } protocol lmtp { mail_plugins = " sieve" } protocol imap { ssl_cert = </etc/ssl/certs/imap-server.pem ssl_key = </etc/ssl/private/imap-server.key } protocol pop3 { ssl_cert = </etc/ssl/certs/pop3-server.pem ssl_key = </etc/ssl/private/imap-server.key } -- MAX-PLANCK-INSTITUT fuer Radioastronomie Jan Behrend - Rechenzentrum ---------------------------------------- Auf dem Huegel 69, D-53121 Bonn Tel: +49 (228) 525 359, Fax: +49 (228) 525 229 jbehrend(a)mpifr-bonn.mpg.de http://www.mpifr-bonn.mpg.de

2 1

[Dovecot] local users and virtual users
by Egbert Jan van den Bussche 17 Nov '10

17 Nov '10

Hi list, I'm facing this problem: I have a e few local (system) users and a bunch of virtual users (in MySQL). To make it easy for the big group, I've set a default domain which is not the domain of the server (which is just the servername). So the big group logs in with there short name without @<domain>. BUT the few system users (in passwd) cannot login to pop or imap because they get the non-local domain attached and cannot be found in the mysql db but they cannot be found in passdb either with their long name. The same applies when system users give their longname with the local domain which IS the localname of the server. This name is not in mysql nor passdb either. Is there a way to find local users in passdb when the come in with a long name? Do I need another passwd like file (i hope not...) Recap: local Domain is :mail-dev.hobby.nl default domain added bij dovecot is kader.hcc.nl kader users are found in mysql regardless if they give @kader.hcc.nl or not (then it is added) system user are never found since longname is not in mysql nor in passdb. dovecot -n: root@mail-dev:/etc/dovecot# dovecot -n # 1.2.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-25-server x86_64 Ubuntu 10.04.1 LTS log_path: /var/log/dovecot/error.log info_log_path: /var/log/dovecot/info.log log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap pop3 imaps pop3s managesieve listen: *, [::] ssl_cert_file: /etc/ssl/certs/ssl-mail.pem ssl_key_file: /etc/ssl/private/ssl-mail.key ssl_cipher_list: ALL:!LOW:!SSLv2:ALL:!aNULL:!ADH:!eNULL:!EXP:RC4+RSA:+HIGH:+MEDIUM disable_plaintext_auth: no verbose_ssl: yes login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login login_executable(managesieve): /usr/lib/dovecot/managesieve-login mail_max_userip_connections(default): 10 mail_max_userip_connections(imap): 10 mail_max_userip_connections(pop3): 3 mail_max_userip_connections(managesieve): 10 verbose_proctitle: yes first_valid_uid: 200 mail_privileged_group: vmail mail_location: maildir:~/Maildir mail_debug: yes mmap_disable: yes dotlock_use_excl: no mail_nfs_storage: yes mail_nfs_index: yes mbox_write_locks: fcntl dotlock mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_executable(managesieve): /usr/lib/dovecot/managesieve mail_plugins(default): convert autocreate mail_plugins(imap): convert autocreate mail_plugins(pop3): convert autocreate mail_plugins(managesieve): mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 mail_plugin_dir(managesieve): /usr/lib/dovecot/modules/managesieve imap_client_workarounds(default): outlook-idle delay-newmail imap_client_workarounds(imap): outlook-idle delay-newmail imap_client_workarounds(pop3): imap_client_workarounds(managesieve): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh pop3_client_workarounds(managesieve): lda: postmaster_address: postmaster deliver_log_format: msgid=%m: %$ rejection_reason: Your message to <%t> was automatically rejected:%n%r auth_socket_path: /var/run/dovecot/auth-master auth default: mechanisms: plain login realms: kader.hcc.nl hobby.nl default_realm: kader.hcc.nl cache_size: 1024 verbose: yes debug: yes debug_passwords: yes passdb: driver: pam args: failure_show_msg=yes cache_key=%u dovecot passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: passwd args: mail=maildir:~/Maildir userdb: driver: sql args: /etc/dovecot/dovecot-sql.conf socket: type: listen client: path: /var/spool/postfix/private/dovecot-auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: vmail group: vmail plugin: convert_mail: mbox:/disk/mail/convert/%n autocreate: Trash autocreate2: Sent autocreate3: Drafts autocreate4: Spam autosubscribe: Trash autosubscribe2: Sent autosubscribe3: Drafts autosubscribe4: Spam Pse help. TIA! Egbert Jan

2 1

[Dovecot] Dovecot + vpopmail + shared folders
by qmail＠top-consulting.net 17 Nov '10

17 Nov '10

I'm using dovecot 1.2.14 with vpopmail. I've enabled shared folders and the default setup was not working. The default setup being this line: location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u Going through the Archives I saw a message from Timo that said to apply a patch and use this line instead: location = maildir:/usr/home/vpopmail/domains/%d/%%n/Maildir:INDEX=~/Maildir/shared/%%u It seems like the patch is already existing in version 1.2.14 and that line works well for shared folders for domains directly under /usr/home/vpopmail/domains. However, with vpopmail after a certain number of domains, it starts putting them in /usr/home/vpopmail/domains/A, ..domains/B, etc. Shared folders do not work for those domains since my location line is forcing it to look directly in /usr/home/vpopmail/domains/xyz.com instead of /usr/home/vpopmail/domains/A/xyz.com Any workaround this ? How come we can't use %h or ~/ directly ?

2 12

[Dovecot] Dovecot ldap connection reconnecting after inactivity
by Aliet Santiesteban Sifontes 17 Nov '10

17 Nov '10

Hi people, I have a setup configured using ldap, I have noticed that after a period of user inactivity if a client open connections to dovecot first attemps fails with this: Nov 16 19:34:43 cl05-02 dovecot: auth: Error: ldap(user(a)xxx.xx.xx,172.29.13.26): Connection appears to be hanging, reconnecting After the connections to ldap has been restablished everything starts working ok, is this a expected behavior or I'm missing something?? Best regards

2 1

[Dovecot] dovecot-antispam-plugin for dovecot-2.0
by Antonio Perez-Aranda 17 Nov '10

17 Nov '10

I'm migrating a customized dovecot-antispam-plugin from dovecot-antispam-plugn-1.3 which doesn't run in dovecot-2.0 Are any body using dovecot-antispam-plugin adapted to 2.0 from mercurial on a production system? This is the adapted version to dovecot 2.0 http://hg.dovecot.org/dovecot-antispam-plugin/

2 1

[Dovecot] 2.0.7: emails read emails become unread
by Kádár Tamás (KTamas) 17 Nov '10

17 Nov '10

Hi My users are reporting that in public folders, emails that were past read suddenly got unread, sometimes even after marking them as read again. Didn't have such problems with 2.0.6 I think. My dovecot -n: # 2.0.7: /usr/local/etc/dovecot/dovecot.conf # OS: Linux 2.6.26-2-xen-amd64 x86_64 Debian 5.0.6 auth_mechanisms = plain login disable_plaintext_auth = no listen = * mail_location = maildir:~/Maildir mail_plugins = acl maildir_very_dirty_syncs = yes namespace { inbox = yes location = prefix = separator = . type = private } namespace { location = maildir:/home/_shared/projects:INDEX=~/Maildir/_shared prefix = shared. separator = . subscriptions = no type = public } passdb { driver = pam } plugin { acl = vfile mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename flag_change append mail_log_fields = uid box msgid from subject size vsize flags mail_log_group_events = yes } protocols = imap pop3 service imap { executable = imap } ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { driver = passwd } verbose_proctitle = yes protocol imap { mail_max_userip_connections = 40 mail_plugins = acl imap_acl }

2 3

[Dovecot] Dovecot 2.0.7 (8793036f6de8) seems to miss some defaults for vsz_limit
by Thomas Leuxner 17 Nov '10

17 Nov '10

Latest Mercurial seems to miss defaults for some services e.g. 'managesieve' and 'lmtp'. Example error message upon start: dovecotdoveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf: service(managesieve-login): vsz_limit is too low failed! Regards Thomas

4 15

Re: [Dovecot] Mail history function?
by Jakob Curdes 17 Nov '10

17 Nov '10

Please keep replies to the list so that others can participate. > I sugest the notify, because the admin can know if a user open a > email, copy to another folder, delete the email....etc. > > but using the MTA it can be a solution too. > At least in Germany, doing this is quite risky as this gives lots of information about the person. German law limits the use of profiles like these quite strictly; in general an employer has no business to log all these actions generally. This does not mean it can be helpful for diagnosing problems, but I would not recommend to do so as a general procedure. On the other hands, it is a de-facto requirement today that you can trace every communiction that has entered the company. The only place where you can do this without potentiall missing some messages is the MTA. This is why all the archival tools want to couple to the MTA... JC

2 1

[Dovecot] mailboxes and IMAP folders mirroring ?
by Frank Bonnet 17 Nov '10

17 Nov '10

Hello This is a bit off Dovecot but ... I'm searching some software to mirror mailboxes and IMAP forlders from the mailhub to another (clone) computer. Actually I use rsync daily but I wonder if it exists some software that are real time mirroring capable ? I'm using Dovecot 1.2.14 and Postfix with MBOX format. Thanks

2 2

[Dovecot] Mail history function?
by Oliver Berse 17 Nov '10

17 Nov '10

I'm a newbie at Dovecot. For a company groupware I need a kind of a history function for mails to see which user sent which mail to whom / got which mail from whom. So I have to get the message ID of in- and outgoing mails (and write related data to a mysql database). My first idea was to monitor the log file with a daemon and search for strings like "deliver(x(a)y.z): 2010-11-15 17:34:56 Info: msgid=<AANLkTikoRgUiEg2KgUW2gLmULD4TX-bPst4yhUbuHoEH(a)a.b>". I'm not sure if this is the right approach. Does anyone know a better solution with Dovecot? thanks, Oliver

5 4

[Dovecot] qmail + dovecot-lda
by ckubu 17 Nov '10

17 Nov '10

hallo, i am changing my mailsetups to qmail+vpopmail+dovecot. is it possible to let dovecot's lda deliver mail into mailboxes but also deliver mails to forward-addresses in .qmail-files, if exists? b.t.w. i know, its not an dovecot issue, but maybe anyone knows: i have setup defaultdelivery in qmail-control directory, but vadddomain ignors it. is there a way to make that entry the default for .qmail-default files? thanks christoph

2 2

[Dovecot] Single-instance storage Thank You
by Daniel L. Miller 17 Nov '10

17 Nov '10

Timo, On following my previous thread that went somewhat off-topic, I noticed - or rather failed to notice - any response from you. This leaves me to draw one of the following conclusions: 1. You didn't see it. 2. You ignored it. 3. You saw it, took offense, and disregarded it. 4. You saw it, accepted the compliment for what it was - and didn't bother to respond. On the chance any of options 1-3 apply - please allow me to state as clearly as possible: your creation, that of Dovecot in general, and single-instance mdbox storage in particular, have significantly contributed to my own ease of system administration - and I offer my sincere thanks and admiration. -- Daniel

2 1

[Dovecot] Help - custom vpopmail
by Rick Romero 16 Nov '10

16 Nov '10

Hi, First, I'm not sure if dovecot should alter this, but it seems vpopmail writes the IP into the 'remote_ip' field instead of the auth type. Dovecot still writes the auth type. I want both. So I modified my vpopmail install to write an additional field into the lastauth table. My custom vpopmail writes the remote IP into remote_ip, and the auth type into a 'type' field. I tested with qmail's POP3 daemon to verify vchkpw would fill the table correcly. But I'm not sure how to get dovecot to do it: I know this is close, but there is something not right in src/auth/userdb-vpopmail.c line 99. vset_lastauth(vpop_user, vpop_domain, &auth_request->remote_ip, t_strdup_noconst(auth_request->service)); I'm, by far, NOT a C programmer - Feel free to laugh at my code publicly :) Thanks, Rick

2 2

[Dovecot] v2.0.7 released
by Timo Sirainen 16 Nov '10

16 Nov '10

http://dovecot.org/releases/2.0/dovecot-2.0.7.tar.gz http://dovecot.org/releases/2.0/dovecot-2.0.7.tar.gz.sig * master: default_process_limit wasn't actually used anywhere, rather the default was unlimited. Now that it is enforced, you might notice that the default limit is too low and you need to increase it. Dovecot logs a warning when this happens. * mail-log plugin: Log mailbox name as virtual name rather than physical name (e.g. namespace prefix is included in the name) + doveadm dump: Added imapzlib type to uncompress IMAP's COMPRESS DEFLATE I/O traffic (e.g. from rawlog). - IMAP: Fixed LIST-STATUS when listing subscriptions with subscriptions=no namespaces. - IMAP: Fixed SELECT QRESYNC not to crash on mailbox close if a lot of changes were being sent. - quota: Don't count virtual mailboxes in quota - doveadm expunge didn't always actually do the physical expunging - Fixed some index reading optimizations introduced by v2.0.5. - LMTP proxying fixes

4 12

[Dovecot] auth-worker ownership issue
by Jason 'XenoPhage' Frisvold 16 Nov '10

16 Nov '10

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Greetings, I installed 2.0.7 this evening and I'm getting these messages in /var/log/maillog : Nov 8 23:36:53 myserver dovecot: auth: Fatal: net_connect_unix(auth-worker) in directory /var/run/dovecot failed: Permission denied (euid=89(vpopmail) egid=89(vchkpw) missing +r perm: auth-worker, euid is not dir owner) Nov 8 23:36:53 myserver dovecot: master: Error: service(auth): command startup failed, throttling If I change the ownership of /var/run/dovecot/auth-worker to vpopmail, dovecot starts working properly. However, restarting the service results in this file being re-owned by dovecot. Am I missing a config option somewhere? I'm using dovecot with qmail and vpopmail 5.4.32. Thanks, - --------------------------- Jason 'XenoPhage' Frisvold xenophage(a)godshell.com - --------------------------- "Any sufficiently advanced magic is indistinguishable from technology." - - Niven's Inverse of Clarke's Third Law -----BEGIN PGP SIGNATURE----- Version: GnuPG/MacGPG2 v2.0.14 (Darwin) iEYEARECAAYFAkzY1OUACgkQ8CjzPZyTUTQVtQCgi3E0N9IL/kBdT59p0CxpU11u 5YMAoIA+2338GzFkRDt8ymusl73tJM07 =cVkA -----END PGP SIGNATURE-----

2 1

[Dovecot] Virtual Folder by user.
by Henrique Fernandes 16 Nov '10

16 Nov '10

Can i only set a virtual folder for especific users ? dovecot 2.0.6. Thanks! []'sf.rique

2 1

[Dovecot] REpeated POP3 mail
by The Doctor 16 Nov '10

16 Nov '10

I know I have brought this up before. Question: How can one debug the pop3 process from repeated e-mail ? -- Member - Liberal International This is doctor(a)nl2k.ab.ca Ici doctor(a)nl2k.ab.ca God, Queen and country! Never Satan President Republic! Beware AntiChrist rising! http://twitter.com/rootnl2k http://www.facebook.com/dyadallee Lest we Forget!!

2 5

[Dovecot] dsync mbox->mdbox: Unexpectedly lost From-line and other issues from a big conversion.
by Axel Thimm 16 Nov '10

16 Nov '10

Hi, I'm trying to convert a 33GB mail store from mbox to compressed mdbox (largest mbox is 2.7GB). The source store is live, e.g. there are mails delivered into it and mails are being read. Actually it is my own mail. :) Although my test runs were very successful I have run into trouble with the first run on the whole store. After fighting a bit around with errors like Error: Trying to open a non-listed mailbox with guid=f59c5b31b8f3df4c70180000e7dd553b I did several reruns in case these errors would be fixed on the next iteration, but my mdbox storage wasn't growing anymore. I decided to restart after removing all old index files from the source store in case I had some corruption somewhere. Since on mbox/maildir index files are completely recreatable this would just slow down thing at the worst. Indeed many of the errors went away, and I managed to convert about 10-20%, but then I hit another array of errors that would persist even after restarting: > $ grep -v Info: dsync2.log.old* > dsync2.log.old1:dsync(user): Error: Next message unexpectedly lost from mbox file /home/user/mail/lists/mplayerhq.hu/ffmpeg-devel at 58706201 (cached) > dsync2.log.old1:dsync(user): Error: read(msg input) failed: Invalid argument > dsync2.log.old1:dsync(user): Error: Next message unexpectedly lost from mbox file /home/user/mail/lists/gnupg.org/gnupg-users at 6507197 (cached) > dsync2.log.old1:dsync(user): Error: Unexpectedly lost From-line from mbox file /home/user/mail/lists/gnupg.org/gnupg-users at 6486645 > dsync2.log.old2:dsync(user): Error: mdbox /home/user/mdbox/mailboxes/lists/mplayerhq.hu/ffmpeg-devel/dbox-Mails: map uid lost for uid 26483 > dsync2.log.old2:dsync(user): Error: msg guid lookup failed: Internal error occurred. Refer to server log for more information. [2010-11-15 02:36:21] > dsync2.log.old2:dsync(user): Warning: mdbox /home/user/mdbox/storage: rebuilding indexes > dsync2.log.old2:dsync(user): Error: Corrupted dbox file /home/user/mdbox/storage/m.1725 (around offset=697710): msg header has bad magic value > dsync2.log.old2:dsync(user): Warning: dbox: Copy of the broken file saved to /home/user/mdbox/storage/m.1725.broken > dsync2.log.old2:dsync(user): Warning: Transaction log file /home/user/mdbox/storage/dovecot.map.index.log was locked for 295 seconds > dsync2.log.old2:dsync(user): Error: Next message unexpectedly lost from mbox file /home/user/mail/lists/mplayerhq.hu/ffmpeg-devel at 58706201 (cached) > dsync2.log.old2:dsync(user): Error: read(msg input) failed: Invalid argument > dsync2.log.old2:dsync(user): Error: Next message unexpectedly lost from mbox file /home/user/mail/lists/gnupg.org/gnupg-users at 6507197 (cached) > dsync2.log.old2:dsync(user): Error: Unexpectedly lost From-line from mbox file /home/user/mail/lists/gnupg.org/gnupg-users at 6486645 > dsync2.log.old2:dsync(user): Error: Unexpectedly lost From-line from mbox file /home/user/mail/lists/gnupg.org/gnupg-users at 6507197 > dsync2.log.old2:dsync(user): Warning: Mailbox changes caused a desync. You may want to run dsync again. > dsync2.log.old3:dsync(user): Error: mdbox /home/user/mdbox/mailboxes/lists/mplayerhq.hu/ffmpeg-devel/dbox-Mails: map uid lost for uid 26484 > dsync2.log.old3:dsync(user): Error: msg guid lookup failed: Internal error occurred. Refer to server log for more information. [2010-11-15 09:49:26] > dsync2.log.old3:dsync(user): Warning: mdbox /home/user/mdbox/storage: rebuilding indexes > dsync2.log.old3:dsync(user): Error: Corrupted dbox file /home/user/mdbox/storage/m.1725 (around offset=758233): msg header has bad magic value > dsync2.log.old3:dsync(user): Error: link(/home/user/mdbox/storage/m.1725, /home/user/mdbox/storage/m.1725.broken) failed: File exists > dsync2.log.old3:dsync(user): Warning: Transaction log file /home/user/mdbox/storage/dovecot.map.index.log was locked for 271 seconds > dsync2.log.old3:dsync(user): Warning: Transaction log file /var/cache/dovecot/indexes/user/lists/lists.fedoraproject.org/.imap/users/dovecot.index.log was locked for 180 seconds > dsync2.log.old3:dsync(user): Error: Next message unexpectedly lost from mbox file /home/user/mail/lists/mplayerhq.hu/ffmpeg-devel at 58706201 (cached) > dsync2.log.old3:dsync(user): Error: read(msg input) failed: Invalid argument > dsync2.log.old3:dsync(user): Error: Next message unexpectedly lost from mbox file /home/user/mail/lists/gnupg.org/gnupg-users at 6507197 (cached) > dsync2.log.old3:dsync(user): Error: Unexpectedly lost From-line from mbox file /home/user/mail/lists/gnupg.org/gnupg-users at 6486645 > dsync2.log.old3:dsync(user): Error: Unexpectedly lost From-line from mbox file /home/user/mail/lists/gnupg.org/gnupg-users at 6507197 > dsync2.log.old3:dsync(user): Warning: Mailbox changes caused a desync. You may want to run dsync again. > dsync2.log.old4:dsync(user): Warning: Transaction log file /var/cache/dovecot/indexes/user/lists/lists.fedoraproject.org/.imap/scm-commits/dovecot.index.log was locked for 244 seconds > dsync2.log.old4:dsync(user): Warning: Transaction log file /var/cache/dovecot/indexes/user/lists/lists.fedoraproject.org/.imap/scm-commits/dovecot.index.log was locked for 186 seconds > dsync2.log.old4:dsync(user): Error: mdbox /home/user/mdbox/mailboxes/lists/mplayerhq.hu/ffmpeg-devel/dbox-Mails: map uid lost for uid 26485 > dsync2.log.old4:dsync(user): Error: msg guid lookup failed: Internal error occurred. Refer to server log for more information. [2010-11-15 12:40:24] > dsync2.log.old4:dsync(user): Warning: mdbox /home/user/mdbox/storage: rebuilding indexes > dsync2.log.old4:dsync(user): Error: Corrupted dbox file /home/user/mdbox/storage/m.1725 (around offset=1324287): msg header has bad magic value > dsync2.log.old4:dsync(user): Error: link(/home/user/mdbox/storage/m.1725, /home/user/mdbox/storage/m.1725.broken) failed: File exists > dsync2.log.old4:dsync(user): Warning: Transaction log file /home/user/mdbox/storage/dovecot.map.index.log was locked for 394 seconds > dsync2.log.old4:dsync(user): Warning: Transaction log file /var/cache/dovecot/indexes/user/lists/lists.fedoraproject.org/.imap/scm-commits/dovecot.index.log was locked for 249 seconds > dsync2.log.old4:dsync(user): Warning: Transaction log file /var/cache/dovecot/indexes/user/lists/lists.fedoraproject.org/.imap/scm-commits/dovecot.index.log was locked for 283 seconds > dsync2.log.old4:dsync(user): Error: Next message unexpectedly lost from mbox file /home/user/mail/lists/mplayerhq.hu/ffmpeg-devel at 58706201 (cached) > dsync2.log.old4:dsync(user): Error: read(msg input) failed: Invalid argument > dsync2.log.old4:dsync(user): Error: Next message unexpectedly lost from mbox file /home/user/mail/lists/gnupg.org/gnupg-users at 6507197 (cached) > dsync2.log.old4:dsync(user): Error: Unexpectedly lost From-line from mbox file /home/user/mail/lists/gnupg.org/gnupg-users at 6486645 > dsync2.log.old4:dsync(user): Error: Unexpectedly lost From-line from mbox file /home/user/mail/lists/gnupg.org/gnupg-users at 6507197 > dsync2.log.old4:dsync(user): Warning: Mailbox changes caused a desync. You may want to run dsync again. The quoted broken mdbox file and its successor differ quite late in the file itself: > $ ls -ltrA mdbox/storage/| tail > -rw------- 1 user user 2096503 2010-11-15 01:53 m.1719 > -rw------- 1 user user 2095681 2010-11-15 01:53 m.1720 > -rw------- 1 user user 2095121 2010-11-15 01:53 m.1721 > -rw------- 1 user user 2091386 2010-11-15 01:53 m.1722 > -rw------- 1 user user 2095194 2010-11-15 01:53 m.1723 > -rw------- 1 user user 2095317 2010-11-15 01:54 m.1724 > -rw------- 1 user user 697754 2010-11-15 01:54 m.1725.broken > -rw------- 1 user user 28818176 2010-11-15 13:04 dovecot.map.index > -rw------- 1 user user 14884 2010-11-15 14:49 dovecot.map.index.log > -rw------- 1 user user 1661548 2010-11-15 14:49 m.1725 > $ cmp mdbox/storage/m.1725.broken mdbox/storage/m.1725 > mdbox/storage/m.1725.broken mdbox/storage/m.1725 differ: byte 697638, line 7642 I'm running the process as the user himself with > $ dsync -vD backup mdbox:~/mdbox while my config looks like $ doveconf -n # 2.0.7: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32.21-168.fc12.x86_64 x86_64 Fedora release 12 (Constantine) mail_location = mbox:~/mail:INBOX=/var/mail/% u:INDEX=/var/cache/dovecot/indexes/%u mail_plugins = " zlib" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date mbox_write_locks = fcntl namespace { inbox = yes location = prefix = separator = / } passdb { driver = pam } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve zlib_save = bz2 } service imap { executable = imap postlogin } service postlogin { executable = script-login rawlog } ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { driver = passwd } protocol lda { info_log_path = /var/log/dovecot-deliver.log log_path = /var/log/dovecot-deliver-errors.log mail_plugins = sieve } protocol imap { mail_plugins = " zlib imap_zlib" } I think I probably have some corrupt mbox files that give dovecot some headache. I'd like to spot them and correct them, so I tried let's convert to maildir first, which I can debug more easily. Unfortunatly the conversion speed to maildir is about 25 times slower than converting to mdbox (wow!), and it would take almost 5 days to convert to maildir. This is no sane timeframe for debugging, so I'd rather try different tactics with mdbox. One thing I'm going to try is to do an offline conversion of a snapshot of the store. Anyway I wanted to document the issues I saw in case it is something that is a bug in dovecot. -- http://thimm.gr/ - http://ATrpms.net/

2 4