- dovecot - dovecot.org

[Dovecot] error when running fts optimize
by Joe Beaubien 11 Jan '14

11 Jan '14

Since yesterday, when I run "fts optimize", I get an error. Command: doveadm -v fts optimize -u formulaire Error: Jan 10 18:05:20 mba dovecot: indexer-worker(formulaire): Error: lucene index /mba_data/emails/formulaire/lucene-indexes: IndexWriter::optimize() failed (#9): bit out of range Does anyone have any idea what causes this and how to fix it? Thanks, Joe Beaubien

1 0

[Dovecot] Possible to force cipher order?
by Matthias Rieber 10 Jan '14

10 Jan '14

Hi, is it possible to force the server cipher order instead of the clients preferences? When I connect with openssl using these ciphers: 'RC4-SHA:DHE-RSA-AES256-GCM-SHA384' -> RC4-SHA will be selected and with 'DHE-RSA-AES256-GCM-SHA384:RC4-SHA' -> DHE-RSA-AES256-GCM-SHA384 It seems to be recommended for webservers to override that due to bad clients choices and increasing knowledge, like RC4 vs. BEAST, AES128 better (theoretical) than AES256. Regards, Matthias

1 1

[Dovecot] Message filtering capability at IMAP proxy
by CM Reddy 10 Jan '14

10 Jan '14

Hi, I would like process the messages at Dovecot IMAP proxy. In one of the documents, it was mentioned that Dovecot proxy currently supports on the fly message filtering in latest releases. Will it it possible to extend the filtering feature to handle the following requirements. 1. Parse the email at IMAP proxy. 2. Replace the links with some other secure links. 3. Replace the attachments with some other document. It would be great, if any one can provide some pointers to move forward. - Thanks in advance CM Reddy

2 1

Re: [Dovecot] imap auto create mailbox: we're not in group 8(mail)
by Joseph Tam 10 Jan '14

10 Jan '14

Adrian Zaugg writes: > How can I configure the auto create mailbox feature that it works and > let run LMTP and IMAP process as user %u and group mail and let create > the mailboxes in /var/mail as (example user tester) with the following > permissions: > > /var/mail: > > drwxrwx--x root mail 3072 Dec 18 01:43 . > drwx------ tester tester 1024 Jan 09 12:53 tester This is probably what you need: # Group to enable temporarily for privileged operations. Currently this is # used only with INBOX when either its initial creation or dotlocking fails. # Typically this is set to "mail" to give access to /var/mail. mail_privileged_group = mail > ...or do I need a different approach? You could also chmod 1777 /var/mail but this will allow arbitrary uses who have filesystem access to create their own files here, and maybe DoS a new user from being created (or maybe even anticipate a new mailbox, create one with mode 0777 and wait to intercept mail?). Joseph Tam <jtam.home(a)gmail.com>

1 0

[Dovecot] LDA quota rejection
by Davide 09 Jan '14

09 Jan '14

Hi to all, i have dovecot 2.2.5 and i have implemented lda rejection through quota full this is my dovecot conf protocol lda { mail_fsync = optimized auth_socket_path = /usr/local/var/run/dovecot/auth-userdb deliver_log_format = msgid=<%f>-<%s>-%m: %$ hostname = mail.cgilfe.it info_log_path = /var/log/dovecot/dovecot-deliver.log log_path = /var/log/dovecot/dovecot-deliver.log mail_plugin_dir = /usr/local/lib/dovecot mail_plugins = $mail_plugins mail_log sieve postmaster_address = postmaster(a)mail.cgilfe.it rejection_subject = Rifiutato: %s rejection_reason = Messaggio a <%t> automaticamente rifiutato:%n%r submission_host = 192.16X.XXX.XX0 } If user over quota receive a messagge internally all is ok but if the user receive a mail from external domains nothing to the sender is sentback. Thanks in advance to all for possible help. -- *Davide Marchi* *T*eorema *F*errara *Srl* Via Spronello, 7 - Ferrara - 44121 Tel. *0532783161* Fax. *0532783368* E-m@il: *davide.marchi(a)mail.cgilfe.it* Skype: *davide.marchi73* Web: *http://www.cgilfe.it* *CONFIDENZIALITA'* *Ai sensi del D.Lgs. 196/2003 si precisa che le informazioni contenute in questo messaggio sono riservate ed a uso esclusivo del destinatario/dei destinatari. Qualora il messaggio in parola Le fosse pervenuto per errore, La invitiamo ad eliminarlo senza copiarlo e a non inoltrarlo a terzi, dandocene gentilmente comunicazione.* *Per favore, pensa all'ambiente. Stampa questa email solo se necessario.*

4 3

[Dovecot] imap auto create mailbox: we're not in group 8(mail)
by Adrian Zaugg 09 Jan '14

09 Jan '14

Dear List Somehow I don't understand the intended work flow to have new mailboxes auto created. On login of a new user with no mailbox, I get 2014-01-09 12:53:06 imap(tester): Error: user tester: Initialization failed: Namespace '': mkdir(/var/mail/tester) failed: Permission denied (euid=1016(tester) egid=1016(tester) missing +w perm: /var/mail, we're not in group 8(mail), dir owned by 0:8 mode=0771) The imap process runs as the user the login performed and thus it has only the privileges of that user. This is good and desired, when a mailbox already exists. I do not want to allow all users to write to /var/mail, only they should write to their dirs inside /var/mail. Same story for LMTP, if no mailbox exists yet: 2014-01-09 13:01:47 lmtp(20416, tester): Error: user tester: Initialization failed: Namespace '': mkdir(/var/mail/tester) failed: Permission denied (euid=1016(tester) egid=1016(tester) missing +w perm: /var/mail, we're not in group 8(mail), dir owned by 0:8 mode=0771) How can I configure the auto create mailbox feature that it works and let run LMTP and IMAP process as user %u and group mail and let create the mailboxes in /var/mail as (example user tester) with the following permissions: /var/mail: drwxrwx--x root mail 3072 Dec 18 01:43 . drwx------ tester tester 1024 Jan 09 12:53 tester ...or do I need a different approach? Thank you for helping me. Best regards, Adrian. My setup: ======== * Exim delivers to LMTP socket as user %u, group mail * maildir storage in /var/mail doveconf -n: # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.3 ext3 auth_cache_negative_ttl = 0 auth_cache_size = 5 M auth_cache_ttl = 4 hours auth_failure_delay = 3 secs auth_mechanisms = plain login digest-md5 cram-md5 apop rpa auth_username_format = %n auth_verbose = yes auth_worker_max_count = 128 first_valid_gid = 1000 first_valid_uid = 1000 last_valid_gid = 60000 last_valid_uid = 60000 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes log_path = /var/log/dovecot/dovecot.log log_timestamp = "%Y-%m-%d %H:%M:%S " login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c %k mail_location = maildir:/var/mail/./%u/:INDEX=MEMORY mail_prefetch_count = 1024 maildir_stat_dirs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave vacation-seconds namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = type = private } passdb { args = scheme=SHA512-CRYPT username_format=%u /etc/cram-md5.pwd driver = passwd-file } plugin { sieve = /var/mail/%u/sieve/.dovecot.sieve sieve_before = /var/mail/%u/sieve/vacation.sieve sieve_dir = /var/mail/%u/sieve sieve_extensions = +vacation +vacation-seconds sieve_max_actions = 1024 sieve_vacation_default_period = 12d sieve_vacation_max_period = 0 sieve_vacation_min_period = 1d } postmaster_address = postmaster@XXXX protocols = " imap lmtp sieve pop3" service auth-worker { user = $default_login_user } service auth { group = mail-security unix_listener auth-client { mode = 0660 user = Debian-exim } unix_listener auth-userdb { mode = 0666 } user = $default_internal_user } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 5 } service lmtp { process_min_avail = 10 unix_listener lmtp { mode = 0666 } } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } service_count = 1 vsz_limit = 64 M } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } service pop3 { process_limit = 256 } ssl_cert = </etc/ssl/XXXX ssl_cipher_list = DHE-RSA-AES256-GCM-SHA384:DHE-RSA-AES256-SHA256:DHE-RSA-AES256-SHA:DHE-RSA-CAMELLIA256-SHA:DHE-RSA-AES256-SHA:DHE-RSA-AES128-GCM-SHA256:DHE-RSA-AES128-SHA256:+TLSv1:!RC4:!aNULL:!eNULL:!LOW:!3DES:!MD5:!EXP:!CBC:!PSK:!SRP:!SSLv2:!3DES:!DSS ssl_key = </etc/ssl/XXXX ssl_parameters_regenerate = 128 hours userdb { args = blocking=no driver = passwd override_fields = home=/var/mail/%u mail=maildir:/var/mail/%u } protocol lmtp { mail_plugins = " sieve" } protocol lda { mail_plugins = " sieve" } protocol imap { mail_max_userip_connections = 64 } protocol pop3 { mail_max_userip_connections = 32 pop3_client_workarounds = oe-ns-eoh pop3_save_uidl = yes }

2 2

Re: [Dovecot] BUG report: doveadm HEADER <field> <pattern> when concatenating with another Search key
by Joseph Tam 09 Jan '14

09 Jan '14

> So E.g. When doing > doveadm fetch -u exampleuser hdr SUBJECT Silvester HEADER > Return-Path someuser(a)example.com > > it initially outputs 13 headers (same as when using with SUBJECT Silvester > only) , when piping it to "grep -i 'Return-Path'" it even found only 3 out > of 13 headers containing a Return-Path at all, 2 of them different than > someuser(a)example.com - so SAME behaviour as with search. I tried using logical conjections of header searches and it works with my installation of dovecot, so either it's a bug introduced later than 2.1.16, or perhaps it from the different search engine you use (I use the default that comes with dovecot -- squat?). Sorry, can't help you out further. Joseph Tam <jtam.home(a)gmail.com>

1 0

[Dovecot] Disallow certain characters in foldernames?
by Charles Marcus 08 Jan '14

08 Jan '14

Is there a way to do this in dovecot? Similar to how you can When using Maildir and Thunderbird, if a user tries to a create folder named "test.1" or "test/1", dovecot will happily create a folder called "test", with a subfolder called "1". Worse, the top level folder "test" is greyed out, which is how Thunderbird displays a folder that can contain only other folders, not both folders and files. I want to disallow this. Obviously I'd prefer if Thunderbird would display a meaningful error, but most likely dovecot cannot control that. I don't really care if the user just gets some kind of weird generic error or not, I'd just prefer to prevent dovecot from creating the problematic folders, and explain the problem to the user if/when they call about it (after NOT reading my carefully crafted documentation explaining the illegal characters that cannot be used in foldernames). -- Best regards, Charles

2 3

[Dovecot] acl, shared folders
by Infoomatic 08 Jan '14

08 Jan '14

Hi list, After spending quite some time to figure out how users can share folders I now hope someone of you could help me out. I am quite sure its just a stupid mistake/misunderstanding ... I am using Ubuntu 12.04 LTS with the shipped dovecot 2.0.19 When I login via telnet as user1 I get the following: 1 create folder1 1 OK Create completed. 2 setacl folder1 user2 rli 2 OK Setacl complete. 3 getacl folder1 * ACL "folder1" "user2" ilr "user1" lrwstipekxacd 3 OK Getacl completed. This seems fine. However, there is nothing listed in the account of user2. I think the mistake is in the namespace configuration of "location" or "prefix" Please help! Thanks! infoomatic # 2.0.19: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-45-generic x86_64 Ubuntu 12.04.3 LTS ext4 auth_username_format = %n disable_plaintext_auth = no mail_debug = yes mail_gid = vmail mail_home = /var/lib/vmail/home/%u mail_location = mdbox:/var/lib/vmail/mail/%u mail_plugins = " acl zlib fts fts_solr acl" mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave imapflags mdbox_rotate_size = 64 M namespace { inbox = yes location = prefix = separator = / type = private } namespace { list = children location = mdbox:/var/lib/vmail/mail/%%n/mailboxes/shared/%n prefix = shared/%%n/ separator = / subscriptions = no type = shared } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile acl_shared_dict = file:/var/lib/vmail/shared-mailboxes fts = solr fts_solr = break-imap-search url=http://localhost:8080/solr/ sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +imapflags zlib_save = bz2 zlib_save_level = 6 } protocols = " imap sieve pop3" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail user = vmail } } service managesieve-login { inet_listener sieve_deprecated { port = 2000 } } ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } protocol lda { mail_plugins = " sieve acl" } protocol imap { mail_plugins = " acl imap_acl" }

2 2

[Dovecot] Dovecot deliver into folder question
by Marc Perkel 08 Jan '14

08 Jan '14

If I want to user dovecot deliver into a folder that is not at the root level - how do I do that? How do I specify a folder in a folder?

4 7

[Dovecot] LMTP with virtual and system users
by Philipp Kolmann 08 Jan '14

08 Jan '14

Hi, I have a mailsystem where i have some local users with shell access and full home dirs which receive mail and also several SQL virtual users only for mail. With the virtual users, everything works fine. Mail is delivered via LMTP and also sieve works :) The SQL Lookup knows what to do with username(a)domain.com The problem is the system user. If exim delivers the mail to the lmtp socket, the LMTPd can't find username(a)local.host I would be able to specify the global auth_username_format=%n but then my SQL queries break and I like the possibility to have xx(a)domain1.com and xx(a)domain2.com routed to two different accounts. As I have seen in the source, I can't specify username_format=%n in the passdb { driver = pam } backend. Do you have any suggestion how to solve this issue? thanks Philipp

3 6

[Dovecot] Question re: filesystem permissions
by Charles Marcus 08 Jan '14

08 Jan '14

Hi all, I want to make sure the filesystems are correct/optimal and secure as possible. This is a virtual hosting setup only (no system users), and dovecot is currently running in high performance mode (I'm thinking I want to change that too, so wondering if that would affect the permissions)... /var/vmail (and everything under it) is owned by vmail:vmail. Current permissions are: /var/vmail 755 /var/vmail/example1.com 777 /var/vmail/example2.com 777 /var/vmail/example1.com/user1 755 (all other user home dirs are the same) /var/vmail/example1.com/user1/Maildir 700 (all other user Maildirs and all subdirs are the same) All files are 600, with the exception of the dovecot-uidvalidity.blahblah files, which are 444 So... is this right? Anything need to be changed? Thanks, -- Best regards, Charles

3 6

[Dovecot] virtual mailboxes folder structure
by Marco Cusano 08 Jan '14

08 Jan '14

Hi, I am trying to find a way to list my virtual mailboxes hiding the namespace prefix into my imap client. Fore example now my “All” mailbox is listed under virtual/ as: Inbox Sent Drafts Spam Trash - virtual All I would like to list as this: Inbox Sent Drafts Spam Trash All This is my 10-mail.conf: http://pastebin.com/DumEbbmy and this is my 15-mailboxes.conf: http://pastebin.com/QFzWGzyC I thought that the list = children paramenter would do but it did not. Thank you

1 0

Re: [Dovecot] BUG report: doveadm HEADER <field> <pattern> when concatenating with another Search key
by megodin＠inboxalias.com 08 Jan '14

08 Jan '14

Hey Joseph! Thanks for testing. > I couldn't recreate this with 2.1.16. Also, my version of "doveadm > search" does not accept missing header patterns. Is this corroborated > by dumping out the header with this same search query? > > doveadm fetch -u exampleuser hdr SUBJECT Silvester \ > HEADER Return-Path someuser at example.com Yes, it's same phenomenon when dumping with fetch. Of course you can only test this properly when you really have some mails with corresponding existing Header fields. (You can also try out other HEADER fields, like Reply-To, References, X-Spam-Score or whatever - just look at some mail headers of your mails and try it with existing fields.) So E.g. When doing doveadm fetch -u exampleuser hdr SUBJECT Silvester HEADER Return-Path someuser(a)example.com it initially outputs 13 headers (same as when using with SUBJECT Silvester only) , when piping it to "grep -i 'Return-Path'" it even found only 3 out of 13 headers containing a Return-Path at all, 2 of them different than someuser(a)example.com - so SAME behaviour as with search. Maybe also relevant, as mail format I'm using sdbox (on a larger user base of 40.000 people). -- (relevant part) of dovecot -n # 2.2.5.5 (e5350245ad9b): /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-358.23.2.el6.x86_64 x86_64 Red Hat Enterprise Linux Server release 6.4 (Santiago) nfs auth_cache_size = 100 M auth_cache_ttl = 10 mins auth_master_user_separator = * auth_mechanisms = plain login auth_username_format = %Ln auth_verbose = yes disable_plaintext_auth = no import_environment = TZ DEBUG_OUTOFMEM DOVECOT_HOSTDOMAIN listen = * lock_method = dotlock mail_fsync = always mail_home = /mnt/nfs/vmails/%u mail_location = sdbox:/mnt/nfs/vmails/%u/mail:ALT=/mnt/archivnfs/vmails/%u/mail mail_plugins = " quota fts fts_lucene" mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mmap_disable = yes service imap-login { process_limit = 200 process_min_avail = 8 service_count = 0 vsz_limit = 512 M } service imap { client_limit = 1 process_limit = 10000 } service pop3-login { process_limit = 200 process_min_avail = 8 } service pop3 { process_limit = 10000 } verbose_proctitle = yes protocol lda { mail_plugins = " quota fts fts_lucene sieve" } protocol imap { imap_client_workarounds = tb-extra-mailbox-sep mail_max_userip_connections = 50 mail_plugins = " quota fts fts_lucene imap_quota" } _________________________________________________________________ Send and receive anonymous emails to your inbox with InboxAlias. http://www.inboxalias.com

1 0

[Dovecot] how to separate virtual delivery and authentication?
by Mihai Badici 08 Jan '14

08 Jan '14

I have a "pure ldap" setting with postfix and dovecot. When using dovecot delivery, the recipient is checked via ldap. The same ldap query is used when authenticate. So, if I want to authenticate with the uid , I can't use a filter like uid=%u because the delivery will fail. I don't want to use %nor something else because I could use multiple e-mail addresses on a single account. I actually use a filter like ( mail=%u)|(uid=%u) but I think for more complex situations should be better to have two separate filters, one for authentication and the other for the delivery. What is your oppinion? -- Mihai Bădici http://mihai.badici.ro

2 7

Re: [Dovecot] BUG report: doveadm HEADER <field> <pattern> when concatenating with another Search key
by Joseph Tam 08 Jan '14

08 Jan '14

On Wed, 8 Jan 2014, dovecot-request(a)dovecot.org wrote: > doveadm search -u exampleuser SUBJECT Silvester > (outputs correctly 10 matches) > > ... > > doveadm search -u exampleuser SUBJECT Silvester HEADER Return-Path > someuser(a)example.com > (gives exactly the same output - but this is WRONG, as the given Subject > AND Return-Path is really only found in 1 Message - uid 15697) I couldn't recreate this with 2.1.16. Also, my version of "doveadm search" does not accept missing header patterns. Is this corroborated by dumping out the header with this same search query? doveadm fetch -u exampleuser hdr SUBJECT Silvester \ HEADER Return-Path someuser(a)example.com Joseph Tam <jtam.home(a)gmail.com>

1 0

[Dovecot] Dovecot can't find CLucene's libstemmer on FreeBSD
by interfaSys sàrl 08 Jan '14

08 Jan '14

Hello, A set of patches was created by Lawrence Chen for the Dovecot2 port so that it could recognise and use libstemmer and libexttextcat. They can't be used as is as he's replacing statements with something that works only on FreeBSD, but I think it would be a good idea to try and include some of his fixes. http://www.freebsd.org/cgi/query-pr.cgi?pr=ports/175813 Cheers, Olivier

1 0

Re: [Dovecot] using OR in doveadm search query
by Joseph Tam 08 Jan '14

08 Jan '14

> > This works for me (at least with tcsh): > > > > $ doveadm search mailbox "shared/* OR (SUBJECT a) (SUBJECT b)" > doveadm does not complain anymore but it does not find anything. I guess > because now the query has become a mailbox name that does not exist. ( I > am using dovecot 2.2.9) Each search token ought to be a command line argument to doveadm, so if you're looking for all message with the string "a" or "b" in the subject in mailboxes shared/*, then this should be the correct syntax, with all arguments sufficiently escaped from shell interpretation: doveadm search mailbox shared/\* $ SUBJECT a OR SUBJECT b $ (Delete "OR" if both strings must be in the subject: expressions are implicitly AND'd if not OR'd. In fact, you can also remove the parenthesis since precedence doesn't matter anymore.) You can check the search query by fetching some values using the same query: doveadm fetch 'mailbox hdr' mailbox shared/\* $ SUBJECT a OR SUBJECT b $ Joseph Tam <jtam.home(a)gmail.com>

1 0

[Dovecot] Mailbox autocreate feature cannot create folders
by interfaSys sàrl 08 Jan '14

08 Jan '14

Hello, The "new" way of creating default mailboxes doesn't work for us. There seems to be a permission problem. We get this in the logs: imap(testuser(a)domain.com): Error: nfs_flush_file_handle_cache_dir: rmdir(/var/mail) failed: Device busy That error message has nothing to do with NFS (not used) or /var/mail and appears every time an app is requesting a list of folders via IMAP and only if we enable the autocreate feature. We're using mdbox, emails are delivered via LDA and the folder permissions look like this: # la /home/user/imap/domain.com/testuser/mdbox/mailboxes/ total 5 drwx------ 3 user mail 3B Jan 5 19:33 INBOX drwx------ 3 user mail 3B Jan 5 19:33 . drwx------ 4 user mail 8B Jan 7 02:43 .. The mailbox definitions used come straight from the wiki: http://wiki2.dovecot.org/MailboxSettings I've enabled debugging, but there is no mention of the mailboxes to create: Debug: dict quota... Debug: Namespace : type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mdbox:~/mdbox Debug: fs:... Debug: acl:... ... Here is what works: - Autocreate plugin - Creating folders via various clients So, it seems Dovecot can create folders, just not using that feature. If that's not a bug, would there be a way to make it work without altering permissions? Cheers, Olivier

1 0

[Dovecot] inotify max_user instances
by Charles Marcus 07 Jan '14

07 Jan '14

Hello, Timo, last year when you remoted into our server and performed the migration from courier-imap, we ran into this issue, and you solved it by doing: echo 1024 > /proc/sys/fs/inotify/max_user_instances Then you said you were going to solve this permanently by changing the init script... Here is what you said (this is from the skype chat): [2012-06-04 10:40:43 AM] timosirainen: probably put to dovecot init script or something I guess I could manually modify my init script, but I'm clueless as to where.how. The current (gentoo) init script is: > #!/sbin/runscript > # Copyright 1999-2012 Gentoo Foundation > # Distributed under the terms of the GNU General Public License, v2 or > later > # $Header: > /var/cvsroot/gentoo-x86/net-mail/dovecot/files/dovecot.init-r4,v 1.1 > 2012/12/01 10:40:49 eras Exp $ > > extra_started_commands="reload" > > depend() { > need localmount > before postfix > after bootmisc ldap mysql ntp-client ntpd postgresql saslauthd > slapd > use logger net > } > > checkconfig() { > DOVECOT_INSTANCE=${SVCNAME##*.} > if [ -n "${DOVECOT_INSTANCE}" -a "${SVCNAME}" != "dovecot" ]; then > DOVECOT_CONF=/etc/dovecot/dovecot.${DOVECOT_INSTANCE}.conf > else > DOVECOT_CONF=/etc/dovecot/dovecot.conf > fi > if [ ! -e ${DOVECOT_CONF} ]; then > eerror "You will need an ${DOVECOT_CONF} first" > return 1 > fi > if [ -x /usr/sbin/dovecot ]; then > DOVECOT_BASEDIR=$(/usr/sbin/dovecot -c ${DOVECOT_CONF} > -a | grep '^base_dir = ' | sed 's/^base_dir = //') > else > eerror "dovecot not executable" > return 1 > fi > DOVECOT_BASEDIR=${DOVECOT_BASEDIR:-/var/run/dovecot} > DOVECOT_PIDFILE=${DOVECOT_BASEDIR}/master.pid > } > > start() { > checkconfig || return 1 > ebegin "Starting ${SVCNAME}" > start-stop-daemon --start --exec /usr/sbin/dovecot \ > --pidfile "${DOVECOT_PIDFILE}" -- -c "${DOVECOT_CONF}" > eend $? > } > > stop() { > checkconfig || return 1 > ebegin "Stopping ${SVCNAME}" > start-stop-daemon --stop --exec /usr/sbin/dovecot \ > --pidfile "${DOVECOT_PIDFILE}" > eend $? > } > > reload() { > checkconfig || return 1 > ebegin "Reloading ${SVCNAME} configs and restarting auth/login > processes" > start-stop-daemon --signal HUP --exec /usr/sbin/dovecot \ > --pidfile "${DOVECOT_PIDFILE}" > eend $? > } Suggestions? -- Best regards, Charles

2 2

[Dovecot] Panic: file mailbox-list-maildir.c: line 133: unreached
by Raúl Massano Brás 07 Jan '14

07 Jan '14

Hi I am using dovecot 2.0.9 on CentOS 6.4 The following error appears in the logs when users connect to the imap server using MACs. All other clients that I tested work fine. ###### BEGIN ERROR ###### Jan 5 18:04:25 mail dovecot: imap(jcf): Panic: file mailbox-list-maildir.c: line 133: unreached Jan 5 18:04:25 mail dovecot: imap(user): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0x3ca6a) [0x7f991df2ca6a] -> /usr/lib64/dovecot/libdovecot.so.0(+0x3cab6) [0x7f991df2cab6] -> /usr/lib64/dovecot/libdovecot.so.0(+0x16dba) [0x7f991df06dba] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x3eace) [0x7f991e1aface] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_list_is_valid_pattern+0x26) [0x7f991e1a4f86] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x3c861) [0x7f991e1ad861] -> /usr/lib64/dovecot/libdovecot-storage.so.0(fs_list_iter_next+0x2f) [0x7f991e1ad3ff] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_list_iter_next+0xa) [0x7f991e1a490a] -> dovecot/imap() [0x40b399] -> dovecot/imap(cmd_list_full+0x426) [0x40c246] -> dovecot/imap() [0x40f8cd] -> dovecot/imap() [0x40f9ba] -> dovecot/imap(client_handle_input+0x135) [0x40fbe5] -> dovecot/imap(client_input+0x5f) [0x41050f] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x48) [0x7f991df37e08] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x9f) [0x7f991df38d7f] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7f991df37d98] -> /usr/lib64/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f991df26203] -> dovecot/imap(main+0x2f9) [0x418809] -> /lib64/libc.so.6(__libc_start_main+0xfd) [0x7f991d76fcdd] -> dovecot/imap() [0x408229] ###### END ERROR ###### The dovecot configuration is: ###### BEGIN CONFIG ###### # dovecot -n # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-358.23.2.el6.x86_64 x86_64 CentOS release 6.4 (Final) disable_plaintext_auth = no mail_access_groups = mail mail_location = mbox:~/mail:INBOX=/var/spool/mail/%u mbox_write_locks = fcntl namespace { hidden = yes inbox = yes list = yes location = mbox:~/mail:INBOX=/var/spool/mail/%u prefix = "#mbox/" separator = / type = private } namespace { location = maildir:~/Maildir prefix = separator = / type = private } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } ssl_ca = </etc/pki/tls/certs/TERENA.crt ssl_cert = </etc/pki/tls/certs/mail.iseg.ulisboa.pt.crt ssl_key = </etc/pki/tls/private/mail.iseg.ulisboa.pt.key syslog_facility = local0 userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } ###### END CONFIG ###### I don't know what to do to allow MAC users to use the system. Can anyone help? Thank you, -- Raúl Brás Instituto Superior de Economia e Gestão Universidade de Lisboa

2 2

[Dovecot] using OR in doveadm search query
by W. de Hoog 07 Jan '14

07 Jan '14

Hi, I am trying to create an OR query but no success yet: $ doveadm search mailbox shared/* OR SUBJECT "a" SUBJECT "b" doveadm(neil): Fatal: Use parenthesis when mixing ANDs and ORs $ doveadm search mailbox shared/* OR $SUBJECT "a"$ $SUBJECT "b"$ doveadm(neil): Fatal: Unknown argument (SUBJECT $ doveadm search mailbox shared/* $OR \(SUBJECT "a"$ $SUBJECT "b"$\) doveadm(neil): Fatal: Unknown argument (OR What is the correct syntax for such a query? -- Willem-Jan de Hoog

2 2

[Dovecot] What's the parameter -w for dovecot-auth: dovecot -w
by ldaamandy 07 Jan '14

07 Jan '14

hello: What's the parameter -w for dovecot-auth: dovecot -w my service of dovecot-auth always activing two: one is" dovecot-auth" , the other is" dovecot-auth -w" i don't know the diffevent between them amandy thanks!

2 4

[Dovecot] need assistance migrating between apple servers
by Raymond Norton 06 Jan '14

06 Jan '14

I am attempting to move imap folders from an Apple Snow Leopard server to a new Apple Mavericks server. Dovecot --version is not working , but I believe the old server is running dovecot 1.1.2 and can confirm the new one is running 2.2.x. I have tried taring and moving folders, but have not been able to get the transfered messages and folders to show up in user accounts (new messages show up fine). I have attempted to recreate index files, but that has not worked either. The last attempt I made to migrate was to use dsync, but it does not exist on the old server and I do not see a way to install it. What method would work best to migrate or move files and folders from the old server and get them to show up for clients on using the new server? -- Raymond Norton LCTN 952.955.7766 Sent from My Desktop

2 1

[Dovecot] virtual mailboxes folder structure
by Marco Cusano 06 Jan '14

06 Jan '14

Hi, I am trying to find a way to list my virtual mailboxes hiding the namespace prefix into my imap client. Fore example now my “All” mailbox is listed under virtual/ as: Inbox Sent Drafts Spam Trash virtual All I would like to list as this: Inbox Sent Drafts Spam Trash All This is my 10-mail.conf: http://pastebin.com/DumEbbmy and this is my 15-mailboxes.conf: http://pastebin.com/QFzWGzyC I thought that the list = children paramenter would do but it did not. Thank you

1 0

[Dovecot] virtual mailboxes folder structure
by Marco Cusano 06 Jan '14

06 Jan '14

Hi, I am trying to find a way to list my virtual mailboxes hiding the namespace prefix into my imap client. Fore example now my “All” mailbox is listed under virtual/ as: Inbox Sent Drafts Spam Trash virtual All I would like to list as this: Inbox Sent Drafts Spam Trash All This is my 10-mail.conf: http://pastebin.com/DumEbbmy and this is my 15-mailboxes.conf: http://pastebin.com/QFzWGzyC I thought that the list = children paramenter would do but it did not. Thank you

1 0

[Dovecot] [SIEVE] Locking Errors with vnd.dovecot.duplicate Extension
by Daniel Parthey 06 Jan '14

06 Jan '14

Hi, we are running a 4 host setup which each hosts a director+mailbox which is mounted via NFSv4 from a DRBD cluster. * Dovecot upstream release 2.1.16 * Doveadm batch subcommand fix - http://hg.dovecot.org/dovecot-2.1/raw-rev/850b5d8bbcc9 * Pigeonhole release 0.3.4 Now we would like to remove duplicate Mails using the vnd.dovecot.duplicate extension using a SIEVE script like this: require ["vnd.dovecot.duplicate", "fileinto", "mailbox", "regex", "vacation", "variables"]; if duplicate { fileinto :create "Trash"; } But as soon as we start delivering duplicate mails, we're sometimes getting locking errors from the mailbox (which is responsible for the user) according to the director: Dec 27 16:36:30 10.129.3.213 dovecot: lmtp(27975, user001(a)example.org) Error: Creating lock file for /mail/dovecot/example.org/user001/.dovecot.lda-dupes timed out in 20 secs Dec 27 16:36:33 10.129.3.213 dovecot: lmtp(27987, user001(a)example.org) Error: Creating lock file for /mail/dovecot/example.org/user001/.dovecot.lda-dupes timed out in 20 secs Dec 27 16:36:35 10.129.3.213 dovecot: lmtp(27994, user001(a)example.org) Error: Creating lock file for /mail/dovecot/example.org/user001/.dovecot.lda-dupes timed out in 20 secs Dec 27 16:36:36 10.129.3.213 dovecot: lmtp(28011, user001(a)example.org) Error: Creating lock file for /mail/dovecot/example.org/user001/.dovecot.lda-dupes timed out in 20 secs Dec 27 16:36:36 10.129.3.213 dovecot: lmtp(28013, user001(a)example.org) Error: Creating lock file for /mail/dovecot/example.org/user001/.dovecot.lda-dupes timed out in 20 secs Dec 27 16:36:38 10.129.3.213 dovecot: lmtp(28017, user001(a)example.org) Error: Creating lock file for /mail/dovecot/example.org/user001/.dovecot.lda-dupes timed out in 20 secs Dec 27 16:36:39 10.129.3.213 dovecot: lmtp(28025, user001(a)example.org) Error: Creating lock file for /mail/dovecot/example.org/user001/.dovecot.lda-dupes timed out in 20 secs Dec 27 16:36:42 10.129.3.213 dovecot: lmtp(28037, user001(a)example.org) Error: Creating lock file for /mail/dovecot/example.org/user001/.dovecot.lda-dupes timed out in 20 secs Dec 27 16:36:43 10.129.3.213 dovecot: lmtp(27973, user001(a)example.org) Error: Creating lock file for /mail/dovecot/example.org/user001/.dovecot.lda-dupes timed out in 20 secs Configs and Error log is attached. Any idea how to mitigate these locking issues? Regards Daniel

1 0

[Dovecot] disable_plaintext_auth = yes not showing in doveconf -n output?
by Charles Marcus 04 Jan '14

04 Jan '14

I have it set, but it doesn't show up. However, I noticed that it does show as enabled by default in doveconf -a output. Is this why it doesn't show up in doveconf -n output? -- Best regards, Charles

4 5

[Dovecot] RFE: IMAP LIST Extension for Special-Use Mailboxes
by Patrick Ben Koetter 03 Jan '14

03 Jan '14

Timo, would you consider adding support for "IMAP LIST Extension for Special-Use Mailboxes" <http://www.rfc-editor.org/rfc/rfc6154.txt> any time near in the future? I would really love to get rid of all those folders created by all those different mail clients just because they can't agree to use the same folder for special purpose. Obviously clients need to support it too. Having Dovecot support it certainly would make them adopt the standard sooner. p@rick -- state of mind Digitale Kommunikation http://www.state-of-mind.de Franziskanerstraße 15 Telefon +49 89 3090 4664 81669 München Telefax +49 89 3090 4666 Amtsgericht München Partnerschaftsregister PR 563

10 17

[Dovecot] Allow both SSL/993 and STARTTLS/143 connections (secure only)
by Charles Marcus 03 Jan '14

03 Jan '14

Hi all, Ok, up until now, I've only always allowed IMAPS connections to dovecot on port 993. I want to also start allowing clients to user port143+STARTTLS, but I walso want to make sure both ports are locked down to ONLY allow secure connections. So... is disable_plaintext_auth = yes in the main config enough to accomplish this? http://wiki2.dovecot.org/SSL/DovecotConfiguration says: There are a couple of different ways to specify when SSL/TLS is required: * disable_plaintext_auth=yes allows plaintext authentication <http://wiki2.dovecot.org/Authentication/Mechanisms> only when SSL/TLS is used first. * ssl = required requires SSL/TLS also for non-plaintext authentication <http://wiki2.dovecot.org/Authentication/Mechanisms>. * If you have only plaintext mechanisms enabled (auth { mechanisms = plain login } ), you can use either (or both) of the above settings. They behave exactly the same way then and the comments in 10-auth.conf say: # Disable LOGIN command and all other plaintext authentications unless # SSL/TLS is used (LOGINDISABLED capability). Note that if the remote IP # matches the local IP (ie. you're connecting from the same computer), the # connection is considered secure and plaintext authentication is allowed. # See also ssl=required setting. #disable_plaintext_auth = yes These seem to be saying that all I need to do is set either or both (ssl-required and/or disable_plaintext_auth=yes). I'm looking for the simplest, and don't like redundant/unnecessary settings, so... which is the best/preferred way? And what is the difference between ssl=required and disable_plaintext_auth=yes? Thanks, -- Best regards, */Charles/***

2 3

[Dovecot] How to remove Dovecot (LMTP) information from Email header
by Anant 02 Jan '14

02 Jan '14

Hello All, I want to remove Dovecot (LMTP) information from Email Header, Please help me. I am using Dovecot 2.0.9 with Exim. Received: from XX.XXblue.co.uk by XX.XXblue.co.uk*(Dovecot) with LMTP id* XIuTJkJFxVLKTwAAG2fxGQ for <anant.saraswat(a)techblue.co.uk>; Thu, 02 Jan 2014 10:59:28 +0000 Received: from [210.7.64.2] (helo=[192.168.100.71]) by solo.techblue.co.uk with esmtp (Exim 4.72) (envelope-from <sysadmin(a)techblue.co.uk>) id 1Vyfzr-0005Oy-7H for anant.saraswat(a)techblue.co.uk; Thu, 02 Jan 2014 10:59:28 +0000 Thanks & Regards, Anant Saraswat

2 2

[Dovecot] Problem building dovecot 2.2.10 with pigeonhole 0.4.2
by Nikolaos Milas 02 Jan '14

02 Jan '14

Hi, I am on CentOS 5.10 x86_64 and I am trying to build RPMs for Dovecot 2.2.10 with pigeonhole 0.4.2. I am getting an error that autogen.sh is missing from pigeonhole 0.4.2 source (as available from: http://pigeonhole.dovecot.org/releases/2.2/dovecot-2.2-pigeonhole-0.4.2.tar…) /var/tmp/rpm-tmp.89185: line 92: /home/mockbuild/rpmbuild/BUILD/dovecot-2.2.10/dovecot-2.2-pigeonhole-0.4.2/autogen.sh: No such file or directory Indeed, the file is missing, as: tar --list -f dovecot-2.2-pigeonhole-0.4.2.tar.gz | grep autogen ...produces no output. However, I managed to use the latest source code: http://hg.rename-it.nl/dovecot-2.2-pigeonhole/shortlog/32beba3bfd8d which does contain an autogen.sh, and this package worked fine. I guess the released source tar pack should be updated? Thanks and regards, Nick

2 1

[Dovecot] Dovecot doesn't seem to read userdb for the first delivery
by phuhimself＠phunehehe.net 02 Jan '14

02 Jan '14

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256 Hello List, First of all, this is my first post so please bear with me if I miss something. I'm using Postfix with Dovecot 2.0.19 as the LDA. The home directory is of the form `/var/mail/virtual/<domain>/<username>`. The mail directory is under the home directory and named `mail`. `mail_location` is left empty, and userdb is specified using SQL: user_query = SELECT uid AS uid, \ gid AS gid, \ homedir AS home, \ maildir AS mail \ FROM users WHERE email = '%u' Everything had been fine, until I added a new user. In the log, Dovecot complains that it doesn't have permission to create the mail directory (email address replaced): > Jan 2 05:46:19 mail1 dovecot: lda(test(a)test.com): Error: user > test(a)test.com: > Initialization failed: Initializing mail storage from mail_location > setting > failed: mkdir(mail) in directory /var/spool/postfix failed: Permission > denied > (euid=5000(virtual) egid=5000(virtual) missing +w perm: > /var/spool/postfix, > dir owned by 0:0 mode=0755) Sometimes it complains about /run/dovecot instead of /var/spool/postfix, but I think that doesn't really matter. I think not specifying `mail_location` confused Dovecot, as explained in [MailLocation][1]. When I put in the right value for `mail_location` the error went away. What I don't understand is, it is said in the [same document][1] that the userdb field `mail` will override `mail_location` anyway. I would think that I can skip `mail_location` if I specify userdb `mail` for all users. Is the document wrong? Thanks, Phu [1]: http://wiki2.dovecot.org/MailLocation -----BEGIN PGP SIGNATURE----- Version: OpenPGP.js v.1.20131017 Comment: http://openpgpjs.org wsFcBAEBCAAQBQJSxRknCRD8UQvv5Zm+EAAAj68P/iidn6jYSNlhLY2640Qg vPC9xg0lhH/LJLEMMK+oSDnOmF+Hjtm/IMctOVDiTnPfdbvoC9oE4RWnKlL0 /couQQHQKjh2L2mqN50buROjUQyR+pQXGNfVGS+jq74S30299/VnH+gWPUSV xYRb1i6wuKVGCCNRF3vJHZs1eCiEFKpvC4LUiI5yarclCUE4mCtRO97Iadu/ GTaXn3euy5/5dyZEiPvld5IcGJ0BMC5RJiHb89EpN7A5J+4MvlMNUdcPYgcF j+ilwsOCpchj1AfjLnosnpCJRysin8aYj9mxGC+gR2/fAIm242qBNrVpnLQM IjP8G1pKhxKzQx2jFnENvhTKaxDSIWva0u/CSxSiCE3Kepj1b39qsjFlM8k7 0/EzoWf1rxzy0kQQ1qNeoz1Ta93D2cWQkTj6AK6kVmtmt9iaqzjGU+n7w3ae n+hoYs19r8LnhqSrlAX/N10h7/B++SRJG81EUB4tJF+LtRknFJa1qyr7Guh/ mOieUupr9Ks5WlPYaZ77t61FZauI0bK716p+J5C/f75EdWMrUInVumGletk/ FIaILS6nhq+D6SvrqiVseKvhjc+6p4HoeNVotceus+yssNmkniey5j3Hs0H5 EPmmkAT+hNN5R0wcbj2LaErG3VQ6SGMdY/suIJQb1Aq08nymtVaA2mS8Tcnm Z+O+ =pqon -----END PGP SIGNATURE-----

1 0

[Dovecot] Wrong file accessed after file was renamed because of wrong size
by Rolf Eike Beer 01 Jan '14

01 Jan '14

I'm migrating from Courier-IMAP. On first access of folders I get this log (slightly anonymized): Jan 1 18:38:27 mail dovecot: imap(username): Error: Cached message size smaller than expected (1452 < 1668) Jan 1 18:38:27 mail dovecot: imap(username): Error: Maildir filename has wrong S value, renamed the file from /var/vpopmail/domains/domain/username/.maildir/cur/1206559119.14350.mail,S=1452:2,RS to /var/vpopmail/domains/domain/username/.maildir/cur/1206559119.14350.mail,S=1668:2,RS Jan 1 18:38:27 mail dovecot: imap(username): Error: Corrupted index cache file /var/vpopmail/domains/domain/username/.maildir/dovecot.index.cache: Broken physical size for mail UID 161 Jan 1 18:38:27 mail dovecot: imap(username): Error: read(/var/vpopmail/domains/domain/username/.maildir/cur/1206559119.14350.mail,S=1452:2,RS) failed: Invalid argument Jan 1 18:38:27 mail dovecot: imap(username): Disconnected: Internal error occurred. Refer to server log for more information. [2014-01-01 18:38:27] in=135 out=63515 This is the same in 2.2.6 and 2.2.10. Greetings, Eike

1 0

[Dovecot] How to add dovecot plugin?
by Timothy Murphy 31 Dec '13

31 Dec '13

I'm running dovecot version 2.0.9 under CentOS-6.5 . I want to add the following plugin: ==================== require "fileinto"; if header :contains "X-Spam-Flag" "YES" { fileinto "Spam"; } ==================== Could some kind soul tell me where exactly I should place this script (eg "anywhere in /etc/dovecot/dovecot.conf" or "anywhere in /etc/dovecot/conf.d/90-plugin.conf"), and do I need to take any other action? Actually, the folder I should like spam to go to is ~/Maildir/.Spam/cur/ - should I modify the above script? If these queries are anwered clearly in some dovecot documentation, please point me to that. -- Timothy Murphy e-mail: gayleard /at/ eircom.net School of Mathematics, Trinity College, Dublin 2, Ireland

2 1

Re: [Dovecot] pop3 rate limit
by michael 30 Dec '13

30 Dec '13

On 2013-12-29 02:05, Christian Rößner wrote: > Hi, > > we have customers with Exchange servers that are polling for new mail > every minute with dozens of pop3 accounts. I am looking for a > mechanism to rate limit this per user. So what I am looking for is a > way to block users from polling, if a user asks for new mail more > than > every 5 minutes (for example). > > Is this possible? Can this be achieved within Dovecot or does it need > external scripting? (I thought about fail2ban, but also want IPv6 > support) > > Thanks in advance > > -Christian Rößner See: www.policyd.org You'll need to use v2.1 to get IPV6 support. Michael Hallager

6 10

[Dovecot] Warning: fscking index file /.../dovecot.index
by Alex Vitola 30 Dec '13

30 Dec '13

We have often found the below error in VPS servers using OpenVZ, and some cases using OpenStack, in neither case is used for storage or sharing ISCSI or NFS Client can not receive messages via POP3 or IMAP In /var/log/maillog the message below is seen Oct 31 15:28:26 vps dovecot: pop3(user(a)domain.com): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0 [0x2b3718e07400] -> /usr/lib64/dovecot/libdovecot.so.0 [0x2b3718e07456] -> /usr/lib64/dovecot/libdovecot.so.0 [0x2b3718e06df3] -> /usr/lib64/dovecot/libdovecot-storage.so.0 [0x2b3718b6566b] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_sync_commit+0x89) [0x2b3718b5ced9] -> /usr/lib64/dovecot/libdovecot-storage.so.0 [0x2b3718aeae4d] -> /usr/lib64/dovecot/libdovecot-storage.so.0 [0x2b3718aea357] -> /usr/lib64/dovecot/libdovecot-storage.so.0 [0x2b3718aea698] -> /usr/lib64/dovecot/libdovecot-storage.so.0(maildir_storage_sync_init+0xbb) [0x2b3718aea83b] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x31) [0x2b3718b15e31] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_sync+0x27) [0x2b3718b18537] -> dovecot/pop3(client_create+0x332) [0x405702] -> dovecot/pop3 [0x40414b] -> dovecot/pop3 [0x404708] -> /usr/lib64/dovecot/libdovecot.so.0 [0x2b3718dc9a52] -> /usr/lib Both POP3 as IMAP Oct 31 15:24:42 vps dovecot: imap(user(a)domain.com): Warning: fscking index file /home/user/mail/domain.com/user/dovecot.index Oct 31 15:28:26 vps dovecot: pop3(user(a)domain.com): Warning: fscking index file /home/user/mail/domain.com/user/dovecot.index Today I do to solve this the procedure below - Access the directory mailbox - Remove files dovecot.index * - Run the command doveadm index-u $ user @ $ domain-q INBOX The question is for what reason this only occurs with VPS servers, I do not find this error on any single physical server to virtual and dovecot settings are the same. att Alex Vitola

1 0

[Dovecot] dovecot 2.2.10 - imap: Error: Can't load plugin imap_stats_plugin:
by giovanni＠neweden.uk.to 30 Dec '13

30 Dec '13

dovecot 2.2.10 is raising this error on my installation. Dec 30 13:57:59 imap: Error: Can't load plugin imap_stats_plugin: Plugin stats must be loaded also (you must set: mail_plugins=$mail_plugins stats) Dec 30 13:57:59 imap: Fatal: Couldn't load required plugins This error occurs at logging phase. The dovecot configuration looks correct to me, here below an excerpt of it: ... ... mail_plugins=$mail_plugins stats protocol imap { mail_plugins = $mail_plugins imap_stats } plugin { # how often to session statistics stats_refresh = 30 secs # track per-IMAP command statistics stats_track_cmds = yes } ... ... I was already using this configuration but only now I am getting this error. From STRACE I see that the stat plugin is correctly localed . Is anybody else getting this error? or am I missing something? Here below an except of the strace message. [pid 17112] open("/usr/local/lib/dovecot/lib95_imap_stats_plugin.so", O_RDONLY) = 14 [pid 17112] read(14, "\177ELF\1\1\1\0\0\0\0\0\0\0\0\0\3\0\3\0\1\0\0\0`\t\0\0004\0\0\0"..., 512) = 512 [pid 17112] fstat64(14, {st_mode=S_IFREG|0755, st_size=53122, ...}) = 0 [pid 17112] mmap2(NULL, 8908, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 14, 0) = 0xf7609000 [pid 17112] mmap2(0xf760b000, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 14, 0x1) = 0xf760b000 [pid 17112] close(14) = 0 [pid 17112] open("/usr/local/lib/dovecot/lib90_stats_plugin.so", O_RDONLY) = 14 [pid 17112] read(14, "\177ELF\1\1\1\0\0\0\0\0\0\0\0\0\3\0\3\0\1\0\0\0@\24\0\0004\0\0\0"..., 512) = 512 [pid 17112] fstat64(14, {st_mode=S_IFREG|0755, st_size=100054, ...}) = 0 [pid 17112] mmap2(NULL, 20320, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 14, 0) = 0xf7604000 [pid 17112] mmap2(0xf7608000, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 14, 0x3) = 0xf7608000 [pid 17112] close(14) = 0 [pid 17112] write(2, "\1\01017112 prefix=imap: \n", 22) = 22 [pid 17112] write(2, "\1\00417112 Can't load plugin imap_s"..., 127) = 127 [pid 17112] munmap(0xf7609000, 8908) = 0 [pid 17112] munmap(0xf7604000, 20320) = 0 [pid 17112] write(2, "\1\00517112 Couldn't load required p"..., 39) = 39 [pid 17112] exit_group(89) = ? Process 17112 detached

2 2

[Dovecot] dsync-local crashes due to assertion failures
by Fabian Groffen 30 Dec '13

30 Dec '13

Hi, I have two servers that share nothing, running dovecot version 2.2.9. The first server hosts the original mail base, which I want to sync using dovecot to the second server. With some trial and error I managed to get synchronisation running using tcp sockets. Now for some accounts I see dsync-local crashing on the server that has the original mail base (which is still the only of the two that receives new mail). The log shows: Dec 8 03:13:14 zeus dovecot: dsync-local(someuser): Panic: file mail-index-tr ansaction-export.c: line 203 (log_append_ext_hdr_update): assertion failed: (u32 .offset + u32.size <= ext_hdr_size) Dec 8 03:13:14 zeus dovecot: dsync-local(someuser): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0x70ea0) [0x7f3ee4137ea0] -> /usr/lib64/dovecot/libdovecot.so.0(+0x70efe) [0x7f3ee4137efe] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f3ee40ebd2c] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_transaction_export+0xbed) [0x7f3ee442e89d] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x89104) [0x7f3ee442d104] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_transaction_commit_full+0xb2) [0x7f3ee442d592] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_transaction_commit+0xc) [0x7f3ee442d63c] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_sync_commit+0xb6) [0x7f3ee44372b6] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x335d6) [0x7f3ee43d75d6] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x328bc) [0x7f3ee43d68bc] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x32d83) [0x7f3ee43d6d83] -> /usr/lib64/dovecot/libdovecot-storage.so.0(maildir_storage_sync_init+0xd9) [0x7f3ee43d7199] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x2e) [0x7f3ee43e7f2e] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_sync+0x27) [0x7f3ee43e8047] -> dovecot/doveadm-server(dsync_brain_master_send_mailbox+0xcf) [0x41f17f] -> dovecot/doveadm-server(dsync_brain_run+0x2c8) [0x41d738] -> dovecot/doveadm-server() [0x41dd70] -> dovecot/doveadm-server() [0x42eda0] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7f3ee41495a6] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0xbd) [0x7f3ee414a62d] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f3ee4149008] -> dovecot/doveadm-server() [0x41bb6c] -> dovecot/doveadm-server() [0x40ee3b] -> dovecot/doveadm-server() [0x419581] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7f3ee41495a6] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0xbd) [0x7f3ee414a62d] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f3ee4149008] -> /usr/lib64/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f3ee40f1643] Dec 8 03:13:14 zeus dovecot: dsync-local(someuser): Fatal: master: service(doveadm): child 14116 killed with signal 6 (core dumps disabled) It seems that despite these crashes, some data is being transferred. Newer accounts seem not to have problems, this happens with older accounts only, for as far as I can see. I tried removing the index files, but that didn't seem to help. Any ideas on what I can do here? Both servers are configured to use maildir storage. Thanks, Fabian -- Fabian Groffen Gentoo on a different level

1 1

[Dovecot] pop3 rate limit
by Christian Rößner 30 Dec '13

30 Dec '13

Hi, we have customers with Exchange servers that are polling for new mail every minute with dozens of pop3 accounts. I am looking for a mechanism to rate limit this per user. So what I am looking for is a way to block users from polling, if a user asks for new mail more than every 5 minutes (for example). Is this possible? Can this be achieved within Dovecot or does it need external scripting? (I thought about fail2ban, but also want IPv6 support) Thanks in advance -Christian Rößner -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstraße 15, 81669 München Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein

2 1

[Dovecot] Sieve's spamtest always returns 0
by martin f krafft 28 Dec '13

28 Dec '13

I am a bit at a loss here with Sieve (pigeonhole) and the spamtest extension. I am using Dovecot 2.1.7 (backported to Debian squeeze), which comes with Pigeonhole 0.3.0. Messages are scanned with SpamAssassin, which adds a header like X-Spam-Status: Yes, score=84.6 required=5.0 tests=… and so I configured spamtest in conf.d/90-plugin.conf like so: sieve_spamtest_status_type = score sieve_spamtest_status_header = X-Spam-Status: [^,]*, score=(-?[[:digit:]]+\.[[:digit:]]).* sieve_spamtest_max_header = X-Spam-Status: [^,]*, score=[^[:space:]]+ required=(-?[[:digit:]]+\.[[:digit:]]).* I tested those regular expressions with sed -r, e.g. % sed -rne "s@^X-Spam-Status: [^,]*, score=-?[[:digit:]]+\.[[:digit:]] required=(-?[[:digit:]]+\.[[:digit:]]).*@\1@p" mailfile 5.0 and they work. Unfortunately, in sieve scripts, the spamtest value is always 0, which is indicative of the spamtest "not having run", which in this case I assume means that the regular expression didn't match. Am I right in assuming that the matching happens at the time of evaluation, and so adding the headers using vnd.dovecot.filter just before works? Or does the spamtest matching happen before the sieve scripts are executed? Can you see any other reason why spamtest always yields a value of 0? Thanks, -- martin | http://madduck.net/ | http://two.sentenc.es/ "those who are faithful know only the trivial side of love: it is the faithless who know love's tragedies." -- oscar wilde spamtraps: madduck.bogus(a)madduck.net

3 4

[Dovecot] Dovecot 'Submission' service?
by Charles Marcus 27 Dec '13

27 Dec '13

I do recall this being discussed, but I can't remember if it is actually in a working state now or not. According to the wiki, it is a work in progress: http://wiki2.dovecot.org/Roadmap?highlight=%28submission%29 So - is it in a functional state yet? Thanks, -- Best regards, */Charless/***

2 2

[Dovecot] Using DSync to convert from maildir to m/sdbox during migration of mail to new server
by Charles Marcus 27 Dec '13

27 Dec '13

Ok, now to work out the precise method (config for the target server and dsync command) to use to perform the migration from the old server to the new one, converting to dbox (s or m, depending on how the other thread discussing this turns out). I'll update the old server to 2.2.10 tomorrow morning so they're both at the same version. So, assuming both servers are running 2.2.10, with OldServer: mail_location = maildir:~/:INDEX=MEMORY and NewServer: mail_location = sdbox:~/sdbox or mail_location = mdbox:~/mdbox After reading and re-reading: http://wiki2.dovecot.org/Tools/Dsync I'm not so sure... First problem - apparently it can only be used one user at a time? And - do you have to actually know the users password too? If so, then this probably isn't going to be easier, and maybe even harder than just rsyncing everything, then slowly converting each user one at a time. -- Best regards, */Charles/*

1 0

[Dovecot] Migrating from Maildir to dbox+SIS... sdbox or mdbox?
by Charles Marcus 27 Dec '13

27 Dec '13

Ok... Now that I've got the niggling issues resolved, on to bigger and better things. I want to convert everyone from Maildir to dbox and enable SIS (our users use a lot of large attachments), and after some reading/googling, I think it may be better to use dsync instead of rsync for the actual migration after all since it will do this at the same time as the syncing. If I'm not mistaken, once I've figured out the correct syntax for the command, I should be able to do the conversion and migration at the same time. So, that is what I want to do, but I still have to choose between sdbox and mdbox. I tend to feel a little safer with sdbox, just because it seems more stable - and I like the idea that if a file gets corrupted somehow, then it is only that one mail that may potentially be lost, but if mdbox indexes get corrupted, you are guaranteed to lose messages (maybe a lot)... But I also really like the idea of an order of magnitude fewer actual files (would make rsync based backups much faster, etc). Timo - the last comments I was able to find from you were back in 2011... would you mind commenting on the current stated of dbox - especially mdbox, as far as reliability goes? The 'scary warnings' about how important the index files are ... well ... scares me... ;) I know there were definitely some issues with mdbox a few years ago - I found the old thread from 2011, but nothing substantial since, so... So... are there any people here, especially larger installs, using mdbox? sdbox? I'd especially be interested in hearing from anyone who has used both, and picked one over the other, and their reasons for doing so. Thanks, -- Best regards, */Charles/*

1 0

[Dovecot] Enabling SIS (single instance storage)
by Charles Marcus 27 Dec '13

27 Dec '13

Ok, didn't find much on this... The bottom of /etc/dovecot/conf.d/10-mail.conf has the following settings: #mail_attachment_dir = #mail_attachment_min_size = 128k #mail_attachment_fs = sis posix #mail_attachment_hash = %{sha1} all of which are apparently the defaults according to doveconf -d output - so no need to set them explicitly, unless I want to change them, right? So, enable the first one - but - the comments don't say anything about supporting variables. I'm assuming you can, otherwise all attachments for all domains would be in a single directory, which some admins might not like (I wouldn't)... so hopefully I can just set it to this: mail_attachment_dir = /var/vmail/%d/.attachments So how does this work during conversion? Users still on maildir simply don't engage it? But as users are converted to dbox, all attachments are de-duped, and then new mails coming in with attachments (for converted users) are de-duped at delivery? The wiki could do with a bit more on enabling and implementing it, especially what to expect when enabling it for the first time on a production system and what to expect along the way when converting existing users... -- Best regards, */Charles/*

1 0

[Dovecot] mail_location, user 'home', questions
by Charles Marcus 27 Dec '13

27 Dec '13

Hi all, Ok, another question... I always like changes to the default settings whenever possible (KISS principle)... So, according to the dovecot wiki, the default location for a maildir setup is: mail_location = maildir:~/Maildir However, when I first tried to access mail on the new box, something wasn't right, and I ended up having to change this to: mail_location = maildir:~ to get mail to display correctly. The filesystem for a users maildir currently has everything (cur/new/tmp, and the individual folders) inside that users directory, ie: /var/vmail/example.com/user/ Do I need to change this so that everything is under a 'Maildir' subdirectroy inside the users directory, like: /var/vmail/example.com/user/Maildir/ ? Also, I'm aware that it is important that even virtual users have valid 'homes', but I'm confused as to where these are (or are supposed to be) by default. My sql query currently contains: user_query = \ SELECT CONCAT('/var/vmail/', maildir) AS home \ FROM mailbox WHERE username = '%u' iterate_query = SELECT username AS user FROM mailbox So... what exactly is this saying? That the users 'home' is '/var/vmail'? Or does it automatically append %d/%u? I'm specifically wondering if the intention for the defaults is for the users home to be: /var/vmail/example.com/user and the users maildirs to be in: /var/vmail/example.com/user/Maildir Would appreciate some clarification... It wouldn't be hard to mv all of the users maildirs to a Maildir subfolder after the sync, but I want to know for sure that that is what I should/need to do... Thanks, -- Best regards, */Charles/*

1 1

[Dovecot] dovecot-postfix stack imap_client_workarounds
by thufir 27 Dec '13

27 Dec '13

To use dovecot-postfix stack with thunderbird, do I put the configuration into /usr/share/dovecot/protocols.d/impad.protocol? That would seem to be how the stack is configured. "Thunderbird To use with Thunderbird, edit the file /etc/dovecot/dovecot.conf: protocol imap { ... login_greeting_capability = yes imap_client_workarounds = tb-extra-mailbox-sep }" https://help.ubuntu.com/community/Dovecot thufir@dur:~$ thufir@dur:~$ cat /usr/share/dovecot/protocols.d/imapd.protocol protocols = $protocols imap thufir@dur:~$ thufir@dur:~$ dovecot -n # 2.0.19: /etc/dovecot/dovecot.conf # OS: Linux 3.5.0-44-generic i686 Ubuntu 12.04.3 LTS mail_location = maildir:~/Maildir managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave passdb { driver = pam } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap pop3 sieve service auth { unix_listener /var/spool/postfix/private/dovecot-auth { group = postfix mode = 0660 user = postfix } } ssl_cert = </etc/ssl/certs/dovecot.pem ssl_cipher_list = ALL:!LOW:!SSLv2:ALL:!aNULL:!ADH:!eNULL:!EXP:RC4+RSA:+HIGH:+MEDIUM ssl_key = </etc/ssl/private/dovecot.pem userdb { driver = passwd } protocol imap { imap_client_workarounds = delay-newmail mail_max_userip_connections = 10 } protocol pop3 { mail_max_userip_connections = 10 pop3_client_workarounds = outlook-no-nuls oe-ns-eoh } protocol lda { deliver_log_format = msgid=%m: %$ mail_plugins = sieve postmaster_address = postmaster quota_full_tempfail = yes rejection_reason = Your message to <%t> was automatically rejected:%n%r } thufir@dur:~$ thufir@dur:~$ thanks, Thufir

2 1

[Dovecot] Thunderbird message cache out of sync after repetitive rsyncs...
by Charles Marcus 27 Dec '13

27 Dec '13

Ok, hopefully there is a solution to this. I've been experimenting with multiple rsyncs in preparation for pulling the trigger on the mail server switch, but have a problem that I really want to fox before doing so. Apparently something causes Thunderbirds local message cache to get out of sync with dovecot after a sync. Here is the series of commands I'm running: 1. stop postfix, stop dovecot on new server 2. rsync -rltgovDHP --delete --exclude-from 'excludes.txt' /path/to/vmail/example.com/ /var/vmail/example.com/ 3. chown vmail:vmail /var/vmail 4. start dovecot, start postfix ls -al /var/vmail/example.com/user/cur shows all of the messages that should be there, and all perms are correct. Go to my account that is pointed to this mail server/account, and none of the new messages show up. Also, some messages are still showing up that shouldn't. I've tried compacting the folders, closing/relaunching Thunderbird, but nothing helps. The only way to get them to show up is to go to the local Thunderbird cache for the account, and delete the files associated with the folder having the problem. The problem is, ALL folders will have this problem, which means that everyone will need to delete ALL of their local cahced folders. This will be a major support problem. Anyone have any ideas? -- Best regards, */Charles/*

5 16

[Dovecot] Server Migration Attempt - new messages DELETED after secondary rsyncs
by Charles Marcus 27 Dec '13

27 Dec '13

Starting a new thread, as I've got a lot more details now... First, I know this may be (or is even likely) something weird happening with Thunderbird, but the bottom line is, I have to find a resolution or a workaround or something, or I will be unable to pull the trigger on the server migration. It is simply unacceptable to lose ANY mails doing this. Goal: migrate mailstore from old server to new server using rsync Thunderbird (24.2) is set up to access the new account for testing Problem: after rsync, ls shows new messages (11 for the 27th), but when Thunderbird accesses the maildir again after another rsync, MOST (but not all) of the new messages are deleted (only one for the 27th remains) Timo - I'd be happy to do anything necessary to track this down if you'll just tell me what you need... Note: if you are pretty confident that upgrading dovecot on the old server and using dsync to do the migration will solve the problem, obviously I'm willing to do that if there is no other choice, but... I hope you'll want to get to the bottom of this regardless, as, according to you and everything I've read, it should work without losing any emails... Ok, as to details... Source (ol/active server): dovecot 2.1.17, postfix virtual for delivery, vmail owned by postfix:postfix Note: using prefix=INBOX. courier compatibility namespace Target: dovecot 2.2.10, dovecot LDA, vmail owned by vmail:vmail, nothing being actively delivered (yet) Note: NOT using prefix=INBOX. courier compatiblity namespace Both doveconf -n outputs at end of this message *** Could the different namespaces, or differing dovecot versions cause this? Current /snapshot/ being used was taken at about 3:48am this morning rsync command (dovecot is STOPPED before performing, source is the latest snapshot of the active server): rsync -rltgovDHP --delete --delete-excluded --exclude-from '/path/to/excludes.txt' /snapshot/.../vmail/example.com/user/ /.../vmail/example.com/user/ I'm only syncing the one user until I get this problem resolved as it is faster. excludes.txt contains only (just to eliminate these which are still on the source): courierimap* Right after the rsync: ls -al /.../user (changes depending on what is in includes.txt) -rw------- 1 vmail vmail 51 Dec 18 10:13 dovecot-keywords -rw------- 1 vmail vmail 221638 Dec 27 02:42 dovecot-uidlist -rw------- 1 vmail vmail 8 Dec 18 09:56 dovecot-uidvalidity -r--r--r-- 1 vmail vmail 0 Jun 9 2012 dovecot-uidvalidity.4fd32805 ls -al /.../user/cur (copy/pasted newest thru 12/25 - this list is always the same after a sync) -rw------- 1 vmail vmail 24904 Dec 25 15:47 1388004452.Vfe02Ic72976M281736.oldhost.example.com:2, -rw------- 1 vmail vmail 5825360 Dec 25 22:52 1388029948.Vfe02Ic7306fM556006.oldhost.example.com:2, -rw------- 1 vmail vmail 27718 Dec 26 02:19 1388042391.Vfe02Ic33b40M543019.oldhost.example.com:2, -rw------- 1 vmail vmail 28083 Dec 26 07:11 1388059893.Vfe02Ic76388M193423.oldhost.example.com:2,S -rw------- 1 vmail vmail 100651 Dec 26 08:02 1388062961.Vfe02Ic763c2M415005.oldhost.example.com:2, -rw------- 1 vmail vmail 5286 Dec 26 09:41 1388068882.Vfe02Ic7642dM83715.oldhost.example.com:2,S -rw------- 1 vmail vmail 53203 Dec 26 09:55 1388069721.Vfe02Ic7646fM716189.oldhost.example.com:2,S -rw------- 1 vmail vmail 12039 Dec 26 12:48 1388080111.Vfe02Ic76742M972942.oldhost.example.com:2,RS -rw------- 1 vmail vmail 13531 Dec 26 13:14 1388081648.Vfe02Ic7674cM68343.oldhost.example.com:2,S -rw------- 1 vmail vmail 25161 Dec 26 15:47 1388090846.Vfe02Ic768acM489505.oldhost.example.com:2, -rw------- 1 vmail vmail 5037 Dec 26 16:27 1388093257.Vfe02Ic76918M766778.oldhost.example.com:2, -rw------- 1 vmail vmail 3157 Dec 26 17:01 1388095312.Vfe02Ic76997M703744.oldhost.example.com:2, -rw------- 1 vmail vmail 22480 Dec 26 17:50 1388098239.Vfe02Ic769deM225078.oldhost.example.com:2, -rw------- 1 vmail vmail 10043 Dec 26 19:59 1388105984.Vfe02Ic76a25M12505.oldhost.example.com:2, -rw------- 1 vmail vmail 10635 Dec 26 21:11 1388110298.Vfe02Ic76a65M649895.oldhost.example.com:2, -rw------- 1 vmail vmail 8695 Dec 26 21:11 1388110319.Vfe02Ic76a6fM696948.oldhost.example.com:2, -rw------- 1 vmail vmail 11045 Dec 26 21:56 1388112965.Vfe02Ic76a57M185504.oldhost.example.com:2, -rw------- 1 vmail vmail 823 Dec 26 22:40 1388115600.Vfe02Ib61cf5M913598.oldhost.example.com:2,ST -rw------- 1 vmail vmail 815 Dec 26 22:40 1388115627.Vfe02Ib63443M811945.oldhost.example.com:2,ST -rw------- 1 vmail vmail 785 Dec 26 22:40 1388115628.Vfe02Ib659c9M617314.oldhost.example.com:2,ST -rw------- 1 vmail vmail 6156 Dec 27 00:05 1388120705.Vfe02Ib7aa31M58188.oldhost.example.com:2,ST -rw------- 1 vmail vmail 869 Dec 27 00:05 1388120713.Vfe02Ib8506aM185504.oldhost.example.com:2,ST -rw------- 1 vmail vmail 925 Dec 27 00:29 1388122155.Vfe02Ibb2a1fM764275.oldhost.example.com:2,ST -rw------- 1 vmail vmail 823 Dec 27 00:38 1388122687.Vfe02Ic2f69aM168075.oldhost.example.com:2,ST -rw------- 1 vmail vmail 801 Dec 27 00:38 1388122696.Vfe02Ic31befM507147.oldhost.example.com:2,ST -rw------- 1 vmail vmail 801 Dec 27 00:38 1388122709.Vfe02Ic3ac2bM981625.oldhost.example.com:2,ST -rw------- 1 vmail vmail 4576 Dec 27 00:57 1388123820.Vfe02Ic769e8M270744.oldhost.example.com:2,ST -rw------- 1 vmail vmail 8379 Dec 27 01:33 1388126003.Vfe02Ib7fd87M510118.oldhost.example.com:2,ST -rw------- 1 vmail vmail 27647 Dec 27 02:20 1388128838.Vfe02Ic7610fM483481.oldhost.example.com:2, -rw------- 1 vmail vmail 6373 Dec 27 02:42 1388130144.Vfe02Ic76a99M631316.oldhost.example.com:2,ST -rw------- 1 vmail vmail 3906 Dec 27 03:01 1388131281.Vfe02Ic76a9cM599830.oldhost.example.com:2,ST Start dovecot, select INBOX in Thunderbird for this account, it only displays these (I got this ls output from AFTER the messages in the cur directory are deleted per below - before doing any of the 3 aqctions below, ALL of the messages show in the ls output): ls -al /.../user/cur -rw------- 1 vmail vmail 24904 Dec 25 15:47 1388004452.Vfe02Ic72976M281736.oldhost.example.com:2, -rw------- 1 vmail vmail 5825360 Dec 25 22:52 1388029948.Vfe02Ic7306fM556006.oldhost.example.com:2, -rw------- 1 vmail vmail 27718 Dec 26 02:19 1388042391.Vfe02Ic33b40M543019.oldhost.example.com:2, -rw------- 1 vmail vmail 28083 Dec 26 07:11 1388059893.Vfe02Ic76388M193423.oldhost.example.com:2,S -rw------- 1 vmail vmail 100651 Dec 26 08:02 1388062961.Vfe02Ic763c2M415005.oldhost.example.com:2, -rw------- 1 vmail vmail 5286 Dec 26 09:41 1388068882.Vfe02Ic7642dM83715.oldhost.example.com:2,S -rw------- 1 vmail vmail 53203 Dec 26 09:55 1388069721.Vfe02Ic7646fM716189.oldhost.example.com:2,S -rw------- 1 vmail vmail 12039 Dec 26 12:48 1388080111.Vfe02Ic76742M972942.oldhost.example.com:2,RS -rw------- 1 vmail vmail 13531 Dec 26 13:14 1388081648.Vfe02Ic7674cM68343.oldhost.example.com:2,S -rw------- 1 vmail vmail 25161 Dec 26 15:47 1388090846.Vfe02Ic768acM489505.oldhost.example.com:2, -rw------- 1 vmail vmail 5037 Dec 26 16:27 1388093257.Vfe02Ic76918M766778.oldhost.example.com:2, -rw------- 1 vmail vmail 3157 Dec 26 17:01 1388095312.Vfe02Ic76997M703744.oldhost.example.com:2, -rw------- 1 vmail vmail 22480 Dec 26 17:50 1388098239.Vfe02Ic769deM225078.oldhost.example.com:2, -rw------- 1 vmail vmail 10043 Dec 26 19:59 1388105984.Vfe02Ic76a25M12505.oldhost.example.com:2, -rw------- 1 vmail vmail 10635 Dec 26 21:11 1388110298.Vfe02Ic76a65M649895.oldhost.example.com:2, -rw------- 1 vmail vmail 8695 Dec 26 21:11 1388110319.Vfe02Ic76a6fM696948.oldhost.example.com:2, -rw------- 1 vmail vmail 11045 Dec 26 21:56 1388112965.Vfe02Ic76a57M185504.oldhost.example.com:2, -rw------- 1 vmail vmail 27647 Dec 27 02:20 1388128838.Vfe02Ic7610fM483481.oldhost.example.com:2, This is weird, because it does show ONE new message from the 27th. And again, ls -al on the cur dir at this point still shows ALL of the messages (11 for the 27th, and 18 for the 26th) shown in the FIRST ls output, ABOVE this second listing (which is shown only to show you what Thunderbird is seeing, and what shows in the ls output AFTER doing any of the 3 actions below). Now... Doing ANY of the following results in MOST (BUT NOT ALL) OF THE NEW MESSAGES BEING DELETED ON THE SERVER - ie, ls -al output changes to the match what is immediately above (what was showing in Thunderbird right after selecting the Inbox right after the rsync). 1. Right-click on the Inbox > Properties > Repair Folder (in Thunderbird) 2. Right-click on INBOX > Compact (in Thunderbird) 3. Manually deleting the .msf file for the INBOX Obviously, I must find a resolution for this before I can pull the trigger on this migration. ************************************************************************ old server dovecon -n: oldhost : Fri Dec 27, 05:59:12 : ~ # doveconf -n # 2.1.17: /etc/dovecot/dovecot.conf # OS: Linux 3.10.7-gentoo-r1 x86_64 Gentoo Base System release 2.2 auth_default_realm = example.com auth_mechanisms = plain login first_valid_uid = 207 last_valid_uid = 207 listen = * login_log_format_elements = user=<%u> method=%m rip=%r lport=%{lport} mpid=%e %c session=<%{session}> mail_gid = 207 mail_location = maildir:~/:INDEX=MEMORY mail_uid = 207 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = INBOX. separator = . } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap lmtp service auth-worker { user = $default_internal_user } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = postfix mode = 0600 user = postfix } } service imap-login { service_count = 0 } service imap { process_limit = 2048 } ssl = required ssl_cert = </etc/ssl/myCerts/imap.pem ssl_key = </etc/ssl/myCerts/imap_key.pem userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol smtp { auth_verbose = yes } protocol lda { mail_plugins = sieve } protocol imap { mail_max_userip_connections = 20 } oldhost : Fri Dec 27, 08:22:04 : ~ ********************************************************** new server dovecot -n: host : Fri Dec 27, 08:13:34 : ~ # doveconf -n # 2.2.10: /etc/dovecot/dovecot.conf # OS: Linux 3.10.17-gentoo x86_64 Gentoo Base System release 2.2 auth_default_realm = example.com auth_mechanisms = plain login first_valid_uid = 200 last_valid_uid = 200 listen = * login_log_format_elements = user=<%u> method=%m %c rip=%r lport=%{lport} mail_gid = vmail mail_location = maildir:~ mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = . } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap lmtp service auth-worker { user = $default_internal_user } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0600 user = vmail } } service imap-login { service_count = 0 } service imap { process_limit = 2048 } ssl = required ssl_cert = </etc/ssl/myCerts/imap.pem ssl_key = </etc/ssl/myCerts/imap_key.pem userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol smtp { auth_verbose = yes } protocol lda { auth_verbose = yes mail_plugins = sieve } protocol imap { mail_max_userip_connections = 20 } host : Fri Dec 27, 08:19:59 : ~ -- Best regards, */Charles/*

3 4

[Dovecot] v2.2.10 released
by Timo Sirainen 27 Dec '13

27 Dec '13

http://dovecot.org/releases/2.2/dovecot-2.2.10.tar.gz http://dovecot.org/releases/2.2/dovecot-2.2.10.tar.gz.sig I've been really busy the last few months, as I guess people in Dovecot mailing list have seen since I haven't been very responsive. There are at least some dsync bugs I haven't had time to look into yet. The busyness probably continues for a while more, but the next year is looking much better for me and for Dovecot in general. We're planning to hire a few more Dovecot coders at some point, so if you're interested send me an email. :) + auth: passdb/userdb dict rewrite to support much more complex setups. See doc/example-config/dovecot-dict-auth.conf.ext. The old settings will continue to work. + auth: Added userdb result_success/failure/tempfail and skip settings, similar to passdb's. See http://wiki2.dovecot.org/UserDatabase + imap: Implemented SETQUOTA command for admin user when quota_set is configured. See http://master.wiki2.dovecot.org/Quota/Configuration + quota: Support "*" and "?" wildcards in mailbox names in quota_rules + mysql: Added ssl_verify_server_cert=no|yes parameter. This currently defaults to "no" to make sure nothing breaks, but likely will become "yes" in Dovecot v2.3. + ldap: Added blocking=yes setting to use auth worker processes for ldap lookups. This is a workaround for now to be able to use multiple simultaneous LDAP connections. + pop3c+dsync performance improvements - quota-status: quota_grace was ignored - ldap: Fixed memory leak with auth_bind=yes and without auth_bind_userdn. - imap: Don't send HIGHESTMODSEQ anymore on SELECT/EXAMINE when CONDSTORE/QRESYNC has never before been enabled for the mailbox. - imap: Fixes to handling mailboxes without permanent modseqs. (When [NOMODSEQ] is returned by SELECT, mainly with in-memory indexes.) - imap: Various fixes to METADATA support. - stats plugin: Processes that only temporarily dropped privileges (e.g. indexer-worker) may have been logging errors about not being able to open /proc/self/io.

3 2