- dovecot - dovecot.org

Re: "Corrupted dbox file [...] purging found mismatched offsets"
by Jesus Cea 29 Jul '14

29 Jul '14

On 29/07/14 01:21, Daniel Parthey wrote: > Are you using dovecot director and a shared filesystem like NFS? > > You not only need to run imap and pop3 service via director, > but also the doveadm service, otherwise different hosts might > access the mdbox simultaneously, which will corrupt your index > files and you will lose flags. No, this is a dovecot server running in my own laptop. I guess some computer crash left the mail in an inconsistent state, and I need to assert the extend of the problem. A well designed system should not lose email, even when crashes are involved. -- Jesús Cea Avión _/_/ _/_/_/ _/_/_/ jcea(a)jcea.es - http://www.jcea.es/ _/_/ _/_/ _/_/ _/_/ _/_/ Twitter: @jcea _/_/ _/_/ _/_/_/_/_/ jabber / xmpp:jcea@jabber.org _/_/ _/_/ _/_/ _/_/ _/_/ "Things are not so easy" _/_/ _/_/ _/_/ _/_/ _/_/ _/_/ "My name is Dump, Core Dump" _/_/_/ _/_/_/ _/_/ _/_/ "El amor es poner tu felicidad en la felicidad de otro" - Leibniz

1 0

Segfault dovecot 2.2.9
by Simon Gareste 29 Jul '14

29 Jul '14

Hi all, When trying to set up dovecot, I somehow managed to get a segfault. Trying to launch dovecot from command line (simply execute 'dovecot') results in the error message: Segmentation fault (core dumped) Trying dovecot -n results in pretty much the same: # 2.2.9: /etc/dovecot/dovecot.conf Segmentation fault (core dumped) Looking at syslog, I see doveconf[3676]: segfault at 200 ip 00007fbb93c4fcb3 sp 00007fff005b4c10 error 4 in libc-2.19.so[7fbb93c04000+1bc000] I tried but couldn't find the core dump anywhere on the server. Any help on this would be appreciated too. I (trying to ) run it with postfix, on an Ubuntu 14.04 (Linux mail2.arturia.com 3.13.0-32-generic #57-Ubuntu SMP Tue Jul 15 03:51:08 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux), brand new server. What troubles me even more is that I just set up successfully another mail server a week ago, with the same configuration (diffing the conf folders) except for log or mailbox paths (driver and stuff are the same). In the google search I've done, I saw some stuff about openssl: both servers are running 1.0.1f, since one is running fine, I guess this is not the culprit. One difference I noticed between the two servers is that on the failing one, there is no /var/run/dovecot. I presume this folder and its files are created once dovecot is launched, so that's why it's not present, and is only a symptom of the failure, not a cause? Thanks for your help, and please tell me what other information I could provide to help. Simon

3 5

Multiple passwords with sql authentication
by BlackVoid 29 Jul '14

29 Jul '14

I'm currently working on a control panel which is using postfix, dovecot and other applications and I want to add application specific passwords to increase security. I found one solution [1], however it requires the password to be included in the query which is something I do not want to do, because the query may be written in clear-text to log-files. So I'm wondering if there is a way to have multiple passwords with dovecot without risking passwords being leakied in clear-text to log-files. [1] http://wiki2.dovecot.org/AuthDatabase/SQL#Password_verification_by_SQL_serv…

4 11

doveadm json formatter
by James Devine 29 Jul '14

29 Jul '14

Any thoughts to adding a json formatter to the doveadm output?

1 0

Migration from mbox/maildir++ to mdbox
by Nima Saed-Samii 28 Jul '14

28 Jul '14

Dear list, dovecot version: 2.1.7 I have an old mail server that uses mboxes for the INBOX and maildirs for subfolders. I want to migrate our mail handling to a new setup using mdboxes for everything. The current config looks like this: # 2.1.7: /etc/dovecot/dovecot.conf doveconf: Warning: service anvil { client_limit=1000 } is lower than required under max. load (1127) # OS: Linux 3.2.0-0.bpo.4-686-pae i686 Debian 6.0.10 auth_mechanisms = plain login disable_plaintext_auth = no first_valid_uid = 114 log_path = /var/log/dovecot.log log_timestamp = "%Y-%m-%d %H:%M:%S " mail_location = mbox:~/Mail/MBox:INBOX=/var/mail/%u mail_max_userip_connections = 30 mail_privileged_group = mail namespace { hidden = yes inbox = yes list = no location = prefix = "#mbox/" separator = / } namespace { location = maildir:~/Mail/Maildir prefix = separator = / } passdb { args = dovecot driver = pam } protocols = imap service auth { client_limit = 1024 user = root } service imap-login { inet_listener imap { port = 0 } process_limit = 1024 } ssl_cert = </etc/ssl/certs/cert-imap.ikp.pem ssl_key = </etc/ssl/private/key-imap.ikp.pem ssl_key_password = ********* userdb { driver = passwd } I would like to use dsync to migrate all to mdboxes and transfer them to the new system. Unfortunately I can't get dsync to do that. Using a config that specifies only one namespace allows me to convert either mboxes or Maildirs to mdboxes but not both. Using the above config dsync somehow thinks the source and destination are the same: Syncing mailbox for user nima (136 MB) Setup done. doveadm(root): Debug: Loading modules from directory: /usr/lib/dovecot/modules doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/lib20_zlib_plugin.so doveadm(root): Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_zlib_plugin.so doveadm(nima): Debug: Effective uid=5224, gid=1162, home=/home/nima doveadm(nima): Debug: Namespace mboxes: type=private, prefix=#mbox/, sep=/, inbox=yes, hidden=no, \ list=yes, subscriptions=yes location=mbox:~/Mail/MBox:INBOX=/var/mail/nima doveadm(nima): Debug: fs: root=/home/nima/Mail/MBox, index=, control=, inbox=/var/mail/nima, alt= doveadm(nima): Debug: Namespace maildirs: type=private, prefix=, sep=/, inbox=no, hidden=no, list=yes, \ subscriptions=yes location=maildir:~/Mail/Maildir doveadm(nima): Debug: maildir++: root=/home/nima/Mail/Maildir, index=, control=, inbox=, alt= dsync(nima): Debug: Effective uid=5224, gid=1162, home=/home/nima dsync(nima): Debug: Namespace mboxes: type=private, prefix=#mbox/, sep=/, inbox=yes, hidden=no, list=yes, \ subscriptions=yes location=mdbox:/scratch/mail-convert/nima dsync(nima): Debug: fs: root=/scratch/mail-convert/nima, index=, control=, inbox=, alt= dsync(nima): Debug: Namespace #mbox/: Using permissions from /scratch/mail-convert/nima: mode=0700 gid=-1 dsync(nima): Debug: Namespace maildirs: type=private, prefix=, sep=/, inbox=no, hidden=no, list=yes, \ subscriptions=yes location=maildir:~/Mail/Maildir dsync(nima): Debug: maildir++: root=/home/nima/Mail/Maildir, index=, control=, inbox=, alt= dsync(nima): Fatal: Both source and destination mail_location points to same directory: /home/nima/Mail/Maildir What am I doing wrong? Best regards, Nima Saed-Samii -- Institute for Nuclear Physics, University of Cologne Zuelpicher Str. 77 50937 Cologne Germany Tel.: +49-221-470-3617 Fax.: +49-221-470-5168 -- Institute for Nuclear Physics, University of Cologne Zuelpicher Str. 77 50937 Cologne Germany Tel.: +49-221-470-3617 Fax.: +49-221-470-5168

1 0

ACLs on Top level mailboxes.
by Dan Carroll 28 Jul '14

28 Jul '14

Hello, I’m in the process of migrating a mail server to new hardware. At the same time, I’ve made the decision to switch from courier to dovecot (v2.2.13) and from what I have seen so far I’m pretty happy. I have two questions for the list. I’d like my users mailboxes (Maildir format) to look like this: Inbox UserCreatedSubFolder1 UserCreatedSubFolder2 … Sent UserCreatedSubFolder3 Drafts Trash Junk Archives The Top level folders (Sent, Drafts etc) are all “Special” and I do not wish the users to be able to delete them. I also don’t want them to create new Top level folders. This will force all custom folders to be under a Top Level folder. The Maildir format currently looks like this: ~/Maildir/cur ~/Maildir/new ~/Maildir/tmp ~/Maildir/.INBOX/.UserCreatedSubFolder1/cur ~/Maildir/.INBOX/.UserCreatedSubFolder1/new ~/Maildir/.INBOX/.UserCreatedSubFolder1/tmp ~/Maildir/.Sent/cur ~/Maildir/.Sent/new ~/Maildir/.Sent/tmp etc…. I can get ACLs working with dovecot-acl files, and the permission I need (I think is) “owner lrwstipe”. But if I put it into the ~/Maildir directory, then it applies to Inbox. I’ve tried creating an .INBOX dir and putting it in there but that did not work. I also tried some global-acl file settings but I could not make that work either. Basically, I’m wondering how to apply ACLs to the Top level and have different ACLs for the actual inbox when using this scheme. I’m not opposed to changing the Maildir format, but that would mean a lot of work re-doing proemial scripts. My second question relates to migration. Is it enough that I copy the Maildir structure and simply delete the courier files or is it a lot better to use a courier->dovecot migration tool? I realise folder subscriptions would be lost but that’s OK, I’ll recreate them manually anyway. Thanks for your time. -Dan

2 1

After upgrade from 2.1 to 2.2.13 clients can create folders with names containing slash character on a Linux system
by David Davidov 28 Jul '14

28 Jul '14

We have following issue: After upgrade from 2.1 to 2.2.13 clients can create folders with names containing slash character. This was not possible with our previous version 2.1. Tested. Our Dovecot runs on Debian Wheezy system. According http://wiki2.dovecot.org/Plugins/Listescape this should be disabled on a Posix system. We use the usual separator '.' as you can see in the config file later. Issue can be reproduced using outlook 2013. On the file system this is the representation of the "Family/Friends" folder /home/vpopmail/domains/0/example.org/steve/Maildir/.Family/Friends /home/vpopmail/domains/0/example.org/steve/Maildir/.Family/Friends/new /home/vpopmail/domains/0/example.org/steve/Maildir/.Family/Friends/tmp /home/vpopmail/domains/0/example.org/steve/Maildir/.Family/Friends/cur Doveadm does not lists properly the folder doveadm mailbox list -usteve(a)alltimes.com |grep -i Family INBOX.Family This is the server configuration: ----------------------- dovecot -n # 2.2.13: /dovecot/etc/dovecot/dovecot.conf # OS: Linux 3.2.59-grsec x86_64 Debian 7.6 auth_username_chars = "abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890@!#$&\'*+=?^_`{|}~.-" base_dir = /var/run/dovecot/ disable_plaintext_auth = no listen = * login_log_format_elements = user=<%u> method=%m rip=%r lip=%l pid=%p %c mail_access_groups = vchkpw mail_fsync = never mail_plugins = quota stats namespace { inbox = yes location = maildir:~/Maildir:INDEX=/home/vpopmail/dovecot-indexes/%d/%n prefix = INBOX. separator = . type = private } passdb { args = /home/vpopmail/bin/chkpw driver = checkpassword } plugin { acl = vfile:/dovecot/acls quota = maildir quota_rule = INBOX.Trash:ignore stats_command_min_time = 1 mins stats_domain_min_time = 12 hours stats_ip_min_time = 12 hours stats_memory_limit = 64 M stats_refresh = 30 secs stats_session_min_time = 15 mins stats_track_cmds = yes stats_user_min_time = 1 hours } protocols = imap pop3 service imap-login { executable = /dovecot/libexec/dovecot/imap-login inet_listener imap { address = * port = 143 } inet_listener imaps { address = * port = 993 } process_min_avail = 16 service_count = 0 } service imap { executable = /dovecot/libexec/dovecot/imap-ld-hack process_limit = 1500 vsz_limit = 256 M } service pop3-login { process_min_avail = 16 service_count = 0 } service pop3 { executable = /dovecot/libexec/dovecot/pop3-ld-hack process_limit = 1500 vsz_limit = 256 M } service stats { fifo_listener stats-mail { mode = 0600 user = vpopmail } } ssl_ca = </apache/conf/ssl.crt/server-ca.crt ssl_cert = </apache/conf/ssl.crt/server.crt ssl_cipher_list = ALL:-ADH:+HIGH:+MEDIUM:-LOW:-SSLv2:-EXP ssl_key = </apache/conf/ssl.key/server.key userdb { driver = vpopmail } userdb { driver = prefetch } protocol imap { imap_client_workarounds = mail_max_userip_connections = 100 mail_plugins = quota stats acl imap_quota imap_stats } protocol pop3 { mail_max_userip_connections = 100 mail_plugins = quota stats acl pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_enable_last = yes pop3_no_flag_updates = yes pop3_uidl_format = %f } ----------------------- We need a way to prevent creation of those folders, because our users create several of them a day. Any suggestions? regards, David Davidov

2 1

[pigeonhole] disregards --with-ldap=no during compilation
by Michael Grimm 28 Jul '14

28 Jul '14

Hi -- I can't get current dovecot and pigeonhole compiled; compilation stops with: | sieve-ldap-db.h:19:10: fatal error: 'ldap.h' file not found Ok, because my dovecot isn't compiled with ldap (--without-ldap), I tried to apply "--with-ldap=no" with configure as advertised in the INSTALL file of pigeonhole, but without success: [...] | ./sieve-ldap-db.h:19:10: fatal error: 'ldap.h' file not found | #include <ldap.h> | ^ | 1 error generated. | gmake[5]: *** [sieve-ldap-db.lo] Error 1 | gmake[5]: Leaving directory `/usr/local/etc/dovecot/SOURCE/dovecot-2.2-pigeonhole/src/lib-sieve/storage/ldap' [...] | gmake: *** [all] Error 2 My configure run logfile shows: [...] | config.status: creating src/lib-sieve/storage/ldap/Makefile [...] | script drivers . : file dict | : -ldap This happens at FreeBSD-STABLE (clang 3.4.1, gmake 3.82) with dovecot at 2d2d75ac6715 and pigeonhole at 1475892e8cff. Any ideas what went wrong? (I'm back to pigeonhole 0.4.3 (1c6130ff5dd6) for the time being.) Thanks and regards, Michael

4 6

Fwd: Disconnected (no auth attempts)
by Michael Pierce 28 Jul '14

28 Jul '14

Hi, Firstly, I'd like to apologise if this is really simple or the answers available easily. I have searched and tried to solve this alone but with no success. I'm having an issue with dovecot to which its reporting "Disconnected (no auth attempts)" in the info log file. From what I understand this is usually due to SSL not being enabled (however, ssl = required is in the config). I hope someone can help. I have included config file, and log file information below. Please and Thanks, Michael Pierce ps, apologies if I was supposed to pastebin these, I was not sure. *dovecot -n* # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux 3.10.9-xxxx-grs-ipv6-64 x86_64 CentOS release 6.5 (Final) auth_debug_passwords = yes base_dir = /var/run/dovecot/ disable_plaintext_auth = no first_valid_uid = 200 info_log_path = /var/log/dovecot-info.log log_path = /var/log/dovecot.log mail_gid = 12 mail_uid = 200 passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } protocols = imap ssl = required ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } *dovecot-sql.conf* driver = mysql connect = host=/var/run/mysqld/mysqld.sock dbname=mailreader_mail user=[removed] password=[removed] default_pass_scheme = SHA512 password_query = SELECT email as user, password, 'maildir:/home/mail'||maildir as userdb_mail FROM users WHERE email = '%u' dovecot-info.conf Jul 28 10:58:50 master: Info: Dovecot v2.0.9 starting up (core dumps disabled) Jul 28 10:58:59 auth: Debug: Loading modules from directory: /usr/lib64/dovecot/auth Jul 28 10:58:59 auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libauthdb_ldap.so Jul 28 10:58:59 auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_mysql.so Jul 28 10:58:59 auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_sqlite.so Jul 28 10:58:59 auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libmech_gssapi.so Jul 28 10:58:59 auth: Debug: auth client connected (pid=22493) Jul 28 10:59:00 imap-login: Info: Disconnected (no auth attempts): rip=[removed], lip=[removed]

2 1

"Corrupted dbox file [...] purging found mismatched offsets"
by Jesus Cea 28 Jul '14

28 Jul '14

Doing a "doveadm purge" today I got this: """ doveadm(jcea): Error: Corrupted dbox file /home/jcea/.thunderbird/dovecot/storage/m.686 (around offset=1385772): purging found mismatched offsets (1385742 vs 1380664, 185/275) doveadm(jcea): Warning: fscking index file /home/jcea/.thunderbird/dovecot/storage/dovecot.map.index doveadm(jcea): Warning: mdbox /home/jcea/.thunderbird/dovecot/storage: rebuilding indexes doveadm(jcea): Error: Purging namespace '' failed: Internal error occurred. Refer to server log for more information. [2014-07-28 01:17:10] """ Checking the log I get this: """ Jul 28 01:17:18 ubuntu dovecot: imap(jcea): Error: /home/jcea//.thunderbird/dovecot/mailboxes/proveedores/dovecot/DbOx-mAiLs/dovecot.index reset, view is now inconsistent Jul 28 01:17:19 ubuntu dovecot: imap(jcea): Error: /home/jcea//.thunderbird/dovecot/mailboxes/varios/OpenStreetMap/osm-newbies/DbOx-mAiLs/dovecot.index reset, view is now inconsistent Jul 28 01:17:20 ubuntu dovecot: imap(jcea): Error: /home/jcea//.thunderbird/dovecot/mailboxes/varios/esc&AOk-pticos/DbOx-mAiLs/dovecot.index reset, view is now inconsistent """ Subsequent "doveadm purge" don't show anything. What happened and why?. Consequences?. Did I lose email? -- Jesús Cea Avión _/_/ _/_/_/ _/_/_/ jcea(a)jcea.es - http://www.jcea.es/ _/_/ _/_/ _/_/ _/_/ _/_/ Twitter: @jcea _/_/ _/_/ _/_/_/_/_/ jabber / xmpp:jcea@jabber.org _/_/ _/_/ _/_/ _/_/ _/_/ "Things are not so easy" _/_/ _/_/ _/_/ _/_/ _/_/ _/_/ "My name is Dump, Core Dump" _/_/_/ _/_/_/ _/_/ _/_/ "El amor es poner tu felicidad en la felicidad de otro" - Leibniz

1 1