- dovecot - dovecot.org

Getting duplicated mails while using imapc and dsync
by Michael 17 Jul '15

17 Jul '15

Hello list, currently I'm migrating our old mailserver to a new mail architecture that is based on a master-master dovecot setup (two machines). The replication actually works but I'm also syncing our mails from the current mailserver via imapc on a regular schedule. For some reason I've in most (but not all) imapc-synced mailboxes duplicated emails that I also can't deduplicate with doveadm. I've also set up test-mailboxes that I don't sync with imapc and in those I don't have any duplicated mails. My command to sync the mails from the old host to the master-master system looks as follows: doveadm -o imapc_user=$i*dovemig -o imapc_password=<password> -o imapc_host=<oldhost> -o imapc_features="rfc822.size fetch-headers" -o mail_prefetch_count=20 -v -D sync -R -u$EMAIL imapc: &> $LOGS/$i.log So, is this actually the wrong approach to sync mails from the old host to the new one or is it just not recommended to sync them over-and-over again in such a setup via imapc or is it better to sync them only once? Any hint/pointing me to the right solution is greatly appreciated. Michael

1 0

Dovecot-EE repository for Debian 8 (Jessie/stable)
by Bernhard Schmidt 17 Jul '15

17 Jul '15

Hi, are there plans to support Debian 8 (alias stable, alias jessie) in the dovecot-ee repository? Currently there are only squeeze and wheezy repos. The wheezy repo is uninstallable due to an unsatisfyable dependency on libicu48. Of course you can install libicu48 from Wheezy on a Jessie system, but this will break security updates and might not be the best idea for a library like that. Bernhard

1 0

migrate via dsync error Panic: file mail-transaction-log.c: line 271 (mail_transaction_log_rotate): assertion failed: (file->locked)
by wuwei 17 Jul '15

17 Jul '15

hi all when I use dsync migrate users from dovecot2.0.14(maildir Solaris10) to dovecot2.2.15(mdbox debian7) , most of the users migrated well, only one user has a error. migrate cmd: "$dovecotHome"bin/doveadm -Dv -o mail_fsync=never -o imapc_host=$ip backup -R -u $user imapc: dovecot2.2.15 log: doveadm(root): Debug: Loading modules from directory: /home/mail/dovecot/lib/dovecot doveadm(root): Debug: Module loaded: /home/mail/dovecot/lib/dovecot/lib10_quota_plugin.so doveadm(root): Debug: Module loaded: /home/mail/dovecot/lib/dovecot/lib15_notify_plugin.so doveadm(root): Debug: Module loaded: /home/mail/dovecot/lib/dovecot/lib20_fts_plugin.so doveadm(root): Debug: Module loaded: /home/mail/dovecot/lib/dovecot/lib20_mail_log_plugin.so doveadm(root): Debug: Module loaded: /home/mail/dovecot/lib/dovecot/lib20_zlib_plugin.so doveadm(root): Debug: Module loaded: /home/mail/dovecot/lib/dovecot/lib21_fts_lucene_plugin.so doveadm(root): Debug: Loading modules from directory: /home/mail/dovecot/lib/dovecot/doveadm doveadm(root): Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /home/mail/dovecot/lib/dovecot/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /home/mail/dovecot/lib/dovecot/doveadm/lib10_doveadm_expire_plugin.so: undefined s ymbol: expire_set_deinit (this is usually intentional, so just ignore this message) doveadm(root): Debug: Module loaded: /home/mail/dovecot/lib/dovecot/doveadm/lib10_doveadm_quota_plugin.so doveadm(root): Debug: Module loaded: /home/mail/dovecot/lib/dovecot/doveadm/lib10_doveadm_sieve_plugin.so doveadm(root): Debug: Module loaded: /home/mail/dovecot/lib/dovecot/doveadm/lib20_doveadm_fts_lucene_plugin.so doveadm(root): Debug: Module loaded: /home/mail/dovecot/lib/dovecot/doveadm/lib20_doveadm_fts_plugin.so doveadm(chenwenguang(a)eachnet.com): Debug: auth input: chenwenguang(a)eachnet.com home=/data/02/eachnet.com/281/721/chenwenguang@eachnet.com uid=1010 gid=1010 mail=mdbox:/ data/02/eachnet.com/281/721/chenwenguang@eachnet.com quota_rule=*:storage=1024MB sieve_dir=/data/02/eachnet.com/281/721/chenwenguang@eachnet.com sieve=/data/02/eachnet. com/281/721/chenwenguang(a)eachnet.com/dovecot.sieve doveadm(chenwenguang(a)eachnet.com): Debug: Added userdb setting: mail=mdbox:/data/02/eachnet.com/281/721/chenwenguang@eachnet.com doveadm(chenwenguang(a)eachnet.com): Debug: Added userdb setting: plugin/quota_rule=*:storage=1024MB doveadm(chenwenguang(a)eachnet.com): Debug: Added userdb setting: plugin/sieve=/data/02/eachnet.com/281/721/chenwenguang@eachnet.com/dovecot.… doveadm(chenwenguang(a)eachnet.com): Debug: Added userdb setting: plugin/sieve_dir=/data/02/eachnet.com/281/721/chenwenguang@eachnet.com doveadm(chenwenguang(a)eachnet.com): Debug: Effective uid=1010, gid=1010, home=/data/02/eachnet.com/281/721/chenwenguang@eachnet.com doveadm(chenwenguang(a)eachnet.com): Debug: Quota root: name=chenwenguang(a)eachnet.com backend=dict args=:redis:host=172.24.202.60:prefix=user_quota/ doveadm(chenwenguang(a)eachnet.com): Debug: Quota rule: root=chenwenguang(a)eachnet.com mailbox=* bytes=1073741824 messages=0 doveadm(chenwenguang(a)eachnet.com): Debug: Quota rule: root=chenwenguang(a)eachnet.com mailbox=Trash bytes=+858993459 (80%) messages=0 doveadm(chenwenguang(a)eachnet.com): Debug: Quota warning: bytes=966367641 (90%) messages=0 reverse=no command=quota-warning 90 chenwenguang(a)eachnet.com doveadm(chenwenguang(a)eachnet.com): Debug: Quota warning: bytes=858993459 (80%) messages=0 reverse=no command=quota-warning 80 chenwenguang(a)eachnet.com doveadm(chenwenguang(a)eachnet.com): Debug: Quota warning: bytes=751619276 (70%) messages=0 reverse=no command=quota-warning 70 chenwenguang(a)eachnet.com doveadm(chenwenguang(a)eachnet.com): Debug: Quota warning: bytes=644245094 (60%) messages=0 reverse=no command=quota-warning 60 chenwenguang(a)eachnet.com doveadm(chenwenguang(a)eachnet.com): Debug: Quota grace: root=chenwenguang(a)eachnet.com bytes=107374182 (10%) doveadm(chenwenguang(a)eachnet.com): Debug: dict quota: user=chenwenguang(a)eachnet.com, uri=redis:host=172.24.202.60:prefix=user_quota/, noenforcing=0 doveadm(chenwenguang(a)eachnet.com): Debug: Namespace inbox: type=private, prefix=, sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=mdbox:/data/02/eachn et.com/281/721/chenwenguang@eachnet.com doveadm(chenwenguang(a)eachnet.com): Debug: fs: root=/data/02/eachnet.com/281/721/chenwenguang@eachnet.com, index=, indexpvt=, control=, inbox=, alt= doveadm(chenwenguang(a)eachnet.com): Debug: Namespace : Using permissions from /data/02/eachnet.com/281/721/chenwenguang(a)eachnet.com: mode=0700 gid=default dsync(chenwenguang(a)eachnet.com): Debug: Effective uid=1010, gid=1010, home=/data/02/eachnet.com/281/721/chenwenguang@eachnet.com dsync(chenwenguang(a)eachnet.com): Debug: Quota root: name=chenwenguang(a)eachnet.com backend=dict args=:redis:host=172.24.202.60:prefix=user_quota/ dsync(chenwenguang(a)eachnet.com): Debug: Quota rule: root=chenwenguang(a)eachnet.com mailbox=* bytes=1073741824 messages=0 dsync(chenwenguang(a)eachnet.com): Debug: Quota rule: root=chenwenguang(a)eachnet.com mailbox=Trash bytes=+858993459 (80%) messages=0 dsync(chenwenguang(a)eachnet.com): Debug: Quota warning: bytes=966367641 (90%) messages=0 reverse=no command=quota-warning 90 chenwenguang(a)eachnet.com dsync(chenwenguang(a)eachnet.com): Debug: Quota warning: bytes=858993459 (80%) messages=0 reverse=no command=quota-warning 80 chenwenguang(a)eachnet.com dsync(chenwenguang(a)eachnet.com): Debug: Quota warning: bytes=751619276 (70%) messages=0 reverse=no command=quota-warning 70 chenwenguang(a)eachnet.com dsync(chenwenguang(a)eachnet.com): Debug: Quota warning: bytes=644245094 (60%) messages=0 reverse=no command=quota-warning 60 chenwenguang(a)eachnet.com dsync(chenwenguang(a)eachnet.com): Debug: Quota grace: root=chenwenguang(a)eachnet.com bytes=107374182 (10%) dsync(chenwenguang(a)eachnet.com): Debug: dict quota: user=chenwenguang(a)eachnet.com, uri=redis:host=172.24.202.60:prefix=user_quota/, noenforcing=0 dsync(chenwenguang(a)eachnet.com): Debug: Namespace inbox: type=private, prefix=, sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=imapc: dsync(chenwenguang(a)eachnet.com): Debug: imapc(172.24.202.201:143): Looking up IP address dsync(chenwenguang(a)eachnet.com): Debug: imapc(172.24.202.201:143): Connecting to 172.24.202.201:143 dsync(chenwenguang(a)eachnet.com): Debug: imapc(172.24.202.201:143): Server capabilities: IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN AUTH=LOGIN dsync(chenwenguang(a)eachnet.com): Debug: imapc(172.24.202.201:143): Authenticating as chenwenguang(a)eachnet.com dsync(chenwenguang(a)eachnet.com): Debug: imapc(172.24.202.201:143): Server capabilities: IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THRE AD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST -STATUS QUOTA dsync(chenwenguang(a)eachnet.com): Debug: imapc(172.24.202.201:143): Authenticated successfully dsync(chenwenguang(a)eachnet.com): Debug: imapc: root=, index=, indexpvt=, control=, inbox=, alt= dsync(chenwenguang(a)eachnet.com): Debug: fts: Indexes disabled for namespace '' dsync(chenwenguang(a)eachnet.com): Debug: brain M: Local mailbox tree: Drafts guid=e0187b65e763143666d22094cedfe6a4 uid_validity=1279693072 uid_next=1 subs=no last_change =0 last_subs=0 dsync(chenwenguang(a)eachnet.com): Debug: brain S: Local mailbox tree: INBOX guid=c92f64f79f0d1ed01e6d5b314f04886c uid_validity=1279693068 uid_next=134807 subs=no last_ch ange=0 last_subs=0 dsync(chenwenguang(a)eachnet.com): Debug: brain M: Local mailbox tree: Trash guid=7f5af7ba291b2df1a11d573bdb55d7e9 uid_validity=1279693071 uid_next=1 subs=no last_change= 0 last_subs=0 dsync(chenwenguang(a)eachnet.com): Debug: brain S: Local mailbox tree: Drafts guid=e0187b65e763143666d22094cedfe6a4 uid_validity=1279693072 uid_next=1 subs=no last_change =0 last_subs=0 dsync(chenwenguang(a)eachnet.com): Debug: brain M: Local mailbox tree: Sent Items guid=34b8141947b9372e94589bd35a54dac5 uid_validity=1279693070 uid_next=1 subs=no last_ch ange=0 last_subs=0 dsync(chenwenguang(a)eachnet.com): Debug: brain S: Local mailbox tree: Trash guid=7f5af7ba291b2df1a11d573bdb55d7e9 uid_validity=1279693071 uid_next=1 subs=no last_change= 0 last_subs=0 dsync(chenwenguang(a)eachnet.com): Debug: brain M: Local mailbox tree: INBOX guid=c92f64f79f0d1ed01e6d5b314f04886c uid_validity=1279693068 uid_next=1 subs=no last_change= 0 last_subs=0 dsync(chenwenguang(a)eachnet.com): Debug: brain S: Local mailbox tree: Sent Items guid=34b8141947b9372e94589bd35a54dac5 uid_validity=1279693070 uid_next=1 subs=no last_ch ange=0 last_subs=0 dsync(chenwenguang(a)eachnet.com): Debug: brain M: Local mailbox tree: Junk E-mail guid=9e1a7b3d0b113405571152c94fcf1154 uid_validity=1279693069 uid_next=1 subs=no last_c hange=0 last_subs=0 dsync(chenwenguang(a)eachnet.com): Debug: brain S: Local mailbox tree: Junk E-mail guid=9e1a7b3d0b113405571152c94fcf1154 uid_validity=1279693069 uid_next=1 subs=no last_c hange=0 last_subs=0 dsync(chenwenguang(a)eachnet.com): Debug: brain M: Remote mailbox tree: INBOX guid=c92f64f79f0d1ed01e6d5b314f04886c uid_validity=1279693068 uid_next=134807 subs=no last_c hange=0 last_subs=0 dsync(chenwenguang(a)eachnet.com): Debug: brain M: Remote mailbox tree: Drafts guid=e0187b65e763143666d22094cedfe6a4 uid_validity=1279693072 uid_next=1 subs=no last_chang e=0 last_subs=0 dsync(chenwenguang(a)eachnet.com): Debug: brain M: Remote mailbox tree: Trash guid=7f5af7ba291b2df1a11d573bdb55d7e9 uid_validity=1279693071 uid_next=1 subs=no last_change =0 last_subs=0 dsync(chenwenguang(a)eachnet.com): Debug: brain M: Remote mailbox tree: Sent Items guid=34b8141947b9372e94589bd35a54dac5 uid_validity=1279693070 uid_next=1 subs=no last_c hange=0 last_subs=0 dsync(chenwenguang(a)eachnet.com): Debug: brain M: Remote mailbox tree: Junk E-mail guid=9e1a7b3d0b113405571152c94fcf1154 uid_validity=1279693069 uid_next=1 subs=no last_ change=0 last_subs=0 dsync(chenwenguang(a)eachnet.com): Debug: brain S: Remote mailbox tree: Drafts guid=e0187b65e763143666d22094cedfe6a4 uid_validity=1279693072 uid_next=1 subs=no last_chang e=0 last_subs=0 dsync(chenwenguang(a)eachnet.com): Debug: brain S: Remote mailbox tree: Trash guid=7f5af7ba291b2df1a11d573bdb55d7e9 uid_validity=1279693071 uid_next=1 subs=no last_change =0 last_subs=0 dsync(chenwenguang(a)eachnet.com): Debug: brain S: Remote mailbox tree: Sent Items guid=34b8141947b9372e94589bd35a54dac5 uid_validity=1279693070 uid_next=1 subs=no last_c hange=0 last_subs=0 dsync(chenwenguang(a)eachnet.com): Debug: brain S: Remote mailbox tree: INBOX guid=c92f64f79f0d1ed01e6d5b314f04886c uid_validity=1279693068 uid_next=1 subs=no last_change =0 last_subs=0 dsync(chenwenguang(a)eachnet.com): Debug: brain S: Remote mailbox tree: Junk E-mail guid=9e1a7b3d0b113405571152c94fcf1154 uid_validity=1279693069 uid_next=1 subs=no last_ change=0 last_subs=0 dsync(chenwenguang(a)eachnet.com): Debug: brain S: Skipping unchanged mailbox e0187b65e763143666d22094cedfe6a4 dsync(chenwenguang(a)eachnet.com): Panic: file mail-transaction-log.c: line 271 (mail_transaction_log_rotate): assertion failed: (file->locked) dsync(chenwenguang(a)eachnet.com): Error: Raw backtrace: /home/mail/dovecot/lib/dovecot/libdovecot.so.0(+0x750bf) [0x7fe817a980bf] -> /home/mail/dovecot/lib/dovecot/libdo vecot.so.0(default_fatal_handler+0x2a) [0x7fe817a9819a] -> /home/mail/dovecot/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fe817a4a335] -> /home/mail/dovecot/lib/dovecot/ libdovecot-storage.so.0(+0xd499f) [0x7fe817ddb99f] -> /home/mail/dovecot/lib/dovecot/libdovecot-storage.so.0(mail_index_write+0x1e6) [0x7fe817ddac46] -> /home/mail/dove cot/lib/dovecot/libdovecot-storage.so.0(mail_index_sync_commit+0x2db) [0x7fe817dd2f2b] -> /home/mail/dovecot/lib/dovecot/libdovecot-storage.so.0(imapc_mailbox_sync_init +0x20d) [0x7fe817d7690d] -> /home/mail/dovecot/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x35) [0x7fe817d89e05] -> /home/mail/dovecot/lib/dovecot/libdovecot -storage.so.0(mailbox_sync+0x27) [0x7fe817d89f27] -> /home/mail/dovecot/bin/doveadm(dsync_brain_slave_recv_mailbox+0x7b) [0x430aeb] -> /home/mail/dovecot/bin/doveadm(ds ync_brain_run+0x256) [0x42e726] -> /home/mail/dovecot/bin/doveadm() [0x414ec0] -> /home/mail/dovecot/bin/doveadm() [0x416a7d] -> /home/mail/dovecot/bin/doveadm(doveadm_ mail_try_run+0x231) [0x417721] -> /home/mail/dovecot/bin/doveadm(main+0x3a8) [0x413bf8] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xfd) [0x7fe8176b5ead] -> / home/mail/dovecot/bin/doveadm() [0x413e11] dovecot2.2.15 conf # 2.2.15: /home/mail/dovecot/etc/dovecot/dovecot.conf doveconf: Warning: service auth { client_limit=80960 } is lower than required under max. load (300000) doveconf: Warning: service anvil { client_limit=60000 } is lower than required under max. load (240003) # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.4 auth_cache_negative_ttl = 1 days auth_cache_size = 1000 k auth_cache_ttl = 1 days auth_debug = yes auth_debug_passwords = yes auth_master_user_separator = * auth_mechanisms = plain login debug_log_path = /data/logs/dovecot/logs/dovecot.log default_client_limit = 60000 default_internal_user = vmail default_login_user = dovecotauth default_process_limit = 60000 disable_plaintext_auth = no first_valid_gid = 1007 first_valid_uid = 1007 imapc_features = rfc822.size fetch-headers imapc_host = 172.24.173.212 imapc_password = 111111 imapc_user = %u info_log_path = /data/logs/dovecot/logs/dovecot.log log_path = /data/logs/dovecot/logs/dovecot.log mail_debug = yes mail_fsync = never mail_plugins = fts fts_lucene mail_log notify quota zlib mail_prefetch_count = 1 maildir_very_dirty_syncs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox "Junk E-mail" { auto = subscribe special_use = \Junk } mailbox "Sent Items" { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = . } passdb { args = /home/mail/dovecot/etc/dovecot/passwd.masterusers driver = passwd-file master = yes } passdb { args = /home/mail/dovecot/bin/CheckPassword driver = checkpassword } plugin { fts = lucene fts_lucene = whitespace_chars=@. mail_debug = yes mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename append mail_log_fields = uid box msgid size quota = dict:%u::redis:host=172.24.202.60:prefix=user_quota/ quota_rule2 = Trash:storage=+80%% quota_warning = storage=90%% quota-warning 90 %u quota_warning2 = storage=80%% quota-warning 80 %u quota_warning3 = storage=70%% quota-warning 70 %u quota_warning4 = storage=60%% quota-warning 60 %u sieve = ~/.dovecot.sieve sieve_dir = ~/sieve welcome_letter_path = /home/mail/dovecot/etc/welcome welcome_letter_url = http://202.108.252.162:8080/domainmail zlib_save = gz zlib_save_level = 6 } pop3_fast_size_lookups = yes pop3_no_flag_updates = yes postmaster_address = postmastar@%d protocols = imap pop3 sieve lmtp service auth-worker { user = dovecotauth } service auth { client_limit = 80960 unix_listener /home/mail/postfix/var/spool/postfix/private/auth-client { group = postfix mode = 0660 user = postfix } } service imap-login { inet_listener imap { port = 143 } service_count = 0 vsz_limit = 2 G } service imap { process_limit = 60240 } service lmtp { inet_listener { port = 11000 } } service managesieve-login { inet_listener sieve { port = 4190 } service_count = 0 vsz_limit = 2 G } service managesieve { process_limit = 80960 } service pop3-login { inet_listener pop3 { port = 110 } service_count = 0 vsz_limit = 2 G } service quota-warning { executable = script /home/mail/dovecot/bin/quota-warning.sh unix_listener quota-warning { user = vmail } user = vmail } ssl = no submission_host = 172.24.203.8:25 userdb { driver = prefetch } userdb { args = /home/mail/dovecot/etc/dovecot/dovecot-dict-auth.conf.ext driver = dict } protocol imap { imap_logout_format = bytes=%i/%o mail_plugins = fts fts_lucene mail_log notify quota zlib imap_quota imap_zlib } protocol pop3 { pop3_logout_format = bytes=%i/%o, top=%t/%p, retr=%r/%b, del=%d/%m, size=%s } protocol sieve { mail_max_userip_connections = 1000 mail_plugins = fts fts_lucene mail_log notify quota zlib quota managesieve_implementation_string = Dovecot Pigeonhole managesieve_logout_format = bytes=%i/%o managesieve_max_compile_errors = 10 managesieve_max_line_length = 65536 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave } need you help!thank you! -- View this message in context: http://dovecot.2317879.n4.nabble.com/migrate-via-dsync-error-Panic-file-mai… Sent from the Dovecot mailing list archive at Nabble.com.

1 0

Quota policy service not rejecting messages when user over quota
by james＠lottspot.com 17 Jul '15

17 Jul '15

For some very odd reason, the quota-status service is failing to enforce quotas. Every other aspect of my configuration is working with absolutely no problems. When I attempt delivery via LTMP, the message is, as expected, rejected due to the user's inbox being full. root@smtp:/usr/local/etc/mail-config # nc -U /var/spool/postfix/private/dovecot-lmtp < 220 mx0.lottspot.com Dovecot ready. > LHLO localhost < 250-mx0.lottspot.com < 250-8BITMIME < 250-ENHANCEDSTATUSCODES < 250 PIPELINING > MAIL FROM:<root@localhost> < 250 2.1.0 OK > RCPT TO:<james(a)lottspot.vpn> < 552 5.2.2 <james(a)lottspot.vpn> Quota exceeded (mailbox for user is full) The policy service however, just lets everything go right through. I know that accessing the userdb is not an issue, because I passed a bogus user before passing my real user and received the expected response. root@smtp:/usr/local/etc/mail-config # nc -U /var/spool/postfix/private/policy-quota > recipient=noop(a)fake.tld > < action=551 User not found < > recipient=james(a)lottspot.vpn > < action=250 Quota status success < I'm using Dovecot 2.2.15, and I have included my quota configuration below. If anyone wants to see full doveconf -n output, I can provide it, but figured it was a bit much for this case. Thanks in advance for any pointers! --> Note: I'm the quota_status_* directives have been set as is for testing purposes only. I'm fully aware not to do that in production. plugin { quota = maildir:User quota quota_rule = *:bytes=1G quota_rule2 = Trash:storage=+10%% quota_status_success = "250 Quota status success" quota_status_nouser = "551 User not found" quota_status_overquota = "552 5.2.2 Recipient mailbox is full" } service quota-status { executable = quota-status -p postfix unix_listener /var/spool/postfix/private/policy-quota { user = postfix group = wheel mode = 0666 } }

2 1

[Sieve] Unable to fileinto subfolders
by james＠lottspot.com 17 Jul '15

17 Jul '15

Hello again list! I am configuring a server running Dovecot 2.2.15 (Pigeonhole 0.4.6), and I am having an issue with Sieve scripts where I cannot sort messages into a subfolder of a mailbox. An email which is matched by the following script: require "fileinto"; if header :contains "Subject" "[SORT ME]" { fileinto "INBOX.Sorted"; } Yields the following error: Jul 16 18:54:46 smtp dovecot: lmtp(james(a)lottspot.vpn): Error: DiJmNGZgqFWLFAEANWXNPw: sieve: msgid=<4973528.yvy4Yu8Tt4@arch_project>: failed to store into mailbox 'INBOX.Sorted': Character not allowed in mailbox name: '.' As far as I can tell based on the Sieve usage page in the wiki (http://wiki2.dovecot.org/Pigeonhole/Sieve/Usage) this is *supposed* to work. I have included my namespace configuration below, but if anyone wants the whole doveconf -n, I will gladly provide it. Thanks in advance for any help! namespace inbox { type = private separator = / prefix = inbox = yes mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } } namespace { type = shared separator = / prefix = shared/%%d/%%n/ location = maildir:/home/%%d/%%n/mail:INDEX=~/indexes/%%d/%%n:INDEXPVT=~/indexes/%%d/%%n subscriptions = no list = children }

3 2

question on Dovecot replication
by Arnold Wang 17 Jul '15

17 Jul '15

I'm running Dovecot 2.2.x and have a question on its replication capability. I plan to run Dovecot in two different sites with two nodes at each site. My question is how many replication partners can each Dovecot node have? Can I define three "mail_replica" entries in every node so any message received by one node will be replicated to three other nodes automatically? Thanks in advance for your help.

1 0

Admin access to sieve filters with managesieve
by Christian Theune 15 Jul '15

15 Jul '15

Hi, I’ve been a long-time user of Cyrus and started using sieve with Dovecot recently. A question that came up is: how do I access a users’s sieve scripts through managesieve without their credentials? Managesieve allows separating authentation and the corresponding mailbox identification, right? That’s what I used with cyrus sieve all the time. :) I didn’t find documentation in the wiki or googling where to configure someone as admin in Dovecot so he can access foreign sieve scripts through managesieve. Pointers? Am I using the right words? Cheers, Christian — Christian Theune · ct(a)flyingcircus.io · +49 345 219401 0 Flying Circus Internet Operations GmbH · http://flyingcircus.io Forsterstraße 29 · 06112 Halle (Saale) · Deutschland HR Stendal HRB 21169 · Geschäftsführer: Christian. Theune, Christian. Zagrodnick

3 3

doveadm search -A problem with dropped privileges
by Sebastian Kricner 14 Jul '15

14 Jul '15

Hello, if you want to answer to this mail, please send it directly to me. I have found a big issue with the following command "doveadm -search -A". It whatsoever works by setting doveadm_worker_count = 0 in the dovecot.conf configuration file. The problem is that doveadm-server or something similar uses privileges of "nobody" and so it fails searching e-mails. Instead also the process tries to create a maildir for "nobody": Debug: Namespace : /var/mail/nobody doesn't exist yet, using default permissions Debug: Namespace : Using permissions from /var/mail/nobody: mode=0700 gid=default Error: User initialization failed: Namespace '': mkdir(/var/mail/nobody) failed: Permission denied (euid=65534(nobody) egid=65534(nobody) missing +w perm: /var/mail, we're not in group 12(mail), dir owned by 0:12 mode=0775) Error: search: User init failed Error: userdb lookup: connect(/var/run/dovecot//auth-userdb) failed: Permission denied (euid=65534(nobody) egid=65534(nobody) missing +r perm: /var/run/dovecot//auth-userdb, we're not in group 12(mail), dir owned by 0:0 mode=0755) Error: search: User lookup failed: Internal error occurred. Refer to server log for more information. Even after setting permissions, so that the process can create a maildir for "nobody" in the /var/mail location, it fails to "setresgid" to the particular user to be scanned. It can´t work because it is not possible to gain other user privileges from another user. # 2.2.16: /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.7 # OS: Linux Gentoo Base System release 2.2 auth_cache_negative_ttl = xx mins auth_cache_size = xx M auth_cache_ttl = xx mins auth_mechanisms = xx xx auth_worker_max_count = xx base_dir = /var/run/dovecot/ default_process_limit = xx dict { expire = sqlite:/xx } doveadm_worker_count = 1 first_valid_gid = xx first_valid_uid = xx login_greeting = xx.xx mail_location = maildir:/xx/xx/%u mail_privileged_group = xx managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate passdb { args = scheme=SHA512 /xx/xx/xx.xx driver = passwd-file } plugin { expire = xx expire2 = xx expire_dict = proxy::expire sieve = ~/.xx.xx sieve_dir = ~/.xx } protocols = imap sieve service auth { unix_listener auth-client { group = xx mode = 0660 } unix_listener auth-userdb { group = xx mode = 0660 } } service dict { unix_listener dict { mode = 0666 } } service imap-login { inet_listener imap { port = 0 } process_limit = 6 service_count = 1 } ssl_cert = </xx/xx/xx/xx.xx.xx ssl_key = </xx/xx/xx/xx.xx.xx ssl_parameters_regenerate = xx days userdb { driver = passwd } protocol lda { mail_plugins = sieve expire } protocol imap { imap_idle_notify_interval = xx mins mail_max_userip_connections = xx mail_plugins = expire } Regards Sebastian Kricner -- http://tuxwave.net -- the difference to think makes it real!

1 0

does dovecot support aio(asynchronous IO)
by boyd 13 Jul '15

13 Jul '15

Dear, Does dovecot support aio(asynchronous IO)? Or do we have a plan/need to support it? Thanks!

1 0

doveadm save message ...
by Hardy Flor 11 Jul '15

11 Jul '15

How can I set the flags for a saved message without search?

2 1

Error while executing dovecot
by Sachin Kulkarni1 10 Jul '15

10 Jul '15

Hello All, I am trying to execute dovecot by below command /opt/app/dovecot/latest/sbin/dovecot -c /opt/app/dovecot/latest/etc/dovecot/dovecot.conf I am getting below error doveconf: Fatal: Error in configuration file /opt/app/dovecot/latest/etc/dovecot/dovecot.conf: default_login_user doesn't exist: dovenull please guide me to resolve this. Thanks and Regards, Sachin ============================================================================================================================ Disclaimer: This message and the information contained herein is proprietary and confidential and subject to the Tech Mahindra policy statement, you may review the policy at http://www.techmahindra.com/Disclaimer.html externally http://tim.techmahindra.com/tim/disclaimer.html internally within TechMahindra. ============================================================================================================================

2 1

Re: Systemd and listen restriction to localhost not enforced
by Joseph Tam 09 Jul '15

09 Jul '15

Sven Strickroth <sven(a)cs-ware.de> writes: > in /etc/dovecot/conf.d/10-master.conf I have restricted IMAP to > localhost only: > > service imap-login { > inet_listener imap { > address = 127.0.0.1 > #port = 143 > } > inet_listener imaps { > #port = 993 > #ssl = yes > } > } > > However, /lib/systemd/system/dovecot.socket make it listen on > 0.0.0.0:143 and [::]:143 causing the service being available to > the public which it should not. - IMHO this is a security issue. I don't know much about systemd, but you'll probably need dovecot configuration listen = 127.0.0.1 Joseph Tam <jtam.home(a)gmail.com>

1 0

Systemd and listen restriction to localhost not enforced
by Sven Strickroth 09 Jul '15

09 Jul '15

Hi, in /etc/dovecot/conf.d/10-master.conf I have restricted IMAP to localhost only: service imap-login { inet_listener imap { address = 127.0.0.1 #port = 143 } inet_listener imaps { #port = 993 #ssl = yes } } However, /lib/systemd/system/dovecot.socket make it listen on 0.0.0.0:143 and [::]:143 causing the service being available to the public which it should not. - IMHO this is a security issue. PS: When starting dovecot I got: Jul 6 22:52:14 srv1 dovecot[19921]: Error: systemd listens on port 143, but it's not configured in Dovecot. Closing. Jul 6 22:52:14 srv1 dovecot: master: Error: systemd listens on port 143, but it's not configured in Dovecot. Closing. -- Best regards, Sven Strickroth PGP key id F5A9D4C4 @ any key-server

1 0

vsz_limit of service doveadm "ignored"?
by Philipp 08 Jul '15

08 Jul '15

Hello, dovecot 2.2.18 on CentOS6.5 Jul 08 11:53:44 dsync-server(system): Fatal: master: service(doveadm): child 32554 returned error 83 (Out of memory (service doveadm { vsz_limit=521 MB }, you may need to increase it) - set CORE_OUTOFMEM=1 environment to get core dump) I tried increasing to 1 G, 1024 M or even disabling via value of zero -- to no change. Every other service has the famous 18446744073709551615 B limit. default_vsz_limit = 2 G The second node with the same setup/config is happily accepting a higher value, since both come from the same provisioning I cannot see (or expect) differences around ulimit and thelike. The configuration comes from a single file, so no include drama or such. Any pointers why the setting is being ignored?

1 0

ESEARCH multiple folders
by Peter Chiochetti 08 Jul '15

08 Jul '15

FTS-Solr is blazingly fast; yet searching e.g. an archive with subfolders still is slow; I learned, that this is a feature/bug of the imap protocol. So I'd like to ask: Does or will dovecot support the "IMAP4 Multimailbox SEARCH Extension" specified in RFC 7377? -- Kind regards Peter

2 2

Scalability with high density servers and proxies, TCP port limits
by Christian Balzer 08 Jul '15

08 Jul '15

Hello, first post in 3 years, kinda shows how painless Dovecot is. ^o^ Also this isn't really a dovecot issue, alas it's involved and since there are some large scale implementations of it I hope somebody here has some insights I might have missed. Currently we're running this setup: 1. LVS (DR mode) in a HA configuration (2 node cluster) 2. Dovecot in proxy mode on a 2 node cluster 3. Dovecot on actual mailbox servers (dual node DRBD clusters) There are about 500k users, but most of them use POP3, so there are usually less than 6k IMAP sesions at any given time. This is about to change, I'm looking at potentially millions of users who will have all semi-permanent IMAP sessions. We already have a pure SSD based mailbox cluster and based on the experiences with that another one is on order that will be able to easily handle about 500k users with regards to IOPS and other needs. However there's the issue of having all these concurrent IMAP sessions. Namely, running out of ephemeral ports. Lets assume 2 million users and 50k ports per IP and revisit the setup above. 1. LVS should have no problem, from experience and tests I expect a well tuned and spec'ed machine to handle millions of connections. This is in DR mode, in NAT mode I assume things would run into a wall a lot quicker. But even if LVS should run out of steam, there's a wide selection of high capacity load balancers available. 2. Here is where the fun starts. Each IMAP session that gets proxied to the real mailbox server needs a port for the outgoing connection. So to support 2 million sessions we need 40 IP addresses here. Ouch. And from a brief test having multiple IP addresses per server won't help either (Dovecot unsurprisingly picks the main IP when establishing a proxy session to the real mailbox), at least not with just one default GW. 3. All of this gets repeated on the actual mailbox servers, by either having a lot of low density servers or (preferably) high density servers with multiple IP addresses. Am I on track so far or missing something obvious? How many concurrent connections do you (hello Timo) think dovecot in proxy mode can handle? High performance mode of course in this case. I'm interested in internal limitations, assume that CPU and RAM are amply supplied. Any and all feedback is appreciated. Regards, Christian -- Christian Balzer Network/Systems Engineer chibi(a)gol.com Global OnLine Japan/Fusion Communications http://www.gol.com/

2 3

HELP: wrinting dovecot-sql.conf to authenticate to an existing database
by Filippo Zeus 08 Jul '15

08 Jul '15

hi all, can anyone help me with dovecot-sql.conf please ? I'm not a mysql expert and I'am trying to authenticate dovecot2 to an existing database. I have a database "egroupware" with table "egw_accounts". The field "account_lid" is the full email address and "account_pwd" is the password in Blowfish format. Here is my dovecot-sql.conf driver = mysql connect = host=localhost dbname=egroupware user=egroupware password=********* default_pass_scheme = BLF-CRYPT password_query = SELECT account_pwd AS password FROM egw_accounts WHERE account_lid = '%u' when I try to login to POP or IMAP I got this error in mail.log/mail.info Error: sql(hidden@mydomain.com,::1): Invalid password in passdb: crypt() failed: Invalid argument auth: Debug: client passdb out: FAIL#0111#011user=hidden(a)mydomain.com dovecot: pop3-login: Debug: Ignoring unknown passdb extra field: I think I'm having trouble with the password value that is stored in the account_pwd as: {crypt}$2a$12$XTAolzXgwMC211MuZELQUedPv9tjZNs7Osh97PnZ50pAKuk3WPGmS Reading at http://wiki2.dovecot.org/Authentication/PasswordSchemes I suppose that the heading "{crypt}$2a$" instead of a simple "$2a$" (witch identifies a Blowfish password) is my problem. How can I fix this ? Here is my dovecot -n output: # 2.2.13: /etc/dovecot/dovecot.conf # OS: Linux 3.16.0-4-amd64 x86_64 Debian 8.1 xfs auth_cache_size = 64 M auth_debug = yes auth_mechanisms = plain login lda_mailbox_autocreate = yes log_timestamp = "%Y-%m-%d %H:%M:%S " login_log_format_elements = USER=<%u> METHOD=%m FROM=%r TO=%l %c mail_location = maildir:/var/mail/%d/%n/Maildir mail_plugins = quota mail_privileged_group = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave spamtest spamtestplus imapflags notify namespace inbox { inbox = yes location = mailbox Archive { auto = no special_use = \Archive } mailbox "Deleted Messages" { auto = no special_use = \Trash } mailbox Drafts { special_use = \Drafts } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { auto = no special_use = \Junk } mailbox Trash { auto = no special_use = \Trash } prefix = separator = . } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { quota = maildir:User quota quota_exceeded_message = Storage quota for this account has been exceeded, please try again later. quota_grace = 10%% quota_rule = *:storage=6G quota_rule2 = Trash:storage=+100M quota_rule3 = spam:ignore quota_warning = storage=95%% quota-warning 95 %u sieve = ~/dovecot.sieve sieve_before = /var/mail/sieve/before.sieve sieve_default = /var/mail/sieve/default.sieve sieve_dir = ~/sieve.d sieve_extensions = +notify +imapflags +spamtest +spamtestplus +relational +comparator-i;ascii-numeric sieve_global_dir = /var/mail/sieve/global.d sieve_max_script_size = 1M } postmaster_address = postmaster@%d protocols = " imap sieve pop3 sieve" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service managesieve-login { inet_listener sieve { port = 4190 } service_count = 1 vsz_limit = 64 M } service managesieve { process_limit = 15 } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { user = vmail } user = dovecot } ssl = required ssl_cert = </etc/ssl/dharma/mail/mail_antonica_it.crt ssl_key = </etc/ssl/dharma/mail/mail_antonica_it.key userdb { args = uid=vmail gid=vmail home=/var/mail/%d/%n driver = static } protocol lda { mail_plugins = quota sieve } protocol imap { mail_plugins = quota imap_quota } protocol sieve { mail_max_userip_connections = 10 managesieve_logout_format = bytes=%i/%o managesieve_max_line_length = 65536 }

2 1

Autocreate folders with specific permissions
by Fabio S. Schmidt 07 Jul '15

07 Jul '15

Hi, I have Dovecot 2.1 deployed running about 65k mailboxes. We need to create a specific folder for all users with specific permissions. I mean, the user could not delete or rename the folder. To create the folder automatically I have used the autocreate, but is there any way to set specific permissions on those folders? My best regards.

1 0

Problem with IMAP-Proxy and M$ Exchange-Server
by Luca Bertoncello 07 Jul '15

07 Jul '15

Hi List! I **HATE** Exchange-Server. I think it's not able to manage E-Mails, but we have to use it at work... Well, we need to read the E-Mails from outside, so I configured Dovecot with IMAPC to connect to the Exchange-Server. It works, but I have a problem... If I receive an E-Mail, and I read it from my phone (for example), I see in Outlook that the E-Mail as been read. If I move the E-Mail in another folder from my phone, I see in Outlook the E-Mail in the new folder **AND** in the INBOX. If I check my E-Mail from another phone (or Mail-Client), I see the E-Mail just in the new folder, so I think, the Exchange-Server did move it. But Outlook does not get this information... Any idea how can I solve my problem? Thanks Luca Bertoncello (lucabert(a)lucabert.de)

1 0

Large jumps in dovecot-uidlist
by Mark 07 Jul '15

07 Jul '15

Since upgrading to Debian Wheezy I have been observing large jumps in the value stored in dovecot-uidlist. The effect of these jumps is to confuse some mail clients (Thunderbird, Opera Mail) causing them not to display messages from a (random?) point in time onwards in the affected folder. I have been unable to determine the root cause of these jumps. What I do know: 1. I never observed the problem while running Debian Squeeze. 2. The only way I have found to fix the issue is to remove all the dovecot* files from the affected folder and restart dovecot. I have tried removing various subsets of the dovecot* files but haven't yet found a subset that works. 3. I first tried upgrading from Squeeze to Wheezy within a few weeks of the Wheezy release. At that point the problem occurred so frequently that I couldn't sync my mail client with my mail box. Multiple folders exhibited this problem and while I was fixing them the problem appeared in other folders. I was unable to reach a point where the system was stable so I reverted back to Squeeze. 4. Some time later (I think a year but I am not sure) I tried the upgrade to Wheezy again. This time the system was stable. After a few days I noticed that the problem was still occurring but less frequently. Since then I have been fixing the problem as I notice it and experimenting with various settings (mainly locking related) without success. I now have a cron job that looks for problematic folders and fixes them when found. 5. I have updated Dovecot packages to those from Jessie via wheezy-backports and the problem still occurs. 6. Dovecot is installed along with postfix, amavisd-new, clamav-daemon, procmail and fetchmail. 7. The mail server is running on a eSATA SheevaPlug that boots of an external USB drive. All user home dirs (and associated mailboxes) are located on a LUKS/ext3 encrypted partition. 8. The output of dovecot -n may be found at the end of this mail. 9. Uid values for the three most recent instances of this problem are: 3801596527, 3371927249, 3443181615 10. Some folders seem more susceptible to this problem but I have not been able to identify any common factors/triggers. 11. The problem occurs - on average - once a day. I am happy to provide any further information, configure any debug logging and/or test suggested configuration settings that may help track down the root cause of this problem. Any help gratefully appreciated. Mark # 2.2.13: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-kirkwood armv5tel Debian 7.8 mail_debug = yes mail_location = maildir:~/Maildir mail_max_userip_connections = 100 namespace { inbox = yes location = mailbox { special_use = \Drafts name = Drafts } mailbox { special_use = \Junk name = Junk } mailbox { special_use = \Sent name = Sent } mailbox { special_use = \Sent name = Sent Messages } mailbox { special_use = \Trash name = Trash } prefix = name = inbox } passdb { driver = pam } protocols = " imap" service replication-notify-fifo { name = aggregator } service anvil-auth-penalty { name = anvil } service auth-worker { name = auth-worker } service { unix_listener { group = postfix mode = 0666 user = postfix path = /var/spool/postfix/private/auth-client } name = auth } service config { name = config } service dict { name = dict } service login/proxy-notify { name = director } service dns-client { name = dns_client } service doveadm-server { name = doveadm } service { inet_listener { port = 0 name = imap } inet_listener { port = 993 ssl = yes name = imaps } process_min_avail = 5 name = imap-login } service imap-urlauth { name = imap-urlauth-login } service imap-urlauth-worker { name = imap-urlauth-worker } service token-login/imap-urlauth { name = imap-urlauth } service { executable = imap postlogin name = imap } service indexer-worker { name = indexer-worker } service indexer { name = indexer } service ipc { name = ipc } service lmtp { name = lmtp } service log-errors { name = log } service pop3 { name = pop3-login } service login/pop3 { name = pop3 } service { executable = script-login -d rawlog name = postlogin } service replicator-doveadm { name = replicator } service login/ssl-params { name = ssl-params } service stats-mail { name = stats } ssl_cert = </etc/ssl/certs/smtpd.crt ssl_cipher_list = HIGH:MEDIUM:!aNULL:!MD5:!RC4 ssl_key = </etc/ssl/private/smtpd.key userdb { driver = passwd } protocol imap { service replication-notify-fifo { name = aggregator } service anvil-auth-penalty { name = anvil } service auth-worker { name = auth-worker } service auth-client { name = auth } service config { name = config } service dict { name = dict } service login/proxy-notify { name = director } service dns-client { name = dns_client } service doveadm-server { name = doveadm } service imap { name = imap-login } service imap-urlauth { name = imap-urlauth-login } service imap-urlauth-worker { name = imap-urlauth-worker } service token-login/imap-urlauth { name = imap-urlauth } service login/imap { name = imap } service indexer-worker { name = indexer-worker } service indexer { name = indexer } service ipc { name = ipc } service lmtp { name = lmtp } service log-errors { name = log } service pop3 { name = pop3-login } service login/pop3 { name = pop3 } service replicator-doveadm { name = replicator } service login/ssl-params { name = ssl-params } service stats-mail { name = stats } }

2 4

Are the Dovecot Enterprise Edition Ubuntu 14.04 packages stable?
by deoren 07 Jul '15

07 Jul '15

I recently begun to migrate mail services to a new box so I could retrofit an existing box. I took this opportunity to check back on the official Dovecot Enterprise Edition (EE) pages to see if support has been added for Ubuntu 14.04 LTS. I never could find the information on the dovecot.fi website, but taking my existing credentials for Dovecot EE repo access and looking at the root path I see that 14.04 packages are available from the APT repo. Are those stable or experimental? I have an Ubuntu 12.04 box I've kept around just for Dovecot EE that I'd like to move to 14.04 if the packages are stable. p.s. Thank you for continuing to provide access for existing users of the repo, but what would new users need to do to obtain access? Thanks for your time.

1 0

Dovecot - Config file details
by Sachin Kulkarni1 07 Jul '15

07 Jul '15

Hello All, We want to install / configure and test Dovecot. We are doing it for the first time. After installation we are now looking for configuration file and need to know significance of below params and what values we should provide ? protocols = listen = base_dir = login_greeting = Please help. Thanks and Regards, Sachin Kulkarni ============================================================================================================================ Disclaimer: This message and the information contained herein is proprietary and confidential and subject to the Tech Mahindra policy statement, you may review the policy at http://www.techmahindra.com/Disclaimer.html externally http://tim.techmahindra.com/tim/disclaimer.html internally within TechMahindra. ============================================================================================================================

2 1

Questions about hardlinks, alternate storage and compression
by Gionatan Danti 06 Jul '15

06 Jul '15

Hi all, I have some questions about hardlinks, alternate storage and compression. I already scanned the list for related information and I have an idea of how things works, but I would like to have a definite answer. System spec: - CentOS 6.6 x64 - dovecot-2.0.9-8.el6_6.4.x86_64 RPM package/version - sdbox mail store 1) About hardlinks: when sending the same message to two different recipients, I see that the two u.x files are created as two different files. Diffing them, I see that the only difference is a single char (see [1] for an example). My questions are: a) it is possible to tell dovecot to create a single file + a single hardlink (linkref=2)? As other IMAP servers support that features (eg: Cyrus, CommunigatePro, etc) I am wondering if I missed something in configuring dovecot... b) If it is not possible, can I run a script that compare the various files and substitute equal ones (minus the changing line) with hardlinks, or it will confuse dovecot? As a side note, why the changing line ever exists? 2) About alternate storage and compression: actually, I use a single mail_location without compression. I would like to have an alternate storage and to enable compression on it only, leaving the main location without compression. I if understand it correctly, it _should_ be done using a command similar to "doveadm -Dv -o "plugin/zlib_save=gz" altmove -uu testuser sentbefore 8d". I'm right thinking that it should work? I will really end with a primary uncompressed mail store and an alternate, zlib-compressed one? Thank you all and sorry if I did some naive questions. [1] 63c63 < G2fd0811c64be8e553d970000eaa8309f --- > G2ed0811c64be8e553d970000eaa8309f -- Danti Gionatan Supporto Tecnico Assyoma S.r.l. - www.assyoma.it email: g.danti(a)assyoma.it - info(a)assyoma.it GPG public key ID: FF5F32A8

1 2

Dovecot LMTP tries to access a directory of a different user, than the one it actually changed to.
by Ernest Deak 06 Jul '15

06 Jul '15

Hello, I encountered a problem when trying to send an email to multiple recipients. === LOG === ... cut ... Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106): Debug: none: root=, index=, control=, inbox= Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106): Connect from local Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106): Debug: Loading modules from directory: /usr/lib64/dovecot Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106): Debug: Module loaded: /usr/lib64/dovecot/lib90_sieve_plugin.so Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106): Debug: auth input: han.solo system_groups_user=han.solo uid=805 gid=800 home=/home/han.solo Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106): Debug: auth input: tester system_groups_user=tester uid=802 gid=800 home=/home/tester Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106): Debug: auth input: vader system_groups_user=vader uid=804 gid=800 home=/home/vader Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106, han.solo): Debug: Effective uid=805, gid=800, home=/home/han.solo Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106, han.solo): Debug: fs: root=/home/han.solo/mail, index=, control=, inbox=/var/mail/han.solo Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106, han.solo): Debug: 70NxN1FlllUqXgAA0vrzwA: sieve: user's script path /home/han.solo/.dovecot.sieve doesn't exist (using global script path in stead) Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106, han.solo): Debug: 70NxN1FlllUqXgAA0vrzwA: sieve: user has no valid personal script Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106, han.solo): Debug: 70NxN1FlllUqXgAA0vrzwA: sieve: no scripts to execute: reverting to default delivery. Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106, han.solo): 70NxN1FlllUqXgAA0vrzwA: msgid=<55966551.IfKOMu/T0WTB9M5x%vader at dhcp90.#####>: saved mail to INBOX Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106, tester): Debug: Effective uid=802, gid=800, home=/home/tester Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106, tester): Debug: fs: root=/home/tester/mail, index=, control=, inbox=/var/mail/tester Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106, tester): Debug: 70NxN1FlllUqXgAA0vrzwA: sieve: user's script path /home/tester/.dovecot.sieve doesn't exist (using global script path in stead) Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106, tester): Debug: 70NxN1FlllUqXgAA0vrzwA: sieve: user has no valid personal script Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106, tester): Debug: 70NxN1FlllUqXgAA0vrzwA: sieve: no scripts to execute: reverting to default delivery. Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106, tester): Error: stat(/home/han.solo/mail/.imap/INBOX/dovecot.index.log) failed: Permission denied (euid=802(tester) egid=800(kerber) missing +x perm: /home/han.solo, euid is not dir owner) Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106, tester): Error: open(/home/han.solo/mail/.imap/INBOX/dovecot.index) failed: Permission denied (euid=802(tester) egid=800(kerber) missing +x perm: /home/han.solo, euid is not dir owner) Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106, tester): 70NxN1FlllUqXgAA0vrzwA: msgid=<55966551.IfKOMu/T0WTB9M5x%vader at dhcp90.#####>: save failed to INBOX: BUG: Unknown internal error Jul 3 12:34:57 dhcp90 sendmail[24121]: t63AYvn5024116: to=<tester at dhcp90.#####>, ctladdr=<vader at dhcp90.#####> (804/800), delay=00:00:00, xdelay=00:00:00, mailer=local, pri=91062, relay=localhost, dsn=4.2.0, stat=Deferred: 451 4.2.0 <tester> BUG: Unknown internal error Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106, vader): Debug: Effective uid=804, gid=800, home=/home/vader Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106, vader): Debug: fs: root=/home/vader/mail, index=, control=, inbox=/var/mail/vader Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106, vader): Debug: 70NxN1FlllUqXgAA0vrzwA: sieve: user's script path /home/vader/.dovecot.sieve doesn't exist (using global script path in stead) Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106, vader): Debug: 70NxN1FlllUqXgAA0vrzwA: sieve: user has no valid personal script Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106, vader): Debug: 70NxN1FlllUqXgAA0vrzwA: sieve: no scripts to execute: reverting to default delivery. Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106, vader): Error: stat(/home/han.solo/mail/.imap/INBOX/dovecot.index.log) failed: Permission denied (euid=804(vader) egid=800(kerber) missing +x perm: /home/han.solo, euid is not dir owner) Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106, vader): Error: open(/home/han.solo/mail/.imap/INBOX/dovecot.index) failed: Permission denied (euid=804(vader) egid=800(kerber) missing +x perm: /home/han.solo, euid is not dir owner) Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106, vader): 70NxN1FlllUqXgAA0vrzwA: msgid=<55966551.IfKOMu/T0WTB9M5x%vader at dhcp90.#####>: save failed to INBOX: BUG: Unknown internal error Jul 3 12:34:57 dhcp90 sendmail[24121]: t63AYvn5024116: to=<vader at dhcp90.#####>, ctladdr=<vader at dhcp90.#####> (804/800), delay=00:00:00, xdelay=00:00:00, mailer=local, pri=91062, relay=localhost, dsn=4.2.0, stat=Deferred: 451 4.2.0 <vader> BUG: Unknown internal error Jul 3 12:34:57 dhcp90 sendmail[24121]: t63AYvn5024116: to=<han.solo at dhcp90.#####>, ctladdr=<vader at dhcp90.#####> (804/800), delay=00:00:00, xdelay=00:00:00, mailer=local, pri=91062, relay=localhost, dsn=2.0.0, stat=Sent Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106): Disconnect from local: Client quit =========== The setup is as follows: All users have /bin/false instead of a shell. Each user has a unique UID but they all have 1 GID (800) My MTA is sendmail I am using dovecot-lmtp for local delivery Mailbox format is mbox Configured managesieve plugin to listen on 4190. (not sure if this is even related but it might) The problem I see is that lmtp(user1) tries to access the home directory /home/user2 and I cannot figure out the reason why. This only happens when sending mails to multiple recipients. I see the that lmtp complains that it doesn't have execute permissions. But I don't want to place execute permissions for others on the entire /home/* dir structure. Also, 700 are the default creation permissions. So new users would have to be chmod'ed manually. (unless there is a setting in dovecot) I used "mailx" to send a test email to multiple recipients `echo "test message" | mailx -s "subject" -r vader at dhcp90.##### han.solo at dhcp90.##### vader at dhcp90.##### tester at dhcp90.#####` The only one who actually receives the message is han.solo at dhcp90.##### and The same happens with aliases in /etc/aliases. `echo "group test" | mailx -s "subject" -r vader at dhcp90.##### grouplist at dhcp90.#####` "grouplist" is defined in /etc/aliases and contains the same users as in the log Any help with this is greatly appreciated. Here is my dovecot configuration: === `dovecot -n` === # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-504.12.2.el6.x86_64 x86_64 CentOS release 6.6 (Final) auth_debug = yes auth_mechanisms = plain login disable_plaintext_auth = no lda_mailbox_autocreate = yes mail_debug = yes mail_full_filesystem_access = yes mail_gid = mail mail_location = mbox:~/mail:INBOX=/var/mail/%u managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date mbox_write_locks = fcntl passdb { driver = pam } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap pop3 lmtp sieve service lmtp { client_limit = 1 executable = /usr/libexec/dovecot/lmtp -L inet_listener lmtp { address = 127.0.0.1 ::1 port = 24 } process_min_avail = 1 } service managesieve-login { inet_listener sieve { port = 4190 } } ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { driver = passwd } protocol lmtp { mail_plugins = " sieve" postmaster_address = postmaster } =============== `rpm -qa | grep dovecot` dovecot-pigeonhole-2.0.9-8.el6_6.4.x86_64 dovecot-2.0.9-8.el6_6.4.x86_64 Thanks in advance.

3 3

FW: Help needed to use dovecot from scratch
by Sachin Kulkarni1 06 Jul '15

06 Jul '15

Hello All, Can anybody help in this please? Thanks and Regards, Sachin Kulkarni -----Original Message----- From: Sachin Kulkarni1 Sent: Tuesday, June 30, 2015 6:13 PM To: dovecot(a)dovecot.org Cc: 'dovecot-owner(a)dovecot.org'; 'dovecot-request(a)dovecot.org' Subject: Help needed to use dovecot from scratch Hello, I need to use Dovecot. So need to install it from scratch on Solaris 10. Please help. Thanks and Regards, Sachin Kulkarni ============================================================================================================================ Disclaimer: This message and the information contained herein is proprietary and confidential and subject to the Tech Mahindra policy statement, you may review the policy at http://www.techmahindra.com/Disclaimer.html externally http://tim.techmahindra.com/tim/disclaimer.html internally within TechMahindra. ============================================================================================================================

2 1

Google like searches from Roundcube
by Kevin Laurie 05 Jul '15

05 Jul '15

hi, trying to get fast searches on roundcube. would like if it could work like gmail (using multiple keywords to perform search) if not wrong, i think this is called fuzzy search(i do have dovecot_fts running)? please advise if anyone has managed to get this? thanks kevin

2 1

outlook downloading duplicate emails on particular days
by Rajesh M 04 Jul '15

04 Jul '15

hi centos 6 with qmail toaster and dovecot 2.2.7 for pop3 and imap i have a strange issue which happens on all 4 of my servers for POP3 users -- on any random day ie once in a while users spread across multiple domains will face a problem of outlook re-downloading ALL the emails in the inbox -- not just a few duplicate emails but the entire inbox. This happens for multiple email users spread across multiple domains sitting in different locations. i am searching for a solution for the last several months but nothing yet require help please my dovecot config file # Settings for 'stock' qmail-toaster disable_plaintext_auth = no default_login_user = vpopmail mail_max_userip_connections = 50 service imap-login { service_count = 0 client_limit = 256 process_min_avail = 4 vsz_limit = 384M process_limit = 400 } service pop3-login { service_count = 0 client_limit = 1000 process_min_avail = 12 vsz_limit = 512M process_limit = 400 } auth_cache_size = 0 auth_cache_ttl = 0 auth_cache_negative_ttl = 0 auth_mechanisms = plain login digest-md5 cram-md5 auth_username_format = %Lu first_valid_uid = 89 first_valid_gid = 89 log_path = /var/log/dovecot.log login_greeting = ready. mail_plugins = $mail_plugins quota plugin/quota = maildir protocols = imap pop3 ssl_cert = </var/qmail/control/servercert.pem ssl_key = </var/qmail/control/servercert.pem # the following will likely be the default at some point ssl_dh_parameters_length = 2048 namespace { inbox = yes location = prefix = # prefix = INBOX. # Use 'prefix = INBOX.' for Courier-IMAP compatible transparent migration. # This forces all client apps to create subfolders underneath/within # the inbox instead of adjacent to it. It's not necessary to be that way. # FWIW, shubes thinks this setting is annoying/rediculous/retarded. # As a practical example, having no prefix allows mobile users to select # which folders get synchronized. Otherwise their whole mailbox is # synchronized, and they have no way to choose which folders they want sync'd. separator = . type = private } passdb { args = cache_key=%u webmail=127.0.0.1 driver = vpopmail } protocol imap { imap_client_workarounds = "delay-newmail" mail_plugins = $mail_plugins imap_quota } protocol pop3 { pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_fast_size_lookups = yes pop3_lock_session = no # pop3_uidl_format = UID%u-%v pop3_no_flag_updates=yes } userdb { args = cache_key=%u quota_template=quota_rule=*:backend=%q driver = vpopmail } plugin { quota = maildir:ignore=Trash quota_rule = ?:storage=0 } thanks raj

1 0

Re: dovecot auth using 100% CPU
by Edward Betts 03 Jul '15

03 Jul '15

Jorge Bastos <mysql.jorge(a)decimal.pt> wrote: > What do you see in the logs? > My guess is that someone is trying a brute force auth against you, Thanks Jorge, I think this is the answer. I'm using dovecot for exim4 SMTP authentication. The exim4 logs show brute force attacks. -- Edward.

3 4

autocreating folders with special chars stored in mysql-userdb
by Hajo Locke 03 Jul '15

03 Jul '15

Hello, i use dovecot 2.2.18 and do some tests with an utf8 mysqlbackend. I use MySQL to authenticate Users and for retrieving some individual settings like autocreating folders etc. by userdb-settings in user-query. Yet no problems with standard language. Now i try to provide userdb-settings in exotic languages. My MySQL table uses utf8 charset. I store some data in my userdb-column. Here an polish example: "namespace/inbox/mailbox=example namespace/inbox/mailbox/example/name=postępować namespace/inbox/mailbox/example/auto=subscribe" Result is a new folder in dovecot, but in client every special char ę and ć is replaced with a "?" I seems that at some point a conversion to latin1 is performed which ruins the utf8 chars. Creating a folder postępować by imap-client is no problem. Hmm, what should i do now? I dont know how to influence dovecot to process retrieved utf8 data furthermore as utf8. Which charset is using dovecot when connecting to mysqldb and how to take influence? Thanks, Hajo

1 1

the file dovecot-uidlist.lock appear then deadlock
by 刘莹莹 03 Jul '15

03 Jul '15

hi: sometimes i can't use imap command to get mails, when this problem appear i find out the file dovecot-uidlist.lock appear at the same time . I don't know Why is this happening ? can you help me ? thanks !

2 2

Dovecot auth username mapping
by Laz C. Peterson 02 Jul '15

02 Jul '15

I have an interesting case here … Virtual mailboxes, domain/username/aliases stored in MySQL, authentication done using PAM. PAM authenticates through Kerberos, which are internal realms and not the email domains — for example, my username would be laz(a)PARAVIS.LOCAL <mailto:laz@PARAVIS.LOCAL> and my email address would be laz(a)paravis.net <mailto:laz@paravis.net>. All of this works just fine. But what I want to do is allow the users to log in using their email address and not their full Kerberos name. It is becoming laborious to help the users understand the difference between their username(a)LOCAL.REALM and username(a)email.address <mailto:username@email.address> and why we have to have two separate identities that mean the same thing. I have the SQL statements to convert either the Kerberos login or the email address to the actual Kerberos login (so they may use either). But I cannot seem to figure out how to get Dovecot to acknowledge this as the mapped username. I’m sure there has to be a way. Any help will be greatly appreciated. Thank you! ~ Laz Peterson Paravis, LLC

4 7

Outlook 2013 not fetching new mail/synchronization issues
by Dragos Pacher 02 Jul '15

02 Jul '15

Hi all, Dovecot 2.2.10 CentOS 6 64 bit. We are having terrible synchronization issues with Outlook 2013 (all updates) on Windows 7 SP1 and 8.1 hosts (all updates). Scenario: 1. Emails were sent since user closed Outlook 2. Next day: start computer, open outlook 3. No new email (even though email were sent overnight) 4. half a day later Outlook fetches emails like nothing happened Second issue: folders created or email send in Outlook 2013 does not synchronize on IMAP, they remain only local .. But I am mostly interested into finding a fix for the first synchronization issue described in scenario. Second is also important but I have a feeling its connected to the first. Any help will be highly appreciated! dovecot.conf listen = * #base_dir = /var/run/dovecot # Enabled mail protocols. #protocols = pop3 imap sieve protocols = pop3 imap # User/group who owns the message files: mail_uid = 89 mail_gid = 89 # Assign uid to virtual users. first_valid_uid = 89 last_valid_uid = 89 mail_max_userip_connections = 200 default_client_limit = 3000 namespace inbox { separator = . prefix = INBOX. inbox = yes # These mailboxes are widely used and could perhaps be created automatically: mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Trash { special_use = \Trash } # For \Sent mailboxes there are two widely used names. We'll mark both of # them as \Sent. User typically deletes one of them if duplicates are created. mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } } # Logging. Reference: http://wiki2.dovecot.org/Logging log_path = /var/log/dovecot.log mail_debug = no auth_verbose = no auth_debug = no auth_debug_passwords = no auth_verbose_passwords = no auth_worker_max_count = 2048 # SSL: Global settings. # Refer to wiki site for per protocol, ip, server name SSL settings: # http://wiki2.dovecot.org/SSL/DovecotConfiguration ssl = yes verbose_ssl = no ssl_ca = </etc/ssl/savvy.cz-CA.pem ssl_cert = </etc/ssl/savvy.cz.crt ssl_key = </etc/ssl/savvy.cz.key disable_plaintext_auth = no # Mail location and mailbox format. #mail_location = maildir:/%Lh/Maildir/:INDEX=/%Lh/Maildir/ mail_location = maildir:~/Maildir:INDEX=/home/dovecotindex/%Lh/Maildir/ # Authentication related settings. # Append this domain name if client gives empty realm. auth_default_realm = # Authentication mechanisms. auth_mechanisms = PLAIN LOGIN service imap-login { client_limit = 3024 process_limit = 2048 process_min_avail = 64 vsz_limit = 64 M } service auth { client_limit = 3072 unix_listener auth-userdb { } inet_listener { port = 12345 } } service imap { vsz_limit = 256M # Max. number of IMAP processes (connections) process_limit = 2048 #imap_idle_notify_interval = 2 mins } service pop3 { # Max. number of POP3 processes (connections) process_limit = 1024 } # Virtual mail accounts. userdb { args = /etc/dovecot/dovecot-mysql.conf driver = sql } passdb { args = /etc/dovecot/dovecot-mysql.conf driver = sql } plugin { auth_socket_path = /var/run/dovecot/auth-master # Plugin: autocreate. Create and subscribe to default IMAP folders. autocreate = INBOX autocreate2 = Sent autocreate3 = Trash autocreate4 = Drafts autocreate5 = Junk autosubscribe = INBOX autosubscribe2 = Sent autosubscribe3 = Trash autosubscribe4 = Drafts autosubscribe5 = Junk # Plugin: expire. expire = Trash 7 Trash/* 7 Junk 30 expire_dict = proxy::expire # Pigeonhole managesieve service. # Reference: http://wiki2.dovecot.org/Pigeonhole/Sieve/Configuration # Per-user sieve settings. sieve_dir = /%Lh/sieve sieve = /%Lh/sieve/dovecot.sieve # Global sieve settings. sieve_global_dir = /home/vpopmail/sieve sieve_global_path = /home/vpopmail/sieve/dovecot.sieve #sieve_before = #sieve_after = } service dict { unix_listener dict { # mode = 0660 # user = vmail # group = vmail } } protocol lda { # Reference: http://wiki2.dovecot.org/LDA #mail_plugins = quota sieve autocreate #auth_socket_path = /var/run/dovecot/auth-master #log_path = /var/log/sieve.log #lda_mailbox_autocreate = yes #postmaster_address = root } protocol imap { mail_max_userip_connections = 2048 imap_client_workarounds = tb-extra-mailbox-sep #mail_plugins = quota imap_quota autocreate #mail_plugins = autocreate } protocol pop3 { #mail_plugins = quota pop3_uidl_format = UID%u-%v pop3_client_workarounds = outlook-no-nuls oe-ns-eoh } Regards, Pacher Dragos

3 12

duplicate namespace prefix
by jjhoffart 02 Jul '15

02 Jul '15

Hello, I am in the process of setting up a server that is running to invocations of dovecot. One of the invocations is acting as a backend and the other as a Director. I believe I have most of the configuration complete but I keep running into the following error: Jul 01 14:17:04 lda(postmaster(a)mydomain.com: Error: user postmaster(a)mydomain.com: Initialization failed: namespace configuration error: Duplicate namespace prefix: "" Jul 01 14:17:04 lda(postmaster(a)xn--mydomain-8za.com: Fatal: Invalid user settings. Refer to server log for more information. Not sure where to go from here and most of my searches on the error have lead me to dead ends hoping someone can help me out. Thanks.

3 2

Using PAM and passwdfile together
by Jim Garrison 02 Jul '15

02 Jul '15

Dovecot 2.0.9 on Centos 6.6 I have some local users and some Postfix virtual mailboxes. The config currently has: > # 2.0.9: /etc/dovecot/dovecot.conf > # OS: Linux 2.6.32-504.12.2.el6.x86_64 x86_64 CentOS release 6.6 (Final) > first_valid_uid = 190 > log_path = /var/log/dovecot.log > mail_access_groups = mail > mail_location = mbox:~/mail:INBOX=/var/mail/%u > mbox_write_locks = fcntl > passdb { > driver = pam > } > passdb { > args = scheme=MD5 username_format=%u /etc/dovecot/auth/%d.passwd > driver = passwd-file > } > protocols = imap pop3 > ssl_ca = </etc/pki/tls/certs/ca-bundle.crt > ssl_cert = </etc/pki/dovecot/certs/mailcert.pem > ssl_key = </etc/pki/dovecot/private/mailkey.pem > ssl_parameters_regenerate = 48 > userdb { > driver = passwd > } > userdb { > args = uid=199 gid=199 home=/var/mail/vhosts/%d/%n mail=mbox:/var/mail/vhosts/%d/%n:INBOX=/var/mail/vhosts/%d/%n/mail > driver = static > } Each time a virtual mailbox user logs in, PAM writes a set of Authentication Failure messages to /var/log/secure when it attempts to find the virtual user, which it then successfully authenticates in the passwd-file. Is there a way to prevent PAM from loggin this spurious error and having dovecot log an authentication failure only if BOTH methods fail? -- Jim Garrison (jhg(a)acm.org) PGP Keys at http://www.jhmg.net RSA 0x04B73B7F DH 0x70738D88

2 1

dovecot-lmtp
by Steven Hopps 02 Jul '15

02 Jul '15

Hi, I'm trying to use dovecot-lmtp so that I can filter messages with sieve, however it doesn't appear to be working. I followed the instructions on wiki2.dovecot.org. I'm running Debian Wheezy. I've got runit configured to execute postfix and dovecot, which may be the source of the problem (runit executes /usr/sbin/dovecot -F). I've got mail_debug turned on and there is nothing in the mail log about lmtp. Any help would be appreciated. -- Steven Hopps || shopps(a)pridetechdesign.com 424-888-0443 || http://www.pridetechdesign.com = Ask about my Security Tune-Up & 24/7 Server Monitoring! =

2 4

Dovecot deleting files and directories
by Jan Ekholm 01 Jul '15

01 Jul '15

Hi, I’m a new Dovecot user and using version 2.2.18 on an OpenSuse system. In general it all works quite nicely and clients can connect to Dovecot and manage mails normally. The layout used is maildir. The users are all virtual, i.e. they do not exist on the Linux system. They all log in without any authentication due to a very specialized and internal setup. However, sometimes Dovecot simply deletes mails from the maildir structure. It also seems to delete entire users too. This is not a simple case of clients deleting mails, but the entire folder for the user seems to sometimes get nuked. I’ve also seen that only the mails and Dovecot’s admin files (indexes etc) are deleted. The log file is not really too informative, mostly lines of this form: Jul 01 14:00:36 imap(firstname.lastname(a)domain.x): Info: Disconnected: IMAP session state is inconsistent, please relogin. in=781 out=2630 Jul 01 14:00:36 imap(operators-east(a)east.domain.x): Debug: Namespace : /opt/mail/operators-east doesn't exist yet, using default permissions Jul 01 14:00:36 imap(operators-east(a)east.domain.x): Debug: Namespace : /opt/mail/operators-east doesn't exist yet, using default permissions Jul 01 14:00:36 imap(operators-east(a)east.domain.x): Debug: Namespace : Using permissions from /opt/mail/operators-east: mode=0700 gid=default Jul 01 14:00:36 imap(firstname.lastname(a)domain.x): Debug: Namespace : /opt/mail/firstname.lastname doesn't exist yet, using default permissions Jul 01 14:00:36 imap(firstname.lastname(a)domain.x): Debug: Namespace : /opt/mail/firstname.lastname doesn't exist yet, using default permissions Jul 01 14:00:36 imap(firstname.lastname(a)domain.x): Debug: Namespace : Using permissions from /opt/mail/firstname.lastname: mode=0700 gid=default Jul 01 14:01:03 imap-login: Info: Login: user=<firstname.lastname(a)domain.x>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=9326, secured, session=<2+YiPc4ZGwB/AAAB> Jul 01 14:01:03 imap(firstname.lastname(a)domain.x): Debug: Effective uid=1001, gid=100, home=/opt/mail/firstname.lastname Jul 01 14:01:03 imap(firstname.lastname(a)domain.x): Debug: maildir++: root=/opt/mail/firstname.lastname, index=, indexpvt=, control=, inbox=/opt/mail/firstname.lastname, alt= Jul 01 14:01:07 imap-login: Info: Login: user=<operators-east(a)east.domain.x>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=9333, secured, session=<11NpPc4ZHAB/AAAB> Jul 01 14:01:07 imap(operators-east(a)east.domain.x): Debug: Effective uid=1001, gid=100, home=/opt/mail/operators-east Jul 01 14:01:07 imap(operators-east(a)east.domain.x): Debug: maildir++: root=/opt/mail/operators-east, index=, indexpvt=, control=, inbox=/opt/mail/operators-east, alt= I’ve changed the name and domain. Not sure if the namespace complaints have anything to do with the directories on disk, but normally they are there when the logging comes. Below is the used config file. I can’t see anything that would trigger deletions and there is no logging or similar about it. To me it’s quite serious that an IMAP server randomly deletes mails and its own files. ########################################################################################### # support only IMAP, no pop3 protocols = imap # listen only on IPv4 (the default is: "* ::") listen = * # where logging gets sent log_path = /var/log/dovecot.log # disable SSL ssl = no disable_plaintext_auth = no # we're using maildir without any extra folders in the user's home directory (set in userdb) mail_location = maildir:~ # user ids default_login_user = dovenull default_internal_user = dovecot # auth config auth_verbose = yes auth_mechanisms = plain # password scheme. Uses an external Python application to verify the password. It gets # sent the username and password and can perform authentication. The current one # simply accepts anything. passdb { driver = checkpassword args = /opt/dovecot-2.2.18/bin/checkpassword.py } # user database userdb { driver = static args = uid=navie gid=users home=/opt/mail/maildir/%n } ########################################################################################### Anything obviously wrong? I’ve seen that mail_location and mail_home should not be the same, but using mail_location = maildir:~/mail gives the exact same behavior. Best regards, Jan Ekholm

2 1

LDAP default value variable interpolation
by Leon Kyneur 01 Jul '15

01 Jul '15

I'm wondering if there is a way I can dynamically generate an LDAP default value by using variables. I have a configuration that works something like this on my front end proxy: pass_attrs = mail=user,\ =nopassword=y,\ =proxy=y,\ =host=mail.%d The above works perfectly well even though it seems a bit hack. I want to fetch the host field from LDAP and default it to "mail.%d" if the attribute isn't populated for the user. I have tried the following : pass_attrs = mail=user,\ =nopassword=y,\ =proxy=y,\ =host=%{ldap:mailHost:mail.%d} however the interpolation doesn't occur on the default. Just wondering if there is a way to achieve this? thanks

2 2

Getting regularly mailbox desyncs while syncing with imapc
by Michael 30 Jun '15

30 Jun '15

Hello list! I sync approximately ~1000 Mailboxes actually without any problems, except my very own mailbox - Dovecot 2.2.18 (mdbox format) running here. The server from where I sync my mails from runs Dovecot 1.2.4 (with mbox format). The last log line that I receive is: dsync(ms(a)ddnetservice.de): Warning: Mailbox changes caused a desync. You may want to run dsync again. dovecot error log: 2015-06-30 13:09:50 imap(ms(a)ddnetservice.de): Error: Corrupted transaction log file /var/vmail/ddnetservice.de/ms/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.log seq 2: indexid changed 1435401731 -> 1435662589 (sync_offset=0) This is the command for running my syncs: doveadm -o imapc_user=<remote_user> -o imapc_password=<remote_pw> -o imapc_host=<remote_host> -o imapc_features="rfc822.size fetch-headers" -o mail_prefetch_count=20 -v -D sync -R -u<local_user> imapc: &> $LOGS/$BOX.log A re-run of this command for my mailbox doesn't fix the problem. The "Inbox" remains empty. Only a "doveadm force-resync -ums(a)ddnetservice.de" fixes this problem with the exception that the Inbox still remains empty. So after force-resyncing I need to run the sync again and my Inbox remains consistent until the next imapc sync run. Actually the desync message is self-explanatory, but I wonder why this behaviour only occurs for my own Inbox (only Inbox, other directories aren't affected) and not anywhere else. Is there any possiblity to debug this? Could also the amount of new incoming mails cause this or do I have maybe a bugged mail in my original mailbox that is causing my trouble? Any hint is appreciated. Thanks, Michael

1 0

Same-server mail transfer
by Andrew Obertas 30 Jun '15

30 Jun '15

Hello, What would be the best way to perform a same-server Maildir transfer, while retaining the IMAP structure already in place, between users with the same GID but different UIDs? I've tried doveadm import but I presume it is encountering a permissions error due to the different UIDs. Worst case scenario, I could move everything over manually and then update the UIDs. I feel like there should be a more elegant solution though that I'm not immediately grasping however. -- Best regards, Andrew Obertas Junior Systems Administrator Infinet Communications Group

1 0

replication - remove/delete in storage
by lejeczek 29 Jun '15

29 Jun '15

hi, novice question - is replication supposed to replicate maildir in it's entirety? I get new mails replicated but not operations of removal/deletion, is this normal? many thanks

2 3

authenticate LDAP to email server
by robert k Wild 29 Jun '15

29 Jun '15

hi all, first things first my version and config - # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-504.el6.x86_64 x86_64 CentOS release 6.6 (Final) auth_mechanisms = plain login mail_location = maildir:~/Maildir mbox_write_locks = fcntl passdb { driver = pam } protocols = imap pop3 service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } } ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { driver = passwd } - i have installed dovecot+postfix email server and a LDAP server, if i create users on the LDAP server can dovecot pick up the usernames and create a mailbox for the individual users as atm if i want to create an email address for users i add the user to the email server and make a directory for the users mailbox and have to chmod and chown also just another question, can i set up mail groups on dovecot? cheers rob -- Regards, Robert K Wild.

4 12

cram-md5 cache problem
by d tbsky 28 Jun '15

28 Jun '15

hi: I was using scientific linux 6 and had cache problem. I upgrade to scientific linux 7 but the problem is the same, so I try to find out why. dovecot version: 2.2.10. postfix + postfixadmin environment. use dovecot-lda to deliver local mail. if I enable cache with "auth_cache_size = 102400" and enable cram-md5 with "auth_mechanisms = plain login cram-md5". I have cache problem: if I change password at postfixadmin, I can not use the new password to login imap when old password is cached. dovecot log below: Jun 28 11:50:32 auth: Debug: client in: AUTH 6 CRAM-MD5 service=imap securedsession=xjn534sZ9gB/AAAB lip=127.0.0.1 rip=127.0.0.1 lport=143 rport=36342 Jun 28 11:50:32 auth: Debug: client passdb out: CONT 6 PDQzNTU5NTA4MTQxODg5NzUuMTQzNTQ2MzQzMkBtYWlsLmxoeS5jb20udHc+ Jun 28 11:50:32 auth: Debug: client in: CONT<hidden> Jun 28 11:50:32 auth: Debug: cache(test(a)test.example.com,127.0.0.1,<xjn534sZ9gB/AAAB>): hit: <hidden> user=test(a)test.example.com userdb_home=/share/postfix/domains/test.example.com/test/home userdb_mail=maildir:/share/postfix/domains/test.example.com/test userdb_uid=143 userdb_gid=143 Jun 28 11:50:32 auth: Info: cram-md5(test(a)test.example.com,127.0.0.1,<xjn534sZ9gB/AAAB>): password mismatch Jun 28 11:50:34 auth: Debug: client passdb out: FAIL 6 user=test(a)test.example.com Jun 28 11:50:34 imap-login: Debug: Ignoring unknown passdb extra field: Jun 28 11:50:34 imap-login: Info: Disconnected (auth failed, 1 attempts in 2 secs): user=<test(a)test.example.com>, method=CRAM-MD5, rip=127.0.0.1, lip=127.0.0.1, secured, session=<xjn534sZ9gB/AAAB> if I disable "cram-md5" with "auth_mechanisms = plain login". everything is fine. dovecot log below: Jun 28 11:32:24 auth: Debug: cache(test(a)test.example.com,127.0.0.1,<WNsin4sZ6gB/AAAB>): hit: <hidden> user=test(a)test.example.com userdb_home=/share/postfix/domains/test.example.com/test/home userdb_mail=maildir:/share/postfix/domains/test.example.com/test userdb_uid=143 userdb_gid=143 Jun 28 11:32:24 auth: Info: cache(test(a)test.example.com,127.0.0.1,<WNsin4sZ6gB/AAAB>): Password mismatch Jun 28 11:32:24 auth-worker(3711): Debug: sql(test(a)test.example.com,127.0.0.1): query: SELECT username as user, password, '/share/postfix/domains/test.example.com/test/home' as userdb_home, 'maildir:/share/postfix/domains/test.example.com/test' as userdb_mail, 143 as userdb_uid, 143 as userdb_gid FROM mailbox WHERE username = 'test(a)test.example.com' AND active = '1' Jun 28 11:32:24 auth: Debug: client passdb out: OK 15 user=test(a)test.example.com Jun 28 11:32:24 auth: Debug: master in: REQUEST 1951268865 3672 15 0b198494a7e732324f6d6c507b25c13e session_pid=3956 request_auth_token Jun 28 11:32:24 auth: Debug: prefetch(test(a)test.example.com,127.0.0.1,<WNsin4sZ6gB/AAAB>): success Regards, tbskyd

1 0

Out of bounds read error in wildcard_match.c
by Hanno Böck 27 Jun '15

27 Jun '15

Hi, I discovered an out of bounds read error in the file wildcard_match.c. Here's the code: /* find the end of each string */ while (*(++mask)); mask--; while (*(++data)); data--; The problem with this: It will search for the end of the strings (zero-terminated), but it'll only start at position 1, not at position 0 (because the ++ in front of the variable will first increment and then return the value). However these strings can be empty. This can be fixed by changing ++mask to mask++ (and same for data), then there must be a -=2 instead of -- afterwards. See attached patch. I found this by compiling dovecot with address sanitizer and running the test suite. cu, -- Hanno Böck http://hboeck.de/ mail/jabber: hanno(a)hboeck.de GPG: BBB51E42

1 0

"Sensible" location for Sieve scripts
by Andrew Beverley 26 Jun '15

26 Jun '15

I'm configuring some Sieve scripts for virtual users. I'd like to keep the Sieve scripts somewhere "sensible". Currently, all the mail goes into /var/mail/vhosts/<domain>/<mailbox> So I thought a good place for the sieve script might be in there as well, for example: /var/mail/vhosts/example.com/username/sieve Is there any reason *not* to store the sieve scripts in the same location as the mail? Thanks, Andy

3 4

replication notification with chroot users
by Tim Kuijsten 25 Jun '15

25 Jun '15

I'm getting the following error when using dovecot replication: dovecot: imap(foo(a)bar.com): Error: open(/var/dovecot/replication-notify-fifo) failed: No such file or directory I guess this has something to do with the fact that every user is chrooted in it's own homedir. Does dsync support dsync notification when all users are chrooted? lmtp does not seem to have this problem so new mails get replicated, but status changes don't. Thanks. -Tim Config on source: # 2.2.15: /etc/dovecot/dovecot.conf # OS: OpenBSD 5.7 amd64 auth_debug = yes auth_mechanisms = plain login auth_verbose = yes dsync_remote_cmd = /usr/bin/ssh imap.netsend.nl first_valid_gid = 30000 first_valid_uid = 30000 last_valid_gid = 30100 last_valid_uid = 30100 mail_debug = yes mail_home = /srv/vmail/%d/%n mail_location = maildir:~/Maildir mail_plugins = " notify replication" passdb { args = /passwd driver = passwd-file } passdb { args = /passwd_smtponly driver = passwd-file } plugin { mail_replica = remoteprefix:imap.netsend.nl } protocols = imap lmtp service aggregator { fifo_listener replication-notify-fifo { mode = 0666 } unix_listener replication-notify { mode = 0666 } } service auth-worker { chroot = /etc/mail unix_listener /etc/mail/auth-worker { mode = 0600 user = $default_internal_user } user = $default_internal_user } service auth { chroot = /etc/mail unix_listener /var/spool/postfix/private/dovecot-auth { group = _postfix mode = 0600 user = _postfix } } service imap-login { inet_listener imap { port = 0 } process_min_avail = 1 } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = _postfix mode = 0600 user = _postfix } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0600 } } ssl = required ssl_cert = </etc/ssl/private/2015/chain.crt ssl_cipher_list = ECDHE-RSA-CHACHA20-POLY1305:DHE-RSA-CHACHA20-POLY1305:ECDHE-RSA-AES256-GCM-SHA384:DHE-RSA-AES256-GCM-SHA384:ECDHE-RSA-AES128-GCM-SHA256:DHE-RSA-AES128-GCM-SHA256:ECDHE-RSA-AES256-SHA384:DHE-RSA-AES256-SHA256:ECDHE-RSA-AES256-SHA:DHE-RSA-AES256-SHA; ssl_dh_parameters_length = 2048 ssl_key = </etc/ssl/private/the.key ssl_prefer_server_ciphers = yes ssl_protocols = !SSLv2 !SSLv3 userdb { args = /passwd default_fields = uid=30000 gid=30000 home=/srv/vmail/%d/%n/./ driver = passwd-file } valid_chroot_dirs = /srv/vmail verbose_ssl = yes protocol imap { mail_max_userip_connections = 20 } config on destination imap.netsend.nl: # 2.2.15: /etc/dovecot/dovecot.conf # OS: OpenBSD 5.7 amd64 auth_debug = yes auth_mechanisms = plain login auth_verbose = yes first_valid_gid = 30000 first_valid_uid = 30000 last_valid_gid = 30100 last_valid_uid = 30100 mail_debug = yes mail_home = /srv/vmail/%d/%n mail_location = sdbox:~/dbox passdb { args = /passwd driver = passwd-file } passdb { args = /passwd_smtponly driver = passwd-file } protocols = imap lmtp service auth-worker { chroot = /etc/mail unix_listener /etc/mail/auth-worker { mode = 0600 user = $default_internal_user } user = $default_internal_user } service auth { chroot = /etc/mail unix_listener /var/spool/postfix/private/dovecot-auth { group = _postfix mode = 0600 user = _postfix } } service imap-login { inet_listener imap { port = 0 } process_min_avail = 1 } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = _postfix mode = 0600 user = _postfix } } ssl = required ssl_cert = </etc/ssl/private/2015/chain.crt ssl_cipher_list = ECDHE-RSA-CHACHA20-POLY1305:DHE-RSA-CHACHA20-POLY1305:ECDHE-RSA-AES256-GCM-SHA384:DHE-RSA-AES256-GCM-SHA384:ECDHE-RSA-AES128-GCM-SHA256:DHE-RSA-AES128-GCM-SHA256:ECDHE-RSA-AES256-SHA384:DHE-RSA-AES256-SHA256:ECDHE-RSA-AES256-SHA:DHE-RSA-AES256-SHA; ssl_dh_parameters_length = 2048 ssl_key = </etc/ssl/private/the.key ssl_prefer_server_ciphers = yes ssl_protocols = !SSLv2 !SSLv3 userdb { args = /passwd default_fields = uid=30000 gid=30000 home=/srv/vmail/%d/%n/./ driver = passwd-file } valid_chroot_dirs = /srv/vmail verbose_ssl = yes protocol imap { mail_max_userip_connections = 20 }

1 0

imap-login: Authenticate PLAIN failed: Unsupported authentication mechanism - with Evolution
by lejeczek 25 Jun '15

25 Jun '15

I wonder if you know if Evolution works with dovecot TLS?

2 2

director
by jjhoffart 25 Jun '15

25 Jun '15

Hello, I am currently trying to setup dovecot with a director instance and have managed to configure to invocations of dovecot on my server but my dovecot log keeps giving me errors about authentication. A little background on my config I am running dovecot with postfix and using an LDAP directory. Here are the errors I am seeing in my logs. dovecot.log Jun 02 10:42:59 auth: Fatal: LDAP: ldap_init() failed with hosts: 1.1.1.1:389 Jun 02 10:42:59 master: Error: service(auth): command startup failed, throttling for 60 secs Jun 02 10:42:59 director: Error: Auth server disconnected unexpectedly Jun 02 10:42:59 pop3-login: Info: Disconnected: Auth process broken (disconnected before auth was ready, waited 0 secs): user=<>, rip=1.1.3.4, lip=1.1.1.1, session=<EumVoosXpQDAqAbv> Jun 02 10:43:59 auth: Fatal: LDAP: ldap_init() failed with hosts: 1.1.1.1:389 Jun 02 10:43:59 master: Error: service(auth): command startup failed, throttling for 60 secs Jun 02 10:43:59 director: Error: Auth server disconnected unexpectedly Jun 02 10:43:59 pop3-login: Info: Disconnected: Auth process broken (disconnected before auth was ready, waited 0 secs): user=<>, rip=1.1.1.1, lip=1.1.1.2, session=<rpEpposXxADAqAbv> dovecot-seive.log Jun 01 14:39:57 lda: Fatal: Internal error occurred. Refer to server log for more information. Jun 01 14:47:51 lda: Error: userdb lookup(postmaster(a)mydomain.com): Disconnected unexpectedly Jun 01 14:47:51 lda: Fatal: Internal error occurred. Refer to server log for more information. mail.log Jun 2 10:41:25 mail1 postfix/smtpd[2932]: name_mask: noanonymous Jun 2 10:41:25 mail1 postfix/smtpd[2932]: xsasl_dovecot_server_connect: Connecting Jun 2 10:41:25 mail1 postfix/smtpd[2932]: fatal: no SASL authentication mechanisms Jun 2 10:41:26 mail1 postfix/master[2068]: warning: process /usr/lib/postfix/smtpd pid 2932 exit status 1 Jun 2 10:41:26 mail1 postfix/master[2068]: warning: /usr/lib/postfix/smtpd: bad command startup -- throttling Jun 2 10:43:06 mail1 postfix/anvil[2934]: statistics: max connection rate 1/60s for (smtp:0.0.0.0) at Jun 2 10:41:25 Jun 2 10:43:06 mail1 postfix/anvil[2934]: statistics: max connection count 1 for (smtp:0.0.0.0) at Jun 2 10:41:25 Jun 2 10:43:06 mail1 postfix/anvil[2934]: statistics: max cache size 1 at Jun 2 10:41:25

2 1

Namespace Translation / IMAP Proxying
by Daniel van Ham Colchete 25 Jun '15

25 Jun '15

Hello everyone! About three years ago we migrated from Courier do Dovecot using the procedure at http://wiki2.dovecot.org/Migration/Courier. So we have a namespace prefix os "INBOX.". We are trying to implement the SOGo collaboration with Exchange ActiveSync integration with Android Lollipop devices. So, in this exact configuration (namespace prefix + ActiveSync + Android Lollipop) things dont work really well [1]. I'm trying to get an IMAP Proxy of any kind in front of my Dovecot system to translate my namespaces when SOGo connects to it. So instead of presenting INBOX and INBOX.Sent it should show INBOX and Sent. I tried to do it with imapc but couldn't find any configuration that would allow it. I also looked at Perdition IMAP Proxy and NGINX but couldn't find it there also. Does anyone knows a way to do it? Best, Daniel Colchete [1] https://lists.inverse.ca/sogo/arc/users/2015-06/msg00301.html

1 0

Fatal: -N parameter requires syncing with remote host
by lejeczek 25 Jun '15

25 Jun '15

hi I get with default (not declared) replication_dsync_parameters above errors, and for users that I'm trying to disable replication. I'm trying to disable with: override_fields = mail_replica="" in userdb and just in case (ldap) also user_attrs = =mail_replica="" my replication conf is pretty basic: service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0660 } } service aggregator { fifo_listener replication-notify-fifo { user = vmail group = Domain Users mode = 0660 } unix_listener replication-notify { user = vmail group = Domain Users } } service doveadm { inet_listener { port = 12345 } } doveadm_password = secret # I can tell simple test: doveadm -v sync -f -u my(a)my.domain ssh vmail@server doveadm dsync-server -u me(a)my.domain works. It's for a user that I don't want replication. What am I missing here? many thanks

1 0

Re: Virtual Mailboxes
by dmiller＠amfes.com 25 Jun '15

25 Jun '15

My next bonehead maneuver - was more of the first! location = virtual:/var/mail/%%d/%%n/mdbox/mailboxes/virtual was adapted from my definition for my shared namespace. Which was intended to share OTHER users - which is why the '%%' prefixes are used. Changing to: location = virtual:/var/mail/%d/%n/mdbox/mailboxes/virtual Now I can actually view something! But I still have a challenge - the mailboxes don't allow subscriptions via IMAP. If I manually edit the "subscriptions" file I can force it and I can now browse & view - but I can't make changes via IMAP clients. What else am I missing? -- Daniel On 2015-06-22 10:31, dmiller(a)amfes.com wrote: > Any ideas on what I need to check or should post to help find the > problem? > > -- > Daniel > > > On 2015-06-20 14:50, dmiller(a)amfes.com wrote: >> The first bonehead maneuver seems to be: >> location = virtual:/var/mail/%%d/%%n/mdbox/virtual >> I'm thinking it should be: >> location = virtual:/var/mail/%%d/%%n/mdbox/mailboxes/virtual >> >> But...it didn't seem to make a difference. And if I have the >> "virtual" folder tree under a location other than >> "/var/mail/domain/user/mdbox/mailboxes" no names appear - so I think I >> have the files in the right place. Any ideas? >> >> -- >> Daniel >> >> >> On 2015-06-20 14:34, dmiller(a)amfes.com wrote: >>> >>> Having some trouble with my first attempt at virtual mailboxes. I've >>> enabled the plugin in 10-mail.conf, added a virtual namespace, and >>> created the dovecot-virtual files in the folders. >>> >>> I see the folder names in the list when I refresh the folders >>> available for subscription - but the folders cannot be subscribed to >>> and I can't view their contents. What obvious mistake did I make? >>> >>> doveconf -n: >>> auth_cache_size = 4 k >>> auth_mechanisms = plain login >>> default_login_user = nobody >>> default_vsz_limit = 1 G >>> dict { >>> acl = mysql:/usr/local/etc/dovecot/dovecot-dict-sql.conf.ext >>> } >>> disable_plaintext_auth = no >>> listen = * >>> mail_attachment_dir = /var/mail/attachments >>> mail_plugins = fts fts_solr acl zlib virtual >>> mail_shared_explicit_inbox = yes >>> managesieve_notify_capability = mailto >>> managesieve_sieve_capability = fileinto reject envelope >>> encoded-character vacation subaddress comparator-i;ascii-numeric >>> relational regex imap4flags copy include variables body enotify >>> environment mailbox date index ihave duplicate >>> mdbox_rotate_interval = 1 days >>> mdbox_rotate_size = 32 M >>> namespace { >>> hidden = no >>> inbox = yes >>> list = yes >>> location = >>> prefix = >>> separator = / >>> subscriptions = yes >>> type = private >>> } >>> namespace { >>> list = children >>> location = mdbox:/var/mail/%%d/%%n/mdbox >>> prefix = shared/%%n/ >>> separator = / >>> subscriptions = no >>> type = shared >>> } >>> namespace { >>> location = virtual:/var/mail/%%d/%%n/mdbox/virtual >>> prefix = virtual/ >>> separator = / >>> } >>> passdb { >>> args = /usr/local/etc/dovecot/dovecot-ldap.conf >>> driver = ldap >>> } >>> plugin { >>> acl = vfile:/usr/local/etc/dovecot/global-acls:cache_secs=300 >>> acl_shared_dict = proxy::acl >>> fts = solr >>> fts_autoindex = yes >>> fts_solr = break-imap-search url=http://solr.amfes.lan:8983/solr/ >>> sieve = ~/.dovecot.sieve >>> sieve_dir = ~/sieve >>> } >>> protocols = imap lmtp sieve >>> service auth { >>> unix_listener /var/spool/postfix/private/auth { >>> group = postfix >>> mode = 0660 >>> user = postfix >>> } >>> unix_listener auth-userdb { >>> group = mail >>> mode = 0600 >>> user = vmail >>> } >>> } >>> service dict { >>> unix_listener dict { >>> group = mail >>> mode = 0660 >>> user = vmail >>> } >>> } >>> service imap-login { >>> process_limit = 200 >>> process_min_avail = 10 >>> service_count = 1 >>> } >>> service lmtp { >>> process_min_avail = 5 >>> unix_listener /var/spool/postfix/private/dovecot-lmtp { >>> group = mail >>> mode = 0666 >>> user = vmail >>> } >>> } >>> service managesieve-login { >>> inet_listener sieve { >>> port = 4190 >>> } >>> inet_listener sieve_deprecated { >>> port = 2000 >>> } >>> process_min_avail = 0 >>> service_count = 1 >>> } >>> ssl_cert = </usr/local/etc/dovecot/ssl/certs/mail.amfes.com.crt >>> ssl_key = </usr/local/etc/dovecot/ssl/private/mail.amfes.com.key >>> userdb { >>> driver = prefetch >>> } >>> userdb { >>> args = /usr/local/etc/dovecot/dovecot-ldap.conf >>> driver = ldap >>> } >>> verbose_proctitle = yes >>> protocol lmtp { >>> mail_plugins = fts fts_solr acl zlib virtual sieve >>> } >>> protocol lda { >>> mail_plugins = fts fts_solr acl zlib virtual sieve >>> } >>> protocol imap { >>> imap_client_workarounds = tb-extra-mailbox-sep >>> imap_idle_notify_interval = 29 mins >>> mail_max_userip_connections = 50 >>> mail_plugins = fts fts_solr acl zlib virtual imap_acl >>> } >>> local 192.168.0.2 { >>> protocol imap { >>> ssl_cert = </usr/local/etc/dovecot/ssl/certs/mail.amfes.com.crt >>> ssl_key = </usr/local/etc/dovecot/ssl/private/mail.amfes.com.key >>> } >>> } >>> >>> Given my mail storage location of /var/mail/%%d/%%n, I have created: >>> /var/mail/mydomain/myname/virtual/newfolder >>> >>> and within that folder created a dovecot-virtual. I created a few >>> like >>> this from the wiki samples - the folder names are visible but no >>> contents. >>> >>> -- >>> Daniel

1 0

EXT4/LVM recommendations for 3TB of mdbox ?
by Nicolas C. 25 Jun '15

25 Jun '15

Hello, Do you have recommendations on EXT4 and LVM options for a 3TB file-system for mdbox? We currently use the mbox format on a XFS with poor performances since the update in v2.1 (Debian). We will switch to EXT4 to have the possibility of shrinking the file-system if needed (which is not possible with XFS), we currently have LVM partitions but with mdbox we will use LVM snapshots to backup the server in a consistent state. So, - any particular options to use with mkfs.ext4 for the creation of the FS ? - do you recommend a «thin» logical volume ? Our storage (IBM Storwize v7000) already have thin provisioning capabilities. The server will be a VMware virtual machine running Debian with RDM LUNs of 500GB. Data blocks will be automatically spread across several RAID disk (SSD, SAS, SATA) by the v7000. The «mdbox_rotate_size» will be configured around 10MB. Thanks, Nicolas C.

3 2

why would replicated to server ask for extra fs permissions?
by lejeczek 24 Jun '15

24 Jun '15

I think I'm near getting a simple replication, but on server which is still "empty" I get: Initialization failed: Namespace '': mkdir(/var/spool/mail/ccnr.biotechnology/nr412/Maildir) failed: Permission denied (euid=1187(nr412) egid=513(Domain Users) missing +w perm: /var/spool/mail, we're not in group 12(mail), dir owned by 0:12 mode=0775 but repl from server runs just fine and their configs are virtually identical. What I missed? many thanks

2 2

is it safe to have two backed used for the same user?
by lejeczek 24 Jun '15

24 Jun '15

hi everybody I wonder if it is safe (and wise) to have two passw-user databases for the same one user. I'm thinking, mail to me via pam mail to me(a)this.domain via ldap whole Maildir would be essentially the same one storage target, I see permissions have to be mangled, available to write for both vmail and actual uid. what do you think? Is it how it's done? regards

2 4

Quota question
by Ralf Hildebrandt 24 Jun '15

24 Jun '15

http://wiki2.dovecot.org/Quota/Configuration says: concat('*:bytes=', quota_limit_bytes) AS quota_rule and concat('*:bytes=', quota_limit_bytes) AS userdb_quota_rule but a generic quota_rule on the same page says: plugin { quota = maildir:User quota quota_rule = *:storage=1G quota_rule2 = Trash:storage=+100M } Are "bytes=" and "storage=" equivalent? http://wiki2.dovecot.org/UserDatabase/ExtraFields also shows "storage=": user_query = SELECT home, uid, gid, \ '*:storage=100M' as quota_rule, mail_plugins, \ 'gz' as `plugin/zlib_save` FROM users WHERE userid = '%u' -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstraße 15, 81669 München Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein

1 1

Migration from courier-imap to dovecot
by alex 23 Jun '15

23 Jun '15

hello, I search a solution to migrate a courier-impa mail accounts in maildir format to a dovecot mail accounts in sandbox format. The first server is an ubuntu 10.4 with courier-imap in maildir format, the accounts are managed by postfix 2.7.0 with MySQL The second server is an debian 7.8 (wheezy) with dovecot 2.2.13 in sdbox format, the accounts are managed by postfix 2.9.6 with MySQL My request is, how to import and convert the mail accounts ?? cordially, *--* *Alexandre Bagouet*

2 1

Assert test not compatible with s390(x) and ppc64 architectures
by Michal Hlavinka 23 Jun '15

23 Jun '15

Hi, we have found that assert test fails on some architectures: test-net.c:59: Assert failed: net_addr2ip("127.0.0.1", &ip) == 0 && ip.family == AF_INET && ip.u.ip4.s_addr == (127 | (1 << 24)) It seems as bug in test suit as test is expecting IPv4 address in LE format (0x0100007f), but it gets address in BE format(0x7f000001). Patch in attachment should fix this issue. Regards Michal Hlavinka

1 0

passdb pam and args/format
by lejeczek 23 Jun '15

23 Jun '15

I wonder if queries to/via pam are formatable? What I'm thinking I'd like to try is to use pam with users(a)local.domain. And I guess I'd have to loose domain part somehow. many thanks

1 0

a temporary failure
by lejeczek 23 Jun '15

23 Jun '15

dear all I have a postfix relaying to dovecot's lda but "strangely" it does not work, I mean I imaging it's me doing something wrong, yet I cannot figure out what. postfix logs: to=<me(a)my.domain>,orig_to=<root@localhost>, relay=dovecot, delay=39296, delays=39294/2.2/0/0.27, dsn=4.3.0, status=deferred (temporary failure) and dovecot logs no error, despite having debug to yes in couple of places, it shows: auth: Debug: master in: USER 1 me(a)my.domain service=lda auth-worker(25343): Debug: passwd(me(a)my.domain): lookup auth-worker(25343): passwd(me(a)my.domain): unknown user auth: Debug: ldap(me(a)my.domain): user search: base=ou=People,dc=my,dc=domain scope=subtree filter=(&(objectClass=person)(uid=me)) fields= auth: Debug: ldap(me(a)my.domain): result: objectClass=top,top,top,top, ... here goes the whole lot of ldap atrribs, and at the end: unused. For passdb & userdb in the configs I only configure ldap backed, nothing else. Ldap works, I can query it without failling. I believe it's very simple set up but I must be wrong somewhere. pass_filter = (&(objectClass=posixAccount)(uid=%n)) pass_attrs = uid=user=%n,userPassword=password user_attrs = =home=/var/spool/mail/%d/%n,=mail=maildir:/var/spool/mail/%d/%n/Maildir:INDEX=/var/spool/mail/%d/%n:CONTROL=/var/spool/mail/%d/%n user_filter = (&(objectClass=person)(uid=%n)) Any suggestions very appreciated. thanks

5 18

Proxy to more Servers
by Luca Bertoncello 23 Jun '15

23 Jun '15

Hi list! Finally I got the LDAP-Authentication work (it was a problem of the OU-Path... :( ). Now I can authenticate the user against the AD and forwarding the IMAP-Connection to the Exchange Server. Wow! My next problem: we have TWO ADs and TWO Exchange-Servers. The first AD has the users for the first Exchange, and the second AD for the second Exchange. I defined two files so: auth-ldap-OLDAD.conf.ext: passdb { driver = ldap args = /etc/dovecot/dovecot-ldap-OLDAD.conf.ext } userdb { driver = ldap args = /etc/dovecot/dovecot-ldap-OLDAD.conf.ext default_fields = imapc_user=%u imapc_password=%w imapc_ssl=imaps imapc_host=sphinx.company.local imapc_port=993 driver=imap uid=imapproxy gid=imapproxy home=/home/imapproxy } auth-ldap-NEWAD.conf.ext: passdb { driver = ldap args = /etc/dovecot/dovecot-ldap-NEWAD.conf.ext } userdb { driver = ldap args = /etc/dovecot/dovecot-ldap-NEWAD.conf.ext default_fields = imapc_user=%u imapc_password=%w imapc_ssl=imaps imapc_host=exchange01.ad.company.org imapc_port=993 driver=imap uid=imapproxy gid=imapproxy home=/home/imapproxy } Well, the authentication works as expected, but when a user of the second AD/Exchanges tries to log in, after a SUCCESSFULLY authentication can't speak with the new Exchange server... :( In the log of Dovecot I see: Jun 23 15:07:58 proxy01 dovecot: imap(chorris): Error: User initialization failed: Namespace '': Mailbox list driver imapc: missing imapc_host Jun 23 15:07:58 proxy01 dovecot: imap(chorris): Error: Invalid user settings. Refer to server log for more information. Could someone explain me, why the configuration for imapc_host in the second file are ignored? Thanks Luca Bertoncello (lucabert(a)lucabert.de)

1 0

allowing shell users to change passwords
by dave＠661.org 23 Jun '15

23 Jun '15

Does anyone else here have a need to allow shell users to change their imap/pop3 passwords? I came up with a little thing that works similarly to regular passwd(1), dovepasswd, which can be found at https://github.com/DavidGriffith/dovepasswd. It does the job for me and I'd love for other people to take a look and give me some feedback. -- David Griffith dave(a)661.org A: Because it fouls the order in which people normally read text. Q: Why is top-posting such a bad thing? A: Top-posting. Q: What is the most annoying thing in e-mail?

2 1

Problem with LDAP... again...
by Luca Bertoncello 23 Jun '15

23 Jun '15

Hi list! I'm always trying to configure Dovecot to ask our LDAP-Server (AD) in order to authenticate the users. I really don'know what can I do wrong... I configured my Dovecot so: hosts = chimaera.company.local dn = CN=mailproxy,CN=Users,DC=company,DC=local dnpass = SECRET sasl_bind = no tls = no debug_level = -1 auth_bind = yes ldap_version = 3 base = dc=company,dc=local deref = never scope = subtree user_filter = (&(sAMAccountName=%n)(objectClass=user)) pass_attrs = userPassword=password pass_filter = (&(samAccountName=%n)(objectClass=user)) default_pass_scheme = CRYPT If I try to login in, with my login and password, I see with ngrep that Dovecot ask the AD for my data AND GET THEM, then I see: T 10.0.46.4:49204 -> 192.168.168.23:389 [AP] 0p...ck."DC=DomainDnsZones,DC=company,DC=local................4....samAccountName..bertoncello....objectClass..user0. # T 192.168.168.23:389 -> 10.0.46.4:49204 [AP] 0........e................000004DC: LdapErr: DSID-0C0906E8, comment: In order to perform this operation a successful bind must be completed on the connection., data 0, v1db1. This is what I see in Dovecot's log: Jun 23 11:26:43 proxy01 dovecot: auth: Debug: client in: AUTH#0111#011PLAIN#011service=imap#011secured#011session=7z8T/SsZ2AAKADPG#011lip=10.0.46.4#011rip=10.0.51.198#011lport=143#011rport=38104#011resp=<hidden> Jun 23 11:26:43 proxy01 dovecot: auth: Debug: ldap(bertoncello,10.0.51.198,<7z8T/SsZ2AAKADPG>): bind search: base=dc=company,dc=local filter=(&(samAccountName=bertoncello)(objectClass=user)) Jun 23 11:26:43 proxy01 dovecot: auth: Error: ldap_search Jun 23 11:26:43 proxy01 dovecot: auth: Error: put_filter: "(&(samAccountName=bertoncello)(objectClass=user))" Jun 23 11:26:43 proxy01 dovecot: auth: Error: put_filter: AND Jun 23 11:26:43 proxy01 dovecot: auth: Error: put_filter_list "(samAccountName=bertoncello)(objectClass=user)" Jun 23 11:26:43 proxy01 dovecot: auth: Error: put_filter: "(samAccountName=bertoncello)" Jun 23 11:26:43 proxy01 dovecot: auth: Error: put_filter: simple Jun 23 11:26:43 proxy01 dovecot: auth: Error: put_simple_filter: "samAccountName=bertoncello" Jun 23 11:26:43 proxy01 dovecot: auth: Error: put_filter: "(objectClass=user)" Jun 23 11:26:43 proxy01 dovecot: auth: Error: put_filter: simple Jun 23 11:26:43 proxy01 dovecot: auth: Error: put_simple_filter: "objectClass=user" Jun 23 11:26:43 proxy01 dovecot: auth: Error: ldap_build_search_req ATTRS: Jun 23 11:26:43 proxy01 dovecot: auth: Error: ldap_send_initial_request Jun 23 11:26:43 proxy01 dovecot: auth: Error: ldap_send_server_request Jun 23 11:26:43 proxy01 dovecot: auth: Error: ldap_result ld 0x1920bb0 msgid -1 Jun 23 11:26:43 proxy01 dovecot: auth: Error: wait4msg ld 0x1920bb0 msgid -1 (timeout 0 usec) Jun 23 11:26:43 proxy01 dovecot: auth: Error: wait4msg continue ld 0x1920bb0 msgid -1 all 0 Jun 23 11:26:43 proxy01 dovecot: auth: Error: ** ld 0x1920bb0 Connections: Jun 23 11:26:43 proxy01 dovecot: auth: Error: * host: chimaera.company.local port: 389 (default) Jun 23 11:26:43 proxy01 dovecot: auth: Error: refcnt: 2 status: Connected Jun 23 11:26:43 proxy01 dovecot: auth: Error: last used: Tue Jun 23 11:26:43 2015 Jun 23 11:26:43 proxy01 dovecot: auth: Error: Jun 23 11:26:43 proxy01 dovecot: auth: Error: Jun 23 11:26:43 proxy01 dovecot: auth: Error: ** ld 0x1920bb0 Outstanding Requests: Jun 23 11:26:43 proxy01 dovecot: auth: Error: * msgid 2, origid 2, status InProgress Jun 23 11:26:43 proxy01 dovecot: auth: Error: outstanding referrals 0, parent count 0 Jun 23 11:26:43 proxy01 dovecot: auth: Error: ld 0x1920bb0 request count 1 (abandoned 0) Jun 23 11:26:43 proxy01 dovecot: auth: Error: ** ld 0x1920bb0 Response Queue: Jun 23 11:26:43 proxy01 dovecot: auth: Error: Empty Jun 23 11:26:43 proxy01 dovecot: auth: Error: ld 0x1920bb0 response count 0 Jun 23 11:26:43 proxy01 dovecot: auth: Error: ldap_chkResponseList ld 0x1920bb0 msgid -1 all 0 Jun 23 11:26:43 proxy01 dovecot: auth: Error: ldap_chkResponseList returns ld 0x1920bb0 NULL Jun 23 11:26:43 proxy01 dovecot: auth: Error: ldap_int_select Jun 23 11:26:43 proxy01 dovecot: auth: Error: read1msg: ld 0x1920bb0 msgid -1 all 0 Jun 23 11:26:43 proxy01 dovecot: auth: Error: ber_get_next failed. Jun 23 11:26:43 proxy01 dovecot: auth: Error: ldap_result ld 0x1920bb0 msgid -1 Jun 23 11:26:43 proxy01 dovecot: auth: Error: wait4msg ld 0x1920bb0 msgid -1 (timeout 0 usec) Jun 23 11:26:43 proxy01 dovecot: auth: Error: wait4msg continue ld 0x1920bb0 msgid -1 all 0 Jun 23 11:26:43 proxy01 dovecot: auth: Error: ** ld 0x1920bb0 Connections: Jun 23 11:26:43 proxy01 dovecot: auth: Error: * host: chimaera.company.local port: 389 (default) Jun 23 11:26:43 proxy01 dovecot: auth: Error: refcnt: 2 status: Connected Jun 23 11:26:43 proxy01 dovecot: auth: Error: last used: Tue Jun 23 11:26:43 2015 Jun 23 11:26:43 proxy01 dovecot: auth: Error: Jun 23 11:26:43 proxy01 dovecot: auth: Error: Jun 23 11:26:43 proxy01 dovecot: auth: Error: ** ld 0x1920bb0 Outstanding Requests: Jun 23 11:26:43 proxy01 dovecot: auth: Error: * msgid 2, origid 2, status InProgress Jun 23 11:26:43 proxy01 dovecot: auth: Error: outstanding referrals 0, parent count 0 Jun 23 11:26:43 proxy01 dovecot: auth: Error: ld 0x1920bb0 request count 1 (abandoned 0) Jun 23 11:26:43 proxy01 dovecot: auth: Error: ** ld 0x1920bb0 Response Queue: Jun 23 11:26:43 proxy01 dovecot: auth: Error: Empty Jun 23 11:26:43 proxy01 dovecot: auth: Error: ld 0x1920bb0 response count 0 Jun 23 11:26:43 proxy01 dovecot: auth: Error: ldap_chkResponseList ld 0x1920bb0 msgid -1 all 0 Jun 23 11:26:43 proxy01 dovecot: auth: Error: ldap_chkResponseList returns ld 0x1920bb0 NULL Jun 23 11:26:43 proxy01 dovecot: auth: Error: ldap_int_select Jun 23 11:26:43 proxy01 dovecot: auth: Error: read1msg: ld 0x1920bb0 msgid -1 all 0 Jun 23 11:26:43 proxy01 dovecot: auth: Error: read1msg: ld 0x1920bb0 msgid 2 message type search-entry Jun 23 11:26:43 proxy01 dovecot: auth: Error: ldap_result ld 0x1920bb0 msgid -1 Jun 23 11:26:43 proxy01 dovecot: auth: Error: wait4msg ld 0x1920bb0 msgid -1 (timeout 0 usec) Jun 23 11:26:43 proxy01 dovecot: auth: Error: wait4msg continue ld 0x1920bb0 msgid -1 all 0 Jun 23 11:26:43 proxy01 dovecot: auth: Error: ** ld 0x1920bb0 Connections: Jun 23 11:26:43 proxy01 dovecot: auth: Error: * host: chimaera.company.local port: 389 (default) Jun 23 11:26:43 proxy01 dovecot: auth: Error: refcnt: 2 status: Connected Jun 23 11:26:43 proxy01 dovecot: auth: Error: last used: Tue Jun 23 11:26:43 2015 Jun 23 11:26:43 proxy01 dovecot: auth: Error: Jun 23 11:26:43 proxy01 dovecot: auth: Error: Jun 23 11:26:43 proxy01 dovecot: auth: Error: ** ld 0x1920bb0 Outstanding Requests: Jun 23 11:26:43 proxy01 dovecot: auth: Error: * msgid 2, origid 2, status InProgress Jun 23 11:26:43 proxy01 dovecot: auth: Error: outstanding referrals 0, parent count 0 Jun 23 11:26:43 proxy01 dovecot: auth: Error: ld 0x1920bb0 request count 1 (abandoned 0) Jun 23 11:26:43 proxy01 dovecot: auth: Error: ** ld 0x1920bb0 Response Queue: Jun 23 11:26:43 proxy01 dovecot: auth: Error: Empty Jun 23 11:26:43 proxy01 dovecot: auth: Error: ld 0x1920bb0 response count 0 Jun 23 11:26:43 proxy01 dovecot: auth: Error: ldap_chkResponseList ld 0x1920bb0 msgid -1 all 0 Jun 23 11:26:43 proxy01 dovecot: auth: Error: ldap_chkResponseList returns ld 0x1920bb0 NULL Jun 23 11:26:43 proxy01 dovecot: auth: Error: ldap_int_select Jun 23 11:26:43 proxy01 dovecot: auth: Error: read1msg: ld 0x1920bb0 msgid -1 all 0 Jun 23 11:26:43 proxy01 dovecot: auth: Error: read1msg: ld 0x1920bb0 msgid 2 message type search-reference Jun 23 11:26:43 proxy01 dovecot: auth: Error: ldap_chase_v3referrals Jun 23 11:26:43 proxy01 dovecot: auth: Error: ldap_url_parse_ext(ldap://DomainDnsZones.company.local/DC=DomainDnsZones,DC=company,DC=local) Jun 23 11:26:43 proxy01 dovecot: auth: Error: re_encode_request: new msgid 3, new dn <DC=DomainDnsZones,DC=company,DC=local> Jun 23 11:26:43 proxy01 dovecot: auth: Error: re_encode_request new request is: Jun 23 11:26:43 proxy01 dovecot: auth: Error: ber_dump: buf=0x1934920 ptr=0x1934992 end=0x19358fc len=114 Jun 23 11:26:43 proxy01 dovecot: auth: Error: 0000: 65 72 30 00 65 72 30 00 00 00 00 00 00 00 00 00 er0.er0......... Jun 23 11:26:43 proxy01 dovecot: auth: Error: 0010: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ Jun 23 11:26:43 proxy01 dovecot: auth: Error: 0020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ Jun 23 11:26:43 proxy01 dovecot: auth: Error: 0030: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ Jun 23 11:26:43 proxy01 dovecot: auth: Error: 0040: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ Jun 23 11:26:43 proxy01 dovecot: auth: Error: 0050: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ Jun 23 11:26:43 proxy01 dovecot: auth: Error: 0060: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ Jun 23 11:26:43 proxy01 dovecot: auth: Error: 0070: 00 00 .. Jun 23 11:26:43 proxy01 dovecot: auth: Error: ldap_chase_v3referral: msgid 2, url "ldap://DomainDnsZones.company.local/DC=DomainDnsZones,DC=company,DC=local" Jun 23 11:26:43 proxy01 dovecot: auth: Error: ldap_send_server_request Jun 23 11:26:43 proxy01 dovecot: auth: Error: ldap_new_connection 0 1 1 Jun 23 11:26:43 proxy01 dovecot: auth: Error: ldap_int_open_connection Jun 23 11:26:43 proxy01 dovecot: auth: Error: ldap_connect_to_host: TCP DomainDnsZones.company.local:389 Jun 23 11:26:43 proxy01 dovecot: auth: Error: ldap_new_socket: 20 Jun 23 11:26:43 proxy01 dovecot: auth: Error: ldap_prepare_socket: 20 Jun 23 11:26:43 proxy01 dovecot: auth: Error: ldap_connect_to_host: Trying 192.168.168.26:389 Jun 23 11:26:43 proxy01 dovecot: auth: Error: ldap_pvt_connect: fd: 20 tm: -1 async: 0 Jun 23 11:26:43 proxy01 dovecot: auth: Error: attempting to connect: Jun 23 11:26:43 proxy01 dovecot: auth: Error: connect errno: 111 Jun 23 11:26:43 proxy01 dovecot: auth: Error: ldap_close_socket: 20 Jun 23 11:26:43 proxy01 dovecot: auth: Error: ldap_new_socket: 20 Jun 23 11:26:43 proxy01 dovecot: auth: Error: ldap_prepare_socket: 20 Jun 23 11:26:43 proxy01 dovecot: auth: Error: ldap_connect_to_host: Trying 192.168.168.23:389 Jun 23 11:26:43 proxy01 dovecot: auth: Error: ldap_pvt_connect: fd: 20 tm: -1 async: 0 Jun 23 11:26:43 proxy01 dovecot: auth: Error: attempting to connect: Jun 23 11:26:43 proxy01 dovecot: auth: Error: connect success Jun 23 11:26:43 proxy01 dovecot: auth: Error: anonymous rebind via ldap_sasl_bind("") Jun 23 11:26:43 proxy01 dovecot: auth: Error: ldap_sasl_bind Jun 23 11:26:43 proxy01 dovecot: auth: Error: ldap_send_initial_request Jun 23 11:26:43 proxy01 dovecot: auth: Error: ldap_send_server_request Jun 23 11:26:43 proxy01 dovecot: auth: Error: ldap_result ld 0x1920bb0 msgid 4 Jun 23 11:26:43 proxy01 dovecot: auth: Error: wait4msg ld 0x1920bb0 msgid 4 (timeout 100000 usec) Jun 23 11:26:43 proxy01 dovecot: auth: Error: wait4msg continue ld 0x1920bb0 msgid 4 all 1 Jun 23 11:26:43 proxy01 dovecot: auth: Error: ** ld 0x1920bb0 Connections: Jun 23 11:26:43 proxy01 dovecot: auth: Error: * host: DomainDnsZones.company.local port: 0 Jun 23 11:26:43 proxy01 dovecot: auth: Error: refcnt: 2 status: Connected Jun 23 11:26:43 proxy01 dovecot: auth: Error: last used: Tue Jun 23 11:26:43 2015 Jun 23 11:26:43 proxy01 dovecot: auth: Error: rebind in progress Jun 23 11:26:43 proxy01 dovecot: auth: Error: queue is empty Jun 23 11:26:43 proxy01 dovecot: auth: Error: Jun 23 11:26:43 proxy01 dovecot: auth: Error: * host: chimaera.company.local port: 389 (default) Jun 23 11:26:43 proxy01 dovecot: auth: Error: refcnt: 3 status: Connected Jun 23 11:26:43 proxy01 dovecot: auth: Error: last used: Tue Jun 23 11:26:43 2015 Jun 23 11:26:43 proxy01 dovecot: auth: Error: Jun 23 11:26:43 proxy01 dovecot: auth: Error: Jun 23 11:26:43 proxy01 dovecot: auth: Error: ** ld 0x1920bb0 Outstanding Requests: Jun 23 11:26:43 proxy01 dovecot: auth: Error: * msgid 4, origid 4, status InProgress Jun 23 11:26:43 proxy01 dovecot: auth: Error: outstanding referrals 0, parent count 0 Jun 23 11:26:43 proxy01 dovecot: auth: Error: * msgid 2, origid 2, status InProgress Jun 23 11:26:43 proxy01 dovecot: auth: Error: outstanding referrals 1, parent count 0 Jun 23 11:26:43 proxy01 dovecot: auth: Error: ld 0x1920bb0 request count 2 (abandoned 0) Jun 23 11:26:43 proxy01 dovecot: auth: Error: ** ld 0x1920bb0 Response Queue: Jun 23 11:26:43 proxy01 dovecot: auth: Error: Empty Jun 23 11:26:43 proxy01 dovecot: auth: Error: ld 0x1920bb0 response count 0 Jun 23 11:26:43 proxy01 dovecot: auth: Error: ldap_chkResponseList ld 0x1920bb0 msgid 4 all 1 Jun 23 11:26:43 proxy01 dovecot: auth: Error: ldap_chkResponseList returns ld 0x1920bb0 NULL Jun 23 11:26:43 proxy01 dovecot: auth: Error: ldap_int_select Jun 23 11:26:43 proxy01 dovecot: auth: Error: read1msg: ld 0x1920bb0 msgid 4 all 1 Jun 23 11:26:43 proxy01 dovecot: auth: Error: read1msg: ld 0x1920bb0 msgid 2 message type search-reference Jun 23 11:26:43 proxy01 dovecot: auth: Error: ldap_chase_v3referrals Jun 23 11:26:43 proxy01 dovecot: auth: Error: ldap_url_parse_ext(ldap://ForestDnsZones.company.local/DC=ForestDnsZones,DC=company,DC=local) Jun 23 11:26:43 proxy01 dovecot: auth: Error: re_encode_request: new msgid 5, new dn <DC=ForestDnsZones,DC=company,DC=local> Jun 23 11:26:43 proxy01 dovecot: auth: Error: re_encode_request new request is: Jun 23 11:26:43 proxy01 dovecot: auth: Error: ber_dump: buf=0x1936cc0 ptr=0x1936d32 end=0x1937c9c len=114 Jun 23 11:26:43 proxy01 dovecot: auth: Error: 0000: 65 72 30 00 65 72 30 00 00 00 00 00 00 00 00 00 er0.er0......... Jun 23 11:26:43 proxy01 dovecot: auth: Error: 0010: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ Jun 23 11:26:43 proxy01 dovecot: auth: Error: 0020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ Jun 23 11:26:43 proxy01 dovecot: auth: Error: 0030: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ Jun 23 11:26:43 proxy01 dovecot: auth: Error: 0040: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ Jun 23 11:26:43 proxy01 dovecot: auth: Error: 0050: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ Jun 23 11:26:43 proxy01 dovecot: auth: Error: 0060: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ Jun 23 11:26:43 proxy01 dovecot: auth: Error: 0070: 00 00 .. Jun 23 11:26:43 proxy01 dovecot: auth: Error: ldap_chase_v3referral: msgid 2, url "ldap://ForestDnsZones.company.local/DC=ForestDnsZones,DC=company,DC=local" Jun 23 11:26:43 proxy01 dovecot: auth: Error: ldap_send_server_request Jun 23 11:26:43 proxy01 dovecot: auth: Error: ldap_new_connection 0 1 1 Jun 23 11:26:43 proxy01 dovecot: auth: Error: ldap_int_open_connection Jun 23 11:26:43 proxy01 dovecot: auth: Error: ldap_connect_to_host: TCP ForestDnsZones.company.local:389 Jun 23 11:26:43 proxy01 dovecot: auth: Error: ldap_new_socket: 21 Jun 23 11:26:43 proxy01 dovecot: auth: Error: ldap_prepare_socket: 21 Jun 23 11:26:43 proxy01 dovecot: auth: Error: ldap_connect_to_host: Trying 192.168.168.18:389 Jun 23 11:26:43 proxy01 dovecot: auth: Error: ldap_pvt_connect: fd: 21 tm: -1 async: 0 Jun 23 11:26:43 proxy01 dovecot: auth: Error: attempting to connect: Jun 23 11:26:43 proxy01 dovecot: auth: Error: connect success Jun 23 11:26:43 proxy01 dovecot: auth: Error: anonymous rebind via ldap_sasl_bind("") Jun 23 11:26:43 proxy01 dovecot: auth: Error: ldap_sasl_bind Jun 23 11:26:43 proxy01 dovecot: auth: Error: ldap_send_initial_request Jun 23 11:26:43 proxy01 dovecot: auth: Error: ldap_send_server_request Jun 23 11:26:43 proxy01 dovecot: auth: Error: ldap_result ld 0x1920bb0 msgid 6 Jun 23 11:26:43 proxy01 dovecot: auth: Error: wait4msg ld 0x1920bb0 msgid 6 (timeout 100000 usec) Jun 23 11:26:43 proxy01 dovecot: auth: Error: wait4msg continue ld 0x1920bb0 msgid 6 all 1 Jun 23 11:26:43 proxy01 dovecot: auth: Error: ** ld 0x1920bb0 Connections: Jun 23 11:26:43 proxy01 dovecot: auth: Error: * host: ForestDnsZones.company.local port: 0 Jun 23 11:26:43 proxy01 dovecot: auth: Error: refcnt: 2 status: Connected Jun 23 11:26:43 proxy01 dovecot: auth: Error: last used: Tue Jun 23 11:26:43 2015 Jun 23 11:26:43 proxy01 dovecot: auth: Error: rebind in progress Jun 23 11:26:43 proxy01 dovecot: auth: Error: queue is empty Jun 23 11:26:43 proxy01 dovecot: auth: Error: Jun 23 11:26:43 proxy01 dovecot: auth: Error: * host: DomainDnsZones.company.local port: 0 Jun 23 11:26:43 proxy01 dovecot: auth: Error: refcnt: 2 status: Connected Jun 23 11:26:43 proxy01 dovecot: auth: Error: last used: Tue Jun 23 11:26:43 2015 Jun 23 11:26:43 proxy01 dovecot: auth: Error: rebind in progress Jun 23 11:26:43 proxy01 dovecot: auth: Error: queue is empty Jun 23 11:26:43 proxy01 dovecot: auth: Error: Jun 23 11:26:43 proxy01 dovecot: auth: Error: * host: chimaera.company.local port: 389 (default) Jun 23 11:26:43 proxy01 dovecot: auth: Error: refcnt: 4 status: Connected Jun 23 11:26:43 proxy01 dovecot: auth: Error: last used: Tue Jun 23 11:26:43 2015 Jun 23 11:26:43 proxy01 dovecot: auth: Error: Jun 23 11:26:43 proxy01 dovecot: auth: Error: Jun 23 11:26:43 proxy01 dovecot: auth: Error: ** ld 0x1920bb0 Outstanding Requests: Jun 23 11:26:43 proxy01 dovecot: auth: Error: * msgid 6, origid 6, status InProgress Jun 23 11:26:43 proxy01 dovecot: auth: Error: outstanding referrals 0, parent count 0 Jun 23 11:26:43 proxy01 dovecot: auth: Error: * msgid 4, origid 4, status InProgress Jun 23 11:26:43 proxy01 dovecot: auth: Error: outstanding referrals 0, parent count 0 Jun 23 11:26:43 proxy01 dovecot: auth: Error: * msgid 2, origid 2, status InProgress Jun 23 11:26:43 proxy01 dovecot: auth: Error: outstanding referrals 2, parent count 0 Jun 23 11:26:43 proxy01 dovecot: auth: Error: ld 0x1920bb0 request count 3 (abandoned 0) Jun 23 11:26:43 proxy01 dovecot: auth: Error: ** ld 0x1920bb0 Response Queue: I can't understand why it happens... I can't understand why Dovecot says anonymous rebind via ldap_sasl_bind(""), too... Thanks for your help! Luca Bertoncello

1 0

Problem with LDAP... again...
by Luca Bertoncello 23 Jun '15

23 Jun '15

Hi list! I'm always trying to configure Dovecot to ask our LDAP-Server (AD) in order to authenticate the users. I really don'know what can I do wrong... I configured my Dovecot so: hosts = chimaera.company.local dn = CN=mailproxy,CN=Users,DC=company,DC=local dnpass = SECRET sasl_bind = no tls = no debug_level = -1 auth_bind = yes ldap_version = 3 base = dc=company,dc=local deref = never scope = subtree user_filter = (&(sAMAccountName=%n)(objectClass=user)) pass_attrs = userPassword=password pass_filter = (&(samAccountName=%n)(objectClass=user)) default_pass_scheme = CRYPT If I try to login in, with my login and password, I see with ngrep that Dovecot ask the AD for my data AND GET THEM, then I see: T 10.0.46.4:49204 -> 192.168.168.23:389 [AP] 0p...ck."DC=DomainDnsZones,DC=company,DC=local................4....samAccountName..bertoncello....objectClass..user0. # T 192.168.168.23:389 -> 10.0.46.4:49204 [AP] 0........e................000004DC: LdapErr: DSID-0C0906E8, comment: In order to perform this operation a successful bind must be completed on the connection., data 0, v1db1. This is what I see in Dovecot's log: -- Dipl. Inf. Luca Bertoncello Hartigstraße 12 01127 Dresden Germany Tel: +49 351 4977290 Mobile: +49 177 3218409 Fax: +49 351 4977291 http://www.lucabert.de/ GPG-Key: http://www.lucabert.de/lucabert.asc E-Mail: lucabert(a)lucabert.de

1 0

LDAP authentication
by Luca Bertoncello 23 Jun '15

23 Jun '15

Hi again I'm trying to authenticate a user against an LDAP Server (well, our AD, but it can LDAP). This is my configuration: hosts = my.server.local auth_bind = yes ldap_version = 3 base = CN=Person,CN=Schema,CN=Configuration,DC=company,DC=local scope = subtree user_attrs = \ =home=/home/imapproxy/%u, \ =mail=maildir:/home/imapproxy/%u pass_attrs = uid=%u, userPassword=%w pass_filter = (&(objectClass=user)(sAMAccountName=%u)) auth_bind_userdn = company\%u If I try to login on the LDAP-Server using ldapsearch it works, but with Dovecot not... I see this in my log: Jun 22 16:14:08 proxy01 dovecot: auth: Debug: client in: AUTH#0111#011PLAIN#011service=imap#011secured#011session=+agW4xsZ4gAKADPG#011lip=10.0.46.4#011rip=10.0.51.198#011lport=143#011rport=34018#011resp=<hidden> Jun 22 16:14:08 proxy01 dovecot: auth: Debug: client passdb out: OK#0111#011user=bertoncello Jun 22 16:14:08 proxy01 dovecot: auth: Debug: master in: REQUEST#0111586495489#01117122#0111#01161785e0770d6c48e7316ab484bc2778c#011session_pid=17125#011request_auth_token Jun 22 16:14:08 proxy01 dovecot: auth: Debug: ldap(bertoncello,10.0.51.198,<+agW4xsZ4gAKADPG>): user search: base=CN=Person,CN=Schema,CN=Configuration,DC=company,DC=local scope=subtree filter=(&(objectClass=posixAccount)(uid=bertoncello)) fields= Jun 22 16:14:08 proxy01 dovecot: auth: Error: ldap(bertoncello,10.0.51.198,<+agW4xsZ4gAKADPG>): ldap_search(base=CN=Person,CN=Schema,CN=Configuration,DC=company,DC=local filter=(&(objectClass=posixAccount)(uid=bertoncello))) failed: Operations error Jun 22 16:14:08 proxy01 dovecot: auth: Debug: master userdb out: FAIL#0111586495489 Jun 22 16:14:08 proxy01 dovecot: imap: Error: Internal auth failure (client-pid=17122 client-id=1) Jun 22 16:14:08 proxy01 dovecot: imap-login: Internal login failure (pid=17122 id=1) (internal failure, 1 successful auths): user=<bertoncello>, method=PLAIN, rip=10.0.51.198, lip=10.0.46.4, mpid=17125, TLS, session=<+agW4xsZ4gAKADPG> and if I sniff with ngrep the comunication with the AD I see: #### T 10.0.46.4:58761 -> 192.168.168.23:389 [AP] 0....`........ # T 192.168.168.23:389 -> 10.0.46.4:58761 [AP] 0........a............ ## T 10.0.46.4:58761 -> 192.168.168.23:389 [AP] 0#...`......company\bertoncello..secret # T 192.168.168.23:389 -> 10.0.46.4:58761 [AP] 0........a............ ## T 10.0.46.4:58761 -> 192.168.168.23:389 [AP] 0....`........ # T 192.168.168.23:389 -> 10.0.46.4:58761 [AP] 0........a............ # T 10.0.46.4:58761 -> 192.168.168.23:389 [AP] 0.....c{.5CN=Person,CN=Schema,CN=Configuration,DC=company,DC=local................1....objectClass..posixAccount....uid..bertoncello0. # T 192.168.168.23:389 -> 10.0.46.4:58761 [AP] 0........e................000004DC: LdapErr: DSID-0C0906E8, comment: In order to perform this operation a successful bind must be completed on the connection., data 0, v1db1. ## T 10.0.46.4:58761 -> 192.168.168.23:389 [AP] 0....B. ### T 192.168.168.23:389 -> 10.0.46.4:58761 [AR] .. and I can't understand why: 1) I read "objectClass..posixAccount" 2) The authentication does not work... Thanks for your help! Luca Bertoncello (lucabert(a)lucabert.de)

4 5

Re: Dovecot 2.2.16: disappearing messages, mismatched summaries, duplicated messages, excessive full re-downloads
by Joseph Tam 22 Jun '15

22 Jun '15

David Gessel writes: > As far as anyone has been able to determine, all artifacts are > resolved. I believe it is fair to say "SOLVED." As I often start > trying to solve problems by searching the list archives, I'll append my > description of the artifacts as googlebait to the bottom of this > message. To say that disabling the use of index files solved your problems is akin to saying amputating your foot solved your bunion problems. Ordinarily, indices ought to be a benefit -- it will help with I/O bottlenecks when mailboxes or number of users get huge. I can't tell from your list of problems whether they are the result of one or many causes, but fixing the index consistency problem would go a long way toward clearing up most of your problems. If INDEX=MEMORY is working for you and you don't see performance degradation, there's no harm in using it, but in my opinion, it may benefit you in the future to get to the bottom of the indexing problem rather than to lop it off altogether. > I am curious if setting INDEX=MEMORY "disables the index completely" as > per http://wiki2.dovecot.org/MailLocation: "If you really want to, you > can also disable the index files completely by appending > :INDEX=MEMORY." Or if there are index files in memory as one might > assume taking the directive literally, and if so, if these are > functionally equivalent to, say, Courier IMAP's caching model. The latter I believe. The important words in the wiki sentence is "index files", not "indexing". Dovecot is still indexing, exept that it builds it from scratch each and every time a worker process accesses a mailbox, so incurs a fixed overhead that cannot be used for the next session. Joseph Tam <jtam.home(a)gmail.com>

1 0

Re: Virtual Mailboxes
by dmiller＠amfes.com 22 Jun '15

22 Jun '15

Any ideas on what I need to check or should post to help find the problem? -- Daniel On 2015-06-20 14:50, dmiller(a)amfes.com wrote: > The first bonehead maneuver seems to be: > location = virtual:/var/mail/%%d/%%n/mdbox/virtual > I'm thinking it should be: > location = virtual:/var/mail/%%d/%%n/mdbox/mailboxes/virtual > > But...it didn't seem to make a difference. And if I have the > "virtual" folder tree under a location other than > "/var/mail/domain/user/mdbox/mailboxes" no names appear - so I think I > have the files in the right place. Any ideas? > > -- > Daniel > > > On 2015-06-20 14:34, dmiller(a)amfes.com wrote: >> >> Having some trouble with my first attempt at virtual mailboxes. I've >> enabled the plugin in 10-mail.conf, added a virtual namespace, and >> created the dovecot-virtual files in the folders. >> >> I see the folder names in the list when I refresh the folders >> available for subscription - but the folders cannot be subscribed to >> and I can't view their contents. What obvious mistake did I make? >> >> doveconf -n: >> auth_cache_size = 4 k >> auth_mechanisms = plain login >> default_login_user = nobody >> default_vsz_limit = 1 G >> dict { >> acl = mysql:/usr/local/etc/dovecot/dovecot-dict-sql.conf.ext >> } >> disable_plaintext_auth = no >> listen = * >> mail_attachment_dir = /var/mail/attachments >> mail_plugins = fts fts_solr acl zlib virtual >> mail_shared_explicit_inbox = yes >> managesieve_notify_capability = mailto >> managesieve_sieve_capability = fileinto reject envelope >> encoded-character vacation subaddress comparator-i;ascii-numeric >> relational regex imap4flags copy include variables body enotify >> environment mailbox date index ihave duplicate >> mdbox_rotate_interval = 1 days >> mdbox_rotate_size = 32 M >> namespace { >> hidden = no >> inbox = yes >> list = yes >> location = >> prefix = >> separator = / >> subscriptions = yes >> type = private >> } >> namespace { >> list = children >> location = mdbox:/var/mail/%%d/%%n/mdbox >> prefix = shared/%%n/ >> separator = / >> subscriptions = no >> type = shared >> } >> namespace { >> location = virtual:/var/mail/%%d/%%n/mdbox/virtual >> prefix = virtual/ >> separator = / >> } >> passdb { >> args = /usr/local/etc/dovecot/dovecot-ldap.conf >> driver = ldap >> } >> plugin { >> acl = vfile:/usr/local/etc/dovecot/global-acls:cache_secs=300 >> acl_shared_dict = proxy::acl >> fts = solr >> fts_autoindex = yes >> fts_solr = break-imap-search url=http://solr.amfes.lan:8983/solr/ >> sieve = ~/.dovecot.sieve >> sieve_dir = ~/sieve >> } >> protocols = imap lmtp sieve >> service auth { >> unix_listener /var/spool/postfix/private/auth { >> group = postfix >> mode = 0660 >> user = postfix >> } >> unix_listener auth-userdb { >> group = mail >> mode = 0600 >> user = vmail >> } >> } >> service dict { >> unix_listener dict { >> group = mail >> mode = 0660 >> user = vmail >> } >> } >> service imap-login { >> process_limit = 200 >> process_min_avail = 10 >> service_count = 1 >> } >> service lmtp { >> process_min_avail = 5 >> unix_listener /var/spool/postfix/private/dovecot-lmtp { >> group = mail >> mode = 0666 >> user = vmail >> } >> } >> service managesieve-login { >> inet_listener sieve { >> port = 4190 >> } >> inet_listener sieve_deprecated { >> port = 2000 >> } >> process_min_avail = 0 >> service_count = 1 >> } >> ssl_cert = </usr/local/etc/dovecot/ssl/certs/mail.amfes.com.crt >> ssl_key = </usr/local/etc/dovecot/ssl/private/mail.amfes.com.key >> userdb { >> driver = prefetch >> } >> userdb { >> args = /usr/local/etc/dovecot/dovecot-ldap.conf >> driver = ldap >> } >> verbose_proctitle = yes >> protocol lmtp { >> mail_plugins = fts fts_solr acl zlib virtual sieve >> } >> protocol lda { >> mail_plugins = fts fts_solr acl zlib virtual sieve >> } >> protocol imap { >> imap_client_workarounds = tb-extra-mailbox-sep >> imap_idle_notify_interval = 29 mins >> mail_max_userip_connections = 50 >> mail_plugins = fts fts_solr acl zlib virtual imap_acl >> } >> local 192.168.0.2 { >> protocol imap { >> ssl_cert = </usr/local/etc/dovecot/ssl/certs/mail.amfes.com.crt >> ssl_key = </usr/local/etc/dovecot/ssl/private/mail.amfes.com.key >> } >> } >> >> Given my mail storage location of /var/mail/%%d/%%n, I have created: >> /var/mail/mydomain/myname/virtual/newfolder >> >> and within that folder created a dovecot-virtual. I created a few like >> this from the wiki samples - the folder names are visible but no >> contents. >> >> -- >> Daniel

1 0

Dovecot as Proxy for __MORE__ Exchange-Servers
by Luca Bertoncello 22 Jun '15

22 Jun '15

Hi list! I'm trying to configure Dovecot 2.2.18 to act as proxy. Dovecot has to authentificate the users against an LDAP-Server (AD) and then act as IMAP-Proxy to an Exchange Server. Now the problem is, that we have TWO Exchange servers (and two ADs, too). How can I say to Dovecot that it has to search for the user in the first AD (and if found proxy to the first Exchange server) and if the user was not found, to search in the second AD (and if found proxy to the second Exchange server)? Thanks a lot Luca Bertoncello (lucabert(a)lucabert.de)

1 0

Quota SQL separate queries?
by Akos Vandra 22 Jun '15

22 Jun '15

Hello, We are trying to enforce per-domain quotas. Currently my quota-sql.conf looks like this: connect = host=/var/run/postgresql dbname=mail user=mailreader map { pattern = priv/quota/storage table = quota username_field = username value_field = bytes } map { pattern = priv/quota/messages table = quota username_field = username value_field = messages } With quota = dict:Domain:%d:proxy::sqlquota This works with a trigger by updating and , however I am unable to show the administrators a list of which of their users are using the most space. That is to be purely informative, and is not to be enforced. I would appreciate if there was a documented way to specify exact SQL queries to run for inserting, updating and selecting from the quota storage, something like this: -- CREATE VIEW quota_domain AS SELECT domain, sum(bytes), sum(messages) FROM quotas GROUP BY domain INSERT/UPDATE INTO quotas(username, domain, bytes, messages) SELECT bytes, messages from quota_domain WHERE domain = %d Is there such a possibility? If not, can you suggest a workaround to have a list of per-user quota usages as well as enforced per-domain quotas? Thanks, Akos Vandra

1 0

Mailbox aliases problem
by azurIt 22 Jun '15

22 Jun '15

Hi, i'm trying to implement malbox aliases but it's not fully working as i expected. This is my configuration: mail_plugins = acl mailbox_alias plugin { mailbox_alias_old = INBOX/Odoslane mailbox_alias_new = INBOX/SentTest } That 'INBOX/' must be there because of this (we were moving from Courier IMAP): namespace inbox { type = private prefix = INBOX/ separator = / inbox = yes list = yes } All of this is working fine, if i create folder SentTest, the link to folder Odoslane is correctly created on filesystem. The problem is that folder SentTest is invisible even after creation: 1 CREATE "INBOX/SentTest" 1 OK Create completed. 2 LIST "" "*" <all folders except SentTest are listed> 2 OK List completed. 3 LIST "INBOX/SentTest" "*" 3 OK List completed. 4 LIST "INBOX/Odoslane" "*" 4 LIST (\HasNoChildren \Sent) "/" INBOX/Odoslane 4 OK List completed. 5 CREATE "INBOX/SentTest" 5 NO [ALREADYEXISTS] Mailbox already exists 6 DELETE "INBOX/SentTest" 6 OK Delete completed. None of the e-mail clients i tried can see the folder. I'm using Dovecot 2.2.13 from Debian Wheezy (wheezy-backports). Any hints? azur

1 1

help with t/s retrieval 'hangs' disconnect for inactivity
by voytek＠sbt.net.au 22 Jun '15

22 Jun '15

I have Dovecot 2.1.17 on Centos, all working well since yesterday one user complaining he can not retrieve emails, TBird mail client says like '1 of 9' and, doesn't go any further. that's on several of his PCs using TBird, on a LAN behind f/wall, quite physically remote to server, server in Sydney, remote client is SEAsia looking at logs I see emails access, looking at server Maildir , new emails get moved from 'new' to 'cur' what else can I do from server end ? what else should be done from user end ? Jun 19 11:28:31 pop3(it(a)aaaa.com.au): Info: Disconnected for inactivity in reading our output top=0/0, retr=1/0, del=0/56, size=6562805 Jun 19 11:29:20 pop3(it(a)aaa.com.au): Info: Connection closed top=0/0, retr=1/0, del=0/56, size=6562805

3 4

[Dovecot] question about /var/mail/xxx
by Mickael Choisnard 22 Jun '15

22 Jun '15

Hi, I need your help to use dovecot with sendmail I use a fresh debian 8 jessie and i installed sendmail and dovecot 2. Sendmail works fine. All mails go to /var/mail/xxx this is problem for dovecot. dovecot cannot get it. # 2.2.13: /etc/dovecot/dovecot.conf # OS: Linux 3.16.0-4-amd64 x86_64 Debian 8.1 auth_mechanisms = plain login auth_verbose = yes auth_verbose_passwords = yes disable_plaintext_auth = no first_valid_uid = 116 last_valid_uid = 116 log_path = /var/log/dovecot.log mail_home = /srv/mail/%u mail_location = mbox:~/mail:INBOX=/var/mail/%u mail_privileged_group = mail namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = scheme=SHA-CRYPT /etc/dovecot/users driver = passwd-file } postmaster_address = root@arpagon protocols = " imap pop3" service auth { unix_listener auth-userdb { group = vmail user = vmail } } ssl = no userdb { args = uid=vmail gid=vmail home=/srv/vmail/%d/%n driver = static } cat /var/log/dovecot.log Jun 19 08:14:18 imap-login: Info: Login: user=<mc110771>, method=PLAIN, rip=10.11.12.30, lip=88.179.182.93, mpid=18799, session=<z46U1dgY+gAKCwwe> Jun 19 08:14:18 imap(mc110771): Info: Disconnected: Logged out in=8 out=395 Jun 19 08:14:26 imap-login: Info: Login: user=<mc110771>, method=PLAIN, rip=10.11.12.30, lip=88.179.182.93, mpid=18801, session=<bNcE1tgY+wAKCwwe> Jun 19 08:14:26 imap-login: Info: Login: user=<mc110771>, method=PLAIN, rip=10.11.12.30, lip=88.179.182.93, mpid=18803, session=<sEIP1tgY/AAKCwwe> Jun 19 08:14:26 imap(mc120771): Error: open() failed with mbox file /var/mail/mc120771: Permission denied Jun 19 08:14:57 imap(mc120771): Info: Disconnected: Logged out in=137 out=640 Jun 19 08:14:57 imap(mc120771): Info: Disconnected: Logged out in=74 out=547 Jun 19 08:18:47 imap-login: Info: Disconnected (no auth attempts in 0 secs): user=<>, rip=10.11.12.45, lip=88.179.182.93, session=<H/mV5dgYhwAKCwwt> Jun 19 08:18:47 imap-login: Info: Disconnected (no auth attempts in 0 secs): user=<>, rip=10.11.12.45, lip=88.179.182.93, session=<2gOX5dgYigAKCwwt> Jun 19 08:18:47 imap-login: Info: Disconnected (no auth attempts in 0 secs): user=<>, rip=10.11.12.45, lip=88.179.182.93, session=<ojeY5dgYjQAKCwwt>

3 5

setting quota through IMAP
by Daniel Tröder 22 Jun '15

22 Jun '15

I'd like to set the quota of a user through the IMAP protocol. I use Pythons imaplib: imap.setquota("test1m(a)uni.dtr", "(storage 8192)") ('NO', ['Quota can be changed only by admin.']) So... which user is the "admin" user in a virtual user setting (passwd: PAM, userdb: LDAP)? Greetings Daniel

2 3

how do I conceptualize system & virtual users?
by lejeczek 22 Jun '15

22 Jun '15

I guess this would be a common case, I am hoping for some final clarification. a few Linux boxes share ldap (multi-master) backend that PAM/SSSD uses to authenticated users, and these LDAPs are also is used by Samba, users start @ uid 1000. Boxes are in the same both DNS and Samba domains. Do I treat these users as system or virtual users from postfix/dovecot perspective? If it can be a matter of choice then which is better/best? many thanks.

3 4

dovecot auth using 100% CPU
by Edward Betts 21 Jun '15

21 Jun '15

Every few days I find that dovecot auth is using all my CPU. This is from dovecot 2.2.13, I've just upgraded to 2.2.18 strace -r -p 17956 output: Process 17956 attached 0.000000 lseek(19, 0, SEEK_CUR) = -1 ESPIPE (Illegal seek) 0.000057 getsockname(19, {sa_family=AF_LOCAL, NULL}, [2]) = 0 0.000043 epoll_ctl(15, EPOLL_CTL_ADD, 19, {EPOLLIN|EPOLLPRI|EPOLLERR|EPOLLHUP, {u32=850618928, u64=140128453618224}}) = 0 0.000040 write(19, "VERSION\tauth-worker\t1\t0\nDBHASH\t5"..., 97) = -1 EPIPE (Broken pipe) 0.000035 --- SIGPIPE {si_signo=SIGPIPE, si_code=SI_USER, si_pid=17956, si_uid=108} --- 0.000020 epoll_wait(15, {{EPOLLIN|EPOLLHUP, {u32=850618928, u64=140128453618224}}}, 14, 12614) = 1 0.000031 read(19, "", 8192) = 0 0.000026 epoll_ctl(15, EPOLL_CTL_DEL, 19, 7fff77616870) = 0 0.000027 close(19) = 0 0.000029 socket(PF_LOCAL, SOCK_STREAM, 0) = 19 0.000027 fcntl(19, F_GETFL) = 0x2 (flags O_RDWR) 0.000028 fcntl(19, F_SETFL, O_RDWR|O_NONBLOCK) = 0 0.000029 connect(19, {sa_family=AF_LOCAL, sun_path="auth-worker"}, 110) = 0 0.000033 fstat(19, {st_mode=S_IFSOCK|0777, st_size=0, ...}) = 0 0.000033 lseek(19, 0, SEEK_CUR) = -1 ESPIPE (Illegal seek) 0.000026 getsockname(19, {sa_family=AF_LOCAL, NULL}, [2]) = 0 0.000030 epoll_ctl(15, EPOLL_CTL_ADD, 19, {EPOLLIN|EPOLLPRI|EPOLLERR|EPOLLHUP, {u32=850618928, u64=140128453618224}}) = 0 0.000035 write(19, "VERSION\tauth-worker\t1\t0\nDBHASH\t5"..., 97) = -1 EPIPE (Broken pipe) 0.000029 --- SIGPIPE {si_signo=SIGPIPE, si_code=SI_USER, si_pid=17956, si_uid=108} --- 0.000015 epoll_wait(15, {{EPOLLIN|EPOLLHUP, {u32=850618928, u64=140128453618224}}}, 14, 12614) = 1 0.000031 read(19, "", 8192) = 0 0.000026 epoll_ctl(15, EPOLL_CTL_DEL, 19, 7fff77616870) = 0 0.000027 close(19) = 0 0.000028 socket(PF_LOCAL, SOCK_STREAM, 0) = 19 0.000036 fcntl(19, F_GETFL) = 0x2 (flags O_RDWR) 0.000026 fcntl(19, F_SETFL, O_RDWR|O_NONBLOCK) = 0 0.000024 connect(19, {sa_family=AF_LOCAL, sun_path="auth-worker"}, 110) = 0 0.000034 fstat(19, {st_mode=S_IFSOCK|0777, st_size=0, ...}) = 0 0.000030 lseek(19, 0, SEEK_CUR) = -1 ESPIPE (Illegal seek) 0.000025 getsockname(19, {sa_family=AF_LOCAL, NULL}, [2]) = 0 0.000031 epoll_ctl(15, EPOLL_CTL_ADD, 19, {EPOLLIN|EPOLLPRI|EPOLLERR|EPOLLHUP, {u32=850618928, u64=140128453618224}}) = 0 0.000036 write(19, "VERSION\tauth-worker\t1\t0\nDBHASH\t5"..., 97) = -1 EPIPE (Broken pipe) 0.000030 --- SIGPIPE {si_signo=SIGPIPE, si_code=SI_USER, si_pid=17956, si_uid=108} --- 0.000016 epoll_wait(15, {{EPOLLIN|EPOLLHUP, {u32=850618928, u64=140128453618224}}}, 14, 12614) = 1 0.000031 read(19, "", 8192) = 0 0.000027 epoll_ctl(15, EPOLL_CTL_DEL, 19, 7fff77616870) = 0 0.000028 close(19) = 0 Any ideas what's wrong? The machine is running Debian. -- Edward.

3 2

Re: Virtual Mailboxes
by dmiller＠amfes.com 21 Jun '15

21 Jun '15

The first bonehead maneuver seems to be: location = virtual:/var/mail/%%d/%%n/mdbox/virtual I'm thinking it should be: location = virtual:/var/mail/%%d/%%n/mdbox/mailboxes/virtual But...it didn't seem to make a difference. And if I have the "virtual" folder tree under a location other than "/var/mail/domain/user/mdbox/mailboxes" no names appear - so I think I have the files in the right place. Any ideas? -- Daniel On 2015-06-20 14:34, dmiller(a)amfes.com wrote: > > Having some trouble with my first attempt at virtual mailboxes. I've > enabled the plugin in 10-mail.conf, added a virtual namespace, and > created the dovecot-virtual files in the folders. > > I see the folder names in the list when I refresh the folders > available for subscription - but the folders cannot be subscribed to > and I can't view their contents. What obvious mistake did I make? > > doveconf -n: > auth_cache_size = 4 k > auth_mechanisms = plain login > default_login_user = nobody > default_vsz_limit = 1 G > dict { > acl = mysql:/usr/local/etc/dovecot/dovecot-dict-sql.conf.ext > } > disable_plaintext_auth = no > listen = * > mail_attachment_dir = /var/mail/attachments > mail_plugins = fts fts_solr acl zlib virtual > mail_shared_explicit_inbox = yes > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope > encoded-character vacation subaddress comparator-i;ascii-numeric > relational regex imap4flags copy include variables body enotify > environment mailbox date index ihave duplicate > mdbox_rotate_interval = 1 days > mdbox_rotate_size = 32 M > namespace { > hidden = no > inbox = yes > list = yes > location = > prefix = > separator = / > subscriptions = yes > type = private > } > namespace { > list = children > location = mdbox:/var/mail/%%d/%%n/mdbox > prefix = shared/%%n/ > separator = / > subscriptions = no > type = shared > } > namespace { > location = virtual:/var/mail/%%d/%%n/mdbox/virtual > prefix = virtual/ > separator = / > } > passdb { > args = /usr/local/etc/dovecot/dovecot-ldap.conf > driver = ldap > } > plugin { > acl = vfile:/usr/local/etc/dovecot/global-acls:cache_secs=300 > acl_shared_dict = proxy::acl > fts = solr > fts_autoindex = yes > fts_solr = break-imap-search url=http://solr.amfes.lan:8983/solr/ > sieve = ~/.dovecot.sieve > sieve_dir = ~/sieve > } > protocols = imap lmtp sieve > service auth { > unix_listener /var/spool/postfix/private/auth { > group = postfix > mode = 0660 > user = postfix > } > unix_listener auth-userdb { > group = mail > mode = 0600 > user = vmail > } > } > service dict { > unix_listener dict { > group = mail > mode = 0660 > user = vmail > } > } > service imap-login { > process_limit = 200 > process_min_avail = 10 > service_count = 1 > } > service lmtp { > process_min_avail = 5 > unix_listener /var/spool/postfix/private/dovecot-lmtp { > group = mail > mode = 0666 > user = vmail > } > } > service managesieve-login { > inet_listener sieve { > port = 4190 > } > inet_listener sieve_deprecated { > port = 2000 > } > process_min_avail = 0 > service_count = 1 > } > ssl_cert = </usr/local/etc/dovecot/ssl/certs/mail.amfes.com.crt > ssl_key = </usr/local/etc/dovecot/ssl/private/mail.amfes.com.key > userdb { > driver = prefetch > } > userdb { > args = /usr/local/etc/dovecot/dovecot-ldap.conf > driver = ldap > } > verbose_proctitle = yes > protocol lmtp { > mail_plugins = fts fts_solr acl zlib virtual sieve > } > protocol lda { > mail_plugins = fts fts_solr acl zlib virtual sieve > } > protocol imap { > imap_client_workarounds = tb-extra-mailbox-sep > imap_idle_notify_interval = 29 mins > mail_max_userip_connections = 50 > mail_plugins = fts fts_solr acl zlib virtual imap_acl > } > local 192.168.0.2 { > protocol imap { > ssl_cert = </usr/local/etc/dovecot/ssl/certs/mail.amfes.com.crt > ssl_key = </usr/local/etc/dovecot/ssl/private/mail.amfes.com.key > } > } > > Given my mail storage location of /var/mail/%%d/%%n, I have created: > /var/mail/mydomain/myname/virtual/newfolder > > and within that folder created a dovecot-virtual. I created a few like > this from the wiki samples - the folder names are visible but no > contents. > > -- > Daniel

1 0

Virtual Mailboxes
by Daniel Miller 21 Jun '15

21 Jun '15

Having some trouble with my first attempt at virtual mailboxes. I've enabled the plugin in 10-mail.conf, added a virtual namespace, and created the dovecot-virtual files in the folders. I see the folder names in the list when I refresh the folders available for subscription - but the folders cannot be subscribed to and I can't view their contents. What obvious mistake did I make? doveconf -n: auth_cache_size = 4 k auth_mechanisms = plain login default_login_user = nobody default_vsz_limit = 1 G dict { acl = mysql:/usr/local/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no listen = * mail_attachment_dir = /var/mail/attachments mail_plugins = fts fts_solr acl zlib virtual mail_shared_explicit_inbox = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mdbox_rotate_interval = 1 days mdbox_rotate_size = 32 M namespace { hidden = no inbox = yes list = yes location = prefix = separator = / subscriptions = yes type = private } namespace { list = children location = mdbox:/var/mail/%%d/%%n/mdbox prefix = shared/%%n/ separator = / subscriptions = no type = shared } namespace { location = virtual:/var/mail/%%d/%%n/mdbox/virtual prefix = virtual/ separator = / } passdb { args = /usr/local/etc/dovecot/dovecot-ldap.conf driver = ldap } plugin { acl = vfile:/usr/local/etc/dovecot/global-acls:cache_secs=300 acl_shared_dict = proxy::acl fts = solr fts_autoindex = yes fts_solr = break-imap-search url=http://solr.amfes.lan:8983/solr/ sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap lmtp sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = mail mode = 0600 user = vmail } } service dict { unix_listener dict { group = mail mode = 0660 user = vmail } } service imap-login { process_limit = 200 process_min_avail = 10 service_count = 1 } service lmtp { process_min_avail = 5 unix_listener /var/spool/postfix/private/dovecot-lmtp { group = mail mode = 0666 user = vmail } } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } process_min_avail = 0 service_count = 1 } ssl_cert =

1 0

Dovecot 2.2.16: disappearing messages, mismatched summaries, duplicated messages, excessive full re-downloads
by David Gessel 20 Jun '15

20 Jun '15

My Dovecot 2.2.16 server is interacting poorly with a variety of mail clients. The symptoms include disappearing messages, mismatched summaries, duplicated messages, and excessive full re-downloads. Dovecot 2.2.16 on FreeBSD 10.1-release r280247M ZFS is interacting suboptimally with various email clients. Output of "dovecot -n" further down. *Client Artifacts* Thunderbird 31.6 Win 7 Ultimate SP1: - messages disappear and reappear with checks somewhat randomly. - Sometimes full re-download of folders is triggered, also seems random - Copies of messages appear, sometimes multiplying with each mail check up to about 5-8 or so of each message. - The summary information in the list pane doesn't match the message headers in the preview pane - quit and restart always cleans it up. - sometimes changing folders cleans it up, but not always - sometimes instigating a manual mail check cleans it up but not always Mulberry 4.08 Win 7 Ultimate SP1: - messages disappear and reappear - full re-scans of entire folders triggered occasionally when changing folders, but not always - message list filled with semi-blank entries (message number, status flags, and dates are listed, but no sender, subject, or body is available). The time stamps do not appear to be correct "date received". - message list fills with duplicates - the last of the set of duplicates, which are not necessarily sequentially numbered, has load-able body text and headers, but the others do not. There may be 3-5 copies, only one of which is the real message. The inbox is sequentially numbered by "message number" (the "natural order of the mailbox") and duplicates have unique numbers. - If there's a deleted message left, the "expunge" button is enabled and this also restores normal mailbox view. - disconnecting and reconnecting usually fixes the issues - changing mailboxes while connected sometimes fixes the issues. Claws 3.10.1 Win 7 Ultimate SP1 - initial load is correct, but once claws tries to sync mail, it locks up and never releases (even after days). Claws is weird like that. Sylpheed 3.4.2 Win 7 Ultimate SP1 - mail list always looks fine, but sometimes clicking a message shows "can't display" in the preview pane - "get messages" restores access to messages. Thunderbird 31.5 Linux Mint 17 Qaina 3.13.0-24-generic - messages disappear and reappear with checks somewhat randomly. - Sometimes full redownload of folders is triggered, also seems random - Copies of messages appear, sometimes multiplying with each mail check - The summary information in the list pane doesn't match the message headers in the preview pane - wrong message total (every other client agrees on 2576 but TB-linux says 3242, perhaps counting dups) Claws 3.9.3 Linux Mint 17 Qaina 3.13.0-24-generic - Occasionally shows "this message can't be displayed" - executing a "get mail" fixes the error K-9 5.004 Android 4.3 - messages appear and then disappear on the next check - message body is occasionally blank (only subject and arrival time appear, no body preview line, clicking on the message shows "no text" *Server artifacts:* dovecot.log shows runs of this error: Apr 15 09:02:37 imap(user(a)domain.com): Warning: Maildir /mail/domain.com/user//.Sent: Expunged message reappeared, giving a new UID (old uid=306286, file=1429102024.M826331P1156.host,S=1678,W=1724:2,S) or this error: Apr 15 10:04:00 indexer-worker(user(a)domain.com): Warning: Maildir /mail/domain.com/user//.Sent: Expunged message reappeared, giving a new UID (old uid=306803, file=1428785463.M645546P27215.host,S=5389,W=5442:2,S) # grep -c "Expunged message reappeared" dovecot.log.0 8981 The first entry in dovecot.log.0 is at Apr 15 10:00:12, and the last entry at Apr 15 12:00:13; Dovecot is logging 4,490 expunged message reappeared messages per hour. Note the server has 4 accounts set up and very limited traffic, so 4,490 per hour would seem like a lot of anything to be logged. # doveadm dump -t mailboxlog /mail/domain.com/user #0: rename 000000803de108b60f00000000000000 (1969-12-31 16:00:00) #24: 00000000000000000000000000000000 (1969-12-31 16:00:00) #48: 000000000000000000000000c8272100 (1969-12-31 16:01:04) #72: 00002e61726368697665732e32303031 (2031-02-20 10:50:40) Fatal: rec read() 10 != 24 "Fatal" seems like an error. I do not see much argument with the assertion that 10 != 24. # doveadm dump -t fts-expunge-log /mail/domain.com/user Fatal: Invalid record_size=2147483648 at offset 0 dovecot-debug.log examples follow after # dovecot -n output, which follows "fixes tried:" *Fixes Tried* # doveadm purge -A # doveadm fts rescan -u user(a)domain.com # doveadm -Dv index -u user INBOX # doveadm force-resync -u user INBOX I've set mbox_dirty_syncs = no mbox_lazy_writes = no ...in an attempt to fix the problem, but none did. I tried removing most of my customizations one by one and testing, but the problem has not been improved. I strongly suspect that the index files are getting thrashed or otherwise abused. I have no idea what's triggering whatever event is resulting in the thousands of expunged messages reappearing, but the client artifacts suggest a mismatch between cache or index files and files on disk: UID, keywords, and set date appear as if from cache but the body of the message does not. It seems as if the UID doesn't match a message on disk any more, which soon gets automatically fixed and everything syncs again until something re-triggers - a false expunge perhaps? Or perhaps the transaction log is suffering some sort of ongoing abuse? *dovecot -n* # dovecot -n # 2.2.16: /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.4.7 # OS: FreeBSD 10.1-RELEASE amd64 auth_default_realm = blackrosetech.com auth_mechanisms = plain login auth_realms = blackrosetech.com eroticanarchy.org debug_log_path = /var/log/dovecot-debug.log deliver_log_format = msgid=%m: %f $p %$ disable_plaintext_auth = no first_valid_gid = 5000 first_valid_uid = 5000 hostname = blackrosetech.com info_log_path = /var/log/dovecot-info.log last_valid_gid = 5000 last_valid_uid = 5000 lda_mailbox_autocreate = yes listen = 10.3.69.135 log_path = /var/log/dovecot.log mail_debug = yes mail_gid = 5000 mail_location = maildir:~:CONTROL=/var/no-quota/%u mail_plugins = quota mail_log notify fts fts_lucene mail_temp_dir = /var/tmp mail_uid = 5000 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate spamtest spamtestplus editheader mbox_dirty_syncs = no mbox_lazy_writes = no namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { expire = Trash fts = lucene fts_autoindex = yes fts_lucene = whitespace_chars=@. mime_parts mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size quota = maildir:User quota quota_exceeded_message = Storage quota for this account has been exceeded, please try again later. quota_rule = *:storage=50G quota_rule2 = Trash:storage=+30%% quota_rule3 = Sent:storage=+30%% quota_warning = storage=90%% quota-warning 90 %u quota_warning2 = storage=75%% quota-warning 75 %u sieve = ~/.dovecot.sieve sieve_before = /usr/local/etc/dovecot/sieve/ sieve_dir = ~/sieve sieve_extensions = +spamtest +spamtestplus +relational +comparator-i;ascii-numeric +editheader sieve_global_dir = /usr/local/etc/dovecot/sieve } postmaster_address = gessel(a)blackrosetech.com protocols = imap lmtp sieve sieve sendmail_path = /usr/local/sbin/sendmail service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0666 user = vmail } } service managesieve-login { inet_listener sieve { port = 4190 } service_count = 1 vsz_limit = 128 M } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { user = vmail } user = vmail } ssl = required ssl_cert = </usr/local/etc/ca/shiofuki-cert.pem ssl_key = </usr/local/etc/ca/shiofuki-unencrypted-key.pem ssl_prefer_server_ciphers = yes userdb { driver = prefetch } userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lda { mail_plugins = quota mail_log notify fts fts_lucene sieve } protocol imap { mail_max_userip_connections = 20 mail_plugins = quota mail_log notify fts fts_lucene imap_quota } protocol lmtp { mail_plugins = quota mail_log notify fts fts_lucene sieve } I appreciate any assistance or insight, -David *dovecot-debug.log excerpts* Apr 15 13:17:26 indexer-worker(user(a)domain.com): user-lookup(user(a)domain.com)Debug: auth input: user(a)domain.com home=/mail/domain.com/user/ mail=maildir:~/ uid=5000 gid=5000 quota_rule=*:bytes=0 Apr 15 13:17:26 indexer-worker(user(a)domain.com): user-lookup(user(a)domain.com)Debug: Added userdb setting: mail=maildir:~/ Apr 15 13:17:26 indexer-worker(user(a)domain.com): user-lookup(user(a)domain.com)Debug: Added userdb setting: plugin/quota_rule=*:bytes=0 Apr 15 13:17:26 indexer-worker(user(a)domain.com): Debug: Effective uid=5000, gid=5000, home=/mail/domain.com/user/ Apr 15 13:17:26 indexer-worker(user(a)domain.com): Debug: Quota root: name=User quota backend=maildir args= Apr 15 13:17:26 indexer-worker(user(a)domain.com): Debug: Quota rule: root=User quota mailbox=* bytes=0 messages=0 Apr 15 13:17:26 indexer-worker(user(a)domain.com): Debug: Quota rule: root=User quota mailbox=Trash bytes=0 (30%) messages=0 Apr 15 13:17:26 indexer-worker(user(a)domain.com): Debug: Quota rule: root=User quota mailbox=Sent bytes=0 (30%) messages=0 Apr 15 13:17:26 indexer-worker(user(a)domain.com): Debug: Quota warning: bytes=0 (90%) messages=0 reverse=no command=quota-warning 90 user(a)domain.com Apr 15 13:17:26 indexer-worker(user(a)domain.com): Debug: Quota warning: bytes=0 (75%) messages=0 reverse=no command=quota-warning 75 user(a)domain.com Apr 15 13:17:26 indexer-worker(user(a)domain.com): Debug: Quota grace: root=User quota bytes=0 (10%) Apr 15 13:17:26 indexer-worker(user(a)domain.com): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:~/ Apr 15 13:17:26 indexer-worker(user(a)domain.com): Debug: maildir++: root=/mail/domain.com/user/, index=, indexpvt=, control=, inbox=/mail/domain.com/user/, alt= Apr 15 13:17:27 indexer-worker(user(a)domain.com): Debug: Ignoring unknown cache field: pop3.order Apr 15 13:17:27 indexer-worker(user(a)domain.com): Debug: Ignoring unknown cache field: binary.parts Apr 15 13:17:27 indexer-worker(user(a)domain.com): Debug: Ignoring unknown cache field: body.snippet Apr 15 13:44:25 lda(user(a)domain.com): Debug: Quota root: name=User quota backend=maildir args= Apr 15 13:44:25 lda(user(a)domain.com): Debug: Quota rule: root=User quota mailbox=* bytes=53687091200 messages=0 Apr 15 13:44:25 lda(user(a)domain.com): Debug: Quota rule: root=User quota mailbox=Trash bytes=+16106127360 (30%) messages=0 Apr 15 13:44:25 lda(user(a)domain.com): Debug: Quota rule: root=User quota mailbox=Sent bytes=+16106127360 (30%) messages=0 Apr 15 13:44:25 lda(user(a)domain.com): Debug: Quota warning: bytes=48318382080 (90%) messages=0 reverse=no command=quota-warning 90 raw mail user Apr 15 13:44:25 lda(user(a)domain.com): Debug: Quota warning: bytes=40265318400 (75%) messages=0 reverse=no command=quota-warning 75 raw mail user Apr 15 13:44:25 lda(user(a)domain.com): Debug: Quota grace: root=User quota bytes=5368709120 (10%) Apr 15 13:44:25 lda(user(a)domain.com): Debug: none: root=, index=, indexpvt=, control=, inbox=, alt= Apr 15 13:49:32 lda(user(a)domain.com): Debug: Quota root: name=User quota backend=maildir args= Apr 15 13:49:32 lda(user(a)domain.com): Debug: Quota rule: root=User quota mailbox=* bytes=53687091200 messages=0 Apr 15 13:49:32 lda(user(a)domain.com): Debug: Quota rule: root=User quota mailbox=Trash bytes=+16106127360 (30%) messages=0 Apr 15 13:49:32 lda(user(a)domain.com): Debug: Quota rule: root=User quota mailbox=Sent bytes=+16106127360 (30%) messages=0 Apr 15 13:49:32 lda(user(a)domain.com): Debug: Quota warning: bytes=48318382080 (90%) messages=0 reverse=no command=quota-warning 90 raw mail user Apr 15 13:49:32 lda(user(a)domain.com): Debug: Quota warning: bytes=40265318400 (75%) messages=0 reverse=no command=quota-warning 75 raw mail user Apr 15 13:49:32 lda(user(a)domain.com): Debug: Quota grace: root=User quota bytes=5368709120 (10%) Apr 15 13:49:32 lda(user(a)domain.com): Debug: none: root=, index=, indexpvt=, control=, inbox=, alt= Apr 15 13:49:41 lda(user(a)domain.com): Debug: sieve: file storage: Using script storage path: /mail/domain.com/user//sieve Apr 15 13:49:41 lda(user(a)domain.com): Debug: sieve: file storage: Relative path to sieve storage in active link: sieve/ Apr 15 13:49:41 lda(user(a)domain.com): Debug: sieve: file script: Opened script `Forwards' from `/mail/domain.com/user/sieve/Forwards.sieve' Apr 15 13:49:41 lda(user(a)domain.com): Debug: sieve: file script: Opened script `File_Server_Msg' from `/mail/domain.com/user/sieve/File_Server_Msg.sieve' Apr 15 13:49:41 lda(user(a)domain.com): Debug: sieve: file script: Opened script `File_SRL' from `/mail/domain.com/user/sieve/File_SRL.sieve' Apr 15 13:49:41 lda(user(a)domain.com): Debug: sieve: file script: Opened script `File_BULK' from `/mail/domain.com/user/sieve/File_BULK.sieve' Apr 15 13:49:41 lda(user(a)domain.com): Debug: sieve: file script: Opened script `File_Commerce' from `/mail/domain.com/user/sieve/File_Commerce.sieve' Apr 15 13:49:41 lda(user(a)domain.com): Debug: sieve: file script: Opened script `File_Impersonal' from `/mail/domain.com/user/sieve/File_Impersonal.sieve' Apr 15 13:49:41 lda(user(a)domain.com): Debug: sieve: file script: Opened script `File_Travel' from `/mail/domain.com/user/sieve/File_Travel.sieve' Apr 15 13:49:41 lda(user(a)domain.com): Debug: sieve: file script: Opened script `File_Tribe' from `/mail/domain.com/user/sieve/File_Tribe.sieve' Apr 15 13:49:41 lda(user(a)domain.com): Debug: sieve: file script: Opened script `File_Info' from `/mail/domain.com/user/sieve/File_Info.sieve' Apr 15 13:49:41 lda(user(a)domain.com): Debug: sieve: file script: Opened script `File_Lists' from `/mail/domain.com/user/sieve/File_Lists.sieve' Apr 15 13:49:41 lda(user(a)domain.com): Debug: sieve: file script: Opened script `File_Trash' from `/mail/domain.com/user/sieve/File_Trash.sieve' Apr 15 13:49:41 lda(user(a)domain.com): Debug: sieve: file script: Opened script `File_Security' from `/mail/domain.com/user/sieve/File_Security.sieve' Apr 15 13:49:41 lda(user(a)domain.com): Debug: sieve: file script: Opened script `File_Notifications' from `/mail/domain.com/user/sieve/File_Notifications.sieve' Apr 15 13:49:41 lda(user(a)domain.com): Debug: sieve: file script: Opened script `File_Spam' from `/mail/domain.com/user/sieve/File_Spam.sieve' Apr 15 13:49:41 lda(user(a)domain.com): Debug: sieve: Script binary /mail/domain.com/user/.dovecot.svbin successfully loaded Apr 15 13:49:41 lda(user(a)domain.com): Debug: sieve: binary save: not saving binary /mail/domain.com/user/.dovecot.svbin, because it is already stored Apr 15 13:49:41 lda(user(a)domain.com): Debug: sieve: Executing script from `/mail/domain.com/user/.dovecot.svbin' Apr 15 13:49:41 lda(user(a)domain.com): Debug: Quota root: name=User quota backend=maildir args= Apr 15 13:49:41 lda(user(a)domain.com): Debug: Quota rule: root=User quota mailbox=* bytes=53687091200 messages=0 Apr 15 13:30:31 imap(user(a)domain.com): Debug: Loading modules from directory: /usr/local/lib/dovecot Apr 15 13:30:31 imap(user(a)domain.com): Debug: Module loaded: /usr/local/lib/dovecot/lib10_quota_plugin.so Apr 15 13:30:31 imap(user(a)domain.com): Debug: Module loaded: /usr/local/lib/dovecot/lib11_imap_quota_plugin.so Apr 15 13:30:31 imap(user(a)domain.com): Debug: Module loaded: /usr/local/lib/dovecot/lib15_notify_plugin.so Apr 15 13:30:31 imap(user(a)domain.com): Debug: Module loaded: /usr/local/lib/dovecot/lib20_fts_plugin.so Apr 15 13:30:31 imap(user(a)domain.com): Debug: Module loaded: /usr/local/lib/dovecot/lib20_mail_log_plugin.so Apr 15 13:30:31 imap(user(a)domain.com): Debug: Module loaded: /usr/local/lib/dovecot/lib21_fts_lucene_plugin.so Apr 15 13:30:31 imap(user(a)domain.com): Debug: Added userdb setting: plugin/quota_rule=*:bytes=0 Apr 15 13:30:31 imap(user(a)domain.com): Debug: Effective uid=5000, gid=5000, home=/mail/domain.com/user/ Apr 15 13:30:31 imap(user(a)domain.com): Debug: Quota root: name=User quota backend=maildir args= Apr 15 13:30:31 imap(user(a)domain.com): Debug: Quota rule: root=User quota mailbox=* bytes=0 messages=0 Apr 15 13:30:31 imap(user(a)domain.com): Debug: Quota rule: root=User quota mailbox=Trash bytes=0 (30%) messages=0 Apr 15 13:30:31 imap(user(a)domain.com): Debug: Quota rule: root=User quota mailbox=Sent bytes=0 (30%) messages=0 Apr 15 13:30:31 imap(user(a)domain.com): Debug: Quota warning: bytes=0 (90%) messages=0 reverse=no command=quota-warning 90 user(a)domain.com Apr 15 13:30:31 imap(user(a)domain.com): Debug: Quota warning: bytes=0 (75%) messages=0 reverse=no command=quota-warning 75 user(a)domain.com Apr 15 13:30:31 imap(user(a)domain.com): Debug: Quota grace: root=User quota bytes=0 (10%) Apr 15 13:30:31 imap(user(a)domain.com): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:~:CONTROL=/var/no-quota/user@domain.com Apr 15 13:30:31 imap(user(a)domain.com): Debug: maildir++: root=/mail/domain.com/user/, index=, indexpvt=, control=/var/no-quota/user(a)domain.com, inbox=/mail/domain.com/user/, alt=

7 29

crash dovecot 2.2.18
by Hajo Locke 19 Jun '15

19 Jun '15

Hello, after upgrading from 2.1.17 to 2.2.18 i have a specific Inbox which causes a crash on dovecot: Jun 19 09:28:03 hostname dovecot: imap(username): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x7075f) [0x7f9298c4375f] -> /usr/lib/dovecot/libdovecot.so.0(+0x707be) [0x7f9298c437be] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f9298bf11aa] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x2bd9a) [0x7f9298ee2d9a] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x98f8b) [0x7f9298f4ff8b] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mail_get_first_header+0xb9) [0x7f9298f502c9] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_get_first_header+0x38) [0x7f9298ee3d18] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xabfa2) [0x7f9298f62fa2] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xac1e2) [0x7f9298f631e2] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read+0x68) [0x7f9298c4d118] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read_data+0x3d) [0x7f9298c4da9d] -> /usr/lib/dovecot/libdovecot.so.0(message_parse_header_next+0x65) [0x7f9298c33065] -> /usr/lib/dovecot/libdovecot.so.0(message_parse_header+0x38) [0x7f9298c338d8] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mail_parse_headers+0x80) [0x7f9298f4f940] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x98cca) [0x7f9298f4fcca] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mail_get_first_header+0xb9) [0x7f9298f502c9] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_get_first_header+0x38) [0x7f9298ee3d18] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x9a85a) [0x7f9298f5185a] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mail_get_date+0x92) [0x7f9298f51972] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_get_date+0x36) [0x7f9298ee3b76] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xa3113) [0x7f9298f5a113] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_sort_list_add+0x31) [0x7f9298f5a471] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_storage_search_next_nonblock+0x3d) [0x7f9298f5801d] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_search_next_nonblock+0x27) [0x7f9298eecd67] -> dovecot/imap [username ip.ip.ip.ip UID SORT](+0x1e7f7) [0x7f92994117f7] -> dovecot/imap [username ip.ip.ip.ip UID SORT](imap_search_start+0xf1) [0x7f9299411c41] -> dovecot/imap [username ip.ip.ip.ip UID SORT](cmd_sort+0x25b) [0x7f9299407c4b] -> dovecot/imap [username ip.ip.ip.ip UID SORT](command_exec+0x4d) [0x7f929940c40d] Mailboxformat is mbox. I think reason was a damaged Index in ~username/mail/.imap/INBOX/ I removed this folder and immediately errors are gone and Mailbox was readable again. Never noticed this kind of errors for years on 2.1.17, maybe this helps to find a Bug in Code. Thanks, Hajo

1 0

dsync selectively
by lejeczek 19 Jun '15

19 Jun '15

hi everybody I've barely started reading on dsync and I wonder.. would you know if it is possible to sync/replicate only specific domain(users)? or it's always the whole lot? many thanks P.

4 8

Dovecot 2.1.9 shared folder deletion causes fault
by JT 19 Jun '15

19 Jun '15

Hey all, I'm getting a fault in dovecot (see below) using shared folders. I have a mailbox that receives new mail (Account X/INBOX). Another account (Account A) has access to the other account (Account X/INBOX) with ACL below. The ACL directory (.DEFAULT) contains: user=AccountA lrwst I removed a test email from Account A/INBOX, which is supposed to remove the email from Account X/INBOX. A fault occurs whenever my client (Thunderbird) attempts to connect and complete the deletion. Other actions complete successfully. It only appears to happen when using Thunderbird. Mac Mail does not cause the fault. I'm not getting a core dump so all I have is what the log outputs. I can reproduce this regularly so let me know if you need any additional information. Thanks, JT === Version: 2.1.9 (Ubuntu Trustydeb package) OS: Ubuntu trusty 14.04 2015-06-18T19:17:50.518505+00:00 mail-103 dovecot: imap(XXX): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x5e271) [0x7eff3f6d1271] -> /usr/lib/dovecot/libdovecot.so.0(+0x5e34e) [0x7eff3f6d134e] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7eff3f68ca9e] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xa7cbc) [0x7eff3f9e2cbc] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_copy+0x6c) [0x7eff3f9ac8ec] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_move+0x15) [0x7eff3f9ac985] -> dovecot/imap(+0xded5) [0x7eff3fe78ed5] -> dovecot/imap(command_exec+0x3c) [0x7eff3fe836dc] -> dovecot/imap(+0x176cf) [0x7eff3fe826cf] -> dovecot/imap(+0x17785) [0x7eff3fe82785] -> dovecot/imap(client_handle_input+0x125) [0x7eff3fe82aa5] -> dovecot/imap(client_input+0x75) [0x7eff3fe82e35] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x27) [0x7eff3f6e1247] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xd7) [0x7eff3f6e1fd7] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7eff3f6e0de8] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7eff3f691c93] -> dovecot/imap(main+0x2c4) [0x7eff3fe772f4] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) [0x7eff3f2cfec5] -> dovecot/imap(+0xc460) [0x7eff3fe77460] 2015-06-18T19:17:50.736901+00:00 mail-103 dovecot: imap(XXX): Fatal: master: service(imap): child 4461 killed with signal 6 (core dumped) 2015-06-18T19:17:51.662157+00:00 mail-103 dovecot: imap(XXX): Panic: file mail-index.c: line 380 (mail_index_keywords_unref): assertion failed: (keywords->refcount > 0) 2015-06-18T19:17:51.662969+00:00 mail-103 dovecot: imap(XXX): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x5e271) [0x7f3fa05bb271] -> /usr/lib/dovecot/libdovecot.so.0(+0x5e34e) [0x7f3fa05bb34e] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f3fa0576a9e] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xa7cbc) [0x7f3fa08cccbc] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_copy+0x6c) [0x7f3fa08968ec] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_move+0x15) [0x7f3fa0896985] -> dovecot/imap(+0xded5) [0x7f3fa0d62ed5] -> dovecot/imap(command_exec+0x3c) [0x7f3fa0d6d6dc] -> dovecot/imap(+0x176cf) [0x7f3fa0d6c6cf] -> dovecot/imap(+0x17785) [0x7f3fa0d6c785] -> dovecot/imap(client_handle_input+0x125) [0x7f3fa0d6caa5] -> dovecot/imap(client_input+0x75) [0x7f3fa0d6ce35] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x27) [0x7f3fa05cb247] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xd7) [0x7f3fa05cbfd7] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f3fa05cade8] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f3fa057bc93] -> dovecot/imap(main+0x2c4) [0x7f3fa0d612f4] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) [0x7f3fa01b9ec5] -> dovecot/imap(+0xc460) [0x7f3fa0d61460] 2015-06-18T19:17:51.857451+00:00 mail-103 dovecot: imap(XXX): Fatal: master: service(imap): child 4464 killed with signal 6 (core dumped) protocol imap { imap_client_workarounds = tb-extra-mailbox-sep imap_idle_notify_interval = 1 mins mail_max_userip_connections = 10 mail_plugins = acl quota acl imap_acl quota imap_quota } plugin { acl = vfile:/etc/dovecot/acl acl_defaults_from_inbox = yes acl_shared_dict = proxy::acl ... } namespace { hidden = no inbox = yes list = yes location = prefix = separator = / subscriptions = yes type = private } namespace { hidden = no list = children location = maildir:/var/mail/public/Maildir:INDEX=/var/mail/%d/%n/Maildir/public prefix = public/ separator = / subscriptions = yes type = public } namespace { list = yes location = maildir:%%h/Maildir:CONTROL=~/Maildir/control/%%u:INDEX=~/Maildir/shared/%%u.indx:INDEXPVT=~/Maildir/shared/%%u.pvt prefix = shared/%%u/ separator = / subscriptions = no type = shared }

2 1

centos 7 dovecot 2.2.10 segmentation fault on devcot/auth using ldap driver in userdb
by Andrea Lisci 19 Jun '15

19 Jun '15

dovecot 2.2.10 packaged by centos 7 configuring ldap driver on userdb cause imap crash during login userdb { driver = ldap args = /etc/dovecot/dovecot-ldap-userdb.conf3.ext # Default fields can be used to specify defaults that LDAP may override #default_fields = home=/home/virtual/%u } #ldap conf --------------- hosts = myDChost base = dc=company,dc=testdomain,dc=dom ldap_version = 3 auth_bind = yes auth_bind_userdn = windowsdomain\%u user_filter = (&(objectclass=person)(|(mail=%u)(sAMAccountName=%n))) user_attrs = =uid=vmail,=gid=vmail,=home=/users/vmail/maildomain.com/%n,=mail_location=maildir:/users/vmail/maildomain.com/%n/Maildir tls = yes tls_require_cert = never dovecot -n --------------- # 2.2.10: /etc/dovecot/dovecot.conf # OS: Linux 3.10.0-229.4.2.el7.x86_64 x86_64 CentOS Linux release 7.1.1503 (Core) xfs auth_debug = yes auth_mechanisms = plain login listen = * mail_debug = yes mail_location = maildir:/users/vmail/maildomain.com/%n/Maildir managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-ldap.conf2.ext driver = ldap } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } ssl = required ssl_cert = </etc/pki/dovecot/certs/mail.maildomain.com.crt.pem ssl_key = </etc/pki/dovecot/private/mail.maildomain.com.key.pem userdb { args = /etc/dovecot/dovecot-ldap-userdb.conf3.ext driver = ldap } protocol lmtp { mail_plugins = " quota sieve" passdb { args = password=foo driver = static } } protocol lda { mail_plugins = " sieve" } core dump ------------- gdb /usr/libexec/dovecot/auth /var/core/25122 GNU gdb (GDB) Red Hat Enterprise Linux 7.6.1-64.el7 Copyright (C) 2013 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-redhat-linux-gnu". For bug reporting instructions, please see: <http://www.gnu.org/software/gdb/bugs/>... Reading symbols from /usr/libexec/dovecot/auth...Reading symbols from /usr/lib/debug/usr/libexec/dovecot/auth.debug...done. done. [New LWP 25122] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". Missing separate debuginfo for /usr/lib64/libnssckbi.so Try: yum --enablerepo='*debug*' install /usr/lib/debug/.build-id/1e/a2171aee7143d971607597b24f2a97e9276cbb.debug Core was generated by `dovecot/auth'. Program terminated with signal 11, Segmentation fault. #0 db_ldap_handle_request_result (res=0x0, idx=<optimized out>, request=<optimized out>, conn=<optimized out>) at db-ldap.c:819 819 request->callback(conn, request, res->msg); (gdb) bt full #0 db_ldap_handle_request_result (res=0x0, idx=<optimized out>, request=<optimized out>, conn=<optimized out>) at db-ldap.c:819 _data_stack_cur_id = 3 srequest = <optimized out> ret = <optimized out> final_result = <optimized out> named_res = <optimized out> #1 db_ldap_handle_result (res=<optimized out>, conn=<optimized out>) at db-ldap.c:886 auth_request = 0x7f3704fa2620 idx = <optimized out> msgid = <optimized out> #2 ldap_input (conn=<optimized out>) at db-ldap.c:918 timeout = {tv_sec = 0, tv_usec = 0} res = 0x7f3704b1b530 msg = 0x7f370489fcb0 prev_reply_diff = <optimized out> ret = <optimized out> #3 0x00007f3702a19a47 in io_loop_call_io (io=0x7f37046dbad0) at ioloop.c:388 ioloop = 0x7f37046bd7b0 t_id = 2 #4 0x00007f3702a1a8cf in io_loop_handler_run (ioloop=ioloop@entry=0x7f37046bd7b0) at ioloop-epoll.c:220 ctx = 0x7f37046c5450 events = <optimized out> list = 0x7f3704998170 io = <optimized out> tv = {tv_sec = 0, tv_usec = 999118} events_count = <optimized out> msecs = <optimized out> ret = 1 i = 0 call = <optimized out> __FUNCTION__ = "io_loop_handler_run" #5 0x00007f3702a19598 in io_loop_run (ioloop=0x7f37046bd7b0) at ioloop.c:412 __FUNCTION__ = "io_loop_run" #6 0x00007f37029c69e3 in master_service_run (service=0x7f37046bd640, callback=<optimized out>) at master-service.c:571 No locals. #7 0x00007f3702ea77f1 in main (argc=1, argv=0x7f37046bd390) at main.c:393 c = <optimized out>

3 2

maildir, how to always add size tags to filename (,S=).
by Sergei Franco 19 Jun '15

19 Jun '15

Hi There, I have thoroughly read through documentation and wiki and I simply cannot find how to force dovecot to always add the size tag to the filename when using maildir format. We are using dovecot 2.2.9 (whatever comes from ubuntu 14.04 LTS). We are using dovecot in conjunction with exim with maidirsize file enabled and maildir quotas. For example exim has following configuration: maildir_tag = ,S=$message_size Which adds the size to the filename of the message. This has enormous (orders of magnitude) performance benefit as to calculate quota one does not need to stat every single file (only getents for each directory). I have wrote a script that adds the size tag retrospectively to files it didn't had it, and rebuild the dovecot index/cache if changes where made. This worked fine. Behaviour of dovecot is very peculiar: it generally adds the ,S= tag (along with ,W= tag) but occasionally it does not (I wander if it depends on the IMAP client). Is there anyway to force dovecot to add size tag to the files (like with exim example above)? Thank you very much. Sergei.

3 2

Best practices for mailbox network file storage?
by Andy Csillag 18 Jun '15

18 Jun '15

Is there a current best practice for a shared filesystem backend for mailboxes (in my case, all virtual accounts)? NFS 3/4, GFS2, GlusterFS, other? In the case of the latter ones, is the use of Director necessary? Any specific anti-recommendations? Also, if it matters, I *think* I want to use BackBlaze racks for storage. Also, I've seen recommendations for the filesystem underneath like XFS or ext4 or whatever. Is there a best practice? Thanks, Drew

3 2

Help with Namespaces
by Steve Matzura 18 Jun '15

18 Jun '15

Most of my users are virtual. Do I need defined namespaces or is the default undefined one OK?

2 2

LMTP with Postfix Problem
by Steve Matzura 18 Jun '15

18 Jun '15

Here's a maillog entry that's one of many I receive when I try sending a test message to my system. The recipient is a virtual user in /etc/virtual. The way I'm expecting it to work is that my message from me to this Postfix virtual user will be sent back to me. Every time the message delivery is attempted, Dovecot says the LMTP directory doesn't exist. I thought it was created automatically as messages arrive. Jun 18 01:48:27 <machine-name> postfix/lmtp[30644]: 4CA5B8CB6: to=<postmaster@<my-domain>>, orig_to=<postmaster>, relay=none, delay=0.02, delays=0.02/0/0/0, dsn=4.4.1, status=deferred (connect to <my-FQDN>[private/dovecot-lmtp]: No such file or directory)

2 2

Pigeonhole vacation from alias address
by Dino Blazeka 18 Jun '15

18 Jun '15

Hi everyone. I've set up my instance not to check recipient address with sieve_vacation_dont_check_recipient=yes to enable users to set up their vacation script without listing addresses (there are to many). Only problem remaining is that when they receive an e-mail sent to their alias, the vacation response comes from their original mail address. Is there a setting or workaround that would enable vacation extension to send response with from field set to whichever address the original message was addressed to. Thank you in advance, Dino P. S. This is my first message to the list so I apologize in advance if I have broken any rules. It was not done intentionally

1 0

get failed auth
by My Work 18 Jun '15

18 Jun '15

Hi, how i can write all users to my db (mysql example) if it is possible that get "unknown user", "auth failed" e.g.? dovecot 2.2.13 root@dev0:/home/fov# dovecot -n # 2.2.13: /etc/dovecot/dovecot.conf # OS: Linux 3.16.0-4-amd64 x86_64 Debian 8.0 ext4 auth_debug = yes auth_debug_passwords = yes auth_mechanisms = plain login auth_socket_path = /var/run/dovecot/auth-master base_dir = /var/run/dovecot/ disable_plaintext_auth = no first_valid_gid = 103 first_valid_uid = 101 listen = * mail_access_groups = mail,Debian-exim,dovecot mail_debug = yes mail_full_filesystem_access = yes mail_gid = 103 mail_location = maildir:/var/vmail/%d/%n mail_uid = 101 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date namespace inbox { inbox = yes location = prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } plugin { autocreate = Trash autocreate2 = Sent autocreate3 = Drafts autocreate4 = Junk autosubscribe = Trash autosubscribe2 = Sent autosubscribe3 = Drafts autosubscribe4 = Junk sieve = /var/vmail/%d/%n/currently-active-script.sieve sieve_dir = /var/vmail/%d/%n/sieve } protocols = imap sieve service auth { unix_listener auth-client { group = Debian-exim mode = 0666 user = Debian-exim } unix_listener auth-master { group = Debian-exim mode = 0666 user = Debian-exim } user = root } service imap-login { inet_listener imap { port = 143 } } service managesieve-login { executable = /usr/lib/dovecot/managesieve-login inet_listener sieve { port = 2074 } process_min_avail = 1 service_count = 1 vsz_limit = 64 M } service managesieve { executable = /usr/lib/dovecot/managesieve process_limit = 10 } ssl = no userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } protocol lda { auth_socket_path = /var/run/dovecot/auth-master info_log_path = /tmp/dovecot-deliver.log log_path = /tmp/dovecot-deliver.log mail_plugins = sieve postmaster_address = postmaster(a)horsetele.com.ua sendmail_path = /usr/sbin/exim4 } protocol imap { imap_client_workarounds = tb-extra-mailbox-sep mail_plugins = autocreate } protocol sieve { managesieve_implementation_string = dovecot managesieve_max_line_length = 65536 }

2 1

privilege of process executed by extprograms plugin
by Takahiro Yakoh 18 Jun '15

18 Jun '15

Hi, I'm just a beginner of extprograms plugin of sieve. When I execute a process via execute or pipe command, the process start with "root" privilege. Why? I believe the process must be executed with recipient privilege. Give me some checkpoints, or hints, please. My setup is as follows: Ubuntu 14.04.2 LTS 64bit + dovecot-core, dovecot-sieve plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_execute_bin_dir = /some/where sieve_extensions = +vnd.dovecot.execute +vnd.dovecot.pipe sieve_pipe_bin_dir = /some/where sieve_plugins = sieve_extprograms } protocol lmtp { mail_plugins = " sieve" postmaster_address = postmaster(a)some.where } Yakoh

1 0

bug in indexer/indexer-worker
by Infoomatic 18 Jun '15

18 Jun '15

Hi, I have already mentioned this in http://www.dovecot.org/pipermail/dovecot/2014-November/098592.html I could reproduce the errors above in a self-compiled v2.2.18 and the prebuilt packages from xi.rename-it.nl (in addition to version 2.2.15 mentioned in the link) The problem occurs when enabling fts_tika in the plugins (tried tika 1.6, 1.7 and 1.8). I tried to move a folder of my mailbox with about 2000 mails to my server (no users, modern hardware). At some point I get an error and from this time on dovecot keeps repeating the last lines with every mail that comes in ... see [1] I then get kernel syslog messages like in [2]. when I try to index all users (had another testuser) mailboxes with "doveadm index" I get the errors of [3]. The mailfolder does contain mails with attachments of all sorts, videos, office documents etc. When disabling fts_tika it works. dovecot -n output is [4] Could someone of the devs please have a look? best regards, infoomatic [1] Then comes the panic which produces loads of errormessages below the "Raw backtrace" part: Jun 16 10:11:08 testhost dovecot: indexer-worker(user1): Warning: I/O leak: 0x7f40b55c39d0 (line 411, fd 20) Jun 16 10:11:08 testhost dovecot: indexer-worker(user1): Warning: Timeout leak: 0x7f40b55c3780 (line 325) Jun 16 10:11:08 testhost dovecot: indexer-worker(user1): Panic: file ioloop.c: line 39 (io_add_file): assertion failed: (callback != NULL) Jun 16 10:11:08 testhost dovecot: indexer-worker(user1): Error: Raw backtrace: /opt/dovecot/lib/dovecot/libdovecot.so.0(+0x78320) [0x7f40b55f4320] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(+0x783fe) [0x7f40b55f43fe] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f40b55a3b25] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(+0x897d0) [0x7f40b56057d0] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(io_loop_move_io+0x3e) [0x7f40b560643e] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(connection_switch_ioloop+0x14) [0x7f40b55f21d4] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(http_client_switch_ioloop+0x28) [0x7f40b55c8148] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(+0x44536) [0x7f40b55c0536] -> /opt/dovecot/lib/dovecot/lib21_fts_solr_plugin.so(solr_connection_post_more+0x49) [0x7f40b108d469] -> /opt/dovecot/lib/dovecot/lib21_fts_solr_plugin.so(+0x3ac9) [0x7f40b1089ac9] -> /opt/dovecot/lib/dovecot/lib21_fts_solr_plugin.so(+0x3b6d) [0x7f40b1089b6d] -> /opt/dovecot/lib/dovecot/lib20_fts_plugin.so(+0x86ec) [0x7f40b495c6ec] -> /opt/dovecot/lib/dovecot/lib20_fts_plugin.so(fts_backend_update_deinit+0x23) [0x7f40b495c723] -> /opt/dovecot/lib/dovecot/lib20_fts_plugin.so(+0xe5cc) [0x7f40b49625cc] -> /opt/dovecot/lib/dovecot/lib20_fts_plugin.so(+0xf451) [0x7f40b4963451] -> /opt/dovecot/lib/dovecot/lib10_quota_plugin.so(+0xb454) [0x7f40b4b97454] -> /opt/dovecot/lib/dovecot/lib01_acl_plugin.so(+0xcfea) [0x7f40b4daafea] -> /opt/dovecot/lib/dovecot/libdovecot-storage.so.0(mailbox_transaction_commit_get_changes+0x41) [0x7f40b58a64f1] -> /opt/dovecot/lib/dovecot/libdovecot-storage.so.0(mailbox_transaction_commit+0xe) [0x7f40b58a658e] -> dovecot/indexer-worker() [0x40250c] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x4c) [0x7f40b560615c] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xbb) [0x7f40b56070ab] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x9) [0x7f40b56061c9] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f40b5606248] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f40b55a9093] -> dovecot/indexer-worker(main+0xe3) [0x401f03] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) [0x7f40b51d8ec5] -> dovecot/indexer-worker() [0x401fc2] Jun 16 10:11:08 testhost dovecot: indexer: Error: Indexer worker disconnected, discarding 2 requests for user1 Jun 16 10:11:08 testhost dovecot: indexer-worker(user1): Fatal: master: service(indexer-worker): child 2066 killed with signal 6 (core dumped) Jun 16 10:11:09 testhost dovecot: indexer-worker(user1): Warning: I/O leak: 0x7f25bc1689d0 (line 120, fd 23) Jun 16 10:11:09 testhost dovecot: indexer-worker(user1): Warning: Timeout leak: 0x7f25bc168780 (line 325) Jun 16 10:11:09 testhost dovecot: indexer: Error: Indexer worker disconnected, discarding 2 requests for user1 Jun 16 10:11:09 testhost dovecot: indexer-worker(user1): Fatal: master: service(indexer-worker): child 2124 killed with signal 11 (core dumped) Jun 16 10:11:09 testhost dovecot: indexer-worker(user1): Warning: I/O leak: 0x7f6cabb149d0 (line 120, fd 23) Jun 16 10:11:09 testhost dovecot: indexer-worker(user1): Warning: Timeout leak: 0x7f6cabb14780 (line 325) Jun 16 10:11:09 testhost dovecot: indexer: Error: Indexer worker disconnected, discarding 2 requests for user1 Jun 16 10:11:09 testhost dovecot: indexer-worker(user1): Fatal: master: service(indexer-worker): child 2125 killed with signal 11 (core dumped) [2] kernel syslog: [Tue Jun 16 09:51:15 2015] indexer-worker[7592]: segfault at 8 ip 00007f066e8c8c27 sp 00007fff36a038b0 error 4 in libdovecot.so.0.0.0[7f066e832000+e7000] [Tue Jun 16 09:51:16 2015] indexer-worker[7594]: segfault at 8 ip 00007f702671ac27 sp 00007ffc6e134840 error 4 in libdovecot.so.0.0.0[7f7026684000+e7000] [Tue Jun 16 09:51:16 2015] indexer-worker[7596]: segfault at 20 ip 00007fb8a5af2c47 sp 00007fff0a344780 error 4 in libdovecot.so.0.0.0[7fb8a5a69000+e7000] [Tue Jun 16 09:51:17 2015] indexer-worker[7598]: segfault at 20 ip 00007f5834b6ac47 sp 00007ffd54f35c00 error 4 in libdovecot.so.0.0.0[7f5834ae1000+e7000] [Tue Jun 16 09:51:18 2015] indexer-worker[7600]: segfault at 20 ip 00007f5b2f6fac47 sp 00007fff1a697690 error 4 in libdovecot.so.0.0.0[7f5b2f671000+e7000] [Tue Jun 16 09:51:19 2015] indexer-worker[7602]: segfault at 20 ip 00007fd6084ddc47 sp 00007ffdb4495af0 error 4 in libdovecot.so.0.0.0[7fd608454000+e7000] [Tue Jun 16 09:51:20 2015] indexer-worker[7604]: segfault at 20 ip 00007f7049789c47 sp 00007ffe71e4bdd0 error 4 in libdovecot.so.0.0.0[7f7049700000+e7000] [Tue Jun 16 09:51:20 2015] indexer-worker[7606]: segfault at 20 ip 00007f771d54dc47 sp 00007ffe01c6ff80 error 4 in libdovecot.so.0.0.0[7f771d4c4000+e7000] [Tue Jun 16 09:51:21 2015] indexer-worker[7608]: segfault at 20 ip 00007fc19d482c47 sp 00007ffc9a0b0280 error 4 in libdovecot.so.0.0.0[7fc19d3f9000+e7000] [Tue Jun 16 09:51:22 2015] indexer-worker[7610]: segfault at 29 ip 00007fa14df25c2b sp 00007ffeb246e5f0 error 4 in libdovecot.so.0.0.0[7fa14de8f000+e7000] [Tue Jun 16 09:51:23 2015] indexer-worker[7612]: segfault at 8 ip 00007fe8e41f2c27 sp 00007ffc700e2170 error 4 in libdovecot.so.0.0.0[7fe8e415c000+e7000] [Tue Jun 16 09:51:24 2015] indexer-worker[7614]: segfault at 8 ip 00007ff9a0c76c27 sp 00007fffecd44c90 error 4 in libdovecot.so.0.0.0[7ff9a0be0000+e7000] [Tue Jun 16 09:51:25 2015] indexer-worker[7616]: segfault at 8 ip 00007fd27867dc27 sp 00007ffedd8407f0 error 4 in libdovecot.so.0.0.0[7fd2785e7000+e7000] [Tue Jun 16 09:51:25 2015] indexer-worker[7618]: segfault at 8 ip 00007f94f8753c27 sp 00007fff56cc5ea0 error 4 in libdovecot.so.0.0.0[7f94f86bd000+e7000] [3] errors from "doveadm index": /opt/dovecot/bin/doveadm index -A '*' doveadm(user1): Warning: I/O leak: 0x7f0e072519d0 (line 120, fd 27) doveadm(user1): Warning: Timeout leak: 0x7f0e07251780 (line 325) Segmentation fault (core dumped) /opt/dovecot/bin/doveadm index -u user1 '*' doveadm(user1): Warning: I/O leak: 0x7f99b4fba9d0 (line 411, fd 14) doveadm(user1): Warning: Timeout leak: 0x7f99b4fba780 (line 325) doveadm(user1): Fatal: pool_system_realloc(17179869184): Out of memory doveadm(user1): Error: Raw backtrace: /opt/dovecot/lib/dovecot/libdovecot.so.0(+0x78320) [0x7f99b4feb320] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x2a) [0x7f99b4feb38a] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f99b4f9ac7f] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(+0x8f3a3) [0x7f99b50023a3] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(+0x7472d) [0x7f99b4fe772d] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(buffer_get_space_unsafe+0x5f) [0x7f99b4fe7f5f] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(io_loop_handle_add+0x24) [0x7f99b4ffdd94] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(+0x89761) [0x7f99b4ffc761] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(io_loop_move_io+0x3e) [0x7f99b4ffd43e] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(connection_switch_ioloop+0x14) [0x7f99b4fe91d4] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(http_client_switch_ioloop+0x28) [0x7f99b4fbf148] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(+0x44536) [0x7f99b4fb7536] -> /opt/dovecot/lib/dovecot/lib21_fts_solr_plugin.so(solr_connection_post_more+0x49) [0x7f99b0c9d469] -> /opt/dovecot/lib/dovecot/lib21_fts_solr_plugin.so(+0x373f) [0x7f99b0c9973f] -> /opt/dovecot/lib/dovecot/lib20_fts_plugin.so(+0x91e8) [0x7f99b43541e8] -> /opt/dovecot/lib/dovecot/lib20_fts_plugin.so(+0x95f0) [0x7f99b43545f0] -> /opt/dovecot/lib/dovecot/lib20_fts_plugin.so(fts_build_mail+0x714) [0x7f99b4354d34] -> /opt/dovecot/lib/dovecot/lib20_fts_plugin.so(+0xf17e) [0x7f99b435a17e] -> /opt/dovecot/lib/dovecot/libdovecot-storage.so.0(mail_precache+0x19) [0x7f99b5294e89] -> /opt/dovecot/bin/doveadm() [0x423211] -> /opt/dovecot/bin/doveadm() [0x41ecc6] -> /opt/dovecot/bin/doveadm(doveadm_mail_try_run+0x27f) [0x41fb8f] -> /opt/dovecot/bin/doveadm(main+0x38f) [0x412a9f] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) [0x7f99b4bcfec5] -> /opt/dovecot/bin/doveadm() [0x412b99] [4] dovecot -n # 2.2.18: /opt/dovecot/etc/dovecot/dovecot.conf # Pigeonhole version 0.4.8 (0c4ae064f307+) # OS: Linux 3.13.0-52-generic x86_64 Ubuntu 14.04.2 LTS ext4 auth_username_format = %n auth_verbose = yes disable_plaintext_auth = no imap_idle_notify_interval = 5 mins mail_gid = vmail mail_home = /var/lib/vmail/home/%d/%u mail_location = mdbox:/var/lib/vmail/mail/%d/%u mail_plugins = fts fts_solr zlib acl quota zlib fts fts_solr acl mail_uid = vmail mailbox_idle_check_interval = 1 mins managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate imapflags notify mdbox_rotate_size = 32 M namespace { list = children location = mdbox:/var/lib/vmail/mail/%d/%%u prefix = shared/%%u/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / type = private } passdb { args = /opt/dovecot/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile acl_defaults_from_inbox = yes acl_shared_dict = file:/var/lib/vmail/shared-mailboxes fts = solr fts_autoindex = yes fts_solr = url=http://localhost:8983/solr/ break-imap-search fts_tika = http://localhost:8081/tika quota = dict:Quota::file:%h/dovecot-quota quota_rule = *:storage=1G quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +notify +imapflags zlib_save = gz zlib_save_level = 9 } protocols = imap sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { group = vmail user = vmail } } service imap-login { inet_listener imaps { port = 0 } } service managesieve-login { inet_listener sieve_deprecated { port = 2000 } } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { port = 0 } } ssl = required ssl_cert = </etc/ssl/testhost/testhost.crt ssl_cipher_list = EDH+CAMELLIA:EDH+aRSA:EECDH+aRSA+AESGCM:EECDH+aRSA+SHA384:EECDH+aRSA+SHA256:EECDH:+CAMELLIA256:+AES256:+CAMELLIA128:+AES128:+SSLv3:!aNULL:!eNULL:!LOW:!3DES:!MD5:!EXP:!PSK:!DSS:!RC4:!SEED:!ECDSA:CAMELLIA256-SHA:AES256-SHA:CAMELLIA128-SHA:AES128-SHA ssl_key = </etc/ssl/testhost/testhost.key ssl_prefer_server_ciphers = yes ssl_protocols = !SSLv2 !SSLv3 userdb { args = /opt/dovecot/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } protocol lda { mail_plugins = fts fts_solr zlib sieve acl } protocol imap { mail_plugins = fts fts_solr zlib acl quota imap_acl imap_quota } protocol sieve { mail_plugins = fts fts_solr }

3 3

FTS lucene and english + german mails
by Felix Zielcke 17 Jun '15

17 Jun '15

Hi, I'm currently looking over the FTS pages to enable it in my dovecot. But I'm unsure what the best settings of the lucene plugin are, if you receive german and english mails. Wiki says: textcat_conf=<path> textcat_dir=<path>: If specified, enable guessing the stemming language for emails and search keywords. This is a little bit problematic in practice, since indexing and searching languages may differ and may not find even exact words because they stem differently. On Debian libstemmer is included in the debian-lucene package. So what settings are the best to have not the problem that exact words can't be found?

2 2

Sorry, wrong paste buffer
by Steve Matzura 17 Jun '15

17 Jun '15

Please ignore last message.

1 0

Re: Mail to nowhere
by Steve Matzura 17 Jun '15

17 Jun '15

On Wed, 17 Jun 2015 09:10:26 -0400, you wrote: >Please send the output of postconf -n to the mailing list. Paul: I purposefully obfuscated my FQDN and domain, but they both have real and good data in them. alias_database = hash:/etc/aliases alias_maps = hash:/etc/aliases, hash:/var/lib/mailman/data/aliases command_directory = /usr/sbin config_directory = /etc/postfix daemon_directory = /usr/libexec/postfix data_directory = /var/lib/postfix debug_peer_level = 2 debugger_command = PATH=/bin:/usr/bin:/usr/local/bin:/usr/X11R6/bin ddd $daemon_directory/$process_name $process_id & sleep 5 html_directory = no inet_interfaces = localhost inet_protocols = all mail_owner = postfix mailq_path = /usr/bin/mailq.postfix manpage_directory = /usr/share/man mydestination = $myhostname, localhost.$mydomain, localhost myhostname = <my-FQDN> newaliases_path = /usr/bin/newaliases.postfix queue_directory = /var/spool/postfix readme_directory = /usr/share/doc/postfix/README_FILES sample_directory = /usr/share/doc/postfix/samples sendmail_path = /usr/sbin/sendmail.postfix setgid_group = postdrop smtp_tls_session_cache_database = btree:${queue_directory}/smtp_scache smtpd_sasl_auth_enable = yes smtpd_tls_auth_only = yes smtpd_tls_key_file = /etc/pki/dovecot/certs/tgv2015.crt smtpd_tls_received_header = yes smtpd_tls_security_level = may smtpd_tls_session_cache_database = btree:${queue_directory}/smtpd_scache smtpd_use_tls = yes unknown_local_recipient_reject_code = 550 virtual_mailbox_base = /var/mail/vhosts virtual_mailbox_domains = <my-domain> virtual_transport = lmtp:unix:private/dovecot-lmtp

1 0

SOLR 5
by Robert Gierzinger 17 Jun '15

17 Jun '15

Hello, I just wanted to give SOLR 5 a try, however there probably have changed quite some bits in the config files, did not even manage to create a core with various solrconfig.xml and schema.xml files, but I am absolutely no expert in solr. Has anybody given it a try or are there some tips on how to get it running? regards, Robert

2 1

dsync userdb and required fields?
by lejeczek 17 Jun '15

17 Jun '15

hi, I'm fiddling with dsync and get these in the logs: auth: Error: password(ps655@): Password data is not valid for scheme SSHA: Input isn't valid base64 encoded data .. auth: Error: ldap(ns580(a),172.25.12.215): ldap_search(base=ou=,ou=mail,dc=virtual,dc=hosting filter=(&(objectclass=person) .... This is on a dovecot that I'd call second, to which I'd like to replicate, first dovecot which is already populated with users, etc. does not show these errors. and I also have seen complains about possixAccunt I think. Do these mean that there is a base minimum required from dovecot/dsync in order to deem/find a user as a valid user? Also I can tell that those users do belong to different domain (not even this RDN) than the one in which the second dovecot is trying to look. These fields/attributes are nowhere defined/mentioned in my configs thus I wonder. many thanks

1 0

Imap process crashes when search in virtual mailbox
by mihaiush 17 Jun '15

17 Jun '15

Hi, When searching in a virtual mailbox imap process crashes if the virtual mailbox has a lot of physical mailboxes behind (more than 80 - 100 mailboxes). Dovecot 2.2.18 build from sources ./configure --prefix=/opt/dovecot2 --with-mysql --with-sqlite --with-solr --with-ssl --disable-rpath --disable-static. Debian Wheezy 3.2.63-2 x86_64. Filesystem is ZFS. docecot -n : # 2.2.18: /services/dovecot1/etc/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.7 auth_master_user_separator = * auth_mechanisms = plain login base_dir = /services/dovecot1/var/run default_client_limit = 10240 default_login_user = dovecot dict { quotadict = mysql:/services/dovecot1/etc/quota.conf } disable_plaintext_auth = no log_path = login_log_format_elements = user=%u session=%{session} mpid=%e rip=%r rrip=%{real_rip} mail_location = mdbox:~/mails mail_log_prefix = "store107: %s(%u): %{session}: " mail_max_userip_connections = 0 mail_plugins = quota virtual fts fts_solr notify mail_log mailbox_list_index = yes mdbox_rotate_size = 256 k mmap_disable = yes namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / } namespace virtual { hidden = yes list = no location = virtual:/services/dovecot1/etc/virtual:INDEX=~/mails/virtual mailbox all { auto = create special_use = \All } mailbox unseen { auto = create } prefix = virtual/ separator = / } passdb { args = /services/dovecot1/etc/passwd.masterusers driver = passwd-file master = yes pass = yes } passdb { args = /services/dovecot1/etc/mysql.conf driver = sql } plugin { fts = solr fts_solr = break-imap-search url=http://10.78.18.127:8080/solr/ mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename flag_change save mailbox_create mail_log_fields = uid box msgid flags quota = dict:user::proxy::quotadict quota_rule = *:storage=1GB quota_rule2 = Trash:storage=+152M quota_rule3 = Trash:messages=+5 } protocols = imap service auth { unix_listener auth-client { mode = 0666 } unix_listener auth-master { group = nogroup mode = 0660 } } service dict { process_limit = 400 unix_listener dict { mode = 0600 user = nobody } } service imap-login { chroot = login client_limit = 2048 inet_listener imap { address = 10.78.18.127 port = 143 } process_limit = 1024 service_count = 0 } service imap { process_limit = 10240 vsz_limit = 320 M } service indexer-worker { process_limit = 4 process_min_avail = 2 service_count = 1 vsz_limit = 1 G } shutdown_clients = no ssl = no syslog_facility = local3 userdb { args = /services/dovecot1/etc/mysql.conf driver = sql } protocol imap { mail_plugins = quota virtual fts fts_solr notify mail_log imap_quota } protocol lda { auth_socket_path = /services/dovecot1/var/run/auth-master mail_plugins = quota virtual fts fts_solr notify mail_log sieve event_broker submission_host = osmtp:8090 } /services/dovecot1/etc/virtual/all/dovecot-virtual : * -Trash -Junk all Error log: 2015-06-16T12:49:25.502864+02:00 sr-be-store07 dovecot: store107: imap( mihaiush(a)sunrise.ch) hCdxU6AY/wAKThJr: Panic: file mail-index-map.c: line 547 (mail_index_map_lookup_seq_range): assertion failed: (first_uid > 0) 2015-06-16T12:49:25.503429+02:00 sr-be-store07 dovecot: store107: imap( mihaiush(a)sunrise.ch) hCdxU6AY/wAKThJr: Error: Raw backtrace: /opt/dovecot2/lib/dovecot/libdovecot.so.0(+0x7c13f) [0x7fe2e433713f] -> /opt/dovecot2/lib/dovecot/libdovecot.so.0(+0x7c19e) [0x7fe2e433719e] -> /opt/dovecot2/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fe2e42e5555] -> /opt/dovecot2/lib/dovecot/libdovecot-storage.so.0(+0xc4d32) [0x7fe2e466fd32] -> /opt/dovecot2/lib/dovecot/libdovecot-storage.so.0(mail_index_lookup_seq_range+0xa) [0x7fe2e46817fa] -> /opt/dovecot2/lib/dovecot/lib20_fts_plugin.so(+0xd0b1) [0x7fe2e30c40b1] -> /opt/dovecot2/lib/dovecot/lib20_fts_plugin.so(+0xd963) [0x7fe2e30c4963] -> /opt/dovecot2/lib/dovecot/lib20_fts_plugin.so(fts_search_lookup+0xa6) [0x7fe2e30c4c36] -> /opt/dovecot2/lib/dovecot/lib20_fts_plugin.so(+0xfdef) [0x7fe2e30c6def] -> dovecot/imap(imap_search_start+0x70) [0x41dec0] -> dovecot/imap(cmd_sort+0x205) [0x414565] -> dovecot/imap(command_exec+0x4c) [0x418aec] -> dovecot/imap() [0x417ad0] -> dovecot/imap() [0x417b64] -> dovecot/imap(client_handle_input+0x115) [0x417e45] -> dovecot/imap(client_input+0x72) [0x418212] -> /opt/dovecot2/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x5b) [0x7fe2e43494fb] -> /opt/dovecot2/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xbb) [0x7fe2e434a54b] -> /opt/dovecot2/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x9) [0x7fe2e4349589] -> /opt/dovecot2/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7fe2e4349608] -> /opt/dovecot2/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7fe2e42eabc3] -> dovecot/imap(main+0x27b) [0x40c60b] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xfd) [0x7fe2e3f4eead] -> dovecot/imap() [0x40c769] 2015-06-16T12:49:25.552150+02:00 sr-be-store07 dovecot: store107: imap( mihaiush(a)sunrise.ch) hCdxU6AY/wAKThJr: Fatal: master: service(imap): child 3923 killed with signal 6 (core dumped) IMAP session: # telnet store107 143 Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN AUTH=LOGIN] Dovecot ready. x login mihaiush(a)sunrise.ch XXX x OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE SEARCH=FUZZY NOTIFY SPECIAL-USE QUOTA] Logged in x select virtual/all * FLAGS (\Answered \Flagged \Deleted \Seen \Draft $Label3 $Label2 $Label5 $Label1 $Label4 parsed attachment) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft $Label3 $Label2 $Label5 $Label1 $Label4 parsed attachment \*)] Flags permitted. * 1963 EXISTS * 1256 RECENT * OK [UNSEEN 2] First unseen. * OK [UIDVALIDITY 1434024437] UIDs valid * OK [UIDNEXT 2677] Predicted next UID * OK [HIGHESTMODSEQ 76] Highest x OK [READ-WRITE] Select completed (0.087 secs). x sort (reverse arrival) utf-8 text vpopmail Connection closed by foreign host. GDB: # gdb /opt/dovecot2/libexec/dovecot/imap /services/dovecot1/var/data/ sunrise.ch/m/mihaiush/core GNU gdb (GDB) 7.4.1-debian Copyright (C) 2012 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html > This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-linux-gnu". For bug reporting instructions, please see: <http://www.gnu.org/software/gdb/bugs/>... Reading symbols from /opt/dovecot2/libexec/dovecot/imap...done. [New LWP 3923] warning: Can't read pathname for load map: Input/output error. [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". Core was generated by `dovecot/imap'. Program terminated with signal 6, Aborted. #0 0x00007fe2e3f62165 in raise () from /lib/x86_64-linux-gnu/libc.so.6 (gdb) (gdb) bt full #0 0x00007fe2e3f62165 in raise () from /lib/x86_64-linux-gnu/libc.so.6 No symbol table info available. #1 0x00007fe2e3f653e0 in abort () from /lib/x86_64-linux-gnu/libc.so.6 No symbol table info available. #2 0x00007fe2e4337135 in default_fatal_finish (type=<optimized out>, status=status@entry=0) at failures.c:202 backtrace = 0x2166c38 "/opt/dovecot2/lib/dovecot/libdovecot.so.0(+0x7c13f) [0x7fe2e433713f] -> /opt/dovecot2/lib/dovecot/libdovecot.so.0(+0x7c19e) [0x7fe2e433719e] -> /opt/dovecot2/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x"... #3 0x00007fe2e433719e in i_internal_fatal_handler (ctx=0x7fffa5660ea0, format=<optimized out>, args=<optimized out>) at failures.c:671 status = 0 #4 0x00007fe2e42e5555 in i_panic (format=format@entry=0x7fe2e468d068 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:276 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0, timestamp_usecs = 0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7fffa5660f90, reg_save_area = 0x7fffa5660ed0}} #5 0x00007fe2e466fd32 in mail_index_map_lookup_seq_range (map=<optimized out>, first_uid=0, last_uid=<optimized out>, first_seq_r=<optimized out>, last_seq_r=<optimized out>) at mail-index-map.c:547 __FUNCTION__ = "mail_index_map_lookup_seq_range" #6 0x00007fe2e46817fa in mail_index_lookup_seq_range (view=<optimized out>, first_uid=<optimized out>, last_uid=<optimized out>, first_seq_r=first_seq_r@entry=0x7fffa5660fe8, last_seq_r=last_seq_r@entry =0x7fffa5660fec) at mail-index-view.c:513 No locals. #7 0x00007fe2e45f819c in mailbox_get_seq_range (box=<optimized out>, uid1=<optimized out>, uid2=<optimized out>, seq1_r=seq1_r@entry=0x7fffa5660fe8, seq2_r=seq2_r@entry=0x7fffa5660fec) at mailbox-get.c:11 No locals. #8 0x00007fe2e30c40b1 in uid_range_to_seqs (uid_range=uid_range@entry=0x7fffa56610b0, seq_range=seq_range@entry=0x25e4840, fctx=<error reading variable: Unhandled dwarf expression opcode 0xfa>, fctx=<error reading variable: Unhandled dwarf expression opcode 0xfa>) at fts-search.c:28 range = 0x2166738 i = <optimized out> count = <optimized out> seq1 = 41023456 seq2 = 0 #9 0x00007fe2e30c4963 in multi_add_lookup_result (args=0x2363d50, level=0x25e4840, fctx=0x23637e0, result=<optimized out>) at fts-search.c:138 br = 0x271f7e0 vuids = {arr = {buffer = 0x2166700, element_size = 8}, v = 0x2166700, v_modifiable = 0x2166700} orig_size = <optimized out> i = <optimized out> vbox = 0x2197c70 #10 fts_search_lookup_level_multi (and_args=<optimized out>, args=0x2363d50, fctx=0x23637e0) at fts-search.c:198 flags = FTS_LOOKUP_FLAG_AND_ARGS mailboxes_arr = {arr = {buffer = 0x2717670, element_size = 8}, v = 0x2717670, v_modifiable = 0x2717670} backend = <optimized out> j = 69 vbox = <optimized out> mailboxes = 0x27176a8 level = 0x25e4840 result = {pool = 0x2717650, box_results = 0x271f7a0} i = <optimized out> mailbox_count = 69 #11 fts_search_lookup_level (fctx=fctx@entry=0x23637e0, args=0x2363d50, and_args=and_args@entry=true) at fts-search.c:212 _data_stack_cur_id = 4 ret = <optimized out> #12 0x00007fe2e30c4c36 in fts_search_lookup (fctx=fctx@entry=0x23637e0) at fts-search.c:358 last_uid = 2676 seq1 = 0 seq2 = 0 __FUNCTION__ = "fts_search_lookup" #13 0x00007fe2e30c6def in fts_mailbox_search_init (t=<optimized out>, args=0x2363c90, sort_program=0x7fffa5661250, wanted_fields=<optimized out>, wanted_headers=<optimized out>) at fts-storage.c:240 ft = 0x23908a0 fbox = <optimized out> flist = <optimized out> ctx = 0x2695dc0 fctx = 0x23637e0 #14 0x000000000041dec0 in imap_search_start (ctx=ctx@entry=0x2195590, sargs=0x2363c90, sort_program=sort_program@entry=0x7fffa5661250) at imap-search.c:587 cmd = 0x2195450 __FUNCTION__ = "imap_search_start" #15 0x0000000000414565 in cmd_sort (cmd=0x2195450) at cmd-sort.c:141 ctx = 0x2195590 sargs = 0x2363c90 sort_program = {4097, MAIL_SORT_END, 56, MAIL_SORT_END, 3831136736, 32738, 35045104, MAIL_SORT_END, MAIL_SORT_ARRIVAL, MAIL_SORT_END, MAIL_SORT_ARRIVAL, MAIL_SORT_END} args = 0x216cb98 list_args = 0x216ccd0 charset = 0x216ce30 "utf-8" ret = <optimized out> #16 0x0000000000418aec in command_exec (cmd=cmd@entry=0x2195450) at imap-commands.c:167 hook = 0x216a120 diff = <optimized out> ---Type <return> to continue, or q <return> to quit--- finished = <optimized out> #17 0x0000000000417ad0 in client_command_input (cmd=cmd@entry=0x2195450) at imap-client.c:814 client = 0x2194850 command = <optimized out> __FUNCTION__ = "client_command_input" #18 0x0000000000417b64 in client_command_input (cmd=0x2195450) at imap-client.c:874 client = 0x2194850 command = <optimized out> __FUNCTION__ = "client_command_input" #19 0x0000000000417e45 in client_handle_next_command (remove_io_r=<synthetic pointer>, client=0x2194850) at imap-client.c:912 No locals. #20 client_handle_input (client=client@entry=0x2194850) at imap-client.c:924 _data_stack_cur_id = 3 ret = 2 remove_io = false handled_commands = false __FUNCTION__ = "client_handle_input" #21 0x0000000000418212 in client_input (client=0x2194850) at imap-client.c:966 cmd = <optimized out> output = 0x2195270 bytes = 46 __FUNCTION__ = "client_input" #22 0x00007fe2e43494fb in io_loop_call_io (io=0x2195360) at ioloop.c:501 ioloop = 0x2169760 t_id = 2 __FUNCTION__ = "io_loop_call_io" #23 0x00007fe2e434a54b in io_loop_handler_run_internal (ioloop=ioloop@entry=0x2169760) at ioloop-epoll.c:220 ctx = 0x216a490 events = 0xf53 event = 0x216b300 list = 0x216bef0 io = <optimized out> tv = {tv_sec = 1799, tv_usec = 999663} events_count = <optimized out> msecs = <optimized out> ret = 1 i = <optimized out> call = <optimized out> __FUNCTION__ = "io_loop_handler_run_internal" #24 0x00007fe2e4349589 in io_loop_handler_run (ioloop=ioloop@entry=0x2169760) at ioloop.c:548 No locals. #25 0x00007fe2e4349608 in io_loop_run (ioloop=0x2169760) at ioloop.c:525 __FUNCTION__ = "io_loop_run" #26 0x00007fe2e42eabc3 in master_service_run (service=0x21695f0, callback=callback@entry=0x421140 <client_connected>) at master-service.c:581 No locals. #27 0x000000000040c60b in main (argc=1, argv=0x2169390) at main.c:431 set_roots = {0x428c20, 0x0} login_set = {auth_socket_path = 0x2161060 "\210\020\026\002", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x420f80 <login_client_connected>, failure_callback = 0x4210f0 <login_client_failed>, request_auth_token = 1} service_flags = <optimized out> storage_service_flags = <optimized out> username = 0x0 c = <optimized out> (gdb) If necessary I can provide the mailbox, it has 7MB.

2 1

Mail to nowhere
by Steve Matzura 17 Jun '15

17 Jun '15

The next phase of my testing procedure involves the simple act of delivering mail to my test box. When I send a message to either a valid or relayed user at my remote machine's address, it never gets there. I know this virtually for sure because I'm tailing /var/log/maillog and nothing new has been added for the past hour. I'm thinking eventually my ISP will send the message back to me as undeliverable, and in that bounced message there may be some information about why it was undeliverable, but maybe someone has a thought as to why I'm not even seeing anything attempt to connect?

5 10

Re: Mail to nowhere
by Richard 17 Jun '15

17 Jun '15

> Date: Tuesday, June 16, 2015 07:05:43 PM -0400 > From: Steve Matzura <number6(a)noisynotes.com> > > On Tue, 16 Jun 2015 17:31:07 +0000, you wrote: > >> By default, most MTAs only listen to localhost, so don't accept >> externally derived mail. Try telnetting to port 25 on the machine >> from some place off your machine's network. If you get a "hang", >> it's likely a firewall issue. If you get a "connection refused" >> message it's probably that the MTA isn't listening on the external >> interface. >> >> If the MTA responds, do a manual delivery exchange and see what >> you get. >> >> If you're not seeing anything in your maillog, this is very likely >> an issue with your MTA's configuration, not dovecot. > > Now that I think about and concentrate on what you wrote, make > perfect sense. Add to that the fact that I received bounces from > my ISP that all said the same thing: Unable to establish an SMTP > connection. The return code was 4.5.1. A 4xx indicates a transient error (i.e., within configured limits, delivery retries will be attempted), 5xx is permanent (immediate reject, no retries), otherwise the specific number isn't all that telling. >From everything you've indicated, this is an MTA issue.

2 1

replication of a big mailbox
by Tim Kuijsten 16 Jun '15

16 Jun '15

I'm running dovecots replicator successfully on 33 mailboxes. There is only one mailbox (the biggest one, 167000 mails) that is not replicating successfully. After 10 minutes the "source" starts logging these messages: dovecot: dsync-local(foo(a)example.com): Error: dsync(imap.netsend.nl): I/O has stalled, no activity for 600 seconds dovecot: dsync-local(foo(a)example.com): Error: Timeout during state=sync_mails (send=mail_requests recv=changes) dovecot: dsync-local(foo(a)example.com): Error: Remote command process isn't dying, killing it dovecot: dsync-local(foo(a)example.com): Error: kill(17459, SIGKILL) failed: Operation not permitted dovecot: doveadm: Error: Pseudo-terminal will not be allocated because stdin is not a terminal. dovecot: doveadm: Error: dsync-remote(foo(a)example.com): Error: Couldn't lock //.dovecot-sync.lock: Timed out after 30 seconds dovecot: doveadm: Error: Pseudo-terminal will not be allocated because stdin is not a terminal. dovecot: doveadm: Error: dsync-remote(foo(a)example.com): Error: Couldn't lock //.dovecot-sync.lock: Timed out after 30 seconds The 30 seconds timeout keeps repeating, while the doveadm process on the destination keeps on going for hours and hours. Destination imap.netsend.nl is creating a lot of hardlinks (at least one hardlink per message) in .temp.... files. This takes about 1,5 hour, after that the number of hardlinks decline again. But it looks like the connection with source is already lost. I've patched the source to overcome the timeout by changing it from 10 minutes to 3 hours[1] but now I'm running into a memory error: dovecot: dsync-local(foo(a)example.com): Error: dsync(imap.netsend.nl): I/O has stalled, no activity for 10800 seconds dovecot: dsync-local(foo(a)example.com): Error: Timeout during state=sync_mails (send=done recv=mails) dovecot: dsync-local(foo(a)example.com): Error: mremap_anon(211677184) failed: Cannot allocate memory The allocate memory error shows up every 10 seconds. Next I'll try to look into the memory allocation code, but maybe someone already has a better idea? Thanks. -Tim Config on source: # 2.2.15: /etc/dovecot/dovecot.conf # OS: OpenBSD 5.7 amd64 auth_debug = yes auth_mechanisms = plain login auth_verbose = yes dsync_remote_cmd = /usr/bin/ssh imap.netsend.nl first_valid_gid = 30000 first_valid_uid = 30000 last_valid_gid = 30100 last_valid_uid = 30100 mail_debug = yes mail_home = /srv/vmail/%d/%n mail_location = maildir:~/Maildir mail_plugins = " notify replication" passdb { args = /passwd driver = passwd-file } passdb { args = /passwd_smtponly driver = passwd-file } plugin { mail_replica = remoteprefix:imap.netsend.nl } protocols = imap lmtp service aggregator { fifo_listener replication-notify-fifo { mode = 0666 } unix_listener replication-notify { mode = 0666 } } service auth-worker { chroot = /etc/mail unix_listener /etc/mail/auth-worker { mode = 0600 user = $default_internal_user } user = $default_internal_user } service auth { chroot = /etc/mail unix_listener /var/spool/postfix/private/dovecot-auth { group = _postfix mode = 0600 user = _postfix } } service imap-login { inet_listener imap { port = 0 } process_min_avail = 1 } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = _postfix mode = 0600 user = _postfix } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0600 } } ssl = required ssl_cert = </etc/ssl/private/2015/chain.crt ssl_cipher_list = ECDHE-RSA-CHACHA20-POLY1305:DHE-RSA-CHACHA20-POLY1305:ECDHE-RSA-AES256-GCM-SHA384:DHE-RSA-AES256-GCM-SHA384:ECDHE-RSA-AES128-GCM-SHA256:DHE-RSA-AES128-GCM-SHA256:ECDHE-RSA-AES256-SHA384:DHE-RSA-AES256-SHA256:ECDHE-RSA-AES256-SHA:DHE-RSA-AES256-SHA; ssl_dh_parameters_length = 2048 ssl_key = </etc/ssl/private/the.key ssl_prefer_server_ciphers = yes ssl_protocols = !SSLv2 !SSLv3 userdb { args = /passwd default_fields = uid=30000 gid=30000 home=/srv/vmail/%d/%n/./ driver = passwd-file } valid_chroot_dirs = /srv/vmail verbose_ssl = yes protocol imap { mail_max_userip_connections = 20 } config on destination imap.netsend.nl: # 2.2.15: /etc/dovecot/dovecot.conf # OS: OpenBSD 5.7 amd64 auth_debug = yes auth_mechanisms = plain login auth_verbose = yes first_valid_gid = 30000 first_valid_uid = 30000 last_valid_gid = 30100 last_valid_uid = 30100 mail_debug = yes mail_home = /srv/vmail/%d/%n mail_location = sdbox:~/dbox passdb { args = /passwd driver = passwd-file } passdb { args = /passwd_smtponly driver = passwd-file } protocols = imap lmtp service auth-worker { chroot = /etc/mail unix_listener /etc/mail/auth-worker { mode = 0600 user = $default_internal_user } user = $default_internal_user } service auth { chroot = /etc/mail unix_listener /var/spool/postfix/private/dovecot-auth { group = _postfix mode = 0600 user = _postfix } } service imap-login { inet_listener imap { port = 0 } process_min_avail = 1 } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = _postfix mode = 0600 user = _postfix } } ssl = required ssl_cert = </etc/ssl/private/2015/chain.crt ssl_cipher_list = ECDHE-RSA-CHACHA20-POLY1305:DHE-RSA-CHACHA20-POLY1305:ECDHE-RSA-AES256-GCM-SHA384:DHE-RSA-AES256-GCM-SHA384:ECDHE-RSA-AES128-GCM-SHA256:DHE-RSA-AES128-GCM-SHA256:ECDHE-RSA-AES256-SHA384:DHE-RSA-AES256-SHA256:ECDHE-RSA-AES256-SHA:DHE-RSA-AES256-SHA; ssl_dh_parameters_length = 2048 ssl_key = </etc/ssl/private/the.key ssl_prefer_server_ciphers = yes ssl_protocols = !SSLv2 !SSLv3 userdb { args = /passwd default_fields = uid=30000 gid=30000 home=/srv/vmail/%d/%n/./ driver = passwd-file } valid_chroot_dirs = /srv/vmail verbose_ssl = yes protocol imap { mail_max_userip_connections = 20 } [1] --- src/doveadm/dsync/dsync-ibc-stream.c 2014-09-29 13:07:07.000000000 +0200 +++ src/doveadm/dsync/dsync-ibc-stream.c2 2015-06-15 12:28:56.000000000 +0200 @@ -24,7 +24,7 @@ #include <stdlib.h> -#define DSYNC_IBC_STREAM_TIMEOUT_MSECS (60*10*1000) +#define DSYNC_IBC_STREAM_TIMEOUT_MSECS (60*180*1000) #define DSYNC_IBC_STREAM_OUTBUF_THROTTLE_SIZE (1024*128) #define DSYNC_PROTOCOL_VERSION_MAJOR 3

1 0

Problem logging in during testing
by Steve Matzura 16 Jun '15

16 Jun '15

Instructions at http://wiki2.dovecot.org/BasicConfiguration say the next thing to test after getting IMAP and Telnet working is to create a dummy user file with the following command: echo "$USER:{PLAIN}password:$UID:$GID::$HOME" > users And place it in /etc/dovecot and protect it appropriately. It was also edited to change the plain-text password from `password' to what it really is. The next section describes changes to 10-auth.conf and other things: If you used the example configuration files, switch to passwd-file by modifying conf.d/10-auth.conf: # Add '#' to comment out the system user login for now: #!include auth-system.conf.ext # Remove '#' to use passwd-file: !include auth-passwdfile.conf.ext In conf.d/auth-passwdfile.conf.ext you should have: passdb { driver = passwd-file args = scheme=CRYPT username_format=%u /etc/dovecot/users } userdb { driver = passwd-file args = username_format=%u /etc/dovecot/users } Verify with doveconf -n passdb userdb that the output looks like above (and there are no other passdbs or userdbs). All done successfully. Now, when I telnet 127.0.0.1 143 and attempt to log in with the string: a login <any username> <any password> whether it's one in my users file or not, I get: a NO [AUTHENTICATIONFAILED] Authentication failed.

4 11

Re: More about my SSL certificate problem
by Joseph Tam 16 Jun '15

16 Jun '15

Steve Matzura writes: > What is the reasoning behind that `<' anyway? It just appears so odd > that a path should have that at its front. I think this was a special syntax-hack that Timo used to mean "read into a buffer", or some different way to handle file data, probably for security reasons. Joseph Tam <jtam.home(a)gmail.com>

1 0

What became of dovecot.passwd?
by Steve Matzura 15 Jun '15

15 Jun '15

Since I've decided to go to version 2, which is a lot more difficult to set up because I have to look in a lot more places than I did with version 1.0.15, what do I do with the old dovecot/passwd or its contents? I see no references to it in any of the stuff in conf.d or doc/dovecot/wiki. As always, thanks in advance.

2 3