September 2015 - dovecot

FreeBSD 10 & default_vsz_limit causing reboots?
by Rick Romero 15 Sep '15

15 Sep '15

Ok, So this is really more of an observation than anything else. I had a FreeBSD 10.1 server that was running great. Some SSL issue came up, or I upgrade Dovecot in ports - something occurred and the machine started rebooting randomly. It would run for 2 weeks, then reboot. It might run for 5 days and then reboot. So I started doing more FreeBSD upgrades, thinking it was a kernel issue. The reboots only increased. This weekend I started thinking I might actually be having hardware issues. But, since I don't have easy physical access to the box and it's REALLY under loaded, I figured what the hell and upraded to 10.2 on Sunday. I think it rebooted 4 times after that on Sunday, and then another 2 times Monday morning. Its worth noting that while I have crash dumps enabled, they don't seem to be occurring. So hardware is still a possibility. After the 2nd Monday morning reboot, I started to wonder if there was some sort of process issue. Besides the OS upgrades - I had been monitoring the Dovecot logs for when the process limits are reached, and increasing them. It's a 'big' box, and load is typically between .30 and .50. CPUs aren't overtaxed, and most of the memory is dedicated to ZFS. The reboots are so short, I've only received one 'down' alert due to them. So it's a conerning issue, but not really impacting production. On a whim I changed my default_vsz_limit (as I had been increasing every other limit but that) from 384M to 512M. The system hasn't rebooted in 24hours. Now that could be a coincidence, but I thought I'd at least put it out there. If you see anything weird in my dovecot config, let me know - My config was originally vpopmail, but over time I've migrated to SQL-only. root@romulus:/usr/local/etc/dovecot # dovecot -n # 2.2.18: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 10.2-RELEASE amd64 auth_master_user_separator = * auth_mechanisms = plain login auth_username_translation = %@ auth_verbose = yes default_login_user = dovecot default_vsz_limit = 512 M disable_plaintext_auth = no first_valid_gid = 89 first_valid_uid = 89 last_valid_gid = 89 last_valid_uid = 89 log_path = /dev/stderr login_greeting = Ready. login_trusted_networks = 172.16.100.0/24 mail_fsync = never mail_plugins = " quota zlib stats" mail_privileged_group = mail namespace compat { alias_for = hidden = yes inbox = no list = no location = prefix = INBOX. separator = . } namespace inbox { inbox = yes location = prefix = separator = . } passdb { args = /usr/local/etc/dovecot/dovecot-master-sql.conf driver = sql master = yes pass = yes } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf driver = sql } plugin { quota = maildir quota_rule = Trash:storage=+10%% stats_refresh = 30 secs stats_track_cmds = yes } protocols = imap pop3 service anvil { client_limit = 3175 } service auth { client_limit = 3684 unix_listener auth-master { mode = 0600 } } service imap-login { process_limit = 1536 process_min_avail = 25 service_count = 1 } service imap-postlogin { executable = script-login rawlog /usr/local/etc/dovecot/lastauth-imap.sh user = vpopmail } service imap { executable = /usr/local/libexec/dovecot/imap imap-postlogin process_limit = 1536 } service pop-postlogin { executable = script-login /usr/local/etc/dovecot/lastauth-pop.sh user = vpopmail } service pop3-login { process_limit = 1536 process_min_avail = 15 service_count = 1 } service pop3 { executable = /usr/local/libexec/dovecot/pop3 pop-postlogin } service stats { fifo_listener stats-mail { mode = 0600 user = vpopmail } } shutdown_clients = no ssl_cert = </etc/ssl/mail.pem ssl_key = </etc/ssl/mail.key ssl_key_password = na userdb { driver = prefetch } verbose_proctitle = yes protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep mail_max_userip_connections = 100 mail_plugins = " quota zlib stats imap_zlib quota imap_quota" } protocol pop3 { mail_max_userip_connections = 100 mail_plugins = quota pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_uidl_format = %08Xu%08Xv }

3 5

Dovecot does not accept new connection with error "imap-login: Error: read(anvil) failed: EOF"
by Julien Fastré 14 Sep '15

14 Sep '15

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256 Hi, First of all, thank you for the work the contributors are doing with Dovecot ! Dovecot is doing a great job ! I am encountering a problem with a configuration and, despite my search on the web, I do not find any solution for this problem. Dovecot seems to stop accepting new connection. The users : - - can not save sent messages to "Sent" folder (using Thunderbird) ; - - can not connect or retrieve message from webmail (using sogo or roundcube) In the log, I see this error : > Jun 30 13:54:53 mail dovecot: imap-login: Error: read(anvil) > failed: EOF Jun 30 13:54:53 mail dovecot: message repeated 2 times: > [ imap-login: Error: read(anvil) failed: EOF] (the message may be repeated more than 2 times) It happens... sometimes. Manually restarting the dovecot service make the software working again. By searching on the web, I regularly see this statement in logs : > dovecot: auth: Error: read(anvil-auth-penalty) failed: EOF like here : http://www.dovecot.org/list/dovecot/2010-November/054694.htm l But it doesn't seem to be the same problem as mine (anvil / anvil-auth-penalty). The problem happens during peak load. Sometimes it happens twice a week, sometimes it may spent two month without any problem (during holidays, I did not had any problem). My configuration : > # doveconf -n # 2.2.9: /etc/dovecot/dovecot.conf # OS: Linux > 3.13.0-49-generic x86_64 Ubuntu 14.04.3 LTS login_trusted_networks > = 10.0.3.0/24 mail_location = mbox:~/mail:INBOX=/var/mail/%u > mail_plugins = quota acl managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope > encoded-character vacation subaddress comparator-i;ascii-numeric > relational regex imap4flags copy include variables body enotify > environment mailbox date ihave namespace { list = children location > = maildir:/var/mail-data/vhosts/%%u:INDEX=~/shared/%%u prefix = > shared/%%u/ separator = / subscriptions = no type = shared } > namespace inbox { inbox = yes location = mailbox Drafts { > special_use = \Drafts } mailbox Junk { special_use = \Junk } > mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { > special_use = \Sent } mailbox Trash { special_use = \Trash } prefix > = separator = / type = private } passdb { driver = pam } passdb { > args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { > acl = vfile acl_shared_dict = > file:/var/mail-data/acl_db/shared-mailboxes quota = maildir:User > quota quota_grace = 10%% quota_rule = *:storage=2G quota_rule2 = > Trash:storage=+100M sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } > postmaster_address = julienfastre(a)cvfe.be protocols = " imap lmtp > sieve" service auth { unix_listener > /var/spool/postfix/private/dovecot-auth { group = postfix mode = > 0660 user = postfix } } service lmtp { unix_listener > /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = > 0600 user = postfix } } ssl_ca = </etc/dovecot/certificates/ca.pem > ssl_cert = </etc/dovecot/certificates/mail.cert.pem ssl_key = > </etc/dovecot/certificates/mail.key.nopass.pem userdb { driver = > passwd } userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver > = ldap } protocol lmtp { mail_plugins = quota acl sieve } protocol > imap { mail_max_userip_connections = 30 mail_plugins = quota acl > imap_quota imap_acl } As somes answer about anvil-auth-penalty may suggest it is linked with proc capabilities, this is the limitation of the /proc > root@mail:/home/ubuntu# ps -aux | grep anvil postfix 4568 0.0 > 0.0 27404 1596 ? S 08:00 0:00 anvil -l -t unix -u -c > dovecot 5788 0.0 0.0 9280 956 ? S 09:45 0:00 > dovecot/anvil root 5973 0.0 0.0 11748 928 pts/2 S+ > 09:57 0:00 grep --color=auto anvil root@mail:/home/ubuntu# cat > /proc/5788/limits Limit Soft Limit > Hard Limit Units Max cpu time unlimited > unlimited seconds Max file size unlimited > unlimited bytes Max data size 268435456 > 268435456 bytes Max stack size 8388608 > unlimited bytes Max core file size 0 > unlimited bytes Max resident set unlimited > unlimited bytes Max processes 257157 > 257157 processes Max open files 1024 > 4096 files Max locked memory 65536 > 65536 bytes Max address space 268435456 > 268435456 bytes Max file locks unlimited > unlimited locks Max pending signals 257157 > 257157 signals Max msgqueue size 819200 > 819200 bytes Max nice priority 0 > 0 Max realtime priority 0 0 > Max realtime timeout unlimited unlimited > us If it may help, dovecot is running inside an lxc container. I would really appreciate any help. Thanks for your time ! Julien Fastré - -- Julien Fastré Champs Libres http://www.champs-libres.coop +32 486 540 660 Champs Libres Cooperative SCRLFS Rue Jean Bury 23 - 4000 Liège - Belgique BE0541.427.670 -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iQIcBAEBCAAGBQJV9n6KAAoJEL+8y7VSV380BtoQALEFOmb2llnlgRrpbHIUuFRY g+dDRYETAmjVTsPoNVR45x5n/CcT6sOY5iZw7r3O2vBtVtyr8T2iF/6d+xKxvRj+ zM76+Cdd27ydkPEI83fDGH0ckXhjRgd1MU8xEi4RjdbgE3LCMlD0TtGImPniPFM9 POY8U3psEGUaiIrd3s6DwHVamYG+8ackvHgKua0L83r4turf6AI/0kdioCStxurE IKkdPTew8W92O3QiVJ0//6A5BC6HT+hTICgUqAx4mAgCVR1PIvRAMywUy08JFJtD A/RmZj2350ApY8oKukhbKfLSamTcP+UApYt6C0PfPjPpSQUVgEkI/zWA2NH+6Pjg XA311MK9+lYcjNqM6AAAjM2H012sh6AC/u17S1t8x85HY0KUk1YldfyLUeHgRg9Y 4JBFxKP7u4exIu1Us5R1qDPOkbE3e4zzUtI57Ae/QhzTiwpWdJkQ/4hdJhwbDcGp X5RTBNldd4mFqdhPeRXN5Vh2OL9HkboA3XIMac2ZrNJC3DEl2GZJRa+Zay/OJCaj 6eppyTxYr0J2shOkvYEz/BbUYLdAX1MkkOM8bWc5rcIsvvUZhe9lX7HMNCZoNTJq Y01l9o/qzu3feIssZ0tJ4FL6hYA6TirO9i/H7NG0cVBsgCccxFtFIDsZBTIW6Gqw Nsf4SLNo7GhADcbAeeOm =2mKN -----END PGP SIGNATURE-----

1 1

no login with MySQL
by Andreas Meyer 14 Sep '15

14 Sep '15

Hello! Setup again to authenticate my users with MySQL but can't login. Sep 13 11:55:49 auth: Info: passwd-file(a.meyer(a)nimmini.de,95.88.63.177,<R7Qe9J0fTgBfWD+x>): unknown user Sep 13 11:55:49 auth: Info: passwd-file(a.meyer(a)nimmini.de,95.88.63.177,<R7Qe9J0fTgBfWD+x>): unknown user Sep 13 11:55:49 imap-login: Info: Login: user=<a.meyer(a)nimmini.de>, method=CRAM-MD5, rip=95.88.63.177, lip=46.38.231.143, mpid=30826, TLS, TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits) Sep 13 11:55:49 imap(a.meyer(a)nimmini.de): Error: user a.meyer(a)nimmini.de: Initialization failed: Namespace '': Home directory not set for user. Can't expand ~/ for mail root dir in: ~/ Sep 13 11:55:49 imap(a.meyer(a)nimmini.de): Error: Invalid user settings. Refer to server log for more information. Sep 13 11:55:49 auth: Debug: auth client connected (pid=30825) Sep 13 11:55:49 auth: Debug: client in: AUTH 1 CRAM-MD5 service=imap secured session=R7Qe9J0fTgBfWD+x lip=46.38.231.143 rip=95.88.63.177 lport=143 rport=45646 Sep 13 11:55:49 auth: Debug: client passdb out: CONT 1 PDkzMDcwNTI5Mzk5NTk1NTYuMTQ0MjEzODE0OUBiaXRtYWNoaW5lMT4= Sep 13 11:55:49 auth: Debug: client in: CONT<hidden> Sep 13 11:55:49 auth: Debug: passwd-file(a.meyer(a)nimmini.de,95.88.63.177,<R7Qe9J0fTgBfWD+x>): lookup: user=a.meyer(a)nimmini.de file=/etc/dovecot/passwd Sep 13 11:55:49 auth-worker(30822): Debug: sql(a.meyer(a)nimmini.de,95.88.63.177): query: SELECT username AS username, password FROM mailbox WHERE username = 'a.meyer(a)nimmini.de' AND active = 1 Sep 13 11:55:49 auth: Debug: client passdb out: OK 1 user=a.meyer(a)nimmini.de Sep 13 11:55:49 auth: Debug: master in: REQUEST 997457921 30821 1 dc2456b4ee1453e5458806ab92da9ee7 session_pid=30826 request_auth_token Sep 13 11:55:49 auth: Debug: passwd-file(a.meyer(a)nimmini.de,95.88.63.177,<R7Qe9J0fTgBfWD+x>): lookup: user=a.meyer(a)nimmini.de file=/etc/dovecot/passwd Sep 13 11:55:49 auth-worker(30822): Debug: passwd-file(a.meyer(a)nimmini.de,95.88.63.177): SELECT maildir, uid, gid, concat('*:storage=', quota) AS quota_rule, concat('Trash:storage=+', quota_trash) AS quota_rule2 FROM mailbox WHERE username = 'a.meyer(a)nimmini.de' Sep 13 11:55:49 auth: Debug: master userdb out: USER 997457921 a.meyer(a)nimmini.de maildir=/var/spool/vhosts/nimmini.de/ uid=5000 gid=5000 quota_rule=*:storage=5242880 quota_rule2=Trash:storage=+100 auth_token=2a4c8e78ff8fcf3f9599eecbefb6a5605f22abe5 Sep 13 11:55:49 imap: Debug: Loading modules from directory: /usr/lib64/dovecot/modules Sep 13 11:55:49 imap: Debug: Module loaded: /usr/lib64/dovecot/modules/lib01_acl_plugin.so Sep 13 11:55:49 imap: Debug: Module loaded: /usr/lib64/dovecot/modules/lib02_imap_acl_plugin.so Sep 13 11:55:49 imap: Debug: Module loaded: /usr/lib64/dovecot/modules/lib10_quota_plugin.so Sep 13 11:55:49 imap: Debug: Module loaded: /usr/lib64/dovecot/modules/lib11_imap_quota_plugin.so Sep 13 11:55:49 imap: Debug: Added userdb setting: plugin/maildir=/var/spool/vhosts/nimmini.de/ Sep 13 11:55:49 imap: Debug: Added userdb setting: plugin/quota_rule=*:storage=5242880 Sep 13 11:55:49 imap: Debug: Added userdb setting: plugin/quota_rule2=Trash:storage=+100 Sep 13 11:55:49 imap(a.meyer(a)nimmini.de): Debug: Effective uid=5000, gid=5000, home= Sep 13 11:55:49 imap(a.meyer(a)nimmini.de): Debug: Quota root: name=User quota backend=maildir args= Sep 13 11:55:49 imap(a.meyer(a)nimmini.de): Debug: Quota rule: root=User quota mailbox=* bytes=5368709120 messages=0 Sep 13 11:55:49 imap(a.meyer(a)nimmini.de): Debug: Quota rule: root=User quota mailbox=Trash bytes=+102400 messages=0 Sep 13 11:55:49 imap(a.meyer(a)nimmini.de): Debug: Quota grace: root=User quota bytes=53687091 (1%) Sep 13 11:55:49 imap(a.meyer(a)nimmini.de): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:~/ This is what claws-mail says: [12:22:48] IMAP4< * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE STARTTLS AUTH=PLAIN AUTH=CRAM-MD5] Dovecot ready. [12:22:48] IMAP4> 1 STARTTLS [12:22:48] IMAP4< 1 OK Begin TLS negotiation now. * IMAP connection is un-authenticated [12:22:48] IMAP4> 2 CAPABILITY [12:22:48] IMAP4< * CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN AUTH=CRAM-MD5 [12:22:48] IMAP4< 2 OK Pre-login capabilities listed, post-login capabilities have more. [12:22:48] IMAP4> Logging a.meyer(a)nimmini.de to mail.nimmini.de using CRAM-MD5 ** IMAP Fehler auf mail.nimmini.de: parse error (sehr wahrscheinlich ein nicht RFC-konformer Server) ** IMAP4-Verbindung unterbrochen [12:22:48] IMAP4< Error logging in to mail.nimmini.de When I set auth_type PLAIN in Roundcube, login fails too. The SELECTS in the database are ok: mysql> SELECT maildir, uid, gid, concat('*:storage=', quota) AS quota_rule, concat('Trash:storage=+', quota_trash) AS quota_rule2 FROM mailbox WHERE username = 'a.meyer(a)nimmini.de'; +-------------------------------+------+------+-------------------+--------------------+ | maildir | uid | gid | quota_rule | quota_rule2 | +-------------------------------+------+------+-------------------+--------------------+ | /var/spool/vhosts/nimmini.de/ | 5000 | 5000 | *:storage=5242880 | Trash:storage=+100 | +-------------------------------+------+------+-------------------+--------------------+ 1 row in set (0,00 sec) mysql> SELECT username AS username, password FROM mailbox WHERE username = 'a.meyer(a)nimmini.de' AND active = 1 -> ; +--------------------+----------+ | username | password | +--------------------+----------+ | a.meyer(a)nimmini.de | hidden | +--------------------+----------+ 1 row in set (0,00 sec) mysql> quit What's wrong? Any help appreciated! Regards Andreas

4 7

concerning dovecot settings for high volume server
by Rajesh M 13 Sep '15

13 Sep '15

hi centos 6 64 bit hex core processor with hyperthreading ie display shows 12 cores 16 gb ram 600 gb 15000 rpm drive we are having around 4000 users on a server i wish to allow 1500 pop3 and 1500 imap connections simultaneously. need help regarding the settings to handle the above imap-login, pop3-login imap pop3 service settings i recently i got an error imap-login: Error: read(imap) failed: Remote closed connection (process_limit reached?) my current dovecot config file # 2.2.7: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-431.23.3.el6.x86_64 x86_64 CentOS release 6.5 (Final) auth_cache_negative_ttl = 0 auth_cache_ttl = 0 auth_mechanisms = plain login digest-md5 cram-md5 default_login_user = vpopmail disable_plaintext_auth = no first_valid_gid = 89 first_valid_uid = 89 log_path = /var/log/dovecot.log login_greeting = ready. mail_max_userip_connections = 50 mail_plugins = " quota" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { inbox = yes location = prefix = separator = . type = private } passdb { args = cache_key=%u webmail=127.0.0.1 driver = vpopmail } plugin { quota = maildir:ignore=Trash quota_rule = ?:storage=0 } protocols = imap pop3 service imap-login { client_limit = 256 process_limit = 400 process_min_avail = 4 service_count = 0 vsz_limit = 512 M } service pop3-login { client_limit = 1000 process_limit = 400 process_min_avail = 12 service_count = 0 vsz_limit = 512 M } ssl_cert = </var/qmail/control/servercert.pem ssl_dh_parameters_length = 2048 ssl_key = </var/qmail/control/servercert.pem userdb { args = cache_key=%u quota_template=quota_rule=*:backend=%q driver = vpopmail } protocol imap { imap_client_workarounds = delay-newmail mail_plugins = " quota imap_quota" } protocol pop3 { pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_fast_size_lookups = yes pop3_lock_session = no pop3_no_flag_updates = yes } thanks very much, rajesh

5 4

Re: concerning dovecot settings for high volume server
by Rajesh M 13 Sep '15

13 Sep '15

----- Original Message ----- From: Tony Morehen [mailto:tmorehen@ajmconsulting.ca] To: dovecot(a)dovecot.org Sent: Sat, 12 Sep 2015 17:57:27 -0400 Subject: Re: concerning dovecot settings for high volume server You may be running up against Linux system/user limits. Run $ cat /proc/sys/kernel/pid_max and $ ulimit -a That should give some insight into your problem. On 12/09/2015 2:53 PM, Rajesh M wrote: > hi > > centos 6 64 bit > > hex core processor with hyperthreading ie display shows 12 cores > 16 gb ram > 600 gb 15000 rpm drive > > we are having around 4000 users on a server > > > i wish to allow 1500 pop3 and 1500 imap connections simultaneously. > > need help regarding the settings to handle the above > > imap-login, pop3-login > imap pop3 service settings > > i recently i got an error > imap-login: Error: read(imap) failed: Remote closed connection (process_limit reached?) > > > my current dovecot config file > > # 2.2.7: /etc/dovecot/dovecot.conf > # OS: Linux 2.6.32-431.23.3.el6.x86_64 x86_64 CentOS release 6.5 (Final) > auth_cache_negative_ttl = 0 > auth_cache_ttl = 0 > auth_mechanisms = plain login digest-md5 cram-md5 > default_login_user = vpopmail > disable_plaintext_auth = no > first_valid_gid = 89 > first_valid_uid = 89 > log_path = /var/log/dovecot.log > login_greeting = ready. > mail_max_userip_connections = 50 > mail_plugins = " quota" > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave > namespace { > inbox = yes > location = > prefix = > separator = . > type = private > } > passdb { > args = cache_key=%u webmail=127.0.0.1 > driver = vpopmail > } > plugin { > quota = maildir:ignore=Trash > quota_rule = ?:storage=0 > } > protocols = imap pop3 > service imap-login { > client_limit = 256 > process_limit = 400 > process_min_avail = 4 > service_count = 0 > vsz_limit = 512 M > } > service pop3-login { > client_limit = 1000 > process_limit = 400 > process_min_avail = 12 > service_count = 0 > vsz_limit = 512 M > } > ssl_cert = </var/qmail/control/servercert.pem > ssl_dh_parameters_length = 2048 > ssl_key = </var/qmail/control/servercert.pem > userdb { > args = cache_key=%u quota_template=quota_rule=*:backend=%q > driver = vpopmail > } > protocol imap { > imap_client_workarounds = delay-newmail > mail_plugins = " quota imap_quota" > } > protocol pop3 { > pop3_client_workarounds = outlook-no-nuls oe-ns-eoh > pop3_fast_size_lookups = yes > pop3_lock_session = no > pop3_no_flag_updates = yes > } > > > thanks very much, > > rajesh this is the first time i got this message since past over an year. the error went away as soon as i restarted dovecot.. surprisingly this happened in the night ie off-office hours. here are the values i got also could you provide me the settings for the limits if wish to handle around 1500 simultaneous connections of pop3 and imap each ? the current values are as follows [root@ns1 log]# cat /proc/sys/kernel/pid_max 49152 [root@ns1 log]# ulimit -a core file size (blocks, -c) 0 data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) 127047 max locked memory (kbytes, -l) 64 max memory size (kbytes, -m) unlimited open files (-n) 1024 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) 10240 cpu time (seconds, -t) unlimited max user processes (-u) 127047 virtual memory (kbytes, -v) unlimited file locks (-x) unlimited thanks rajesh

2 1

Need help on checkpassword userdb/passdb
by Mark Foley 13 Sep '15

13 Sep '15

I'm experimenting with checkpassword as an auth method for usedb and passdb (http://wiki2.dovecot.org/AuthDatabase/CheckPassword) I've set up the userdb and passdb *exactly* as the wiki suggests as the "standard way": passdb { driver = checkpassword args = /user/util/bin/checkpassword } userdb { driver = prefetch } I've created a checkpassword program that does receive the correct user and password from dovecot. And I am successfully authenticating with ntlm_auth and exiting with status 0. My debug output: AUTHORIZED: (null) USER: (null) userdb_uid: (null) userdb_gid: (null) arg1=/usr/local/libexec/dovecot/checkpassword-reply CMD: /usr/bin/ntlm_auth --username="mark" --password='mypass' ntlm_auth status: 0 Now, the wiki says 2 things that have me stumped: 1. It says that, "Dovecot calls the script with AUTHORIZED=1 environment set when performing a userdb lookup. The script must acknowledge this by changing the environment to AUTHORIZED=2, otherwise the lookup fails." As you can see from my program log, "AUTHORIZED" is not set. Why? Nor are any of the other environment variables mentioned in the wiki. I've listed all the environment variables that *are* passed to the program at the bottom of this message. 2. The wiki says, "Your program received a path to checkpassword-reply binary as the first parameter. Execute it." I did so as a fork() and then execve("/usr/local/libexec/dovecot/checkpassword-reply") How do I know it worked ... or failed? What am I doing wrong? Dovecot log entries: Sep 10 22:54:04 auth: Debug: auth client connected (pid=14748) Sep 10 22:54:04 auth: Debug: client in: AUTH 1 PLAIN service=imap session=AkYg1G8f8QDAqAA6 lip=192.168.0.2 rip=192.168.0.58 lport=143 rport=49649 resp=AG1hcmsAZ2xhY29uXzk= (previous base64 data may contain sensitive data) Sep 10 22:54:04 auth: Debug: checkpassword(mark,192.168.0.58,<AkYg1G8f8QDAqAA6>): execute: /user/util/bin/checkpassword /usr/local/libexec/dovecot/checkpassword-reply Sep 10 22:54:04 auth: Debug: checkpassword(mark,192.168.0.58,<AkYg1G8f8QDAqAA6>): exit_status=0 Sep 10 22:54:04 auth: Debug: checkpassword(mark,192.168.0.58,<AkYg1G8f8QDAqAA6>): Received input: Sep 10 22:54:06 auth: Debug: client passdb out: FAIL 1 user=mark temp ENV variables passed to the checkpassword program: DOVECOT_PRESERVE_ENVS=TZ CORE_OUTOFMEM CORE_ERROR DOVECOT_CHILD_PROCESS=1 CONFIG_FILE=/usr/local/var/run/dovecot/config CLIENT_LIMIT=1000 PROCESS_LIMIT=1 PROCESS_MIN_AVAIL=0 IDLE_KILL=60 GENERATION=2991 DOVECOT_HOSTNAME=mail DOVECOT_HOSTDOMAIN=mail.hprs.local DOVECOT_VERSION=2.2.15 LOG_SERVICE=1 SOCKET_COUNT=6 SSL_SOCKET_COUNT=0 SOCKET_NAMES=login tokenlogin auth-login auth-client auth-userdb auth-master PROTO=TCP ORIG_UID=151 SERVICE=imap TCPLOCALIP=192.168.0.2 LOCAL_IP=192.168.0.2 TCPREMOTEIP=192.168.0.58 REMOTE_IP=192.168.0.58 TCPLOCALPORT=143 TCPREMOTEPORT=49649 AUTH_USER=mark AUTH_USERNAME=mark AUTH_SERVICE=imap AUTH_LIP=192.168.0.2 AUTH_RIP=192.168.0.58 AUTH_PID=14748 AUTH_MECH=PLAIN AUTH_SECURED= AUTH_LPORT=143 AUTH_RPORT=49649 AUTH_CERT= AUTH_SESSION=AkYg1G8f8QDAqAA6 AUTH_REAL_LIP=192.168.0.2 AUTH_REAL_RIP=192.168.0.58 AUTH_REAL_LPORT=143 AUTH_REAL_RPORT=49649 AUTH_ORIG_USER=mark AUTH_ORIG_USERNAME=mark --Mark

1 2

Is it a bug when you move mail between namespaces....
by Larry Rosenman 11 Sep '15

11 Sep '15

that the fts data gets lost? doveconf -n attached -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx(a)gmail.com US Mail: 7011 W Parmer Ln, Apt 1115, Austin, TX 78729-6961

2 8

Dovecot CalDAV server
by Timo Sirainen 11 Sep '15

11 Sep '15

I've been once in a while over the years thinking about implementing CalDAV (and CardDAV) to Dovecot. It might be time to start that soon. Does anyone have any suggestions? So far my main goals would be: - scalable, of course - configurable storage (object storage, regular fs, maybe some key-value dbs, maybe storing as emails) - efficient indexes (potentially using key-value dbs? or maybe just local files. not sure yet what kind of indexing is needed) - have it work with dsync (= replication & migration) Some things I wonder about: - Maybe there is already some code out there that could be used to implement it faster? - Maybe even use something else besides C to implement it.. Then again that makes integration to Dovecot more difficult. - Is anybody interested in helping to develop this? :) I think I still have too much other work that I won't spend a lot of time coding it.. One thing that makes this easier is that Open-Xchange has already implemented a CalDAV server, so they can help to avoid the biggest design mistakes. (There are a couple of reasons why they'd want to replace that.)

11 13

Re: Message moved to Spam folder mysteriously
by Alfredo Saldanha 11 Sep '15

11 Sep '15

Hello Robert, I've checked, there is no client connected according my imap logs. So weird. ----- Mensagem original ----- De: "Robert Schetterer" <rs(a)sys4.de> Para: dovecot(a)dovecot.org Enviadas: Quinta-feira, 10 de setembro de 2015 15:48:47 Assunto: Re: Message moved to Spam folder mysteriously Am 10.09.2015 um 20:02 schrieb Alfredo Saldanha: > Hi there, > > How dovecot move the message to Spam without antispam plugin installed or sieve rule to move to this folder? > I have no configuration to do this. > > My logs: > Sep 10 12:12:44 mda02 dovecot: imap(my.user(a)mydomain.com): Warning: Inotify instance limit for user 5000 (UID vmail) exceeded, disabling. Increase /proc/sys/fs/inotify/max_user_instances > Sep 10 12:12:45 mda02 dovecot: imap(my.user(a)mydomain.com): copy from INBOX: box=Spam, uid=134, msgid=<466c888b2179f7e2c0fc74b186396785(a)mydomain.com>, size=2838 > Sep 10 12:12:45 mda02 dovecot: imap(my.user(a)mydomain.com): expunge: box=INBOX, uid=826, msgid=<466c888b2179f7e2c0fc74b186396785(a)mydomain.com>, size=2838 > > I don't have any client connected at the imap server in this time. Double check this, usally i.e Thunderbird use its only antispam solution to move mails into spam folder if they exist and configured > > Some tip? > > BR, > > Alfredo > Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstraße 15, 81669 München Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein

1 0

Re: Message moved to Spam folder mysteriously
by Alfredo Saldanha 11 Sep '15

11 Sep '15

Hi Larry, I have nothing. ----- Mensagem original ----- De: "Larry Rosenman" <larryrtx(a)gmail.com> Para: "Alfredo Saldanha" <asaldanha(a)infolink.com.br> Cc: "Dovecot Mailing List" <dovecot(a)dovecot.org> Enviadas: Quinta-feira, 10 de setembro de 2015 15:04:38 Assunto: Re: Message moved to Spam folder mysteriously Do you have SIeve(pigeonhole) with rules? Or an Anti-Spam proxy in front of Dovecot? On Thu, Sep 10, 2015 at 1:02 PM, Alfredo Saldanha < asaldanha(a)infolink.com.br > wrote: Hi there, How dovecot move the message to Spam without antispam plugin installed or sieve rule to move to this folder? I have no configuration to do this. My logs: Sep 10 12:12:44 mda02 dovecot: imap( my.user(a)mydomain.com ): Warning: Inotify instance limit for user 5000 (UID vmail) exceeded, disabling. Increase /proc/sys/fs/inotify/max_user_instances Sep 10 12:12:45 mda02 dovecot: imap( my.user(a)mydomain.com ): copy from INBOX: box=Spam, uid=134, msgid=< 466c888b2179f7e2c0fc74b186396785(a)mydomain.com >, size=2838 Sep 10 12:12:45 mda02 dovecot: imap( my.user(a)mydomain.com ): expunge: box=INBOX, uid=826, msgid=< 466c888b2179f7e2c0fc74b186396785(a)mydomain.com >, size=2838 I don't have any client connected at the imap server in this time. Some tip? BR, Alfredo -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx(a)gmail.com US Mail: 7011 W Parmer Ln, Apt 1115, Austin, TX 78729-6961

1 0