December 2008 - dovecot

[Dovecot] Auth_username_format question
by Romer Ventura 05 Dec '08

05 Dec '08

Hello again, I have change authentication to LDAP from Kerberos due to recent changes to my plans and I am having a little problem getting the malbox created in desired path. At the moment the home folders are being created in: /home/vmail/DOMAIN.COM/%Ln and it worked great with kerberos, but with LDAP the domain part is missing so I did the following: Auth_username_format = %Ln Then I did: # telnet localhost pop3 Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. +OK Dovecot ready. user test4(a)domain.com +OK pass password +OK Logged in. But I saw in the logs the following: dovecot: auth(default): master out: USER 1 test4 uid=1001 gid=1000 home=/home/vmail//test4 The domain was missing.. So does it mean that auth_username_format dictates what dovecot will use, not only for the authentication part, but for everything else as well..? To me it seems that once the username has been formatted it forgets everything that doesn¹t constitute part of the specified format. Or am I misunderstanding the entire concept..? How cant I preserve the domain part so that the homes can be placed in the desired location: /home/vmail/%d/%u...? Thanks

2 1

[Dovecot] Dovecot Proxy with MySQL auth
by Justin Krejci 05 Dec '08

05 Dec '08

We are looking at deploying several pop/imap servers to house the mail for 15,000 or more mailbox accounts. We are contemplating on the design and are looking at using MySQL auth (we already have a MySQL environment in place for our user auth to live) and proxy_maybe so each server can proxy for all the others and we just have a network load balancer distribute the incoming connections to all of the Dovecot servers. Each server would have its own local maildir storage for the users local to that server and all of the authentication and target backend pop/imap server data would be stored in the same MySQL database. The problem we are running into is the documentation is not very clear on this type of scenario. http://wiki.dovecot.org/PasswordDatabase/ExtraFields/Proxy At the bottom of this page it gives a query example of "SELECT NULL AS password, ." but that does not seem to allow for us to use the proxy_maybe if the destination server is localhost (and therefore do not proxy) it does not seem that the above query will actually send the real password for authentication. Is this a misunderstanding on our part or is the use of mysql auth + proxy_maybe not feasible? Assuming the latter we surmised using a separate instance of Dovecot on each machine to act solely as a proxy front end (use proxy instead of proxy_maybe) then on the second instance there is no proxy config and it listens on a separate TCP port like 80143 or whatever. Any input or suggestions would be appreciated. Justin Krejci

2 4

[Dovecot] Roadmap
by Jonathan Siegle 05 Dec '08

05 Dec '08

I've been running 1.2alpha3 for weeks now without issue. However, some people in my testing department object to even testing "alpha" code. Are there specific features/bugs that need resolved before alpha reaches beta? Thanks, Jonathan

2 1

[Dovecot] Dovecot authenticating to multiple kerberos realms
by Romer Ventura 04 Dec '08

04 Dec '08

Hello, I got Postfix, Dovecot 1.1.7 configure to use pam and the pam.d/dovecot file is configure to use pam_krb5 module. Everything is working with no problems, but I am finding that the user must type the domain part in uppercase in order to successfully authenticate. So I am wondering if there is any way for the user to login as user1(a)domain.com instead of user1@DOMAIN.COM...? Any ideas..? Thanks

2 2

[Dovecot] Antispam plugin + scriptsieve
by Allan Cassaro 03 Dec '08

03 Dec '08

Hi, I wrote a little python program that works with antispam plugin, to create or remove sieve rules based on "From:" of any e-mail that is moved to some folder configured in dovecot.conf. He works fine with "Felamimail" the email program of "eGroupware". After setup, is very simple: If an user move a message to "blocked" folder, is appended a rule in the script sieve of this user. If the message is deleted or moved out that folder, the rule is removed too. The setup is very simple: (after setup antispam plugin) Change this in dovecot.conf: protocol imap { mail_plugins = antispam } plugin { antispam_spam = Blocked antispam_mail_sendmail = /usr/libexec/dovecot/blockthis.py antispam_mail_sendmail_args = -u;%u antispam_mail_spam = -a antispam_mail_notspam = -d } Hooo... this script create a "include global script" statament in script sieve... If you don't want this feature, just comment this 2 lines: sievelist.append('require ["fileinto", "include"];\n') sievelist.append('include :global "global.sieve";\n') Here this is very useful! :D This script was created to suit my needs, so, have some paths in the code... It's not very "user friendly" yet... but if have intereting I will implement others features (like a config file). Download here: http://allan.cassaro.googlepages.com/blockthis.py Regards.

1 1

[Dovecot] Antispam plugin + scriptsieve
by Allan Cassaro 03 Dec '08

03 Dec '08

Hi, I wrote a little python program that works with antispam plugin, to create or remove sieve rules based on "From:" of any e-mail that is moved to some folder configured in dovecot.conf. He works fine with "Felamimail" the email program of "eGroupware". After setup, is very simple: If an user move a message to "blocked" folder, is appended a rule in the script sieve of this user. If the message is deleted or moved out that folder, the rule is removed too. The setup is very simple: (after setup antispam plugin) Change this in dovecot.conf: protocol imap { mail_plugins = antispam } plugin { antispam_spam = Blocked antispam_mail_sendmail = /usr/libexec/dovecot/blockthis.py antispam_mail_sendmail_args = -u;%u antispam_mail_spam = -a antispam_mail_notspam = -d } Hooo... this script create a "include global script" statament in script sieve... If you don't want this feature, just comment this 2 lines: sievelist.append('require ["fileinto", "include"];\n') sievelist.append('include :global "global.sieve";\n') Here this is very useful! :D Regards.

1 0

[Dovecot] my_vsnprintf crash on HP-UX
by Marc Beyer 03 Dec '08

03 Dec '08

Hi, sorry for the double post, I stupidly composed this as a reply to an earlier mail, which causes it to appear in an older thread. Posting again so it doesn't get lost in the archives: dovecot 1.1.7 reliably crashes every time I try to open a mailbox using IMAP. Error in the logs: dovecot: Dec 02 23:14:15 Error: setmntent(/etc/mtab) failed: No such file or directory dovecot: Dec 02 23:14:16 Panic: IMAP(arandomuser(a)example.com): my_vsnprintf(): Output string too big dovecot: Dec 02 23:14:16 Error: child 4815 (imap) killed with signal 6 dovecot: Dec 02 23:14:19 Panic: IMAP(arandomuser(a)example.com): my_vsnprintf(): Output string too big dovecot: Dec 02 23:14:19 Error: child 4816 (imap) killed with signal 6 ... (it goes on until the daemon is killed) # dovecot -n # 1.1.7: /opt/dovecot-1.1.7/etc/dovecot.conf Error: setmntent(/etc/mtab) failed: No such file or directory # OS: HP-UX B.11.31 ia64 base_dir: /var/run/dovecot log_path: /var/adm/syslog/dovecot/err.log info_log_path: /var/adm/syslog/dovecot/info.log protocols: imap imaps pop pops ssl_cert_file: /opt/dovecot/etc/dovecot.crt ssl_key_file: /opt/dovecot/etc/dovecot.key login_dir: /var/run/dovecot/login login_executable: /opt/dovecot/libexec/dovecot/imap-login verbose_proctitle: yes first_valid_uid: 113 last_valid_uid: 113 first_valid_gid: 109 last_valid_gid: 109 mail_uid: exim mail_gid: exim mail_location: maildir:/maildir/%d/%n mail_debug: yes mail_drop_priv_before_exec: yes mail_executable: /opt/dovecot/libexec/dovecot/imap mail_plugin_dir: /opt/dovecot/lib/dovecot/imap/ namespace: type: private separator: . prefix: INBOX. inbox: yes list: yes subscriptions: yes auth default: mechanisms: plain login cram-md5 executable: /opt/dovecot/libexec/dovecot/dovecot-auth user: exim verbose: yes debug: yes debug_passwords: yes passdb: driver: sql args: /opt/dovecot/etc/dovecot-mysql.conf userdb: driver: static args: uid=113 gid=109 home=/maildir/%d/%n gdb backtrace (this is the HP-UX gdb, not the GNU debugger, dovecot was compiled with the HP-UX cc): (gdb) bt #0 0x60000000c03ef990:0 in kill+0x30 () from /usr/lib/hpux32/libc.so.1 #1 0x60000000c02a0e60:0 in raise+0x120 () from /usr/lib/hpux32/libc.so.1 #2 0x60000000c03b0f70:0 in abort+0x170 () from /usr/lib/hpux32/libc.so.1 #3 0x42ab6a0:0 in default_fatal_finish (type=LOG_TYPE_PANIC, status=0) at failures.c:150 #4 0x42acd40:0 in i_internal_fatal_handler (type=LOG_TYPE_PANIC, status=0, fmt=0x409f750 "my_vsnprintf(): Output string too big", args=0x7ffff418) at failures.c:430 #5 0x42abb50:0 in i_panic ( format=0x409f750 "my_vsnprintf(): Output string too big") at failures.c:197 #6 0x4306fb0:0 in my_vsnprintf (str=0x7ffff4a0 "4935b742", size=9, format=0x4094998 "%08x", ap=0x7ffff478) at compat.c:276 #7 0x42f9a20:0 in i_snprintf (dest=0x7ffff4a0 "4935b742", max_chars=9, format=0x4094998 "%08x") at strfuncs.c:23 #8 0x41e6cd0:0 in mailbox_uidvalidity_write ( path=0x4001d400 "/maildir/example.com/arandomuser/dovecot-uidvalidity", uid_validity=1228257090) at mailbox-uidvalidity.c:42 #9 0x41e7ac0:0 in mailbox_uidvalidity_next_rescan ( path=0x4001d400 "/maildir/example.com/arandomuser/dovecot-uidvalidity") at mailbox-uidvalidity.c:154 #10 0x41e7de0:0 in mailbox_uidvalidity_next ( path=0x4001d400 "/maildir/example.com/arandomuser/dovecot-uidvalidity") at mailbox-uidvalidity.c:181 ---Type <return> to continue, or q <return> to quit--- #11 0x4110540:0 in maildir_get_uidvalidity_next (storage=0x40046698) at maildir-storage.c:1054 #12 0x4121c60:0 in maildir_uidlist_sync_update (ctx=0x40044e60) at maildir-uidlist.c:1219 #13 0x4124a70:0 in maildir_uidlist_sync_finish (ctx=0x40044e60) at maildir-uidlist.c:1609 #14 0x4114120:0 in maildir_sync_context (ctx=0x4001c220, forced=false, find_uid=0x0, lost_files_r=0x7ffff590) at maildir-sync.c:781 #15 0x41147b0:0 in maildir_storage_sync_init (box=0x4005ca28, flags=MAILBOX_SYNC_FLAG_FIX_INCONSISTENT|MAILBOX_SYNC_FLAG_FULL_READ) at maildir-sync.c:859 #16 0x41de2e0:0 in mailbox_sync_init (box=0x4005ca28, flags=MAILBOX_SYNC_FLAG_FIX_INCONSISTENT|MAILBOX_SYNC_FLAG_FULL_READ) at mail-storage.c:516 #17 0x41de4a0:0 in mailbox_sync (box=0x4005ca28, flags=MAILBOX_SYNC_FLAG_FIX_INCONSISTENT|MAILBOX_SYNC_FLAG_FULL_READ, status_items=STATUS_KEYWORDS|STATUS_FIRST_UNSEEN_SEQ|STATUS_UIDVALIDITY|STATUS_UIDNEXT|STATUS_RECENT|STATUS_MESSAGES, status_r=0x7ffff5c0) at mail-storage.c:545 #18 0x40bc200:0 in cmd_select_full (cmd=0x40054298, readonly=false) at cmd-select.c:39 #19 0x40bc640:0 in cmd_select (cmd=0x40054298) at cmd-select.c:88 #20 0x40c9c00:0 in client_command_input (cmd=0x40054298) at client.c:580 ---Type <return> to continue, or q <return> to quit--- #21 0x40ca340:0 in client_command_input (cmd=0x40054298) at client.c:629 #22 0x40ca6a0:0 in client_handle_next_command (client=0x40046da0, remove_io_r=0x7ffff610) at client.c:670 #23 0x40c9470:0 in client_handle_input (client=0x40046da0) at client.c:680 #24 0x40c6ec0:0 in client_input (client=0x40046da0) at client.c:725 #25 0x42cdb60:0 in io_loop_handler_run (ioloop=0x4002e9f0) at ioloop-poll.c:204 #26 0x42cb780:0 in io_loop_run (ioloop=0x4002e9f0) at ioloop.c:320 #27 0x40efa90:0 in main (argc=3, argv=0x7ffffa44, envp=0x7ffffa54) at main.c:293 (gdb) Doing a system call trace via tusc -p -v -o dovetrace -k -f dovecot I get the following for a crashed process (different pid since I didn't want to do the tusc on the same run). Lines start with the [5301]: [5301] open("/maildir/example.com/arandomuser", O_RDONLY|0x200000, 0152000) ................................................................................ = 8 [5301] fstat(8, 0x7ffff440) ................................................................................................................................ = 0 [5301] fcntl(8, F_SETFD, 0) ................................................................................................................................ = 0 [5301] getdents(8, 0x4007b3d0, 8192) ....................................................................................................................... = 312 [5301] getdents(8, 0x4007b3d0, 8192) ....................................................................................................................... = 0 [5301] close(8) ............................................................................................................................................ = 0 [5301] rename("/maildir/example.com/arandomuser/dovecot-uidvalidity.4935b740", "/maildir/example.com/arandomuser/dovecot-uidvalidity.4935b741") ............ = 0 [5301] open("/maildir/example.com/arandomuser/dovecot-uidvalidity", O_RDWR|O_CREAT|0x800, 0666) ............................................................ = 8 [5301] brk(0x400b1000) ..................................................................................................................................... = 0 [5301] brk(0x400c1000) ..................................................................................................................................... = 0 [5301] brk(0x400e1000) ..................................................................................................................................... = 0 [5301] brk(0x40121000) ..................................................................................................................................... = 0 [5301] brk(0x401a1000) ..................................................................................................................................... = 0 [5301] write(2, "01P m y _ v s n p r i n t f ( ) ".., 40) .................................................................................................. = 40 [5301] sigprocmask(SIG_UNBLOCK, NULL, 0x7ffff3a0) .......................................................................................................... = 0 [5301] sigaction(SIGABRT, NULL, 0x7ffff3c0) ................................................................................................................ = 0 [5301] close(1) ............................................................................................................................................ = 0 [5301] sigprocmask(SIG_BLOCK, 0x7ffff3a0, NULL) ............................................................................................................ = 0 [5301] sigaction(SIGABRT, 0x7ffff3c0, NULL) ................................................................................................................ = 0 [5301] sigprocmask(SIG_UNBLOCK, 0x7ffff3a0, NULL) .......................................................................................................... = 0 [5301] getpid() ............................................................................................................................................ = 5301 (5295) [5301] Received signal 6, SIGABRT, in kill(), [SIG_DFL], no siginfo [5301] kill(6, SIGABRT) .................................................................................................................................... [entry] [5301] exit(6) [implicit (kill failure)] ................................................................................................................... WIFSIGNALED(SIGABRT)|WCOREDUMP [5295] waitpid(-1, WIFSIGNALED(SIGABRT)|WCOREDUMP, WNOHANG) ................................................................................................ = 5301 [5302] kill(5301, SIG#0) ................................................................................................................................... ERR#3 ESRCH Anything you can think of that would help? Cheers, Marc

2 2

[Dovecot] Loginname - mapping
by Roald Amundsen 03 Dec '08

03 Dec '08

Hi! I have a server with a few thousand mailboxes (for a few hundred domains) on it. The usernames are following several naming conventions: username_domain domain_username username_domain.tld username-domain domain.username The reason for this chaos is that the accounts were set up on different mailservers, some imail, some linux, some with virtualmin and some manually and through aquisitons etc it has all ended up in one server. Now we are setting up atmail to replace imp. The loginprocess of atmail is a bit different in that you just type in your mail address and atmail tries a few combinations of loginnames to login. However, some of the combinations over atmail cant login to. Some of them works fine when using this line in dovecot.conf auth_username_translation = @_ Is there any facility to let dovecot do username mapping? If I eg have a file: usermapping that looks like this: user(a)domain1.com domain1_user user(a)domain2.com user_domain2 user(a)domain3.com domain3.user And yes, I know that the best way is to start again and use virtual domains and get all into one naming standard, but unfortunately, that is not going to happen. The other alternative is of course to hack into the source code of atmail, but I am not that confident in PHP. Any ideas? -- Regards Roald Amundsen

2 4

[Dovecot] Problem with sieve: Keep: Generic Error
by Thomas Siebert 03 Dec '08

03 Dec '08

Hi, i came across a strange error message in Ubuntu 8.10s package (Dovecot 1.1.4) regarding sieve: sieve runtime error: Keep: Generic Error sieve_execute_bytecode(/etc/dovecot/sieve/default.sievec) failed Note that the Sieve Scripts are basically executed fine and working fine. After a lot of testing I suppose the following: "keep" doesn't detect the private namespace I have to use (courier-compatibility...), thus sieve fails to do "keep", the message is handed back to dovecot-deliver which does a "keep"-similar action itself. If I have a script with "keep;" as the only command, I get this error message. If my script is totally blank (i.e. implicit keep only), I get the same error. But if there's no implicit or explicit "keep", e.g. "fileinto INBOX;" as only command, there's no error. Also IMAP-Folders, e.g. "fileinto INBOX.Test", work. Unfortunately, "fileinto INBOX" as default is no option for me, as I use a delimiter and want to let deliver put the mails into the according IMAP-Folders. Is this a known bug? Any Ideas? Thanks, Thomas Here's my dovecot -n output: log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap imaps pop3 pop3s ssl_cert_file: /etc/ssl/certs/mail_cip.pem ssl_key_file: /etc/ssl/private/mail_cip.key disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login first_valid_uid: 501 last_valid_uid: 501 first_valid_gid: 501 last_valid_gid: 501 mail_privileged_group: mail mail_uid: 501 mail_gid: 501 mail_location: maildir:~/Maildir mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_plugins(default): acl quota imap_quota mail_plugins(imap): acl quota imap_quota mail_plugins(pop3): quota mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 imap_client_workarounds(default): delay-newmail netscape-eoh imap_client_workarounds(imap): delay-newmail netscape-eoh imap_client_workarounds(pop3): pop3_uidl_format(default): %08Xu%08Xv pop3_uidl_format(imap): %08Xu%08Xv pop3_uidl_format(pop3): %f pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh namespace: type: private prefix: INBOX. inbox: yes list: yes subscriptions: yes auth default: mechanisms: plain login passdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf userdb: driver: prefetch userdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 384 user: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: vmail plugin: quota: maildir:User quota quota_rule: *:storage=100M quota_rule2: *:messages=5000 quota_warning: storage=95%% /etc/dovecot/quota_warn_size.sh 95 quota_warning2: storage=90%% /etc/dovecot/quota_warn_size.sh 90 quota_warning3: storage=80%% /etc/dovecot/quota_warn_size.sh 80 quota_warning4: messages=95%% /etc/dovecot/quota_warn_count.sh 95 quota_warning5: messages=90%% /etc/dovecot/quota_warn_count.sh 90 quota_warning6: messages=80%% /etc/dovecot/quota_warn_count.sh 80 acl: vfile:/etc/dovecot/acls:cache_secs=300

1 0

[Dovecot] Dovecot auth-worker permission denied.
by Romer Ventura 03 Dec '08

03 Dec '08

Hello, I am trying to get dovecot to use virtual users and authenticate using PAM+kerberos against Active Directory and I am running into some problems. I followed the tutorials from the wiki page from: http://www.linuxmail.info/active-directory-dovecot-pam-authentication/ And here is what I get from the /var/log/mail log: Nov 26 15:12:27 housigma20 dovecot: auth(default): client in: AUTH 1 PLAIN service=pop3 secured lip=127.0.0.1 rip=127.0.0.1 lport=110 rport=36327 resp=AGxpbnV4dABob3VzdG9u Nov 26 15:12:27 housigma20 dovecot: auth-worker(default): pam(linuxt,127.0.0.1): lookup service=dovecot Nov 26 15:12:27 housigma20 dovecot: auth-worker(default): pam(linuxt,127.0.0.1): pam_authenticate() failed: Permission denied Nov 26 15:12:29 housigma20 dovecot: auth(default): client out: FAIL 1 user=linuxt Nov 26 15:12:31 housigma20 dovecot: pop3-login: Aborted login (auth failed, 1 attempts): user=<linuxt>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured Any ideas..? Other than this: http://www.dovecot.org/list/dovecot/2008-July/032455.html Thanks...! /etc/pam.d/dovecot: auth sufficient pam_krb5.so no_user_check validate account sufficient pam_permit.so Here is my dovecot n and version: # 1.1.6: /etc/dovecot/dovecot.conf # OS: Linux 2.6.16.60-0.21-xenpae i686 SUSE Linux Enterprise Server 10 (i586) protocols: pop3 pop3s imap imaps login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login mail_privileged_group: mail mail_location: maildir:~/Maildir/ mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 imap_client_workarounds(default): delay-newmail outlook-idle netscape-eoh imap_client_workarounds(imap): delay-newmail outlook-idle netscape-eoh imap_client_workarounds(pop3): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: mechanisms: plain login debug: yes debug_passwords: yes passdb: driver: pam userdb: driver: static args: uid=1004 gid=1002 home=/home/vmail/%d/%Lu socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix

2 2