- dovecot - dovecot.org

[Dovecot] Question about directory hashing
by Javier de Miguel Rodríguez 11 Jun '10

11 Jun '10

Hello I have been reading http://wiki.dovecot.org/MailLocation and http://wiki.dovecot.org/Variables and I do not fully understand the directory hashing feature. I want to migrate > 70.000 users from Sun Messaging to Dovecot using imapsync. I have tested with mail_location=maildir:/buzones/us.es/%1Hu/%2.1u/%n but I get the following directory tree: `-- 0 |-- - |-- 1 |-- 2 |-- 3 |-- 8 |-- _ |-- a |-- ab |-- b |-- c |-- d |-- e |-- ev |-- f |-- g |-- h |-- i |-- ie |-- is |-- j |-- jb |-- jj |-- jp |-- js |-- k |-- l |-- m |-- mb |-- n |-- o |-- p |-- pp |-- q |-- r |-- rm |-- s |-- t |-- u |-- v |-- w |-- x |-- y `-- z The ideal directory layout should be the following: First directory level: Letters from a to z Second directory level: Numbers from 0 to 200 Third directory level: %n (username without @domain) How can I achive this directory layout (or other optimized for 70.000 users) . I use ext3 on Red Hat Enterprise Linux 5 with directory indexes on. Regards Javier de Miguel

2 1

[Dovecot] Fail2ban
by Jerrale Gayle 11 Jun '10

11 Jun '10

I have fail2ban working for EVERYTHING else except dovecot. I have tried using my own custom regex in conjunction with the regex on the dovecot.org site. Neither are picked up by fail2ban and I'm trying to use an imminent attack agaist dovecot, going on now, to my advantage to see when I get the right regexp. Here are my current ones: failregex = .*dovecot: (?:pop3-login|imap-login): (?:Disconnected|Aborted login) $(?:auth failed, .* attempts|no auth attempts)$:.*rip=<HOST>,.* <<< this is my custom (?: pop3-login|imap-login): (?:Authentication failure|Aborted login \(auth failed|Aborted login \(tried to use disabled|Disconnected \(auth failed).*rip=(?P<host>\S*),.* <<< from dovecot.org .*warning:.\S*\[(?P<host>)\]: SASL.(?:PLAIN|LOGIN).authentication failed:.* Here is the current attack: Jun 10 17:18:10 mail dovecot: pop3-login: Disconnected (auth failed, 1 attempts): user=<rahul>, method=PLAIN, rip=113.12.82.71, lip=173.50.101.12 Can someone help me out a little? Thanks, Jerrale G

6 6

[Dovecot] Evolution and Thunderbird do different things?
by Phil Howard 10 Jun '10

10 Jun '10

I'm trying both Evolution and Thunderbird on my IMAP server, and find that there are differences in how some things are done, between clients. Shouldn't there have been a standard way to do these things in the IMAP protocol? The first thing I noticed is that when deleting email from one client, it puts a "T" on the file name, leaving it where it is, and from the other client, it moves the mail to a ".Trash" directory on the server (and created a 2nd "Trash" folder ... so now I have 2 "Trash" folders, one with some deleted mail in it, and the other with some deleted mail in it). I'm not saying Dovecot has a problem here. But maybe IMAP the protocol does for not having a standard way to do things, and these clients, for not doing it the same way (if there is some standard somewhere). Any IMAP experts here know what the story is with this?

5 8

[Dovecot] Problem with LDAP query
by Aleix Dorca 10 Jun '10

10 Jun '10

Hi people, first message to this list. I've a problem with dovecot 1.0.15 (debian latest package) and an LDAP query. The situation is the following. My LDAP users have multiple mail addresses (field 'mail') and mail should be able to be sent to any of these and the mail should always end on the user's mailbox. This is not working for me now. My dovecot-ldap.conf relevant config shows: user-attrs = uid=user user_filter = (&(objectClass=posixAccount)(|(uid=%n)(mail=%u))) This correctly detects multiple addresses but mail always end in folder (from dovecot.conf): mail_location = maildir:/home/vmail/%n/Maildir So if user@domain gets a mail it ends in /home/vmail/user/Maildir but if the same user gets an email to user-alt@domain it ends in /home/vmail/user-alt/Maildir instead of /home/vmail/user/Maildir. I've been debugging and I get this on my mail.log file: Jun 10 12:41:29 horologium deliver(user-alt@domain): auth input: user-alt@domain Jun 10 12:41:29 horologium deliver(user-alt@domain): auth input: user=user Jun 10 12:41:29 horologium deliver(user-alt@domain): auth input: uid=5000 Jun 10 12:41:29 horologium deliver(user-alt@domain): auth input: gid=5000 Jun 10 12:41:29 horologium deliver(user-alt@domain): maildir: data=/home/vmail/user-alt/Maildir Jun 10 12:41:29 horologium deliver(user-alt@domain): maildir: root=/home/vmail/user-alt/Maildir, index=/home/vmail/user-alt/Maildir, control=, inbox= Since I'm in version 1.0.15 can't use the mailLocation with the $ substitution. Anyway, any help will be appreciated. My dovecot -n result: # 1.0.15: /etc/dovecot/dovecot.conf log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap imaps pop3 pop3s ssl_cert_file: /etc/dovecot/certs/domain.crt ssl_key_file: /etc/dovecot/certs/domain.key disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login mail_privileged_group: mail mail_location: maildir:/home/vmail/%n/Maildir mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %08Xu%08Xv auth default: mechanisms: plain login passdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf userdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf socket: type: listen master: path: /var/run/dovecot/auth-master mode: 384 user: vmail group: vmail Thanks a lot, Aleix Dorca.

1 0

[Dovecot] Dovecot v2.0.beta5 (2d6cf78982dc): Crashes upon client login
by Thomas Leuxner 10 Jun '10

10 Jun '10

Core dump upon client login with latest changes, gdb attached: ==> /var/log/dovecot.log <== Jun 8 19:26:05 spectre dovecot: master: Dovecot v2.0.beta5 (2d6cf78982dc) starting up Jun 8 19:26:21 spectre dovecot: imap-login: Login: user=<tlx(a)leuxner.net>, method=PLAIN, rip=10.10.10.10, lip=1.2.3.4, mpid=9997, TLS Jun 8 19:26:21 spectre dovecot: master: Error: service(imap): child 9997 killed with signal 11 (core dumped) Jun 8 19:26:21 spectre dovecot: imap-login: Login: user=<tlx(a)leuxner.net>, method=PLAIN, rip=10.10.10.10, lip=1.2.3.4, mpid=9999, TLS Jun 8 19:26:21 spectre dovecot: master: Error: service(imap): child 9999 killed with signal 11 (core dumped) Jun 8 19:26:26 spectre dovecot: imap-login: Login: user=<tlx(a)leuxner.net>, method=PLAIN, rip=10.10.10.10, lip=1.2.3.4, mpid=10001, TLS Jun 8 19:26:28 spectre dovecot: master: Error: service(imap): child 10001 killed with signal 11 (core dumped) Jun 8 19:26:32 spectre dovecot: master: Warning: Killed with signal 15 (by pid=10021 uid=0 code=kill) Core was generated by `dovecot/imap'. Program terminated with signal 11, Segmentation fault. [New process 10001] #0 quota_mailbox_transaction_commit (ctx=0x1d66660, changes_r=0x7fffec59fd80) at quota-storage.c:91 91 quota-storage.c: No such file or directory. in quota-storage.c #0 quota_mailbox_transaction_commit (ctx=0x1d66660, changes_r=0x7fffec59fd80) at quota-storage.c:91 qbox = (struct quota_mailbox *) 0x1d5df50 qt = (struct quota_transaction_context *) 0x0 #1 0x00007fcfcaf5b69d in mailbox_transaction_commit_get_changes (_t=<value optimized out>, changes_r=0x7fffec59fd80) at mail-storage.c:1194 _data_stack_cur_id = 4 t = (struct mailbox_transaction_context *) 0x1d66660 ret = <value optimized out> #2 0x00007fcfcaf5b6d6 in mailbox_transaction_commit (t=0x18) at mail-storage.c:1178 changes = {pool = 0xa0, uid_validity = 0, saved_uids = {arr = {buffer = 0x0, element_size = 30553128}, v = 0x0, v_modifiable = 0x0}, ignored_uid_changes = 30770416, ignored_modseq_changes = 0} ret = <value optimized out> #3 0x0000000000415a93 in imap_search_deinit (ctx=0x1d584e0) at imap-search.c:575 ret = 0 #4 0x00000000004160cc in cmd_search_more (cmd=0x1d583d8) at imap-search.c:402 ctx = (struct imap_search_context *) 0x1d584e0 opts = SEARCH_RETURN_ALL sync_flags = <value optimized out> end_time = {tv_sec = 30988688, tv_usec = 1024} id = 18766 id_min = <value optimized out> id_max = 0 time_msecs = <value optimized out> tryagain = false lost_data = false __FUNCTION__ = "cmd_search_more" #5 0x0000000000416484 in imap_search_start (ctx=0x1d584e0, sargs=0x1d65698, sort_program=0x0) at imap-search.c:550 cmd = (struct client_command_context *) 0x1d583d8 wanted_fields = 0 wanted_headers = (struct mailbox_header_lookup_ctx *) 0x0 #6 0x000000000040d443 in cmd_search (cmd=0x1d583d8) at cmd-search.c:45 ctx = <value optimized out> sargs = (struct mail_search_args *) 0x1d65698 args = (const struct imap_arg *) 0x1d5ac30 charset = 0x41a0cc "UTF-8" ret = 0 #7 0x000000000041030c in client_command_input (cmd=0x1d583d8) at imap-client.c:646 client = (struct client *) 0x1d57c78 command = <value optimized out> __FUNCTION__ = "client_command_input" #8 0x00000000004103bd in client_command_input (cmd=0x1d583d8) at imap-client.c:696 client = (struct client *) 0x1d57c78 command = (struct command *) 0x8 __FUNCTION__ = "client_command_input" #9 0x0000000000410535 in client_handle_input (client=0x1d57c78) at imap-client.c:737 _data_stack_cur_id = 3 ret = 34 remove_io = <value optimized out> handled_commands = false __FUNCTION__ = "client_handle_input" #10 0x0000000000410f82 in client_input (client=0x1d57c78) at imap-client.c:788 cmd = <value optimized out> output = (struct ostream *) 0x1d58258 bytes = <value optimized out> __FUNCTION__ = "client_input" #11 0x00007fcfcacf98eb in io_loop_handler_run (ioloop=<value optimized out>) at ioloop-epoll.c:212 ctx = (struct ioloop_handler_context *) 0x1d2b7d0 event = (const struct epoll_event *) 0x1d2b840 list = (struct io_list *) 0x1d58330 io = (struct io_file *) 0x1d582f0 tv = {tv_sec = 1799, tv_usec = 999330} t_id = 2 msecs = <value optimized out> ret = 1 call = <value optimized out> #12 0x00007fcfcacf8a68 in io_loop_run (ioloop=0x1d2b5c0) at ioloop.c:350 No locals. #13 0x00007fcfcace8563 in master_service_run (service=0x1d2b490, callback=0x18) at master-service.c:480 No locals. #14 0x0000000000419121 in main (argc=1, argv=0x1d2b370) at main.c:359 service_flags = <value optimized out> storage_service_flags = <value optimized out> postlogin_socket_path = 0x0 username = 0x0 c = <value optimized out> set_roots = {0x41c320, 0x0}

2 5

[Dovecot] converting from vm-pop3d
by Tim Uckun 09 Jun '10

09 Jun '10

Hello All. I am looking into an old server which is running vm-pop3d. This server is having problems because the pop3 server is taking up 100% of the CPU. I looked at the largest mailboxes and there are a handful over 20 megs in size, the largest one is 55megs, they are all mbox format (I think). I have been looking at the wiki and it looks like there is a perl script to make the mailboxes behave. There are also other scripts that try and convert mbox to maildir formats and from what I can gather dovecot can do this as well. Finally the dovecot in the fedora repos is 1.0.X and I notice that the latest in 1.2.X is there a more up to date dovecot RPM repo? I would appreciate any advice anybody can give me on how to proceed with this transition. Thank you in advance.

2 4

Re: [Dovecot] Fwd: converting from vm-pop3d
by Tim Uckun 09 Jun '10

09 Jun '10

>> I hate to be rude but I am going to bump my post. Does anybody have >> any advice on migrating from vm-pop3d? > > Which version of vm-pop3d you use ? > vm-pop3d POP3 Server Version 1.1.7f-DA-2

2 1

[Dovecot] dovecot 2.0b3 crash with lmtp and DNS based proxy
by Oliver Eales 09 Jun '10

09 Jun '10

Hello, i am trying to proxy a LMTP connection with version 2.0b3 Currently i have the problem when trying to use a named based proxy for LMTP the process doesn't resolve the hostname and crashes: Feb 26 16:53:26 auth: Debug: ldap(vodafonemail56@vodafone.de,::1): pass search: base=ou=mailboxes,ou=vfag,c=de,o=vodafone scope=subtree filter=(&(objectClass=uco)(mail=vodafonemail56(a)vodafone.de)) fields=userpassword,isactive,host Feb 26 16:53:26 auth: Debug: ldap(vodafonemail56@vodafone.de,::1): result: userpassword(password)=<hidden> proxy(proxy)=1 host(host)=kangaroo.arcor-so.net Feb 26 16:53:26 auth: Debug: master out: PASS 1 proxy host=kanagroo.arcor-so.net Feb 26 16:53:26 lmtp(17929): Debug: auth input: proxy host=kangaroo.arcor-so.net Feb 26 16:53:26 lmtp(17929): Error: lmtp client: kangaroo.arcor-so.net is not a valid IP Feb 26 16:53:30 lmtp(17929): Info: Disconnect from ::1: Client quit Feb 26 16:53:30 master: Error: service(lmtp): child 17929 killed with signal 11 (core dumped) Program terminated with signal 11, Segmentation fault. #0 0x00000000004081fe in lmtp_proxy_try_finish (proxy=0x633898) at lmtp-proxy.c:193 193 if (lmtp_proxy_send_data_replies(proxy) && (gdb) bt full #0 0x00000000004081fe in lmtp_proxy_try_finish (proxy=0x633898) at lmtp-proxy.c:193 No locals. #1 0x0000000000409bb3 in lmtp_client_deinit (_client=<value optimized out>) at lmtp-client.c:137 client = (struct lmtp_client *) 0x633db8 #2 0x00000000004089c8 in lmtp_proxy_deinit (_proxy=<value optimized out>) at lmtp-proxy.c:86 proxy = (struct lmtp_proxy *) 0x633898 #3 0x000000000040602e in client_destroy (client=0x6191c8, prefix=<value optimized out>, reason=<value optimized out>) at client.c:255 No locals. #4 0x00000000004067d3 in cmd_quit (client=0xb, args=<value optimized out>) at commands.c:407 No locals. #5 0x000000000040669b in client_input_handle (client=0x6191c8) at client.c:61 _data_stack_cur_id = 3 output = (struct ostream *) 0x619b80 line = 0x631461 "quit" ret = <value optimized out> #6 0x00007f3217c9b8db in io_loop_handler_run (ioloop=<value optimized out>) at ioloop-epoll.c:208 ctx = (struct ioloop_handler_context *) 0x6177b0 event = (const struct epoll_event *) 0x617820 list = (struct io_list *) 0x619c60 io = (struct io_file *) 0x619c20 tv = {tv_sec = 59, tv_usec = 976185} t_id = 2 msecs = <value optimized out> ret = 1 call = <value optimized out> #7 0x00007f3217c9aa48 in io_loop_run (ioloop=0x6175a0) at ioloop.c:350 No locals. #8 0x00007f3217c8ae03 in master_service_run (service=0x617480, callback=0x6) at master-service.c:478 No locals. #9 0x0000000000405b92 in main (argc=1, argv=0x617370) at main.c:92 ---Type <return> to continue, or q <return> to quit--- set_roots = {0x40bd00, 0x40b980, 0x0} service_flags = <value optimized out> storage_service_flags = 675 c = <value optimized out> (gdb) Regards, Oliver Eales

2 4

[Dovecot] Dovecot v2.0.beta5 (1b45f9641924): Auth Crashes
by Thomas Leuxner 08 Jun '10

08 Jun '10

Hi, not sure which change caused it, but one of the latest adds between those two snapshots breaks userdb lookup: Jun 1 21:53:30 spectre dovecot: master: Dovecot v2.0.beta5 (1b45f9641924) starting up Jun 1 21:53:30 spectre dovecot: master: Warning: Killed with signal 15 (by pid=6898 uid=0 […] Jun 1 21:53:40 spectre dovecot: master: Dovecot v2.0.beta5 (55b8480849b0) starting up Jun 1 21:53:40 spectre dovecot: master: Warning: Killed with signal 15 (by pid=8577 uid=0 code=kill) Jun 1 21:52:30 spectre postfix/lmtp[6787]: F151B408D: to=<tlx(a)leuxner.net>, relay=spectre.leuxner.net[private/dovecot-lmtp], delay=0.09, delays=0.06/0/0/0.04, dsn=4.3.0, status=deferred (host spectre.leuxner.net[private/dovecot-lmtp] said: 451 4.3.0 <tlx(a)leuxner.net> Internal error occurred. Refer to server log for more information. (in reply to RCPT TO command)) ==> /var/log/dovecot.log <== Jun 1 21:52:30 spectre dovecot: lmtp(6788): Connect from local Jun 1 21:52:30 spectre dovecot: master: Error: service(auth): child 6797 killed with signal 11 (core not dumped) Jun 1 21:52:30 spectre dovecot: lmtp(6788): Error: userdb lookup(tlx(a)leuxner.net): Disconnected unexpectedly Jun 1 21:52:30 spectre dovecot: master: Error: service(auth): command startup failed, throttling Jun 1 21:52:30 spectre dovecot: lmtp(6788): Disconnect from local: Client quit ==> /var/log/mail.log <== Jun 1 21:52:58 spectre postfix/qmgr[3246]: 5619A4086: from=<users-return-95390-lists=leuxner.net(a)httpd.apache.org>, size=6226, nrcpt=1 (queue active) ==> /var/log/dovecot.log <== Jun 1 21:52:58 spectre dovecot: lmtp(6788): Connect from local Reverting to changeset 55b8480849b0 restores functionality. Regards Thomas

3 10

[Dovecot] The driver said: (QUOTA) "Quota exceeded" (Ingo sieve filter in horde)
by Iced Fox 08 Jun '10

08 Jun '10

I have $conf['storage']['params']['driverconfig'] = 'horde'; $conf['storage']['driver'] = 'sql'; in /var/www/html/horde/ingo/config/conf.php I have 2,146 records for one of the users in ingo_lists table of horde DB. The size of the script (.dovecot.sieve file) is 99.965 bytes. When trying to activate script I get the following # Changes saved. # Error There was an error activating the script. The driver said: (QUOTA) "Quota exceeded" Please let me know where I can change that size of QUOTA

2 1