July 2012 - dovecot - dovecot.org

[Dovecot] Maildir messages
by Nick＠5sg.eu 13 Jul '12

13 Jul '12

Hi all, Hopefully, I'm sending this to the right place... Can someone guide me on changing the Maildir messages files back to the single file format I used to have instead of the dovecot.index /cur /tmp /new format my newer server currently has. I'm running dovecot v1.2.9 postfix v2.7 on Ubuntu v10.4 Thanks, Nick. . . . . MU/Webcasting -- _/ _/ _/ _/ _/ _/ _/ _/ _/ _/ _/ _/ _/ _/ _/ _/ _/ _/ _/ _/ _/ _/ . . . . . . . . Please join my Tech MeetUp group that meets in the NYC metro area Webcasting and Video Streaming Network: http://TheWebcasting.net . . . . . . . . _/ _/ _/ _/ _/ _/ _/ _/ _/ _/ _/ _/ _/ _/ _/ _/ _/ _/ _/ _/ _/ _/

7 13

[Dovecot] imap-login: Panic: epoll_ctl(add, 6) failed: Invalid argument
by Angel L. Mateo 13 Jul '12

13 Jul '12

Hello, More problems (it seems that we won't be able to put our new servers in production). The problem now is that when we reach 1000 dovecot processes we have errors like: Jul 9 12:10:22 myotis31 dovecot: imap-login: Panic: epoll_ctl(add, 6) failed: Invalid argument Jul 9 12:10:22 myotis31 dovecot: imap-login: Fatal: master: service(imap-login): child 32251 killed with signal 6 (core dumps disabled) and server doesn't accept any new connection. Our servers are running in ubuntu 12.04 with kernel 3.2.0-24-generic kernel. I have found a similar problem at https://bugzilla.redhat.com/show_bug.cgi?id=681578 but it is for redhat kernel of series 2.6. Could be the same problem? Any pointer to this problem for ubuntu kernels? Or for generic 3.0 kernels? Any idea? -- Angel L. Mateo Martínez Sección de Telemática Área de Tecnologías de la Información y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868887590 Fax: 868888337

3 5

[Dovecot] mail_log plugin logs UTF-8 mailbox name
by Ewald Dieterich 11 Jul '12

11 Jul '12

A small bug in the mail_log plugin: When I copy a mail from the inbox to a mailbox with special characters, the mailbox name is logged in UTF-8: [...] copy from INBOX: box=INBOX.Euro €, [...] I guess the name should be in mUTF-7, like it is done when I copy the other way round: [...] copy from Euro &IKw-: box=INBOX, [...]

2 2

[Dovecot] more info (more dsync problems)
by Jeff Gustafson 11 Jul '12

11 Jul '12

Rerunning the dsync command right after the timeout (see previous message) gave me these errors: dsync-local(vmail): Error: remote: dsync-remote(vmail): Error: Corrupted dbox file /home/.incoming_mail_migrations/users/user%domain.com/mdbox/s torage/m.60 (around offset=807789): msg header has bad magic value dsync-local(vmail): Error: remote: dsync-remote(vmail): Error: Corrupted dbox file /home/.incoming_mail_migrations/users/user%domain.com/mdbox/s torage/m.60 (around offset=807789): msg header has bad magic value dsync-local(vmail): Error: remote: dsync-remote(vmail): Warning: mdbox /home/.incoming_mail_migrations/users/user% domain.com/mdbox/storage: Inconsistency in map index (2,75904 != 2,82524) dsync-remote(vmail): Warning: mdbox /home/.incoming_mail_migrations/users/user% domain.com/mdbox/storage: rebuilding indexes dsync-local(vmail): Error: remote: dsync-remote(vmail): Error: Corrupted dbox file /home/.incoming_mail_migrations/users/user% domain.com/mdbox/storage/m.60 (around offset=807789): msg header has bad magic value dsync-local(vmail): Error: remote: dsync-remote(vmail): Warning: dbox: Copy of the broken file saved to /home/.incoming_mail_migrations/users/user% domain.com/mdbox/storage/m.60.broken dsync-local(vmail): Error: remote: dsync-remote(vmail): Error: Corrupted dbox file /home/.incoming_mail_migrations/users/user% domain.com/mdbox/storage/m.60 (around offset=807789): EOF reading msg header (got 0/30 bytes) dsync-local(vmail): Error: remote: dsync-remote(vmail): Warning: mdbox /home/.incoming_mail_migrations/users/user% domain.com/mdbox/storage: rebuilding indexes dsync-local(vmail): Error: remote: dsync-remote(vmail): Error: mdbox /home/.incoming_mail_migrations/users/user% domain.com/mdbox/storage: Duplicate GUID 1341304555.M433317P26661.n13,S=142447,W=144391 in m.62:790375 and m.60:790375

1 0

[Dovecot] more dsync problems: Error: proxy client timed out
by Jeff Gustafson 11 Jul '12

11 Jul '12

Hi all, I'm using dsync for backups. I recently upgraded to 2.1.7 due to issues with dsync mirror/backups. 2.1.7 fixed the issue with the guid conflict, but now I'm seeing this error on a couple of mailboxes: Error: proxy client timed out (waiting for output stream to flush, 0 bytes left) If there are 0 bytes left, why is it trying to flush? I'm using this command to backup the mailbox: dsync -vo mail_home=/home/users/user%domain.com backup ssh vmail(a)10.1.2.2 dsync -o mail_home=/home/.incoming_mail_migrations/users/user%adomain.com Any ideas? ...Jeff

1 0

Re: [Dovecot] Howto add another disk storage
by Stan Hoeppner 10 Jul '12

10 Jul '12

On 7/8/2012 5:16 PM, Matthias-Christian Ott wrote: > On 2012-07-08 23:29, Stan Hoeppner wrote: >> On 7/8/2012 8:27 AM, Patrick Domack wrote: >>> >>> Quoting Wojciech Puchar <wojtek(a)wojtek.tensor.gdynia.pl>: >>> >>>>> I think there are optimal situations where any configuration looks >>>>> good . . How often can a real-world disk actually deliver the 6Gbs >>>>> when only a minority of disk reads are long sequential runs on the >>>>> platters? >>>> none of hard drives can saturate 1.5Gb/s >>> >>> There are many disks out that do 150-200MB/sec, easily exceeding 1.5gb/s >>> speeds. >> >> There are a few SAS drives that can saturate a 150MB/s link, such as the >> Seagate Cheetah 15k.7, which can sustain 204MB/s streaming read on the >> outer tracks. >> >> But, again, streaming rate is irrelevant to mail storage. What matters >> is random seek latency. And the faster the spindle, the lower the >> latency. Thus 15k Seagate SAS drives are excellent candidates for mail >> store duty, as are any 10k or 15k drives. > > This is simply not true. SATA SSDs (~0,66 €/GB) are as expensive as the > 15k Seagate SAS HDDs (0,63 €/GB), but definitely faster. First, this sub discussion in this thread has been dealing strictly with mechanical storage, and that was intentional. Now you've injected solid state storage, and in the process you first disagreed with my statement, then agreed with it. Apparently you didn't realize you did so. Would you please clarify what I stated that is "simply not true"? You comment WRT SSD doesn't prove anything I said to be untrue. Quite the contrary, you reinforced my statements. -- Stan

11 25

[Dovecot] recover .sieve plaintext from .sievec binary file
by Florin Andrei 10 Jul '12

10 Jul '12

Hi, I upgraded a server from an old Linux distribution to a much newer one. In the process, Dovecot got upgraded from v1 to v2. By mistake, I deleted the .sieve plaintext file with all the Sieve filters, but I still do have the .sievec compiled binary. Is there any way to dump the binary file back into plaintext format? Keep in mind, I'm running v2 now, and the binary was made on a v1 Dovecot server. Thanks. -- Florin Andrei http://florin.myip.org/

3 4

[Dovecot] configuring imap_stats
by Reinhard Vicinus 09 Jul '12

09 Jul '12

Hi, i'm trying to configure imap_stats like it's documented in the wiki: http://wiki2.dovecot.org/Statistics. But as soon as i activate the imap_stats plugin i get the following error message trying to login via imap: dovecot: imap: Error: Can't load plugin imap_stats_plugin: Plugin stats must be loaded also (you must set: mail_plugins=$mail_plugins stats) But the stats plugin is configured as you can see in the attached configurations. Also i can get statistics without the imap_stats enabled, but as far as i know only of the pop3 users. Kind regards Reinhard

2 1

[Dovecot] mailboxes missing after upgrade from 2.1.4 to 2.1.7
by Micah Anderson 09 Jul '12

09 Jul '12

Hi all, I mentioned this on the #dovecot irc channel, but I thought I would post here so I can provide more details. The basic problem is that when I upgraded from 2.1.4 to 2.1.7, some users no longer are able to see their folders in pine/alpine. The folders are actually there, and are subscribed (according to doveadm) and its possible to do operations on those folders, if you know the name (for example, opening the folder works fine if you know the name). When I downgrade to 2.1.4 again, the folders appear again, so its clearly something that changed between the two versions. I looked through the changelog, and found a few possibile culprits, I think pine/alpine use imapc, so that could be related: . imapc: Use imapc_list_prefix also for listing subscriptions . Fixed looking up parent mailbox name with different namespace vs. layout separators. . imapc: Don't list mailboxes that don't match list patterns. . layout=fs: Fixed listing mailboxes with prefix=INBOX/ . LIST with mailbox {} settings incorrectly set subscribed-flags. Here is my dovecot -n output: # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.5 auth_default_realm = example.net auth_verbose = yes default_process_limit = 256 default_vsz_limit = 512 M dict { expire = mysql:/etc/dovecot/dovecot-dict-sql.conf quota = mysql:/etc/dovecot/dovecot-dict-sql.conf } disable_plaintext_auth = no first_valid_gid = 8 first_valid_uid = 8 last_valid_gid = 8 last_valid_uid = 8 listen = * login_greeting = howdy, ready. mail_location = mdbox:~/mdbox:INDEX=/srv/dovecot_indexes/%d/%1n/%n mail_plugins = expire quota zlib stats maildir_very_dirty_syncs = yes namespace { inbox = yes location = prefix = separator = . } namespace { alias_for = hidden = yes inbox = no list = no location = prefix = INBOX. separator = . } passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } plugin { antispam_allow_append_to_spam = yes antispam_backend = pipe antispam_debug_target = syslog antispam_pipe_program = /usr/local/bin/train_spam antispam_pipe_program_args = -d;10.0.1.109 antispam_pipe_program_notspam_arg = ham antispam_pipe_program_spam_arg = spam antispam_pipe_tmpdir = /var/tmp antispam_signature = X-Spam-Flag antispam_signature_missing = error antispam_spam_pattern_ignorecase = SPAM antispam_trash_pattern = trash;Trash;Deleted * expire = Trash expire2 = Trash/* expire3 = Spam expire_dict = proxy::expire quota = dict:Your mail quota::proxy::quota quota_rule = *:bytes=100663296 quota_rule2 = Trash:bytes=+20%% quota_rule3 = Spam:bytes=+10%% quota_rule4 = INBOX.Trash:bytes=+20%% quota_rule5 = INBOX.Spam:bytes=+10%% quota_rule6 = INBOX.restored_from_backups:bytes=+500%% sieve = ~/.dovecot.sieve sieve_after = /var/lib/dovecot/sieve/after.sieve sieve_before = /var/lib/dovecot/sieve/default.sieve sieve_dir = ~/sieve stats_refresh = 30 secs stats_track_cmds = yes zlib_save = gz zlib_save_level = 6 } postmaster_address = postmaster(a)example.net protocols = " imap pop3" service anvil { unix_listener anvil { group = dovecot mode = 0660 user = root } } service auth { unix_listener auth-userdb { group = mail mode = 0600 user = mail } } service dict { unix_listener dict { group = mail mode = 0600 user = mail } } service imap-login { process_min_avail = 10 service_count = 0 vsz_limit = 512 M } service imap-postlogin { executable = script-login /usr/local/sbin/postlogin_imap } service imap { executable = imap imap-postlogin process_limit = 2048 } service pop3-login { process_min_avail = 10 service_count = 0 vsz_limit = 512 M } service pop3-postlogin { executable = script-login /usr/local/sbin/postlogin_pop } service pop3 { executable = pop3 pop3-postlogin } service stats { fifo_listener stats-mail { mode = 0600 user = mail } } ssl_cert = </etc/certs/wildcard/cert.pem ssl_cipher_list = HIGH:-ADH:-aNULL ssl_key = </etc/certs/wildcard/key.pem userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } verbose_proctitle = yes protocol lda { mail_plugins = expire quota zlib stats sieve plugin { quota_exceeded_message = Sorry, your message cannot be delivered to that person because their mailbox is full. If you can contact them another way, you may wish to tell them of this problem. quota_rule7 = INBOX:bytes=+10%% } } protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep mail_max_userip_connections = 20 mail_plugins = expire quota zlib stats imap_quota imap_zlib antispam imap_stats plugin { quota_exceeded_message = You are over quota. To avoid losing mail, immediately empty your Trash and Sent folders and delete emails with large attachments. Visit https://help.example.net/quota for more help. } } protocol pop3 { mail_plugins = expire quota zlib stats pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_uidl_format = %g } As requested by tss in #dovecot, I attempted to add 'rawlog' to: service imap-postlogin { executable = script-login /usr/local/sbin/postlogin_imap } to get: service imap-postlogin { executable = script-login rawlogin /usr/local/sbin/postlogin_imap } but with that, it doesn't even open the INBOX folder, and there is nothing in the user's rawlog folder, I get this error: dovecot: imap-postlogin: Error: Fatal: This process must not be run as root it didn't open even the INBOX imap folder I went over the http://wiki2.dovecot.org/Debugging/Rawlog and made sure everything was correct there, but it still didn't work right. Any ideas or suggestions of things to try would be greatly appreciated! thanks, micah --

1 1

[Dovecot] Howto add another disk storage
by Adrian Minta 09 Jul '12

09 Jul '12

Hi all What is the best strategy to add another storage to an existing virtual mail system ? Move some domains to the new storage and create symlinks ? Switch to dovecot hashing ? But in this case what is the easy-east way to migrate ? Thanks for any suggestions or tips !

15 50