- dovecot - dovecot.org

[Dovecot] doveadm fetch LARGE attachments and remove message
by Bradley Giesbrecht 19 Jun '12

19 Jun '12

Looking at the wiki and man pages I am unsure how to fetch email attachments from a unix shell. I have an "doveadm search" that returns the messages that have the attachments I am after. Would I loop through an "doveadm fetch" and use a commandline imap client to save the attachments and move the message to the Trash? Or is there a doveadm command for this? Regards, Bradley Giesbrecht (pixilla)

2 2

[Dovecot] dovecot-sieve and LMT
by Martin Weil 19 Jun '12

19 Jun '12

Dear list, My mail server is working perfectly. So I am trying to add feature after feature, until I have all the features I need. This has worked fine until now. I am trying to get dovecot-sieve to work. So I activated dovecot-lda and the sieve plugin and told postfix to use deliver instead of procmail. After restarting all services I then created a test sieve file. Obviously I have not yet understood the whole process completely because, it simply does not work. I suspect some permission problems or misconfiguration of the sieve file, but I am not sure where to look for solutions. -rw-r--r-- 1 2001 2001 116 2012-06-16 21:25 /var/mail/vmail/domain.com/user/dovecot.sieve dovecot.sieve require "fileinto"; if header :contains ["subject"] ["Test"] { fileinto ".Folder1"; } else { fileinto ".Folder2"; } Of course Folder1 and Folder2 do exist. (/var/mail/vmail/domain.com/user/mail/.Folder1 and Folder2) As far as I can tell there are no errors reported anywhere, I checked mail.log and syslog. 2001 is the virtual uid/gid of this particular user. If anyone can help me with this it would be great. The Mailserver works very well apart from this. There was one odd thing apart from this. In the docs I read that auth-master has to be running for deliver to work correctly. I did not know this before, but mails were delivered correctly after I started using deliver. So is there a need for auth-master to be running or not? Thanks a lot Martin dovecot -n output: # 1.2.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.18-028stab091.2 i686 Ubuntu 10.04.4 LTS reiserfs log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap imaps lda ssl: required ssl_cert_file: /home/mweil/CA/cert.pem ssl_key_file: /home/mweil/CA/key.pem login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login mail_max_userip_connections: 25 mail_privileged_group: mail mail_uid: 10000 mail_gid: 10000 mail_location: maildir:/var/mail/vmail/%d/%n/mail mbox_write_locks: fcntl dotlock lda: postmaster_address: postmaster(a)domain.com mail_plugins: sieve mail_plugin_dir: /usr/lib/dovecot/modules/lda auth default: user: nobody passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: prefetch userdb: driver: sql args: /etc/dovecot/dovecot-sql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 432 plugin: sieve: /var/mail/vmail/%d/%u/dovecot.sieve postconf -n: alias_database = hash:/etc/aliases alias_maps = hash:/etc/aliases append_dot_mydomain = no biff = no broken_sasl_auth_clients = yes config_directory = /etc/postfix inet_interfaces = all mailbox_command = /usr/lib/dovecot/deliver mailbox_size_limit = 0 message_size_limit = 102400000 mydestination = host.domain.net, localhost, mydomain = domain.com myhostname = host.domain.com mynetworks = 127.0.0.1 myorigin = $mydomain readme_directory = no recipient_delimiter = + relayhost = smtp_tls_session_cache_database = btree:${data_directory}/smtp_scache smtpd_banner = $myhostname ESMTP $mail_name (Ubuntu) smtpd_client_restrictions = smtpd_error_sleep_time = 1s smtpd_hard_error_limit = 20 smtpd_helo_restrictions = smtpd_recipient_restrictions = permit_mynetworks reject_sender_login_mismatch permit_sasl_authenticated reject_unauth_destination reject_unverified_recipient smtpd_sasl_auth_enable = yes smtpd_sasl_path = private/auth smtpd_sasl_security_options = noanonymous smtpd_sasl_type = dovecot smtpd_sender_login_maps = pgsql:/etc/postfix/lookup/pgsql_sasl_senders.cf smtpd_sender_restrictions = smtpd_soft_error_limit = 10 smtpd_tls_auth_only = yes smtpd_tls_cert_file = /home/mweil/CA/cert.pem smtpd_tls_key_file = /home/mweil/CA/key.pem smtpd_tls_session_cache_database = btree:${data_directory}/smtpd_scache smtpd_use_tls = yes virtual_alias_maps = pgsql:/etc/postfix/lookup/pgsql_virtual_alias.cf virtual_gid_maps = pgsql:/etc/postfix/lookup/pgsql_virtual_gid.cf virtual_mailbox_base = /var/mail/vmail/ virtual_mailbox_domains = domain.com virtual_mailbox_limit = 0 virtual_mailbox_maps = pgsql:/etc/postfix/lookup/pgsql_virtual_accounts.cf virtual_uid_maps = pgsql:/etc/postfix/lookup/pgsql_virtual_uid.cf

3 7

[Dovecot] question about fts_squat
by Wojciech Puchar 18 Jun '12

18 Jun '12

just installed dovecot with fts_squat config attached after message. When i telnet to imap server and execute by hand 1 login user password select foldername search body "someword" it works fine, and at blazing speed except first run (indexing). i already indexed everything by doveadm index offline to prevent server overload if multiple users (after i tell them) will try fulltext search. All great BUT it doesn't work in thunderbird. Just gives zero results. i used tcpdump to check how thunderbird executes it and it uses search undeleted body "someword" tried manually and it DOES NOT WORK. always give empty results. even search all body "someword" doesn't work. while search body "someword" always work very well. what's wrong? # 2.1.7: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 8.3-STABLE amd64 disable_plaintext_auth = no listen = * mail_location = maildir:~/Maildir mail_plugins = fts fts_squat namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /usr/local/etc/dovecot/deny-users deny = yes driver = passwd-file } passdb { driver = pam } plugin { fts = squat fts_squat = partial=4 full=10 } protocols = imap ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { driver = passwd } protocol imap { mail_plugins = fts fts_squat }

2 5

[Dovecot] question about fts_squat
by Wojciech Puchar 18 Jun '12

18 Jun '12

i repost my question as it probably wasn't received properly - i did it just after subscribing possibly too early. thanks for answers ---------------------------------------------- just installed dovecot with fts_squat config attached after message. When i telnet to imap server and execute by hand 1 login user password select foldername search body "someword" it works fine, and at blazing speed except first run (indexing). i already indexed everything by doveadm index offline to prevent server overload if multiple users (after i tell them) will try fulltext search. All great BUT it doesn't work in thunderbird. Just gives zero results. i used tcpdump to check how thunderbird executes it and it uses search undeleted body "someword" tried manually and it DOES NOT WORK. always give empty results. even search all body "someword" doesn't work. while search body "someword" always work very well. what's wrong? # 2.1.7: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 8.3-STABLE amd64 disable_plaintext_auth = no listen = * mail_location = maildir:~/Maildir mail_plugins = fts fts_squat namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /usr/local/etc/dovecot/deny-users deny = yes driver = passwd-file } passdb { driver = pam } plugin { fts = squat fts_squat = partial=4 full=10 } protocols = imap ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { driver = passwd } protocol imap { mail_plugins = fts fts_squat }

1 0

[Dovecot] Problem with lmtp director proxy
by Angel L. Mateo 18 Jun '12

18 Jun '12

Hi, I have a timeout problem only when I have heavy load in my system. I have two director servers directing to 4 backend servers. The problem is when my smtp relays tries to deliver mail to my users via lmtp (proxied with director). In the smtp logs I have: Jun 12 11:41:18 xenon13 postfix/lmtp[4248]: 4433E5D5A0: to=<myuser(a)um.es>, relay=pop.um.es[155.54.212.106]:24, delay=31, delays=0.41/0.06/0/30, dsn=4.4.0, status=deferred (host pop.um.es[155.54.212.106] said: 451 4.4.0 Remote server not answering (timeout while waiting for reply to DATA reply) (in reply to end of DATA command)) If I look for this connection in the director servers I have: Jun 12 11:40:39 myotis41 dovecot: lmtp(6595): Connect from 155.54.212.167 Jun 12 11:40:39 myotis41 dovecot: lmtp(6595): Debug: auth input: user=user1 proxy host=155.54.211.163 proxy_refresh=450 Jun 12 11:40:39 myotis41 dovecot: lmtp(6595): Debug: auth input: user=user2 proxy host=155.54.211.163 proxy_refresh=450 .... (more users, a total of 34 recipients) Jun 12 11:40:39 myotis41 dovecot: lmtp(6595): Debug: auth input: user=myuser proxy host=155.54.211.164 proxy_refresh=450 ... Jun 12 11:41:09 myotis41 dovecot: lmtp(6595): Disconnect from 155.54.212.167: Client quit (in reset) and in one of the final server (the one for the user in question): Jun 12 11:40:38 myotis34 dovecot: lmtp(16824): Connect from 155.54.211.186 Jun 12 11:40:38 myotis34 dovecot: lmtp(16824, <user1>): wJ9BD7YM10 +4QQAAG5O5Qg: sieve: msgid=<182283367.48.1339494011054.JavaMail.tomcat@sakai-prod4>: stored mail into mailbox 'INBOX' ... Jun 12 11:41:10 myotis34 dovecot: lmtp(16824, <myuser>): wJ9BD7YM10+4QQA AG5O5Qg: sieve: msgid=<182283367.48.1339494011054.JavaMail.tomcat@sakai-prod4>: stored mail into mailbox 'INBOX' ... Jun 12 11:41:11 myotis34 dovecot: lmtp(16824): Disconnect from 155.54.211.186: Connection closed (in reset) So the mail seems to be correctly delivered in about 30 seconds. All my postfix timeouts are bigger than this time: lmtp_connect_timeout = 0s lmtp_connection_cache_time_limit = 2s lmtp_connection_reuse_time_limit = 300s lmtp_data_done_timeout = 600s lmtp_data_init_timeout = 120s lmtp_data_xfer_timeout = 180s lmtp_lhlo_timeout = 300s lmtp_mail_timeout = 300s lmtp_pix_workaround_delay_time = 10s lmtp_pix_workaround_threshold_time = 500s lmtp_quit_timeout = 300s lmtp_rcpt_timeout = 300s lmtp_rset_timeout = 20s lmtp_sasl_auth_cache_time = 90d lmtp_starttls_timeout = 300s lmtp_tls_session_cache_timeout = 3600s lmtp_xforward_timeout = 300s So... why do I have this error? As a side effect this mail was delivered twice in the user's mailbox, this is one and the other when postfix retries again. Any help? Thank you -- Angel L. Mateo Martínez Sección de Telemática Área de Tecnologías de la Información _o) y las Comunicaciones Aplicadas (ATICA) / \\ http://www.um.es/atica _(___V Tfo: 868887590 Fax: 868888337

3 11

[Dovecot] Maildir + quota + listescape = wrong dir location
by Mariusz Kruk 18 Jun '12

18 Jun '12

I've just stumbled across a strange thing which seems to be a bug. It happens in 2.0.9 as well as 2.0.11 in which I tested it. dovecot -n output: # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-220.17.1.el6.x86_64 x86_64 CentOS release 6.2 (Final) listen = * mail_location = maildir:~/mail mail_plugins = " quota listescape" mbox_write_locks = fcntl namespace { inbox = yes location = prefix = separator = / type = private } passdb { driver = pam } plugin { quota = maildir:User quota quota_rule = *:storage=1G } protocols = imap ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { driver = passwd } protocol imap { mail_plugins = " quota listescape imap_quota autocreate" } The problem with this setup is that with listescape loaded doveadm (as well as dovecot running by itself) can't properly get quotas for nested subfolders. Listescape causes dovecot to use namespace separator for fetching directory names corresponding to folders instead of interpreting them according to layout rules. When I tried stracing, i got this: # strace -e trace=stat doveadm quota recalc -u testimap 2>&1 | grep testimap stat("/home/testimap/mail", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 stat("/home/testimap/mail/new", 0x7fff220ca290) = -1 ENOENT (No such file or directory) stat("/home/testimap/mail/cur", 0x7fff220ca290) = -1 ENOENT (No such file or directory) stat("/home/testimap/mail/.INBOX/test/new", 0x7fff220ca290) = -1 ENOENT (No such file or directory) stat("/home/testimap/mail/.INBOX/test/cur", 0x7fff220ca290) = -1 ENOENT (No such file or directory) stat("/home/testimap/mail/.test/new", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 stat("/home/testimap/mail/.test/cur", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 stat("/home/testimap/mail/new", 0x7fff220ca290) = -1 ENOENT (No such file or directory) stat("/home/testimap/mail/cur", 0x7fff220ca290) = -1 ENOENT (No such file or directory) stat("/home/testimap/mail/.INBOX/test/new", 0x7fff220ca290) = -1 ENOENT (No such file or directory) stat("/home/testimap/mail/.INBOX/test/cur", 0x7fff220ca290) = -1 ENOENT (No such file or directory) stat("/home/testimap/mail/.test/new", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 stat("/home/testimap/mail/.test/cur", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 stat("/home/testimap/mail", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 If I either disable listescape or change namespace separator to dot, the path gets resolved correctly (although it's still wrong behaviour with '.' as separator, just happens to give right result in this case). # strace -e trace=stat doveadm quota recalc -u testimap 2>&1 | grep testimap stat("/home/testimap/mail", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 stat("/home/testimap/mail/new", 0x7fffac6b0cb0) = -1 ENOENT (No such file or directory) stat("/home/testimap/mail/cur", 0x7fffac6b0cb0) = -1 ENOENT (No such file or directory) stat("/home/testimap/mail/.INBOX.test/new", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 stat("/home/testimap/mail/.INBOX.test/cur", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 stat("/home/testimap/mail/.test/new", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 stat("/home/testimap/mail/.test/cur", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 stat("/home/testimap/mail/new", 0x7fffac6b0cb0) = -1 ENOENT (No such file or directory) stat("/home/testimap/mail/cur", 0x7fffac6b0cb0) = -1 ENOENT (No such file or directory) stat("/home/testimap/mail/.INBOX.test/new", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 stat("/home/testimap/mail/.INBOX.test/cur", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 stat("/home/testimap/mail/.test/new", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 stat("/home/testimap/mail/.test/cur", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 stat("/home/testimap/mail", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 And in this case quota info gets updated correctly. I believe this is a bug but maybe I'm missing something about listescape configuration. Regards Mariusz Kruk

2 1

[Dovecot] Dovecot Maildir - How to Seperate mail folders
by Guido Weiler 18 Jun '12

18 Jun '12

Hi Timo, thank you very much for your quick reply. I tried that but it is not possible to SELECT such a mailbox. I have in dovecot.conf: --- mail_location=maildir:/data/messages%h namespace private { separator = / prefix = location = maildir:/data/messages%h inbox = yes list = yes } namespace public { separator = / prefix = greetings/ location = maildir:/data/greetings%h inbox = no list = yes hidden = yes } --- Messages are coming in from EXIM separated by a special HEADER into this two folders. For INBOX this works fine but not for greetings, although the maildir files are being created upon delivery. Sample IMAP Session AFTER delivering a greeting-type message: --- 01 OK Logged in. >> 02 list "" "*" * LIST (\HasNoChildren) "/" "INBOX" * LIST (\Noselect \HasChildren) "/" "greetings" * LIST (\HasNoChildren) "/" "greetings/INBOX" 02 OK List completed. >> 03 select "greetings/INBOX" 03 NO Mailbox doesn't exist: INBOX >> 04 select greetings 04 NO Mailbox doesn't exist: greetings --- What is this "\Noselect" mailbox showing up and why is it saying "greetings/INBOX" in the third row when in fact there isn't a mailbox with this name? I am very sorry for having to bother you again, but I don't know what we are doing wrong here. (Dovecot version is 1.1.16) Guido Weiler -----Ursprüngliche Nachricht----- Von: Timo Sirainen [mailto:tss@iki.fi] Gesendet: Montag, 11. Juni 2012 22:48 An: Guido Weiler Betreff: Re: Dovecot Maildir - How to Seperate mail folders You should be able to do this with namespaces. namespace { prefix = INBOX/VeryImportantMessages/ location = maildir:/very/important/messages hidden = yes } On 8.6.2012, at 18.09, Guido Weiler wrote: > Hello Timo, > > for one of our latest dovecot/IMAP-projects, we need to separate physical locations of some special IMAP folders. > So to make, for example the "INBOX/VeryImportantMessages"-Folder is on a completely different volume or mount point than the mails in INBOX or other user generated imap subfolders. > > Can you tell me if there is any possible way to implement this / change it in dovecots maildir implementation, or maybe it is already planned to do so in further versions of dovecot? > > We have to treat all messages in that one special folder with an extended backup scenario, and I think it would be the best if we can implement to have an additional mail_location parameter in dovecot.conf (e.g. important_mail_location). > > We are somewhat familiar with the dovecot source code since we already implemented plugins and other modifications to dovecot 1.1.16 but any advise or information is very appreciated. > > Kind regards, > > > Guido Weiler

2 1

[Dovecot] Sieve and fileinto encoding change?
by Angel L. Mateo 18 Jun '12

18 Jun '12

Hello, I have changed from debian servers (debian lenny 5) running dovecot 1.1.16 to new ones with ubuntu 12.04 and dovecot 2.1.5 and now I'm having problems with sieve filters storing mails in folders with spanish characters (accents). Myh problem is the one described at http://www.dovecot.org/list/dovecot/2009-October/044061.html and http://dovecot.org/list/dovecot/2009-July/041690.html, that is, in my sieve scripts (generated with horde ingo) folder's names are in utf-7 instead of utf-8. Although I'm planning to patch ingo, my question is why those same scripts, with utf-7 folder's names, are working with dovecot 1.1.16 but not with 2.1.5? Because in my old servers those scripts worked without any problem...

2 1

[Dovecot] Error: doveadm client attempted non-PLAIN authentication
by Daniel Parthey 17 Jun '12

17 Jun '12

Hi doveadm search -u user(a)example.org -S localhost:19000 all produces the following error in the logs: dovecot: doveadm: Error: doveadm client attempted non-PLAIN authentication What am I missing? * tcpdump of tcp communication on port 19000 is attached * dovecot.conf is attached Regards Daniel

2 5

[Dovecot] doveadm backup panic
by Gedalya 16 Jun '12

16 Jun '12

using latest auto build didn't help. this happens only with a specific account. # doveadm -o imapc_user=-----(a)domain.com -o imapc_password=---- backup -u =-----(a)domain.com -R imapc: dsync(----(a)domain.com): Panic: pool_data_stack_realloc(): stack frame changed dsync(----(a)domain.com): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x4209a) [0xb762b09a] -> /usr/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x41) [0xb762b1a1] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0xb75fd99e] -> /usr/lib/dovecot/libdovecot.so.0(+0x547ce) [0xb763d7ce] -> /usr/lib/dovecot/libdovecot.so.0(+0x3ebf9) [0xb7627bf9] -> /usr/lib/dovecot/libdovecot.so.0(buffer_get_space_unsafe+0x78) [0xb7628658] -> /usr/lib/dovecot/libdovecot.so.0(buffer_append_space_unsafe+0x2a) [0xb762875a] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x60005) [0xb76dc005] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x62aa9) [0xb76deaa9] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x66e61) [0xb76e2e61] -> /usr/lib/dovecot/libdovecot-storage.so.0(imapc_connection_input_pending+0x14d) [0xb76e3a3d] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x67aac) [0xb76e3aac] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x44) [0xb763a034] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xce) [0xb763ae8e] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x40) [0xb76399d0] -> /usr/lib/dovecot/libdovecot-storage.so.0(imapc_client_run+0xa7) [0xb76e0297] -> /usr/lib/dovecot/libdovecot-storage.so.0(imapc_storage_run+0x26) [0xb76df1e6] -> /usr/lib/dovecot/libdovecot-storage.so.0(imapc_mailbox_sync_init+0x6de) [0xb76ddfde] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x3b) [0xb76f468b] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x3c) [0xb76f47cc] -> doveadm() [0x8072510] -> doveadm() [0x8072789] -> doveadm() [0x80729b2] -> doveadm(dsync_worker_msg_iter_next+0x29) [0x8070a69] -> doveadm() [0x806b6e1] -> doveadm() [0x806b736] -> doveadm(dsync_brain_msg_sync_more+0x4cb) [0x806bc7b] -> doveadm(dsync_brain_sync+0x3bb) [0x806a3ab] Aborted

2 3