June 2012 - dovecot - dovecot.org

[Dovecot] question about fts_squat
by Wojciech Puchar 18 Jun '12

18 Jun '12

just installed dovecot with fts_squat config attached after message. When i telnet to imap server and execute by hand 1 login user password select foldername search body "someword" it works fine, and at blazing speed except first run (indexing). i already indexed everything by doveadm index offline to prevent server overload if multiple users (after i tell them) will try fulltext search. All great BUT it doesn't work in thunderbird. Just gives zero results. i used tcpdump to check how thunderbird executes it and it uses search undeleted body "someword" tried manually and it DOES NOT WORK. always give empty results. even search all body "someword" doesn't work. while search body "someword" always work very well. what's wrong? # 2.1.7: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 8.3-STABLE amd64 disable_plaintext_auth = no listen = * mail_location = maildir:~/Maildir mail_plugins = fts fts_squat namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /usr/local/etc/dovecot/deny-users deny = yes driver = passwd-file } passdb { driver = pam } plugin { fts = squat fts_squat = partial=4 full=10 } protocols = imap ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { driver = passwd } protocol imap { mail_plugins = fts fts_squat }

2 5

[Dovecot] question about fts_squat
by Wojciech Puchar 18 Jun '12

18 Jun '12

i repost my question as it probably wasn't received properly - i did it just after subscribing possibly too early. thanks for answers ---------------------------------------------- just installed dovecot with fts_squat config attached after message. When i telnet to imap server and execute by hand 1 login user password select foldername search body "someword" it works fine, and at blazing speed except first run (indexing). i already indexed everything by doveadm index offline to prevent server overload if multiple users (after i tell them) will try fulltext search. All great BUT it doesn't work in thunderbird. Just gives zero results. i used tcpdump to check how thunderbird executes it and it uses search undeleted body "someword" tried manually and it DOES NOT WORK. always give empty results. even search all body "someword" doesn't work. while search body "someword" always work very well. what's wrong? # 2.1.7: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 8.3-STABLE amd64 disable_plaintext_auth = no listen = * mail_location = maildir:~/Maildir mail_plugins = fts fts_squat namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /usr/local/etc/dovecot/deny-users deny = yes driver = passwd-file } passdb { driver = pam } plugin { fts = squat fts_squat = partial=4 full=10 } protocols = imap ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { driver = passwd } protocol imap { mail_plugins = fts fts_squat }

1 0

[Dovecot] Problem with lmtp director proxy
by Angel L. Mateo 18 Jun '12

18 Jun '12

Hi, I have a timeout problem only when I have heavy load in my system. I have two director servers directing to 4 backend servers. The problem is when my smtp relays tries to deliver mail to my users via lmtp (proxied with director). In the smtp logs I have: Jun 12 11:41:18 xenon13 postfix/lmtp[4248]: 4433E5D5A0: to=<myuser(a)um.es>, relay=pop.um.es[155.54.212.106]:24, delay=31, delays=0.41/0.06/0/30, dsn=4.4.0, status=deferred (host pop.um.es[155.54.212.106] said: 451 4.4.0 Remote server not answering (timeout while waiting for reply to DATA reply) (in reply to end of DATA command)) If I look for this connection in the director servers I have: Jun 12 11:40:39 myotis41 dovecot: lmtp(6595): Connect from 155.54.212.167 Jun 12 11:40:39 myotis41 dovecot: lmtp(6595): Debug: auth input: user=user1 proxy host=155.54.211.163 proxy_refresh=450 Jun 12 11:40:39 myotis41 dovecot: lmtp(6595): Debug: auth input: user=user2 proxy host=155.54.211.163 proxy_refresh=450 .... (more users, a total of 34 recipients) Jun 12 11:40:39 myotis41 dovecot: lmtp(6595): Debug: auth input: user=myuser proxy host=155.54.211.164 proxy_refresh=450 ... Jun 12 11:41:09 myotis41 dovecot: lmtp(6595): Disconnect from 155.54.212.167: Client quit (in reset) and in one of the final server (the one for the user in question): Jun 12 11:40:38 myotis34 dovecot: lmtp(16824): Connect from 155.54.211.186 Jun 12 11:40:38 myotis34 dovecot: lmtp(16824, <user1>): wJ9BD7YM10 +4QQAAG5O5Qg: sieve: msgid=<182283367.48.1339494011054.JavaMail.tomcat@sakai-prod4>: stored mail into mailbox 'INBOX' ... Jun 12 11:41:10 myotis34 dovecot: lmtp(16824, <myuser>): wJ9BD7YM10+4QQA AG5O5Qg: sieve: msgid=<182283367.48.1339494011054.JavaMail.tomcat@sakai-prod4>: stored mail into mailbox 'INBOX' ... Jun 12 11:41:11 myotis34 dovecot: lmtp(16824): Disconnect from 155.54.211.186: Connection closed (in reset) So the mail seems to be correctly delivered in about 30 seconds. All my postfix timeouts are bigger than this time: lmtp_connect_timeout = 0s lmtp_connection_cache_time_limit = 2s lmtp_connection_reuse_time_limit = 300s lmtp_data_done_timeout = 600s lmtp_data_init_timeout = 120s lmtp_data_xfer_timeout = 180s lmtp_lhlo_timeout = 300s lmtp_mail_timeout = 300s lmtp_pix_workaround_delay_time = 10s lmtp_pix_workaround_threshold_time = 500s lmtp_quit_timeout = 300s lmtp_rcpt_timeout = 300s lmtp_rset_timeout = 20s lmtp_sasl_auth_cache_time = 90d lmtp_starttls_timeout = 300s lmtp_tls_session_cache_timeout = 3600s lmtp_xforward_timeout = 300s So... why do I have this error? As a side effect this mail was delivered twice in the user's mailbox, this is one and the other when postfix retries again. Any help? Thank you -- Angel L. Mateo Martínez Sección de Telemática Área de Tecnologías de la Información _o) y las Comunicaciones Aplicadas (ATICA) / \\ http://www.um.es/atica _(___V Tfo: 868887590 Fax: 868888337

3 11

[Dovecot] Maildir + quota + listescape = wrong dir location
by Mariusz Kruk 18 Jun '12

18 Jun '12

I've just stumbled across a strange thing which seems to be a bug. It happens in 2.0.9 as well as 2.0.11 in which I tested it. dovecot -n output: # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-220.17.1.el6.x86_64 x86_64 CentOS release 6.2 (Final) listen = * mail_location = maildir:~/mail mail_plugins = " quota listescape" mbox_write_locks = fcntl namespace { inbox = yes location = prefix = separator = / type = private } passdb { driver = pam } plugin { quota = maildir:User quota quota_rule = *:storage=1G } protocols = imap ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { driver = passwd } protocol imap { mail_plugins = " quota listescape imap_quota autocreate" } The problem with this setup is that with listescape loaded doveadm (as well as dovecot running by itself) can't properly get quotas for nested subfolders. Listescape causes dovecot to use namespace separator for fetching directory names corresponding to folders instead of interpreting them according to layout rules. When I tried stracing, i got this: # strace -e trace=stat doveadm quota recalc -u testimap 2>&1 | grep testimap stat("/home/testimap/mail", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 stat("/home/testimap/mail/new", 0x7fff220ca290) = -1 ENOENT (No such file or directory) stat("/home/testimap/mail/cur", 0x7fff220ca290) = -1 ENOENT (No such file or directory) stat("/home/testimap/mail/.INBOX/test/new", 0x7fff220ca290) = -1 ENOENT (No such file or directory) stat("/home/testimap/mail/.INBOX/test/cur", 0x7fff220ca290) = -1 ENOENT (No such file or directory) stat("/home/testimap/mail/.test/new", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 stat("/home/testimap/mail/.test/cur", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 stat("/home/testimap/mail/new", 0x7fff220ca290) = -1 ENOENT (No such file or directory) stat("/home/testimap/mail/cur", 0x7fff220ca290) = -1 ENOENT (No such file or directory) stat("/home/testimap/mail/.INBOX/test/new", 0x7fff220ca290) = -1 ENOENT (No such file or directory) stat("/home/testimap/mail/.INBOX/test/cur", 0x7fff220ca290) = -1 ENOENT (No such file or directory) stat("/home/testimap/mail/.test/new", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 stat("/home/testimap/mail/.test/cur", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 stat("/home/testimap/mail", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 If I either disable listescape or change namespace separator to dot, the path gets resolved correctly (although it's still wrong behaviour with '.' as separator, just happens to give right result in this case). # strace -e trace=stat doveadm quota recalc -u testimap 2>&1 | grep testimap stat("/home/testimap/mail", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 stat("/home/testimap/mail/new", 0x7fffac6b0cb0) = -1 ENOENT (No such file or directory) stat("/home/testimap/mail/cur", 0x7fffac6b0cb0) = -1 ENOENT (No such file or directory) stat("/home/testimap/mail/.INBOX.test/new", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 stat("/home/testimap/mail/.INBOX.test/cur", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 stat("/home/testimap/mail/.test/new", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 stat("/home/testimap/mail/.test/cur", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 stat("/home/testimap/mail/new", 0x7fffac6b0cb0) = -1 ENOENT (No such file or directory) stat("/home/testimap/mail/cur", 0x7fffac6b0cb0) = -1 ENOENT (No such file or directory) stat("/home/testimap/mail/.INBOX.test/new", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 stat("/home/testimap/mail/.INBOX.test/cur", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 stat("/home/testimap/mail/.test/new", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 stat("/home/testimap/mail/.test/cur", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 stat("/home/testimap/mail", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 And in this case quota info gets updated correctly. I believe this is a bug but maybe I'm missing something about listescape configuration. Regards Mariusz Kruk

2 1

[Dovecot] Dovecot Maildir - How to Seperate mail folders
by Guido Weiler 18 Jun '12

18 Jun '12

Hi Timo, thank you very much for your quick reply. I tried that but it is not possible to SELECT such a mailbox. I have in dovecot.conf: --- mail_location=maildir:/data/messages%h namespace private { separator = / prefix = location = maildir:/data/messages%h inbox = yes list = yes } namespace public { separator = / prefix = greetings/ location = maildir:/data/greetings%h inbox = no list = yes hidden = yes } --- Messages are coming in from EXIM separated by a special HEADER into this two folders. For INBOX this works fine but not for greetings, although the maildir files are being created upon delivery. Sample IMAP Session AFTER delivering a greeting-type message: --- 01 OK Logged in. >> 02 list "" "*" * LIST (\HasNoChildren) "/" "INBOX" * LIST (\Noselect \HasChildren) "/" "greetings" * LIST (\HasNoChildren) "/" "greetings/INBOX" 02 OK List completed. >> 03 select "greetings/INBOX" 03 NO Mailbox doesn't exist: INBOX >> 04 select greetings 04 NO Mailbox doesn't exist: greetings --- What is this "\Noselect" mailbox showing up and why is it saying "greetings/INBOX" in the third row when in fact there isn't a mailbox with this name? I am very sorry for having to bother you again, but I don't know what we are doing wrong here. (Dovecot version is 1.1.16) Guido Weiler -----Ursprüngliche Nachricht----- Von: Timo Sirainen [mailto:tss@iki.fi] Gesendet: Montag, 11. Juni 2012 22:48 An: Guido Weiler Betreff: Re: Dovecot Maildir - How to Seperate mail folders You should be able to do this with namespaces. namespace { prefix = INBOX/VeryImportantMessages/ location = maildir:/very/important/messages hidden = yes } On 8.6.2012, at 18.09, Guido Weiler wrote: > Hello Timo, > > for one of our latest dovecot/IMAP-projects, we need to separate physical locations of some special IMAP folders. > So to make, for example the "INBOX/VeryImportantMessages"-Folder is on a completely different volume or mount point than the mails in INBOX or other user generated imap subfolders. > > Can you tell me if there is any possible way to implement this / change it in dovecots maildir implementation, or maybe it is already planned to do so in further versions of dovecot? > > We have to treat all messages in that one special folder with an extended backup scenario, and I think it would be the best if we can implement to have an additional mail_location parameter in dovecot.conf (e.g. important_mail_location). > > We are somewhat familiar with the dovecot source code since we already implemented plugins and other modifications to dovecot 1.1.16 but any advise or information is very appreciated. > > Kind regards, > > > Guido Weiler

2 1

[Dovecot] Sieve and fileinto encoding change?
by Angel L. Mateo 18 Jun '12

18 Jun '12

Hello, I have changed from debian servers (debian lenny 5) running dovecot 1.1.16 to new ones with ubuntu 12.04 and dovecot 2.1.5 and now I'm having problems with sieve filters storing mails in folders with spanish characters (accents). Myh problem is the one described at http://www.dovecot.org/list/dovecot/2009-October/044061.html and http://dovecot.org/list/dovecot/2009-July/041690.html, that is, in my sieve scripts (generated with horde ingo) folder's names are in utf-7 instead of utf-8. Although I'm planning to patch ingo, my question is why those same scripts, with utf-7 folder's names, are working with dovecot 1.1.16 but not with 2.1.5? Because in my old servers those scripts worked without any problem...

2 1

[Dovecot] Error: doveadm client attempted non-PLAIN authentication
by Daniel Parthey 17 Jun '12

17 Jun '12

Hi doveadm search -u user(a)example.org -S localhost:19000 all produces the following error in the logs: dovecot: doveadm: Error: doveadm client attempted non-PLAIN authentication What am I missing? * tcpdump of tcp communication on port 19000 is attached * dovecot.conf is attached Regards Daniel

2 5

[Dovecot] doveadm backup panic
by Gedalya 16 Jun '12

16 Jun '12

using latest auto build didn't help. this happens only with a specific account. # doveadm -o imapc_user=-----(a)domain.com -o imapc_password=---- backup -u =-----(a)domain.com -R imapc: dsync(----(a)domain.com): Panic: pool_data_stack_realloc(): stack frame changed dsync(----(a)domain.com): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x4209a) [0xb762b09a] -> /usr/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x41) [0xb762b1a1] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0xb75fd99e] -> /usr/lib/dovecot/libdovecot.so.0(+0x547ce) [0xb763d7ce] -> /usr/lib/dovecot/libdovecot.so.0(+0x3ebf9) [0xb7627bf9] -> /usr/lib/dovecot/libdovecot.so.0(buffer_get_space_unsafe+0x78) [0xb7628658] -> /usr/lib/dovecot/libdovecot.so.0(buffer_append_space_unsafe+0x2a) [0xb762875a] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x60005) [0xb76dc005] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x62aa9) [0xb76deaa9] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x66e61) [0xb76e2e61] -> /usr/lib/dovecot/libdovecot-storage.so.0(imapc_connection_input_pending+0x14d) [0xb76e3a3d] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x67aac) [0xb76e3aac] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x44) [0xb763a034] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xce) [0xb763ae8e] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x40) [0xb76399d0] -> /usr/lib/dovecot/libdovecot-storage.so.0(imapc_client_run+0xa7) [0xb76e0297] -> /usr/lib/dovecot/libdovecot-storage.so.0(imapc_storage_run+0x26) [0xb76df1e6] -> /usr/lib/dovecot/libdovecot-storage.so.0(imapc_mailbox_sync_init+0x6de) [0xb76ddfde] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x3b) [0xb76f468b] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x3c) [0xb76f47cc] -> doveadm() [0x8072510] -> doveadm() [0x8072789] -> doveadm() [0x80729b2] -> doveadm(dsync_worker_msg_iter_next+0x29) [0x8070a69] -> doveadm() [0x806b6e1] -> doveadm() [0x806b736] -> doveadm(dsync_brain_msg_sync_more+0x4cb) [0x806bc7b] -> doveadm(dsync_brain_sync+0x3bb) [0x806a3ab] Aborted

2 3

[Dovecot] migrating v.1 to v.2
by Voytek Eymont 15 Jun '12

15 Jun '12

I have a working Dovecot/MySQL with version 1.x I'm looking at setting a new server using ver. 2 I'm currently pre-planning: can I use config files from ver 1 installation on version 2 setup 'as is'; or what's a proper way to do such migration/upgrade ? -- V

2 3

[Dovecot] Sieve stopped working
by Ben Versang 15 Jun '12

15 Jun '12

Hi, I have installed RoundCube a couple of years ago on a Snow Leopard server. All nice and dandy up to today. Sieve has stopped working and I have spent hours and been unable so far to get it up and running again. When I run ps aux |grep sieve it is not returning anything to me suggesting that the problem is not with sieve it-self but rather with Dovecot not starting the sieve. If anyone could give me some leads I can't think of anyting else. netstat -a |grep 2000 returns returns nothing telnet localhost 2000 Trying ::1... telnet: connect to address ::1: Connection refused Trying fe80::1... telnet: connect to address fe80::1: Connection refused Trying 127.0.0.1... telnet: connect to address 127.0.0.1: Connection refused telnet: Unable to connect to remote host The rest of mail functions are working fine (IMAP, SMTP...). Thanks in advance Ben

2 1