November 2012 - dovecot

[Dovecot] acl and subfolder
by Laurent Foucher 07 Nov '12

07 Nov '12

hello, I'm using dovecot 2.0.16 and i would like to use acl for subfolder. The file dovecot-acl is well written in both folder test and the subfolder test/Test : cat /home/user2/Maildir/.test.Test/dovecot-acl user=user1 ilrws cat /home/user2/Maildir/.test/dovecot-acl user=user1 ilprws When user1 want to list, the folder test is well shown, but not the subfolder test/Test. This is the logs : Debug: acl: acl username = user1 imap(laurent.foucher): Debug: acl: owner = 0 Shuka-a dovecot: imap(user1): Debug: acl vfile: Global ACL directory: (none) Shuka-a dovecot: imap(user1): Debug: acl vfile: reading file /home/user2/Maildir/.test/dovecot-acl [....] imap(user1): Debug: acl: Mailbox not in dovecot-acl-list: Partages/user2/test/Test I don't userstand why the file dovecot-acl is not read from the subfolder, while user1 and user2 have the same gid and write access to the directories. Thanks for your answers. dovecot -n auth_cache_size = 512 M default_client_limit = 8400 disable_plaintext_auth = no mail_access_groups = dovecot mail_debug = yes mail_location = maildir:~/Maildir mail_plugins = acl mail_privileged_group = dovecot managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave imapflags notify namespace { inbox = yes location = prefix = separator = / type = private } namespace { list = children location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u prefix = Partages/%%u/ separator = / subscriptions = no type = shared } passdb { args = cache_key=%u%s * driver = pam } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile acl_shared_dict = file:/var/lib/dovecot/shared-mailboxes.db mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +notify +imapflags } postmaster_address = postmaster(a)iut-tlse3.fr protocols = " imap sieve" service auth { client_limit = 8500 unix_listener auth-userdb { group = Personnel_IUT mode = 0666 } } service imap-login { process_limit = 4096 process_min_avail = 16 service_count = 0 vsz_limit = 256 M } service imap { process_limit = 4096 vsz_limit = 3036 M } ssl_cert = </etc/ssl/certs/cert-5383-imaps.iut-tlse3.fr.pem ssl_key = </etc/ssl/private/imaps.iut-tlse3.fr.key userdb { driver = passwd } userdb { driver = prefetch } protocol lda { info_log_path = /var/log/dovecot/dovecot-lda.log log_path = /var/log/dovecot/dovecot-lda-errors.log mail_plugins = acl sieve } protocol imap { imap_id_log = * mail_plugins = acl imap_acl listescape } -- - Laurent Foucher < I U T 'A' Paul Sabatier > laurent.foucher(a)iut-tlse3.fr Enseignant/Chargé de mission Systèmes & Réseau

2 2

[Dovecot] Auth USER lookup failed
by Angel L. Mateo 07 Nov '12

07 Nov '12

Hello, I'm running dovecot 2.1.9 and I'm trying to configure shared folders. So, as described at http://wiki2.dovecot.org/SharedMailboxes/Shared I have configured a namespace like this: namespace { type = shared separator = / prefix = shared/%%u/ location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u subscriptions = no list = yes } In one user (user1) I have configured ACLs so another one (user2) has access to a folder. Now, I want to susbscribe user2 to this folder. The problem I have is that whenever I try to list folders for this user (running thunderbird client) I get a panic and an error in the dovecot server (I have attached the complete log). The error says: Nov 6 11:58:56 myotis30 dovecot: auth: Error: userdb(user1): client doesn't have lookup permissions for this user: userdb uid (113246) doesn't match peer uid (14585) (change userdb socket permissions) Nov 6 11:58:56 myotis30 dovecot: auth: Debug: master out: FAIL#0112 Nov 6 11:58:56 myotis30 dovecot: imap(user2): Error: user user1: Auth USER lookup failed Nov 6 11:58:56 myotis30 dovecot: imap(user2): Debug: auth input: Nov 6 11:58:56 myotis30 dovecot: imap(user2): Error: Couldn't create namespace 'shared/' for user user1: userdb didn't return a home directory, but plugin setting quota used it (%h): dict:User quota::file:%h/Maildir/dovecot.quota It seems that imap process running for user2 is trying to a user lookup that fails. So I have manually tried it root@myotis30:/etc/dovecot/conf.d# sudo -u user2 doveadm user user2 userdb: user2 home : <homeDirectory> uid : 14585 gid : 404 root@myotis30:/etc/dovecot/conf.d# sudo -u user2 doveadm user user1 doveadm(user2): Error: user user1: Auth USER lookup failed doveadm(user2): Error: userdb lookup failed for user1 I have checked the socket permissions, but they are 0666 (if I'm looking the right socket): root@myotis30:/etc/dovecot/conf.d# ls -l /var/run/dovecot/auth-userdb srwxrwxrwx 1 dovecot root 0 nov 6 11:43 /var/run/dovecot/auth-userdb In fact, I have tried to put all sockets with permissions 0666 and 0777, but the error persists. Any idea? -- Angel L. Mateo Martínez Sección de Telemática Área de Tecnologías de la Información y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868889150 Fax: 868888337

2 1

[Dovecot] LDAP congestion
by Bernhard Schmidt 07 Nov '12

07 Nov '12

Hello, I've been asked to have a look at a misbehaving mail server of some colleagues today where almost all logins where failing or excessively delayed, while the LDAP database itself was pretty fast. They run Dovecot 1.2.11 (yes, I know, stoneage) against an LDAP server run by a 3rd party, auth_bind=yes (required). The problem is that this third party LDAP server delays bindResponse 3 seconds when the password is wrong. A user wanted to login every 2-3 seconds this morning with the wrong password, which effectively killed the system because the LDAP connection was mostly stalled waiting for the auth timeout. >From a previous discussion with Timo I know that bindRequests cannot be parallelized in LDAP, so the problem does not come completely unexpected. Other than removing the failure delay in the LDAP server, is there anything one can do? If there is any change in newer Dovecot versions about that please tell me so I can encourage them to upgrade, but I haven't seen anything in the changelog. Any way to get several LDAP workers/connections for passdb in parallel? Thanks, Bernhard

2 1

[Dovecot] "starting" dovecot
by Dave Abrahams 07 Nov '12

07 Nov '12

My system never issues the "dovecot start" command. I do, however, run /usr/local/libexec/dovecot/imap on port 9xxx. I talk to the server through port 9xxx and through the preauth tunnel. Is this arrangement OK? Are there some things that will only work if "dovecot" is invoked? Thanks, -- Dave Abrahams BoostPro Computing Software Development Training http://www.boostpro.com Clang/LLVM/EDG Compilers C++ Boost

3 5

[Dovecot] Indexing problems
by Dave Abrahams 07 Nov '12

07 Nov '12

It looks like something is going very wrong here. Any advice? --8<---------------cut here---------------start------------->8--- $ doveadm -vvvD index '*' doveadm(dave): Debug: Loading modules from directory: /usr/local/lib/dovecot doveadm(dave): Debug: Module loaded: /usr/local/lib/dovecot/lib20_fts_plugin.so doveadm(dave): Debug: Module loaded: /usr/local/lib/dovecot/lib20_zlib_plugin.so doveadm(dave): Debug: Module loaded: /usr/local/lib/dovecot/lib21_fts_lucene_plugin.so doveadm(dave): Debug: Loading modules from directory: /usr/local/Cellar/dovecot/2.1.9/lib/dovecot/doveadm doveadm(dave): Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: dlopen(/usr/local/Cellar/dovecot/2.1.9/lib/dovecot/doveadm/lib10_doveadm_acl_plugin.so, 10): Symbol not found: _acl_user_module Referenced from: /usr/local/Cellar/dovecot/2.1.9/lib/dovecot/doveadm/lib10_doveadm_acl_plugin.so Expected in: flat namespace in /usr/local/Cellar/dovecot/2.1.9/lib/dovecot/doveadm/lib10_doveadm_acl_plugin.so (this is usually intentional, so just ignore this message) doveadm(dave): Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: dlopen(/usr/local/Cellar/dovecot/2.1.9/lib/dovecot/doveadm/lib10_doveadm_expire_plugin.so, 10): Symbol not found: _expire_set_deinit Referenced from: /usr/local/Cellar/dovecot/2.1.9/lib/dovecot/doveadm/lib10_doveadm_expire_plugin.so Expected in: flat namespace in /usr/local/Cellar/dovecot/2.1.9/lib/dovecot/doveadm/lib10_doveadm_expire_plugin.so (this is usually intentional, so just ignore this message) doveadm(dave): Debug: Skipping module doveadm_quota_plugin, because dlopen() failed: dlopen(/usr/local/Cellar/dovecot/2.1.9/lib/dovecot/doveadm/lib10_doveadm_quota_plugin.so, 10): Symbol not found: _quota_user_module Referenced from: /usr/local/Cellar/dovecot/2.1.9/lib/dovecot/doveadm/lib10_doveadm_quota_plugin.so Expected in: flat namespace in /usr/local/Cellar/dovecot/2.1.9/lib/dovecot/doveadm/lib10_doveadm_quota_plugin.so (this is usually intentional, so just ignore this message) doveadm(dave): Debug: Module loaded: /usr/local/Cellar/dovecot/2.1.9/lib/dovecot/doveadm/lib10_doveadm_zlib_plugin.so doveadm(dave): Debug: Module loaded: /usr/local/Cellar/dovecot/2.1.9/lib/dovecot/doveadm/lib20_doveadm_fts_lucene_plugin.so doveadm(dave): Debug: Module loaded: /usr/local/Cellar/dovecot/2.1.9/lib/dovecot/doveadm/lib20_doveadm_fts_plugin.so doveadm(dave): Debug: Effective uid=501, gid=20, home=/Users/dave doveadm(dave): Debug: Namespace inbox: type=private, prefix=, sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=mdbox:/Users/dave/Library/Data/LocalIMAP/mdbox doveadm(dave): Debug: fs: root=/Users/dave/Library/Data/LocalIMAP/mdbox, index=, control=, inbox=, alt= doveadm(dave): Debug: Namespace : Using permissions from /Users/dave/Library/Data/LocalIMAP/mdbox: mode=0700 gid=-1 doveadm(dave): Info: [Gmail].All: Cache is already up to date doveadm(dave): Info: [Gmail].All Mail: Caching mails seq=2..231746 8000/231745Assertion failed: (numDocsInStore*8 == directory->fileLength( (docStoreSegment + "." + IndexFileNames::FIELDS_INDEX_EXTENSION).c_str() )), function closeDocStore, file /tmp/clucene-gmYE/src/core/CLucene/index/DocumentsWriter.cpp, line 210. Abort trap: 6 cone:local dave$ --8<---------------cut here---------------end--------------->8--- -- Dave Abrahams BoostPro Computing Software Development Training http://www.boostpro.com Clang/LLVM/EDG Compilers C++ Boost

2 1

[Dovecot] Modifying mailbox GUIDs?
by Faheem Patel 07 Nov '12

07 Nov '12

Greetings all, I can view a mailbox's GUID like so: doveadm mailbox status -u guid However, how may I *modify* a mailbox GUID? Can this be done using doveadm or some other tool? If not, how may I go about modifying the dovecot.mailbox.log (where I assume GUID data is stored)? My specific use case has to do with me wanting to modify an existing mailbox's GUID so that its messages are mirrored into a folder of the same name using "dsync mirror". (As we know, dsync utilizes GUIDs to determine mailbox uniqueness) Thanks! -- - Faheem

2 2

[Dovecot] Error: Internal quota calculation error
by Micah Anderson 07 Nov '12

07 Nov '12

Hello, I'm using 2.1.7 with seive and mysql quotas. We had an outage the other day where the database server where quotas are stored was not available for a short period of time. In dovecot land, the following types of errors occured in that scenario: Oct 26 22:19:01 grosbeak dovecot: lda(example(a)riseup.net): Error: Internal quota calculation error Oct 26 22:19:01 grosbeak dovecot: lda(example(a)riseup.net): Error: sieve: msgid=<20122132765181x.ABCCE457(a)example.com>: failed to store into mailbox 'Trash': Internal error occurred. Refer to server log for more information. [2012-10-26 22:19:01] Oct 26 22:19:01 grosbeak dovecot: lda(example(a)riseup.net): Error: sieve: script /maildir/e/example/.dovecot.sieve failed with unsuccessful implicit keep (user logfile /maildir/e/example/.dovecot.sieve.log may reveal additional details) I expect that there would be quota calculation errors as dovecot could not reach the database server, but what worried me was the 'failed to store into mailbox' message from sieve. The 'Trash' mailbox in this particular seive script is the correct location for the message to be filed into, but the worrisome message is the 'failed with unsuccessful implicit keep'. I looked through all the message-ids that reported this error and I found that the messages were properly delivered in the end, so this might be some issue interacting between sieve, dovecot and quota and just causing a scary message that can be ignored? thanks for any information you can provide, dovecot is great! micah --

2 1

[Dovecot] backtrace for non-existant %{ldap:attr} on login
by Steffen Kaiser 07 Nov '12

07 Nov '12

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hello, I'm fetching the user and auth data from LDAP, this is the string: pass_attrs = uid=user,userPassword=password,homeDirectory=userdb_home,mailUidNumber=userdb_uid,mailGidNumber=userdb_gid,mailLocationDovecot=userdb_mail,uid=userdb_user,=userdb_quota_rule=*:bytes=%{ldap:mailQuotaBytes}, =userdb_quota_rule2=Trash:bytes=+%{ldap:mailQuotaBytesTrash} If mailQuotaBytesTrash or mailQuotaBytes is not present, the LOGIN process does not work: 1 login user pwd 1 NO [UNAVAILABLE] Temporary authentication failure. [mailsrv2:2012-10-31 08:56:51] * OK Waiting for authentication process to respond.. If I add those two attributes, the user can login successfully. dovecot-2.1.10/sbin/dovecot --version 2.1.10 (9cdeab12f3e1) The log entries: 2012-10-31 09:56:51 auth: Panic: pool_data_stack_realloc(): stack frame changed 2012-10-31 09:56:51 auth: Error: Raw backtrace: /usr/local/dovecot-2.1.10/lib/dovecot/libdovecot.so.0(+0x4857a) [0x7f2c0528c57a] -> /usr/local/dovecot-2.1.10/lib/dovecot/libdovecot.so.0(+0x485c6) [0x7f2c0528c5c6] -> /usr/local/dovecot-2.1.10/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f2c0525feaf] -> /usr/local/dovecot-2.1.10/lib/dovecot/libdovecot.so.0(+0x58f2e) [0x7f2c0529cf2e] -> /usr/local/dovecot-2.1.10/lib/dovecot/libdovecot.so.0(+0x442f5) [0x7f2c052882f5] -> /usr/local/dovecot-2.1.10/lib/dovecot/libdovecot.so.0(buffer_get_space_unsafe+0x68) [0x7f2c05288728] -> /usr/local/dovecot-2.1.10/lib/dovecot/libdovecot.so.0(str_vprintfa+0x6d) [0x7f2c052a796d] -> /usr/local/dovecot-2.1.10/lib/dovecot/libdovecot.so.0(str_printfa+0x88) [0x7f2c052a7ac8] -> dovecot2.1/auth [0 wait, 1 passdb, 0 userdb]() [0x42682e] -> /usr/local/dovecot-2.1.10/lib/dovecot/libdovecot.so.0(var_expand_with_funcs+0x6fb) [0x7f2c052ac48b] -> dovecot2.1/auth [0 wait, 1 passdb, 0 userdb](db_ldap_result_iterate_next+0x12f) [0x42734f] -> dovecot2.1/auth [0 wait, 1 passdb, 0 userdb]() [0x428974] -> dovecot2.1/auth [0 wait, 1 passdb, 0 userdb]() [0x428f5f] -> dovecot2.1/auth [0 wait, 1 passdb, 0 userdb]() [0x4282a1] -> /usr/local/dovecot-2.1.10/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7f2c05298756] -> /usr/local/dovecot-2.1.10/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x9f) [0x7f2c0529978f] -> /usr/local/dovecot-2.1.10/lib/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7f2c052986f8] -> /usr/local/dovecot-2.1.10/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f2c052840d3] -> dovecot2.1/auth [0 wait, 1 passdb, 0 userdb](main+0x376) [0x41bba6] -> /lib/libc.so.6(__libc_start_main+0xfd) [0x7f2c04449c8d] -> dovecot2.1/auth [0 wait, 1 passdb, 0 userdb]() [0x40cf89] 2012-10-31 09:56:51 auth: Fatal: master: service(auth): child 15865 killed with signal 6 (core dumps disabled) 2012-10-31 09:56:51 imap-login: Warning: Auth connection closed with 1 pending requests (max 0 secs, pid=15869, EOF) - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUJDqe2oxLS8a3A9mAQI+YQf/Qd4IIeM35Hmmpl1IMcQwJFK4854G5Dku yK+GsWhE2gxI6KaLO6DSI/kpN79qhQRkHsUAHzoPiZ7kQpZprNaEP/CIPkTzw//i HyC2Odpfa8fWUOqtH5Cp6X5spF6hQa4mmQyzgXguF9bdjZkNu4vQ78wRuQGG4eHi BOkNL0b93DsN3NSIoXDpiAiJn1aleTLe7mYkfsGewjb+AN+FpR4hLbf32yRRn8J0 Fkn8agEijixGMXEBD4ZprTbX9NbUr92YPfRycMnA2A00MUUlv/iKlqXRpMLafRjL bnHL/QE80xHoKKJUR96/RjruciIolAtlyYvhTU9ibRpLYm5Hcd9bZg== =iPvg -----END PGP SIGNATURE-----

2 1

[Dovecot] copymail deleted
by Christian Rößner 07 Nov '12

07 Nov '12

Hi, I had enabled an option in dovecot. mail_attachment_dir = /var/mail/virtual/copymail/attachments After a while I checked /var/mail/virtual and did some cleanup. I did not remember that copymail was specified in dovecot and erased it. Oct 30 10:56:05 mx0 dovecot: imap(hidden): Error: file_istream.stat(/var/mail/virtual/copymail/attachments/6a/50/6a506530265ef7c9feb396410eaf6946036e9a79-b034401e794009503a0400002cb72ff6) failed: No such file or directory Oct 30 10:56:05 mx0 dovecot: imap(hidden): Error: istream-concat: Failed to get size of stream /var/mail/virtual/copymail/attachments/6a/50/6a506530265ef7c9feb396410eaf6946036e9a79-b034401e794009503a0400002cb72ff6 Oct 30 10:56:05 mx0 dovecot: imap(hidden): Error: read() failed: Invalid argument (FETCH for mailbox INBOX UID 196) Oct 30 10:56:05 mx0 dovecot: imap(hidden): Disconnected: Internal error occurred. Refer to server log for more information. [2012-10-30 10:56:05] in=150 out=950 I have Bacula and have restored most of the stuff, but obviously not all files. That is not too important. But I do not know, how to tell dovecot that it may "forget" about files that produce a "No such file or directory" error. Can I do some "rescan/rebuild" in dovecot? Kind regards -Christian Rößner -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstraße 15, 81669 München Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Joerg Heidrich

2 5

[Dovecot] how to best import Evolution/Thunderbird mail into dovecot?
by Christoph Anton Mitterer 07 Nov '12

07 Nov '12

Hi. I'm migrating all my mail archive (some 60 GB) from Evolution (which is really a broken piece of software) into dovecot. Now I face the problem how to do this best... Evolution (which is still a old 2.32.x version) itself uses mbox files, in a special hierarchical structure to allow subfolders and that like. It also stores it's own status info in X-Evolution and X-Evolution-Source mail headers. Unfortunately,... much of the mail was earlier from a Thunderbird installation, which uses it's own status headers (X-Mozilla*) that were not recognised by Evolution. I have no idea which mbox subformat was always used throughout the different programs and versions... 1) Any way to check for that? To make things worse... Thunder(burden) seems to have used a modified From_ line syntax... "^From -<address> <date>$" Ideally I'd like migrate all mail into dovecot (for storage reasons again, mbox) retaining the different status flags (read, forwarded, etc.) and getting rid of the proprietary headers (of course only when they were. First thing I tried was to simply copy mail within Evolution (i.e. dragging&dropping it from the local folders to the IMAP folders from dovecot). - that preserves the status from Evolution, but doesn't restore that from Thunderbird - it clutters up the information of all From_ lines... "<address> <date>" becomes "<address of my default evolution account> <now>" - neither does it handle the special Thunderbird From_ lines - neither does it remove the Thunderbird or the X-Evolution-Source headers - if Evolution has already had corrupted index files (and this is extremely likely... as it happens even immediately during recreating all of them)... so I may loose mail So my idea was that I need a program that: - can parse all the different mbox formats (those that use the quoted ">From" style and those that use Conent-Length) - can differentiate message headers from body (so that I can drop the proprietary headers and replace them by what dovecot uses as headers) - must of course understand multiline message headers 2) Any idea for a tool like that? The meaning of the X-Evolution and X-Mozilla* headers are easy to find on the web.... so I can convert them. So I basically "just" need a tool that parses all kinds of mbox formats... allow me to drop/add headers... and spits out the rest unmodified. 3) dovecot uses some special headers like X-UID and X-IMAPD... will it create these on it's own, the first time it processes the new mbox file? I mean these headers won't be there after creation. 4) Should I drop out (during) conversion... any other mail headers.. that dovecot uses as it's own? Thanks, Chris.

6 13