- dovecot - dovecot.org

[Dovecot] Segfault in ACL Plugin + user shared folders
by Markus Werner 21 Apr '09

21 Apr '09

Hi Timo, I have another problem, this time with user shared folders: User "markus" shared the folder "ForTest" to test: SETACL "INBOX/ForTest" test akxeilrwts dovecot-acl and shared-mailboxes.db have been successfully updated. As user "test" the folder (and "#User" namespace) is not visible. When I configure the shared namespace with "list = yes", the namespace and folder became visible and accessible, but lines like this are logged: Apr 7 22:08:58 asterix dovecot: IMAP(test): acl vfile: reading file /var/spool/dovecot/users/test/Maildir/.Shared/dovecot-acl Apr 7 22:09:03 asterix dovecot: IMAP(test): Invalid namespace prefix %u/ vs % Apr 7 22:09:03 asterix dovecot: IMAP(test): auth input: uid=2000 Apr 7 22:09:03 asterix dovecot: IMAP(test): auth input: gid=2000 Apr 7 22:09:03 asterix dovecot: IMAP(test): auth input: home=/var/spool/dovecot/users/markus Apr 7 22:09:03 asterix dovecot: IMAP(test): maildir: data=/var/spool/dovecot/users/markus/Maildir:INDEX=~/Maildir/index/shared/markus Apr 7 22:09:03 asterix dovecot: IMAP(test): maildir++: root=/var/spool/dovecot/users/markus/Maildir, index=/var/spool/dovecot/users/markus/Maildir, index=/var/spool/dovecot/users/test/Maildir/index/shared/markus, control=, inbox=/var/spool/dovecot/users/markus/Maildir Apr 7 22:09:03 asterix dovecot: IMAP(test): acl: initializing backend with data: vfile Apr 7 22:09:03 asterix dovecot: IMAP(test): acl: acl username = test Apr 7 22:09:03 asterix dovecot: IMAP(test): acl: owner = 0 Apr 7 22:09:03 asterix dovecot: IMAP(test): acl vfile: Global ACL directory: (null) Apr 7 22:09:03 asterix dovecot: IMAP(test): acl vfile: reading file /var/spool/dovecot/users/markus/Maildir/.ForTest/dovecot-acl Apr 7 22:09:08 asterix dovecot: IMAP(test): Invalid namespace prefix %u/ vs markus When I try to access the folder directly with "list = children" set, then dovecot segfaults. Last lines in logfile: Apr 7 22:28:04 asterix dovecot: IMAP(test): acl: initializing backend with data: vfile Apr 7 22:28:04 asterix dovecot: IMAP(test): acl: acl username = test Apr 7 22:28:04 asterix dovecot: IMAP(test): acl: owner = 0 Apr 7 22:28:04 asterix dovecot: IMAP(test): acl vfile: Global ACL directory: (null) Apr 7 22:28:04 asterix dovecot: child 5441 (imap) killed with signal 11 (core dumped) The backtrace looks like the one I got with your first quota fix, but quota works now and this error is reproducible with or without the quota plugin: GNU gdb 6.8-debian Copyright (C) 2008 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "i486-linux-gnu"... warning: Can't read pathname for load map: Input/output error. Reading symbols from /lib/i686/cmov/libdl.so.2...done. Loaded symbols for /lib/i686/cmov/libdl.so.2 Reading symbols from /lib/i686/cmov/libc.so.6...done. Loaded symbols for /lib/i686/cmov/libc.so.6 Reading symbols from /lib/ld-linux.so.2...done. Loaded symbols for /lib/ld-linux.so.2 Reading symbols from /opt/dovecot/lib/dovecot/imap/lib01_acl_plugin.so...done. Loaded symbols for /opt/dovecot/lib/dovecot/imap/lib01_acl_plugin.so Reading symbols from /opt/dovecot/lib/dovecot/imap/lib02_imap_acl_plugin.so...done. Loaded symbols for /opt/dovecot/lib/dovecot/imap/lib02_imap_acl_plugin.so Reading symbols from /opt/dovecot/lib/dovecot/imap/lib10_quota_plugin.so...done. Loaded symbols for /opt/dovecot/lib/dovecot/imap/lib10_quota_plugin.so Reading symbols from /opt/dovecot/lib/dovecot/imap/lib11_imap_quota_plugin.so...done. Loaded symbols for /opt/dovecot/lib/dovecot/imap/lib11_imap_quota_plugin.so Reading symbols from /opt/dovecot/lib/dovecot/imap/lib20_fts_plugin.so...done. Loaded symbols for /opt/dovecot/lib/dovecot/imap/lib20_fts_plugin.so Reading symbols from /opt/dovecot/lib/dovecot/imap/lib21_fts_squat_plugin.so...done. Loaded symbols for /opt/dovecot/lib/dovecot/imap/lib21_fts_squat_plugin.so Reading symbols from /lib/i686/cmov/libnss_compat.so.2...done. Loaded symbols for /lib/i686/cmov/libnss_compat.so.2 Reading symbols from /lib/i686/cmov/libnsl.so.1...done. Loaded symbols for /lib/i686/cmov/libnsl.so.1 Reading symbols from /lib/i686/cmov/libnss_nis.so.2...done. Loaded symbols for /lib/i686/cmov/libnss_nis.so.2 Reading symbols from /lib/i686/cmov/libnss_files.so.2...done. Loaded symbols for /lib/i686/cmov/libnss_files.so.2 Core was generated by `imap'. Program terminated with signal 11, Segmentation fault. [New process 5441] #0 0xb7ee43f1 in acl_mailbox_get_aclobj (box=0x8693488) at acl-mailbox.c:49 49 struct acl_mailbox *abox = ACL_CONTEXT(box); (gdb) bt full #0 0xb7ee43f1 in acl_mailbox_get_aclobj (box=0x8693488) at acl-mailbox.c:49 No locals. #1 0xb7d77c89 in cmd_myrights (cmd=0x8658b90) at imap-acl-plugin.c:305 storage = (struct mail_storage *) 0x8666af8 box = (struct mailbox *) 0x8693488 mailbox = 0x865dc98 "#User/markus/ForTest" real_mailbox = 0x865dc9e "markus/ForTest" rights = <value optimized out> str = <value optimized out> #2 0x0806700c in client_command_input (cmd=0x8658b90) at client.c:603 client = (struct client *) 0x8658900 command = <value optimized out> __PRETTY_FUNCTION__ = "client_command_input" #3 0x080670a9 in client_command_input (cmd=0x8658b90) at client.c:652 client = (struct client *) 0x8658900 command = <value optimized out> __PRETTY_FUNCTION__ = "client_command_input" #4 0x080676ed in client_handle_input (client=0x8658900) at client.c:693 _data_stack_cur_id = 3 ret = <value optimized out> remove_io = <value optimized out> handled_commands = true #5 0x08067ba3 in client_input (client=0x8658900) at client.c:748 cmd = <value optimized out> output = (struct ostream *) 0x8658ab4 bytes = <value optimized out> __PRETTY_FUNCTION__ = "client_input" #6 0x080f73f0 in io_loop_handler_run (ioloop=0x8651af0) at ioloop-epoll.c:208 ctx = (struct ioloop_handler_context *) 0x8651bf8 event = (const struct epoll_event *) 0x8651c38 list = (struct io_list *) 0x8658b38 io = (struct io_file *) 0x8658b10 tv = {tv_sec = 4, tv_usec = 999783} t_id = 2 msecs = <value optimized out> ret = 1 i = 0 j = 0 call = <value optimized out> #7 0x080f6880 in io_loop_run (ioloop=0x8651af0) at ioloop.c:338 No locals. #8 0x080704c5 in main (argc=Cannot access memory at address 0xc ) at main.c:320 No locals. # 1.2.rc2: /opt/dovecot/etc/dovecot.conf # OS: Linux 2.6.26-1-686 i686 Debian 5.0 base_dir: /var/run/dovecot protocols: imap pop3 listen: 127.0.0.1,192.168.128.151 ssl_listen: 192.168.128.151 ssl_ca_file: /opt/dovecot/etc/certs/cacert.pem ssl_cert_file: /opt/dovecot/etc/certs/asterixCert.pem ssl_key_file: /opt/dovecot/etc/certs/asterixKey.pem ssl_parameters_regenerate: 0 ssl_cipher_list: ALL:!LOW:!SSLv2 disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /opt/dovecot/libexec/dovecot/imap-login login_executable(imap): /opt/dovecot/libexec/dovecot/imap-login login_executable(pop3): /opt/dovecot/libexec/dovecot/pop3-login login_user: dovecotl login_process_per_connection: no login_processes_count: 1 login_max_processes_count: 3 max_mail_processes: 100 mail_max_userip_connections: 8 first_valid_uid: 2000 last_valid_uid: 2000 first_valid_gid: 2000 last_valid_gid: 2000 mail_access_groups: dovecot mail_uid: 2000 mail_gid: 2000 mail_location: maildir:~/Maildir mail_debug(default): yes mail_debug(imap): yes mail_debug(pop3): no mail_executable(default): /opt/dovecot/libexec/dovecot/imap mail_executable(imap): /opt/dovecot/libexec/dovecot/imap mail_executable(pop3): /opt/dovecot/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota acl imap_acl fts fts_squat mail_plugins(imap): quota imap_quota acl imap_acl fts fts_squat mail_plugins(pop3): mail_plugin_dir(default): /opt/dovecot/lib/dovecot/imap mail_plugin_dir(imap): /opt/dovecot/lib/dovecot/imap mail_plugin_dir(pop3): /opt/dovecot/lib/dovecot/pop3 pop3_no_flag_updates(default): no pop3_no_flag_updates(imap): no pop3_no_flag_updates(pop3): yes namespace: type: private separator: / prefix: INBOX/ inbox: yes list: yes subscriptions: yes namespace: type: public separator: / prefix: #Shared/ location: maildir:/var/spool/dovecot/sharedfolders:INDEX=~/Maildir/index/public:CONTROL=~/Maildir/control/public list: yes subscriptions: yes namespace: type: shared separator: / prefix: #User/%%u/ location: maildir:%%h/Maildir:INDEX=~/Maildir/index/shared/%%u list: children auth default: mechanisms: plain login user: dovecota worker_max_count: 3 passdb: driver: passwd-file args: /opt/dovecot/etc/passwd userdb: driver: passwd-file args: /opt/dovecot/etc/passwd socket: type: listen client: path: /var/run/dovecot/auth-client mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 432 user: dovecota group: dovecot plugin: sieve: ~/.dovecot/.dovecot.sieve acl: vfile acl_shared_dict: file:/var/lib/dovecot/shared-mailboxes.db acl_anyone: allow quota: dict:user::file:%h/Maildir/dovecot-quota quota_rule: *:storage=10G:messages=500000 fts: squat fts_squat: partial=4 full=10

2 10

[Dovecot] Dovecot -> Gmail (via POP Mail Fetcher)
by Neil 20 Apr '09

20 Apr '09

I'm trying to move my entire email store from my Dovecot installation (which I normally access via IMAP) into Gmail using Gmail's Mail Fetcher (which functions over POP); and I'm running into two problems: 1. Gmail only imported 78 out of 1000+ mails in my inbox, which I'm taking to mean that Dovecot is reporting only those 78 as new. How can I get Dovecot to send all mail over as new? 2. I can't be sure of this yet (since, due to #1, Gmail doesn't seem to be downloading everything), but I'm pretty sure Dovecot is only reporting my Inbox emails over POP; is there a way I can get all my mail, from all my folders, to stream in over POP? Thanks, Neil PS. I'm not leaving Dovecot entirely, I just need to have my mail in another place in case something happens to my server...

4 7

[Dovecot] Strange behaivour with extended characters
by Armando Soto Baeza 20 Apr '09

20 Apr '09

Hi there. I am using dovecot in almost all the mail servers I configure, but I have not noticed some problems till now, when I configured a server for a japanese language based customer. Now I know, the problem is not about this customer, but it seems to be a constant in all my servers (for some reason we did not noticed that before). The situation is like this. When receving mail with extended (not only japanese) characters in the subject, Outlook Express does not recognize them. Most of our users do not use OE, but most of the japanese do. This is not all. When extended chars are also in the body, they look well when the maqil still arrives, but if forwarded to another account, or when mail is an answer to another, extended characters are not well displayed. In some tests we have done, I found more or less the same is happening when using squirrelmail. The funny thing is that the problem dos not appear when using Evolution or Outlook (the MS Office component). I move some pamrs in dovecot.conf and get some results (before moving them, the problem extended to attachements), but still remains as described. Somebody has seen such a behaivour and solved it? I was thinking to change dovecot for another agent, but will be happier using dovecot. Any suggestion? Thanks in advice.

2 1

[Dovecot] [SIEVE: Redirect] Double ">" in forwarded envelop sender address => Gmail syntax error
by Toorop 20 Apr '09

20 Apr '09

Hi, Plateform: gentoo + qmail My deliver line is in a .qmail-USER file: |/var/qmail/bin/preline /usr/libexec/dovecot/deliver -f ${SENDER:-<>} -d user(a)domain.tld I notice that sieve implementation in Dovecot use double ">" for the envelop sender when there is a redirect command in sieve script. (i've tried preline -f, without -f ${SENDER:-<>},... but nothing change for the the envelop sender syntax, alway the double ">") And that fact breaks forwardin to Gmail. Gmail reply that there is a syntax error probably due to the double "<<" (<<address>> and not <address>) as we can see in the log behind: Dovecot logs: deliver(stephane@XXXX): Apr 20 16:06:44 Info: Sending a forward to <XXXX(a)gmail.com> with return path <<stephane@XXXXXX>> deliver(stephane@XXXXX: Apr 20 16:06:44 Info: msgid=<49EC816D.9090403(a)XXXXX.com>: forwarded to <XXXXX(a)gmail.com> qmail-send logs: 2009-04-20 16:06:44.877793500 info msg 14815541: bytes 1290 from <<stephane(a)XXXXX.com>> qp 17780 uid 89 2009-04-20 16:06:44.892303500 starting delivery 6356: msg 14815541 to remote XXXXX(a)gmail.com 2009-04-20 16:06:44.982424500 delivery 6356: failure: Connected_to_209.85.219.1_but_sender_was_rejected./Remote_host_said:_555_5.5.2_Syntax_error._1si7169155ewy.101/ 2009-04-20 16:06:44.982502500 status: local 0/10 remote 0/80 Is there something to do to fix that probleme ? Thanks. -- Toorop <O> http://www.flickr.com/photos/toorop/

3 3

[Dovecot] 0 mails available even if mails in mailbox
by Raphael Thoma 20 Apr '09

20 Apr '09

Hello We are currently facing the problem, that dovecot doesn't return any messages (Pop3: +OK 0 messages) even if there are messages in the cur and new directory (maildir format). The logfile does not contain any information other than login/logout. After I deleted the dovecot.index file, all messages are available and everything works as expected. According to the wiki page [1] the main index file should be synchronized when the cur and new timestamps changed. I suppose this synchronization doesn't work correctly because the problem still existed after I changed the timestamps manually. Dovecot version: 10.0.14 Operating System: FreeBSD 7.0-RELEASE-p1 CPU Arch: amd64 Filesystem: NFS Clients: The problem exists on Pop3 and IMAP. It doesn't matter which client. I could reproduce the problem on outlook, thunderbird and even on telnet. Reproduced: +OK Dovecot ready. user user(a)domain.com +OK pass password +OK Logged in. list +OK 0 messages: After deleting dovecot.index: +OK Dovecot ready. user user(a)domain.com +OK pass password +OK Logged in. list +OK 20 messages: It seems to be a problem with the index-file from dovecot which doesn't seem to be synchronized. What could be the reason for this behaviour? How can we fix this issue for all customers? Kind regards Raphael Thoma [1] http://wiki.dovecot.org/IndexFiles

3 5

[Dovecot] Quota not being dispayed correctly in 1.2rc2 (with proof)
by Ralf Hildebrandt 20 Apr '09

20 Apr '09

User reports: 0% of 640MB -- which cannot be true. I logged in as masteruser and was able to confirm this. I'm getting "0.0% von 640.0MB" == "0.0% of 640.0MB" His maildirsize file is attached. His mailbox is nearly full. Manual login: # telnet localhost 143 Trying 127.0.0.1... Connected to localhost.localdomain. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE STARTTLS AUTH=PLAIN AUTH=LOGIN] Dovecot ready. . LOGIN user*masteruser topsecretpassword . OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE SORT THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH QUOTA] Logged in . SELECT INBOX * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 3261 EXISTS * 0 RECENT * OK [UIDVALIDITY 1179137269] UIDs valid * OK [UIDNEXT 8900] Predicted next UID * OK [HIGHESTMODSEQ 1] . OK [READ-WRITE] Select completed. . GETQUOTA "" * QUOTA "" (STORAGE 0 655360) . OK Getquota completed. WTF? -- Ralf Hildebrandt Postfix - Einrichtung, Betrieb und Wartung Tel. +49 (0)30-450 570-155 http://www.computerbeschimpfung.de If you spend more on coffee than on IT security, then you will be hacked -- what's more, you deserve to be hacked.

3 5

[Dovecot] dovecot deliver with sieve: Corrupted index cache file (in-memory index).cache: Broken fields for mail UID
by Mathias Gug 19 Apr '09

19 Apr '09

Hi, Running dovecot deliver 1.1.11 with a sieve script (dovecot-sieve 1.1.6 + changeset b9567e94b897) the following messages started to show up in the mail logs for some (spam) messages: deliver(mathiaz): Apr 18 19:03:06 Error: Corrupted index cache file (in-memory index).cache: Broken fields for mail UID 1 deliver(mathiaz): Apr 18 19:03:06 Error: Couldn't fix broken header unfolding deliver(mathiaz): Apr 18 19:03:06 Info: msgid=<01c9548a$f1666dfe$6c822ecf@pillarsx6>: saved mail to INBOX How serious are these? Without changeset b9567e94b897 applied deliver would actually crash and the message would be lost. More information can be found in the Ubuntu bug: https://bugs.launchpad.net/ubuntu/+source/dovecot/+bug/264306 -- Mathias Gug Ubuntu Developer http://www.ubuntu.com

1 0

[Dovecot] Suggestion: deliver should honor mail_log_prefix
by Mike Abbott 19 Apr '09

19 Apr '09

I can set the log prefix for imap/pop3 processes using mail_log_prefix but the log prefix for deliver is hard-coded. (I'm using 1.1.13.) Deliver should either honor mail_log_prefix or have its own setting (deliver_log_prefix?). What do you think?

2 1

[Dovecot] Released Sieve v0.1.5 and ManageSieve v0.11.4 for Dovecot v1.2.rc3 and ManageSieve v0.10.6 for Dovecot v1.1.14
by Stephan Bosch 18 Apr '09

18 Apr '09

Hello Dovecot users, This is a simultaneous release of new versions of Sieve-related software for Dovecot v1.1 and v1.2. Only the Sieve implementation itself has seen significant development. The ManageSieve packages only have small fixes and the ManageSieve patches are updated as usual to match the new Dovecot releases. Changelog Sieve v0.1.5: * Ported the implementation of the Sieve include extension to the latest draft. This means that the import and export commands are replaced by a new command called global. The import and export commands are now DEPRICATED and are mere aliases for the global command. The new specification also adds the :once modifier to the include command. The also newly specified global.* variable namespace is not implemented yet as support for variable namespaces is currently missing. * Did a major rework of the multiscript support for better error handling and made sure that persistent global scripts (sieve_before/sieve_after) are always executed, even when the user does not have a script of his own and a global default is missing. + Provided basic support for the environment extension. Currenly, the name, version and host items are useful. Others are pending. + Improved error message that is presented when an unknown Sieve extension is provided as argument to the require command. It now notifies the user that Sieve core commands do not need to be specified in require. - Fixed bug in includes at levels deeper than one. - Fixed bug in address matching that was caused by the failure to handle group specifications. In Dovecot, these are marked by address items with NULL elements, which causes a segfault if not considered. The group 'undisclosed-recipients:;' in particular triggered this bug. Bug reported by Bernhard Schmidt. Changelog ManageSieve v0.11.4 (Dovecot v1.2.rc3): * Adjusted to changes in the Dovecot signal handler API. Changelog ManageSieve v0.10.6 (Dovecot v1.1.14): - Fixed small problems in the login proxy support. -- The releases are available as follows: Sieve for Dovecot 1.2: http://www.rename-it.nl/dovecot/1.2/dovecot-1.2-sieve-0.1.5.tar.gz http://www.rename-it.nl/dovecot/1.2/dovecot-1.2-sieve-0.1.5.tar.gz.sig ManageSieve for Dovecot v1.2 (package + patch): http://www.rename-it.nl/dovecot/1.2/dovecot-1.2-managesieve-0.11.4.tar.gz http://www.rename-it.nl/dovecot/1.2/dovecot-1.2-managesieve-0.11.4.tar.gz.s… http://www.rename-it.nl/dovecot/1.2/dovecot-1.2.rc3-managesieve-0.11.4.diff… http://www.rename-it.nl/dovecot/1.2/dovecot-1.2.rc3-managesieve-0.11.4.diff… ManageSieve + patch for Dovecot v1.1 (package + patch): http://www.rename-it.nl/dovecot/1.1/dovecot-1.1-managesieve-0.10.6.tar.gz http://www.rename-it.nl/dovecot/1.1/dovecot-1.1-managesieve-0.10.6.tar.gz.s… http://www.rename-it.nl/dovecot/1.1/dovecot-1.1.14-managesieve-0.10.6.diff.… http://www.rename-it.nl/dovecot/1.1/dovecot-1.1.14-managesieve-0.10.6.diff.… -- Have fun testing the new releases and don't hesitate to notify me when there are problems. Regards, -- Stephan Bosch stephan(a)rename-it.nl

1 0

[Dovecot] Mail replication
by Renaud Allard 18 Apr '09

18 Apr '09

Hello, I am running an asynchronously replicated mail setup. 2 servers are each running an smtp server which uses dovecot as the LDA. I am using unison to replicate mail files between servers. Before, I was using Maildir format and after reading so much good papers about the very good performance of dbox format, I decided to switch to dbox. However, I now have a very annoying problem, as mails are created with names like u.1234 and numbers are following each others. So, if there is for example a mail stored as u.1001 on both servers, and now 2 mails arrive at about the same time, 1 on each server. Then, they will both be created as u.1002, that means unison will encounter a conflict as both files are different. So my question would be, is there a way to tell the servers to increment by 2 instead of 1 and have each an offset (like you can do with mysql with auto incrementing tables for example)? That way, with former example, one mail would be stored as u.1002 and the other as u.1003. Thanks

2 3