- dovecot - dovecot.org

[Dovecot] Bad file descriptor with maildir and bzip2 files
by Chris Burton 02 Sep '08

02 Sep '08

Hi, I'm using the zlib plugin with dovecot 1.1.2 (on Centos 4.5, x86, ext3) and some bzip2 (version 1.0.2) compressed mail files are causing the following error to show in the logs when I click on the folder in outlook express. Aug 27 11:39:15 server-2 dovecot: IMAP(marchive): fstat(maildir) failed: Bad file descriptor Aug 27 11:39:17 Info: IMAP(marchive): Loading modules from directory: /usr/local/lib/dovecot/imap/ Aug 27 11:39:17 Info: IMAP(marchive): Module loaded: /usr/local/lib/dovecot/imap//lib20_zlib_plugin.so Aug 27 11:39:17 Info: IMAP(marchive): Effective uid=606, gid=609, home=/home/marchive Aug 27 11:39:17 Info: IMAP(marchive): maildir: data=/var/spool/maildir/marchive Aug 27 11:39:17 Info: IMAP(marchive): maildir++: root=/var/spool/maildir/marchive, index=, control=, inbox=/var/spool/maildir/marchive Aug 27 11:39:18 Info: IMAP(marchive): Disconnected: Internal error occurred. Refer to server log for more information. [20 08-08-27 11:39:18] bytes=246/1040 I attached strace to it and got the following: 11:39:18.193667 open("/var/spool/maildir/marchive/.2003.INBOX.Charlie.Old.OldInbox.2004/cur/1169027932.P30745Q17M499928.server-2:2,S=103418,Z", O_RDONLY|O_LARGEFILE) = 11 11:39:18.194130 fstat64(11, {st_mode=S_IFREG|0644, st_size=47637, ...}) = 0 11:39:18.194494 pread64(11, "BZh91AY&SY\231\206Z\257\0S\360\377\200\177\3746,U\357\377\377\377\377\377\360\277"..., 4096, 0) = 4096 11:39:18.200204 dup(11) = 12 11:39:18.200557 close(11) = 0 11:39:18.200916 fcntl64(12, F_GETFL) = 0x8000 (flags O_RDONLY|O_LARGEFILE) 11:39:18.200971 fstat64(12, {st_mode=S_IFREG|0644, st_size=47637, ...}) = 0 11:39:18.201104 mmap2(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0xb7ff2000 11:39:18.201216 _llseek(12, 0, [0], SEEK_CUR) = 0 11:39:18.201355 fstat64(12, {st_mode=S_IFREG|0644, st_size=47637, ...}) = 0 11:39:18.201478 brk(0x9e61000) = 0x9e61000 11:39:18.201612 read(12, "BZh91AY&SY\231\206Z\257\0S\360\377\200\177\3746,U\357\377\377\377\377\377\360\277"..., 4096) = 4096 11:39:18.201694 read(12, "\277\217\261\0g!\273\')/3\343V\336\276}\273/\210I\26^\255\304\323\r\275Wts\3773"..., 4096) = 4096 11:39:18.201793 mmap2(NULL, 3600384, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0xb7c68000 11:39:18.205993 read(12, "~\214\261E*@[\200\245\302\232\201\334\331\272\225NQ\244\260\371\3473cc\312\255\326\246\17\'\222"..., 4096) = 4096 < continues reading from the file > 11:39:18.225970 read(12, "+:E\225\7\217W\264\367\27\226\262i9\34\227=\350\250BcmF\306\'\231m\265\233\337\343\237"..., 4096) = 2581 11:39:18.226040 read(12, "", 4096) = 0 < 26x more of this read > 11:39:18.233913 munmap(0xb7c68000, 3600384) = 0 11:39:18.234070 close(12) = 0 11:39:18.234120 munmap(0xb7ff2000, 4096) = 0 11:39:18.234184 fcntl64(12, F_GETFL) = -1 EBADF (Bad file descriptor) 11:39:18.234255 fstat64(12, 0xbff0a9a0) = -1 EBADF (Bad file descriptor) 11:39:18.234347 write(2, "\1Efstat(maildir) failed: Bad fil"..., 45) = 45 To me it looks like its trying to call fcntl on the handle its just closed? I've since decompressed these files and recompressed with "gzip -9" and they seem to be opening OK. dovecot -n gives: # 1.1.2: /usr/local/etc/dovecot.conf info_log_path: /var/log/dovecot.log protocols: imap imaps pop3 ssl_disable: yes disable_plaintext_auth: no login_dir: /usr/local/var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login mail_location: maildir:/var/spool/maildir/%u mail_debug: yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugins: zlib mail_plugin_dir(default): /usr/local/lib/dovecot/imap/ mail_plugin_dir(imap): /usr/local/lib/dovecot/imap/ mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3/ imap_client_workarounds(default): delay-newmail imap_client_workarounds(imap): delay-newmail imap_client_workarounds(pop3): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls auth default: passdb: driver: pam userdb: driver: passwd ChrisB.

3 6

[Dovecot] sieve plugin
by Андрей 02 Sep '08

02 Sep '08

I try to cinfigure dovecot run sieve scripts on incoming mail. In my dovecot.conf: <...> protocol lda { # Address to use when sending rejection mails. postmaster_address = root(a)vpcit.ru # Hostname to use in various parts of sent mails, eg. in Message-Id. # Default is the system's real hostname. hostname = vpcit.ru # Support for dynamically loadable plugins. mail_plugins is a space separated # list of plugins to load. #mail_plugins = mail_plugin_dir = /usr/lib/dovecot/modules/lda # Binary to use for sending mails. #sendmail_path = /usr/lib/sendmail # UNIX socket path to master authentication server to find users. auth_socket_path = /var/run/dovecot/auth-master # Enabling Sieve plugin for server-side mail filtering mail_plugins = cmusieve } <...> plugin { sieve = /var/mail/%d/%1n/%n/.dovecot.sieve } Then i set experiments on my maildir. In /var/mail/vpcit.ru/d/dukenukem i created script .dovecot.sieve: require "fileinto"; if header :comparator "i;ascii-casemap" :contains "Subject" "sieve check" { fileinto "Trash"; stop; } Permissions on /var/mail/vpcit.ru/d/dukenukem are: drwx------ 5000 mail So script should put every message that has "sieve check" subject into Trash folder. 1) Trash folder isn't created, should i create it manually? 2) Even when i create Trash folder and make 777 permissions to maildir, nothing happens (message is dropped into inbox dir) 3) Should i configure my Kontact (KMail) e-mail client some way? 4) What i've done incorrect? The mail system works fine at the moment for receive and send, trouble only with sieve scripting. Yours faithfully, Andrey.

3 4

[Dovecot] question about OpenSSL with DC
by Stewart Dean 02 Sep '08

02 Sep '08

IBM recently changed both its delivery package for OpenSSL and the locations it put things. Luckily, I have a second machine other than my mail server that I can test things on and DC 1.0.15 seems to be be running OK (thus I got all the configure/compilation tweaks right), but.....is there anyway to check the DC binaries to determine where it's getting its OpenSSl binaries and libraries (needed at runtime)? -- ==== Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 sdean(a)bard.edu voice: 845-758-7475, fax: 845-758-7035

3 2

[Dovecot] Virtual users, postfix and dovecot deliver LDA
by Petri Asikainen 02 Sep '08

02 Sep '08

Hi, I have question about how to setup ldap-lookups in dovecot. I have done my homework by googling and reading documention and sample configuration files. But cant resolve this issue. Background: I have setup postfix and dovecot. Postix is configured to ldap alias maps and is delivering mails to /var/spool/vmail/username/Maildir correctly . Username is ldap attribute sAMAccountName from active directory. Goal: To use dovecots sieve plugin I have to setup postfix to use dovecots deliver. Changed postfix main.cf to virtual_transport = dovecot and master.cf to include lines: dovecot unix - n n - - pipe flags=DRhu user=vmail:mail argv=/usr/lib/dovecot/lda/deliver -d ${recipient} Problem is that mail get delivered to /var/spool/vmail/users.email@address , not folder named as ldap attribute sAMAccountNameas it should. The question is: How I can configure deliver to do map email address to ldap attribute sAMAccountName? Second question is can I use ldap groups as distribution lists whit deliver? Dovecot version is 1.1.2 and postfix 2.5.1 Cheers, Petri

2 11

[Dovecot] Read-only FS
by Radomir Zoltowski 01 Sep '08

01 Sep '08

Hi all, Imagine an NFS mounted read-only file system containing directories full of plain mboxes. Any recommendations on how to approach the access with dovecot? I believe all NFS recommended options apply, how about index/cache files though? Can I switch them off deliberately for good? Performance degradation is not an issue. Thanks, R. -- _________________________________________________________ Radomir Zoltowski <Radomir.Zoltowski(a)s3group.com> Applications Engineer Silicon & Software Systems Ltd., IT Department South County Business Park, Leopardstown, Dublin 18, IRELAND Tel.: +353 1 291 1224, Fax: +353 1 291 1001 _________________________________________________________ The information contained in this e-mail and in any attachments is confidential and is designated solely for the attention of the intended recipient(s). If you are not an intended recipient, you must not use, disclose, copy, distribute or retain this e-mail or any part thereof. If you have received this e-mail in error, please notify the sender by return e-mail and delete all copies of this e-mail from your computer system(s). Please direct any additional queries to: communications(a)s3group.com. Thank You. Silicon and Software Systems Limited. Registered in Ireland no. 378073. Registered Office: South County Business Park, Leopardstown, Dublin 18

2 2

[Dovecot] Dovecot 1.1.1 + zlib plugin + mbox crash
by Chris Wakelin 01 Sep '08

01 Sep '08

I've tried this on both Solaris 8 and SuSE Enterprise 9 (64-bit). I get a assert-crash when using a gzipped mbox folder . OK Logged in. . SELECT test.gz * FLAGS (\Answered \Flagged \Deleted \Seen \Draft $Label4 $Label2 $Label1 $Label3 $Label5) * OK [PERMANENTFLAGS ()] Read-only mailbox. * 167 EXISTS * 0 RECENT * OK [UNSEEN 2] First unseen. * OK [UIDVALIDITY 1096038620] UIDs valid * OK [UIDNEXT 42890] Predicted next UID . OK [READ-ONLY] Select completed. . FETCH 167 FULL * 167 FETCH (FLAGS () INTERNALDATE "05-Jan-2003 07:05:37 +0000" RFC822.SIZE 4693 ENVELOPE ("Sat, 04 Jan 2003 21:05:48 -0800" "[xxxxxxx] xx: xxxx xxxxxxxxxxx" (("xxxxx xxxxxxxx" NIL "xxxxxxxxxxxx" "xxxxx.xxx")) ((NIL NIL "xxxxxxx-xxxxxx" "xxxxxxxxxx.xx")) (("xxxxx xxxxxxxx" NIL "xxxxxxxxxxxx" "xxxxx.xxx")) (("xxxxxxx xxxx xxxx" NIL "xxxxxxx" "xxxxxxxxxx.xx")) NIL NIL NIL "<xxxxxxxx.xxxxxxx(a)xxxxx.xxx>") BODY ("text" "plain" ("charset" "us-ascii" "format" "flowed") NIL NIL "7bit" 3408 35)) . OK Fetch completed. . FETCH 167 BODY[] Connection closed by foreign host. dovecot: Jul 23 15:35:39 Info: imap-login: Login: user=<xxxxxxxx>, method=PLAIN, rip=xxx.xxx.xxx.xxx, lip=xxx.xxx.xxx.xxx dovecot: Jul 23 15:35:39 Info: auth(default): new auth connection: pid=841 dovecot: Jul 23 15:35:54 Panic: IMAP 888 xxxxxxxx xxx.xxx.xxx.xxx : file istream-raw-mbox.c: line 363 (i_stream_create_raw_mbox): assertion failed: (input->v_offset == 0) dovecot: Jul 23 15:35:54 Error: IMAP 888 xxxxxxxx xxx.xxx.xxx.xxx : Raw backtrace: imap [0x4833b8] -> imap [0x483413] -> imap [0x482e46] -> imap [0x43ce47] -> imap(mbox_file_open_stream+0x40) [0x434f40] -> imap [0x4363c1] -> imap [0x436778] -> imap(mail_get_stream+0xa) [0x4547ea] -> imap(index_mail_set_seq+0x144) [ 0x44b444] -> imap [0x436a79] -> imap(mail_set_seq+0x7) [0x454697] -> imap(index_storage_search_next_nonblock+0xd7) [0x44ef07] -> imap(mailbox_search_next_non block+0x10) [0x455ef0] -> imap(mailbox_search_next+0x20) [0x455f20] -> imap(imap_fetch+0x87) [0x41d457] -> imap(cmd_fetch+0x1f4) [0x4174b4] -> imap [0x41b2e4 ] -> imap [0x41b2d8] -> imap [0x41bc91] -> imap(client_input+0x5f) [0x41bdaf] -> imap(io_loop_handler_run+0xf7) [0x489d97] -> imap(io_loop_run+0x28) [0x48906 8] -> imap(main+0x462) [0x4233b2] -> /lib64/tls/libc.so.6(__libc_start_main+0xea) [0x2a9578caaa] -> imap(__ctype_b_loc+0x4a) [0x415b3a] dovecot: Jul 23 15:35:54 Error: child 888 (imap) killed with signal 6 dovecot -n output: # 1.1.1: /opt/RDGdovect/etc/dovecot.conf base_dir: /opt/RDGdovect/var/run/ log_path: /opt/RDGdovect/var/log/dovecot.log info_log_path: /opt/RDGdovect/var/log/dovecot.log protocols: imap listen: *:143 ssl_disable: yes disable_plaintext_auth: no shutdown_clients: no login_dir: /opt/RDGdovect/var/run/login login_executable: /opt/RDGdovect/libexec/dovecot/imap-login login_greeting: University of Reading IMAP test1.1 ready. login_process_per_connection: no verbose_proctitle: yes mail_location: mbox:/export/folders/%13.h/mail/:INBOX=/export/mail/%13.h/INBOX:INDEX=/export/indexes/%13.h mbox_very_dirty_syncs: yes mail_drop_priv_before_exec: yes mail_plugins: zlib mail_log_prefix: %Us %p %u %r : imap_client_workarounds: outlook-idle delay-newmail auth default: mechanisms: plain login username_format: %Ln verbose: yes debug: yes passdb: driver: ldap args: /opt/RDGdovect/etc/dovecot-ldap.conf userdb: driver: passwd-file args: /opt/RDGdovect/etc/userdb I've attached the relevant test.gz file (anonymised for the test) Has anybody else got it working? Best Wishes, Chris -- --+---+---+---+---+---+---+---+---+---+---+---+---+---+---+---+---+---+- Christopher Wakelin, c.d.wakelin(a)reading.ac.uk IT Services Centre, The University of Reading, Tel: +44 (0)118 378 8439 Whiteknights, Reading, RG6 2AF, UK Fax: +44 (0)118 975 3094

3 16

Re: [Dovecot] Authentication problems
by Rodti MacLeary 01 Sep '08

01 Sep '08

On Mon, 01 Sep 2008 17:17:27 +0300, Timo Sirainen <tss(a)iki.fi> wrote: >> Extracts of /var/log/mail.log attached below. Nothing new in mail.err. > > Those are only Postfix's logs. See Dovecot's logs. > http://wiki.dovecot.org/Logging Sorry, I pulled these from syslog: Sep 1 13:52:36 localhost dovecot: imap-login: Login: user=<user(a)domain.tld>, method=PLAIN, rip=xxx.xxx.xxx.xxx, lip=xxx.xxx.xxx.xxx, TLS Sep 1 13:52:57 localhost dovecot: imap-login: Login: user=<user(a)domain.tld>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured Sep 1 13:52:57 localhost dovecot: IMAP(user(a)domain.tld): Disconnected: Logged out Sep 1 13:53:01 localhost dovecot: imap-login: Login: user=<user(a)domain.tld>, method=PLAIN, rip=xxx.xxx.xxx.xxx, lip=xxx.xxx.xxx.xxx, TLS Sep 1 13:53:08 localhost postfix/smtpd[6047]: connect from unknown[xxx.xxx.xxx.xxx] Sep 1 13:53:09 localhost postfix/smtpd[6047]: lost connection after EHLO from unknown[xxx.xxx.xxx.xxx] Sep 1 13:53:09 localhost postfix/smtpd[6047]: disconnect from unknown[xxx.xxx.xxx.xxx] Sep 1 13:53:12 localhost postfix/smtpd[6047]: connect from unknown[xxx.xxx.xxx.xxx]

1 0

[Dovecot] Autocreating INBOX only
by Edgar Fuß 01 Sep '08

01 Sep '08

I would like deliver not to automatically create subfolders for mails addressed to user+some_strange_name(a)domain.com, but nevertheless automatically create INBOX for new users. I'm not sure whether a new option like -M or -m -m would be appropriate, i.e., whether anyone needs the current -m behaviour. It looks to me like one would need to change mailbox_open_or_create_synced() if (box != NULL || no_mailbox_autocreate) return box; to something like (assuming an enum mailbox_autocreate {_never,_inbox,_always} if (box != NULL) return box; if (mailbox_autocreate == mailbox_autocreate_never || strcasecmp (mailbox, "INBOX") != 0) return NULL;

2 3

Re: [Dovecot] usernames with/without domain - my solution
by Mark Zealey 01 Sep '08

01 Sep '08

We do it the same and it works fine, however we do it by inbound port (because we're behind some loadbalancers that can do port translation. We create a port -> domain mapping table and then you can just do the join with "where port = '%a'" (dovecot 1.1 only). Seems a little neater than the per-ip solution if you're in a loadbalanced environment. I don't see why you need the group by or having statements (assuming you have normalized tables). Mark -- Mark Zealey -- Shared Hosting Team Leader Product Development * Webfusion 123-reg.co.uk, webfusion.co.uk, donhost.co.uk, supanames.co.uk This mail is subject to http://www.gxn.net/disclaimer > -----Original Message----- > From: dovecot-bounces+mark.zealey=webfusion.com(a)dovecot.org > [mailto:dovecot-bounces+mark.zealey=webfusion.com@dovecot.org] > On Behalf Of Ian B > Sent: 01 September 2008 09:29 > To: dovecot(a)dovecot.org > Subject: [Dovecot] usernames with/without domain - my solution > > My existing pop3/imap environment is courier imap + vpopmail > + qmail with MySQL backend. I'm looking at migrating this to Dovecot. > > Currently I have multiple instances of Courier bound to > different loopback IPs (the IPs correspond with the virtual > IPs on a server load balancer). When a user authenticates > they don't have to specify a domain - if they don't, Courier > will use a 'default' domain (defined in the Courier config > for that instance). > > Moving to Dovecot I want to avoid having to running an > instance of Dovecot listening on each loopback IP, but still > handle usernames that may not have the domain component. > > I wasn't able to find any examples showing how to achieve > this exactly, so came up with the following solution: > > 1. create a new 2 column SQL table: 'domain', 'IP' - this > allows me to map between the local Dovecot IP and the 'default' domain > 2. create a (rather ugly looking) sql query that combines > data from both the vpopmail table and the new table > > The SQL query is as follows: > > > SELECT > IF('%d' = '',dovecot.domain,'%d') AS authdomain, > CONCAT(pw_name, '@', pw_domain) AS user, > pw_passwd AS password, pw_dir AS userdb_home, 89 AS > userdb_uid, 89 AS userdb_gid > FROM vpopmail, dovecot_authmap AS dovecot > WHERE pw_name = '%n' > AND dovecot.local_ip = SUBSTRING_INDEX('%l', ':', -1) > GROUP BY pw_domain HAVING pw_domain = authdomain > > > NOTE: I'm prefetching userdb info > > This works, however I'd like to know what others think of > this approach, and whether there is a better way to achieve > what I require. > > Thanks, > Ian. > > > Win a MacBook Air or iPod touch with Yahoo!7. > http://au.docs.yahoo.com/homepageset >

1 0

[Dovecot] How do I move delete messages to Trash?
by Robert S 01 Sep '08

01 Sep '08

I've recently replaced courier-imap with dovecot - mainly for performance benefits. All of my users in the office use Outlook Express. It appears that dovecot has no facility to move deleted messages to a Trash folder - where they can be removed after a specified time with a cronjob. Other mail clients seem to have an option to specify a Trash folder. I see that there's a deleted-to-trash plugin at http://wiki.dovecot.org/Plugins/deleted-to-trash but I've got no idea as to how I'd implement this. Could somebody please give me some pointers? I realise that OE might not be the best mail client for implementing IMAP but that's what everyone in the office uses!

1 0