- dovecot - dovecot.org

[Dovecot] a dovecot / smtp / pop3 scenario
by Spyros Tsiolis 07 Jan '10

07 Jan '10

Hello again people, OK, could someone verify this ? One box, running linux CentOS. One instance of Dovecot running for Imap/Imaps only Another instance of a pop3/smtp server running to serve pop3/smtp . will this work ? Thank you kindly for your time, Spyros

2 1

[Dovecot] dovecot refuses to remove folders
by Harald Dunkel 07 Jan '10

07 Jan '10

Hi folks, I've got a problem between Thunderbird 3.0 and Dovecot imapd version 1.2.9. Configuration: # 1.2.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32.2 x86_64 Debian squeeze/sid log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap imaps pop3 pop3s managesieve login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login login_executable(managesieve): /usr/lib/dovecot/managesieve-login mail_privileged_group: mail mbox_write_locks: fcntl dotlock mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_executable(managesieve): /usr/lib/dovecot/managesieve mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 mail_plugin_dir(managesieve): /usr/lib/dovecot/modules/managesieve namespace: type: private separator: / location: maildir:~/Maildir:LAYOUT=fs inbox: yes list: yes subscriptions: yes auth default: passdb: driver: pam userdb: driver: passwd Please note the "LAYOUT=fs" and "seperator: /". AFAICS Dovecot refuses to remove a folder with '/' inside or at the end. Sample session (extracted from Thunderbird log file): 5 list "" "Trash/*" * LIST (\HasChildren) "/" "Trash/" * LIST (\HasNoChildren) "/" "Trash/subfolder2delete" 5 OK List completed. 6 list "" "Trash/subfolder2delete/*" * LIST (\HasNoChildren) "/" "Trash/subfolder2delete/" 6 OK List completed. 7 delete "Trash/subfolder2delete/" 7 NO [CANNOT] Invalid mailbox name I was pretty sure that this is a bug in Thunderbird, so I had created https://bugzilla.mozilla.org/show_bug.cgi?id=537626 . Unfortunately the Thunderbird developers are not convinced. Maybe somebody on this list can comment on this? Many thanx Harri

2 1

[Dovecot] auth, partially resolved
by Spyros Tsiolis 07 Jan '10

07 Jan '10

Hello people, After a lot of wading through the dovecot documentation (which btw, is excellent !, everything lies under "dovecot/doc/wiki"), I managed to authenticate a couple of accounts. For starters, I want dovecot to work as an imap/imaps box and nothing else. So , I went ahead and created a "passwd" file with two users. One user being my name (spyros) and plaintext password and the other user "postmaster" with encrypted password ("/etc/dovecot/passwd" shown) : --- spyros@webmail.domain.gr:{PLAIN}plainpassword postmaster@webmail.domain.gr:{SSHA}SSHAPassword --- Now, if I telnet to port 143 with both users, the system comes back with the following : --- [root@webmail dovecot]# telnet localhost 143 Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE STARTTLS AUTH=PLAIN] Dovecot ready . login spyros(a)webmail.domain.gr password . OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH] Logged in --- As I said, it allows login on port 143 for both users. So, the same for "postmaster". Now for port 993 : --- [root@webmail dovecot]# openssl s_client -connect webmail.domain.gr:993 [lots of SSL-related certificate information] * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE AUTH=PLAIN] Dovecot ready . login spyros(a)webmail.domain.gr password . OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH] Logged in --- Again, the same for user "postmaster". I don't paste. So, everything is fine. However, I have an issue with the (?!) issued certificate. If I check the dovecot logs I find nothing. If on the other hand, I do the same check on the Horde application, It comes back with the following : --- * Trying protocol imap/notls, Port 143: SUCCESS - INBOX has 0 messages (0 new 0 recent) * Trying protocol imap/ssl, Port 993: ERROR - The server returned the following error message: SECURITY PROBLEM: insecure server advertised AUTH=PLAIN[SERVERBUG] Internal error occurred. Refer to server log for more information. [2010-01-05 13:30:12]Certificate failure for localhost: self signed certificate: /C=GR/ST=Kerkyra/L=Kerkyra/O=Tourist Enterprizes/OU=IMAP server/CN=webmail.domain.gr/emailAddress=postmaster(a)webmail.domain.gr * Trying protocol imap/ssl/novalidate-cert, Port 993: SUCCESS - INBOX has 0 messages (0 new 0 recent) * Trying protocol imap/tls/novalidate-cert, Port 143: SUCCESS - INBOX has 0 messages (0 new 0 recent) --- Now, I know I am not supposed to ask you chaps about this, but direct my questions to the horde mailing list. However, I would like an opinion before I go ahead and bug them with this. Certificate was created with "dovecot/doc/mkcert.sh" and the relevant certificate file (can't recall its name at the moment). Any help would be appreciated. On the other hand, If I went too far with this I apologize and I'll try to find another way to resolve this. Thank you people, s.

2 1

[Dovecot] Post-logoff script
by Aaron Roberts 07 Jan '10

07 Jan '10

Hi, Is it possible with dovecot to run a script on user logoff event - something like post-login script? What I want to achieve is updating a SQL table with online/offline status. Thanks in advance, Aaron

2 2

Re: [Dovecot] Oracle SQL driver
by Alexander Bukharov 06 Jan '10

06 Jan '10

> There wouldn't be any uncommitted statements. The only such statements are > sent inside commit(), the others are SELECTs and such that don't modify > anything. Ok. I made things this way. > Well, that also wastes memory :) I thought I remembered using VARCHAR > pointers about 10 years ago. I think I still have that code around, but I > currently don't have a computer where I could put that hard drive. Maybe in > a few days. No need for this. I found a way to handle VARCHAR pointers. Now all ok. There is always a time to learn =) > Does Oracle handle \ specially? I don't have Oracle installed currently or > access to any installations. No unless an escape clause is specified in SQL-statement. > I'll check the updated patch later. Here is a fixed one.

1 0

[Dovecot] problem with uidlist
by Cor Bosman 06 Jan '10

06 Jan '10

In both 1.2.6 and 1.2.7 (probably also before that, but dont have logs) im seeing quite a few of these: Nov 17 12:45:12 userimap10.xs4all.nl dovecot: IMAP(xxxxxxx): /var/spool/mail/dovecot-control/c/c0/xxxxxxx/INBOX/.INBOX/dovecot-uidlist: Duplicate file entry at line 2650: 1257768394._smtp.mxdrop238.41874,S=17304:2,Sad (uid 34270 -> 37166) I never really looked at it because it doesnt seem to be causing many problems, but i just noticed something that probably hints at the cause.. Nov 17 12:45:12 userimap10.xs4all.nl dovecot: IMAP(xxxxxxx): /var/spool/mail/dovecot-control/c/c0/xxxxxxx/INBOX/.INBOX/dovecot-uidlist: Duplicate file entry at line 2650: 1257768394._smtp.mxdrop238.41874,S=17304:2,Sad (uid 34270 -> 37166) Nov 17 12:45:12 userimap10.xs4all.nl dovecot: IMAP(xxxxxxx): /var/spool/mail/dovecot-control/c/c0/xxxxxxx/INBOX/.INBOX/dovecot-uidlist: Duplicate file entry at line 2651: 1257769385._smtp.mxdrop155.53889,S=305996:2,Sad (uid 34271 -> 37167) Nov 17 12:45:12 userimap10.xs4all.nl dovecot: IMAP(xxxxxxx): /var/spool/mail/dovecot-control/c/c0/xxxxxxx/INBOX/.INBOX/dovecot-uidlist: Duplicate file entry at line 2652: 1257769984._smtp.mxdrop107.23815,S=320781:2,Sabd (uid 34272 -> 37168) Nov 17 12:45:12 userimap10.xs4all.nl dovecot: IMAP(xxxxxxx): /var/spool/mail/dovecot-control/c/c0/xxxxxxx/INBOX/.INBOX/dovecot-uidlist: Duplicate file entry at line 2670: 1257858287._smtp.mxdrop131.43563,S=26827:2,Sad (uid 34311 -> 37186) Nov 17 12:45:12 userimap10.xs4all.nl dovecot: IMAP(xxxxxxx): /var/spool/mail/dovecot-control/c/c0/xxxxxxx/INBOX/.INBOX/dovecot-uidlist: Duplicate file entry at line 2671: 1257858303._smtp.mxdrop238.88513,S=2143:2,Sad (uid 34312 -> 37187) Nov 17 12:45:12 userimap10.xs4all.nl dovecot: IMAP(xxxxxxx): /var/spool/mail/dovecot-control/c/c0/xxxxxxx/INBOX/.INBOX/dovecot-uidlist: Duplicate file entry at line 2672: 1257858868._smtp.mxdrop217.21298,S=8548:2,Sad (uid 34314 -> 37188) Nov 17 12:45:12 userimap7.xs4all.nl dovecot: IMAP(xxxxxxx): /var/spool/mail/dovecot-control/c/c0/xxxxxxx/INBOX/.INBOX/dovecot-uidlist: Duplicate file entry at line 994: 1244800736._smtp.mxdrop237.59318,S=4573:2,Sad (uid 32467 -> 35510) Nov 17 12:45:12 userimap7.xs4all.nl dovecot: IMAP(xxxxxxx): /var/spool/mail/dovecot-control/c/c0/xxxxxxx/INBOX/.INBOX/dovecot-uidlist: Duplicate file entry at line 995: 1244807927._smtp.mxdrop215.53275,S=439887:2,Sad (uid 32468 -> 35511) Nov 17 12:45:12 userimap7.xs4all.nl dovecot: IMAP(xxxxxxx): /var/spool/mail/dovecot-control/c/c0/xxxxxxx/INBOX/.INBOX/dovecot-uidlist: Duplicate file entry at line 996: 1244828590._smtp.mxdrop111.81795,S=3606:2,RSabd (uid 32469 -> 35512) This customer seems to be using our IMAP service from 2 machines at the same time. Possibly a webmail service and a desktop imap client. It may be that both machines are trying to manipulate the uidlist at the same time, causing who knows that kind of corruption. This could maybe explain some of the coredumps im seeing in 1.2.7? This is on Debian/Lenny, using NFS spool and NFS control/indexes. Timo, you asked in private mail a few days ago if we're sure the filenames are forever unique. Im sure. I double checked it in the source code. The above filenames are timestamp_hostname.pid, and that seems pretty unique right? Regards, Cor

3 2

Re: [Dovecot] dovecot-1.2.8 imap crash (with backtrace)
by David Halik 06 Jan '10

06 Jan '10

I found this post from a couple of weeks ago: http://www.mail-archive.com/dovecot@dovecot.org/msg24127.html Any update on this? I'm experiencing the same issue. Out of a user population of 4000, I get about 20 of these dumps a day, so it's not major issue, but I thought I'd follow up. Here is an example: http://pastebin.com/f29c55de5 I can provide a more detailed debug log from teh core dump if necessary, but since the above email already had it I figured I'd wait. Note this is *not* the same issue as: - maildir: v1.2.7 and v1.2.8 caused assert-crashes in maildir_uidlist_records_drop_expunges() I applied those patches to my 1.2.8 installation before 1.2.9 was released and that immediately fixed the expunge crash, but the array_delete bug is still there. dovecot -n --------------- bash-3.2# /usr/sbin/dovecot -n # 1.2.8: /etc/dovecot.conf # OS: Linux 2.6.18-164.6.1.el5 x86_64 CentOS release 5.4 (Final) listen: * ssl_cert_file: /rci/local/certs/imapd-pop3d.pem ssl_key_file: /rci/local/certs/imapd-pop3d.pem disable_plaintext_auth: yes login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login login_max_processes_count: 2048 max_mail_processes: 2048 first_valid_uid: 100 mail_location: maildir:~/Maildir:INDEX=/rci/nqu%h/dovecot:CONTROL=/rci/nqu%h/dovecot mmap_disable: yes mail_nfs_storage: yes mail_nfs_index: yes mail_drop_priv_before_exec: yes mail_executable(default): /rci/local/etc/convert-courier-imap.sh mail_executable(imap): /rci/local/etc/convert-courier-imap.sh mail_executable(pop3): /rci/local/etc/convert-courier-pop.sh mail_plugin_dir(default): /usr/lib64/dovecot/imap mail_plugin_dir(imap): /usr/lib64/dovecot/imap mail_plugin_dir(pop3): /usr/lib64/dovecot/pop3 pop3_uidl_format(default): %08Xu%08Xv pop3_uidl_format(imap): %08Xu%08Xv pop3_uidl_format(pop3): UID%u-%v namespace: type: private separator: . prefix: INBOX. inbox: yes list: yes subscriptions: yes auth default: passdb: driver: pam args: dovecot userdb: driver: passwd -- ================================ David Halik System Administrator OIT-CSS Rutgers University dhalik(a)jla.rutgers.edu ================================

3 22

Re: [Dovecot] Sieve > Pigeonhole > external storage with LDAP or other data source available to dovecot
by Martin F. Foster 06 Jan '10

06 Jan '10

> On 5.1.2010, at 10.02, Martin F. Foster wrote: > > >> I am looking at porting and generalizing an old in-house patch that I'm using for the CMU Sieve plugin. It allows sieve script to test& lookup arguments from LDAP. >> > .. > >> Related work: >> >> 1. Pigeonhole low priority TODO would like to implement alternate >> script storage, eg: LDAP& SQL. I'm not immediately interested in >> alternate types of script storage, but for what I want to acheive, >> I need to sanely access at least an LDAP directory. >> 2. draft-ietf-sieve-external-lists >> (http://tools.ietf.org/html/draft-ietf-sieve-external-lists-01) >> proposes a mechanism to pull mailing list addresses from external >> storage mechanisms such as LDAP, ACAP or relational databases. I'm interested in this, but would like to extend this >> functionality beyond just lists as the example above demonstrates. >> > I haven't looked into that draft or thought much about this, but would doing the lookups via Dovecot's lib-dict be ok? That would of course need a dict-ldap backend implemented, but it would be a generic way to solve this, if its API is good enough. > After another day of looking into this, I believe that there are two concerns to be addressed: 1. dovecot implementation: how dovecot/pigeonhole provides access to these external sources in a sane way. I do like the dict interface for this, which could keep LDAP url's (or SQL queries, etc) out of sieve scripts, and into nicely compartementalized configuration files. Being very ldap focussed at my site, I hadn't looked at dict before today. 2. sieve language: an extension which would allow scripts to get information from an external source. I'm asking the draft-ietf-sieve-external-lists authors a few questions about this. The end result would be something like what follows: Dovecot implementation (proposed): ------------------------------------- <dovecot.conf> dict { dict_sieve = ldap:/etc/dovecot/dovecot-sieve-ldap.conf } plugin { # TODO: proxy this dict? sieve_extsrc = dict } </dovecot.conf> then I'm not sure how you specify multiple hosts with the dict-sql format, so I'm using the postfix convention. there's probably a better way for dovecot. <dovecot-sieve-ldap.conf> map { name = responder_mode server_host = ldap://server1.mycorp.com, ldap://server2.mycorp.com search_base = o=mailstuff query_filter = (&(objectclass=mailschema)(uid=%u)) result_attribute = responder_mode result_scope = sub bind = no version = 3 } map { name = responder_text server_host = ldap://server1.mycorp.com, ldap://server2.mycorp.com search_base = o=mailstuff query_filter = (&(objectclass=mailschema)(uid=%u)) result_attribute = responder_text result_scope = sub bind = no version = 3 } map { name = forward_keep server_host = ldap://server1.mycorp.com, ldap://server2.mycorp.com search_base = o=mailstuff query_filter = (&(objectclass=mailschema)(uid=%u)) result_attribute = mailForwardKeep result_scope = sub bind = no version = 3 } map { # in this case we can have many responses name = forward_addresses server_host = ldap://server1.mycorp.com, ldap://server2.mycorp.com search_base = o=mailstuff query_filter = (&(objectclass=mailschema)(uid=%u)) result_attribute = mailForwardAddress result_scope = sub bind = no version = 3 } </dovecot-sieve-ldap.conf> Sieve language: --------------------- then with proposed new functions of the sieve language (all names plucked out of my head 2hrs ago, would have to think about the semantics some more): 1. a “:list” argument that expects a string-list 2. a “:extsrc” argument that expects an <ext-name: string> and returns a string-list 3. a “:extsrc1” argument that expects an <ext-name: string> and returns a string 4. a new test that uses information that is not in the message, say “arbitrary [comparator] string string” (syntax needs work) sample uses in scripts are then: 1. redirect to a mailing list sourced from ldap (or wheverver): # mailForwardAddress attribute can be present >=0 times redirect :list :extsrc “dict:forward_addresses” 2. decide whether to keep or discard forwarded messages (eg: after the above rule) # mailForwardKeep attribute should only be present once, if at all if arbitrary :is :extsrc1 “dict:forward_keep” “TRUE” { keep; } 3. decide vacation action and text based in information in an ldap dir: # mailResponderMode & mailResponderText attrs should only be present once, if at all if arbitrary :is :extsrc1 “dict:responder_mode” “alwaysreply” { vacation :days 1 :extsrc1 “dict:responder_text"; } if arbitrary :is :extsrc1 “dict:responder_mode” “holiday” { vacation :days 30 :extsrc1 “dict:responder_text”; } ... where the "dict:mapname" syntax would be dovecot implementation specific. could also support the URL & TAG-URI schemes as proposed by draft-ietf-sieve-external-lists. This would allow query URLs as a more general case, using whatever's configured in /etc/ldap/ldap.conf (or whatever the platform's ldap client lib uses). Doing this does raise some resource consumption concerns, hence there should probably be a means of restricting external queries to global scripts only (or sieve_before, sieve_after), and a means of providing timeout values, etc. eg: if arbitrary :is :extsrc1 “ldap:///o=myorg?mailForwardKeep” “TRUE” { keep; } I'll keep on thinking about the design, staring intently at the dovecot sources and http://wiki.dovecot.org/Design for another couple days before attempting to write some code to test this. Feedback on the design of both the sieve language extension, & dovecot interface very appreciated. Cheers, -Martin Foster

1 0

[Dovecot] Failed IMAP Login Attempts in Logs
by Carlos Williams 06 Jan '10

06 Jan '10

I had a user telling me that they can't login to the Postfix email server via Webmail (RoundCube) and I decided to see if I could locate this issue in the logs and understand if the user was simply using a wrong password credential and or something more serious. More than likely the person is just using a wrong password but in search of this on my logs, I don't understand why Dovecot doesn't log failed login attempts. When I attempted to login with a wrong password, I show the following in my logs: [root@mail log]# cat /var/log/maillog | grep 'Jan 5' | grep -i 'dovecot' | grep -i 'carlos' Jan 5 11:00:13 mail dovecot: imap-login: Disconnected: user=<carlos>, method=PLAIN, rip=::ffff:192.168.0.10, lip=::ffff:192.168.0.10 Is there a log level or something I am not searching for that will allow me to see failed or invalid logins for Dovecot (IMAP)? Thanks!

3 2

[Dovecot] Sorting in IMAP list command?
by Ronald Johnson 06 Jan '10

06 Jan '10

Hi All, I'm running Dovecot 1.2.9 and have noticed the IMAP list command does not appear to send a sorted list of folders with list command. For example on our Cyrus server I get a sorted list of folders (with INBOX listed first): 2 list "" "*" * LIST (\Noinferiors) "/" "INBOX" * LIST (\HasNoChildren) "/" "CalProject" * LIST (\HasNoChildren) "/" "Deleted Messages" * LIST (\HasNoChildren) "/" "Drafts" ... while on our Dovecot server I get seemingly random listing: 2 list "" "*" * LIST (\HasNoChildren) "/" "lsf" * LIST (\HasNoChildren) "/" "mrg" * LIST (\HasNoChildren) "/" "studiosysadmins" * LIST (\HasNoChildren) "/" "Deleted Messages" * LIST (\HasNoChildren) "/" "TriTeam" * LIST (\HasNoChildren) "/" "systemupdates" * LIST (\HasNoChildren) "/" "bb" * LIST (\HasNoChildren) "/" "nagios" * LIST (\HasNoChildren) "/" "server" ... Is this intentional, or have I done something wrong? I didn't see any option in the dovecot.conf to set the behavior of the list output. Here is `dovecot -n`: # 1.2.9: /usr/local/etc/dovecot.conf # OS: Linux 2.6.18-164.6.1.el5 x86_64 Red Hat Enterprise Linux Server release 5.4 (Tikanga) nfs protocols: imap imaps managesieve ssl_cert_file: /etc/pki/dovecot/certs/dovecot.pem ssl_key_file: /etc/pki/dovecot/private/dovecot.pem disable_plaintext_auth: no login_dir: /usr/local/var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(managesieve): /usr/local/libexec/dovecot/managesieve-login mail_access_groups: BOLT mail_location: maildir:/var/dovecot/imap/%u/Maildir mmap_disable: yes mail_nfs_storage: yes mail_nfs_index: yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(managesieve): /usr/local/libexec/dovecot/managesieve mail_plugins(default): acl imap_acl autocreate mail_plugins(imap): acl imap_acl autocreate mail_plugins(managesieve): mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(managesieve): /usr/local/lib/dovecot/managesieve namespace: type: private separator: / inbox: yes list: yes subscriptions: yes namespace: type: public separator: / prefix: Public/ location: maildir:/var/dovecot/imap/public:CONTROL=/var/dovecot/imap/%u/Maildir/public:INDEX=/var/dovecot/imap/%u/Maildir/public list: yes namespace: type: public separator: / prefix: Boltlogs/ location: maildir:/var/dovecot/imap/boltlogs/Maildir/:CONTROL=/var/dovecot/imap/%u/Maildir/public-boltlogs:INDEX=/var/dovecot/imap/%u/Maildir/public-boltlogs list: yes lda: postmaster_address: postmaster(a)example.com mail_plugins: sieve acl mail_plugin_dir: /usr/local/lib/dovecot/lda/ auth default: passdb: driver: pam userdb: driver: passwd plugin: acl: vfile sieve: /var/dovecot/imap/%u/home/.dovecot.sieve sieve_dir: /var/dovecot/imap/%u/home/sieve home: /var/dovecot/imap/%u/home autocreate: Trash autosubscribe: Trash Cheers, Ron

3 3