- dovecot - dovecot.org

[Dovecot] pop3+leave messages on server
by Papp Tamas 24 Jan '10

24 Jan '10

hi All, I have a srange problem. Before dovecot there was a courier imap and it worked just fine. The client(s) are the same then before, so I think, this is an server side problem. I have a user with Outlook and he uses pop3 and leaves messages on server. Sometimes the messages get downloaded again, when he starts the outlook. Not all, but 7-9 hours back. uidl format is like it's suggested: pop3_uidl_format = %08Xu%08Xv Any idea, what's wrong and what I can do? Thank you very much, tamas

6 16

[Dovecot] strange behaviour with seen/unseen messages in virtual folders.
by Matthias Rieber 24 Jan '10

24 Jan '10

Hi, I've a virtual folder that contains unseen messages. When I mark the message and expunge the folder, the message should disappear. This works as expected in alpine. Alpine uses the following commands: 06000010 STORE 1 +Flags (\SEEN) 06000020 EXPUNGE Using roundcube mail, the message wont disappear, when I perform the same steps. RoundCube Mails sends: flg UID STORE 445 +FLAGS (\Seen) exp1 EXPUNGE But the message doesn't dissapear. But I can expunge it with alpine, as long as the folder contains one message. If it contains more messages, some or even all messages won't disappear. When I mark them as unseen/seen in alpine, I can expunge them with alpine. The expunge command send by roundcube mail never expunges any seen message in the unseen folder. Whether it was flagged as seen by alpine nor roundcube mail. kind regards, matthias

2 1

[Dovecot] Need simplest method for providing alternate mail location
by Stewart Dean 24 Jan '10

24 Jan '10

I am looking to migrate my DC V1.2 from mbox to maildir format....and want to do this in stages, user group by user group rather than in one horrendous fell swoop....since I'd rather fell things didn't happen. Since I'm running sendmail/procmail, I can change the ~/.procmailrc to change the writing of the INBOX, but the IMAP mail location access info is knottier when one wants to do things a bit at a time. Setting aside for now the matter of converting existing folders, I will be moving: = from a mbox setup with the INBOX in /var/spool/mail/<userid> and the folders in ~/mail = to both in ~/Maildir (unless someone has better ideas) It seems that one could: 1) Change the namespaces in the client...but this is not feasible, because it would means going out to all my 4000+ users desktop and modifying them. 2) Having some sort of db to tell DC it a mail_userdb extra field and override the mail_location in dovecot.conf 3) Perhaps waiting for DC v2.0 which will have this architected in. A) Is there any sense the v2.0 will be coming Real Soon Now and will fulfill #3? B) What's the simplest way to implement #2? I would really rather not install MySQL on my mail server and have all the overhead of installing and managing it when all I need it for is a temporary resource to tell DC where things are until the switchover is complete and Maildir is the default. Is it feasible to do this with an additional flat file in the /etc/passwd mode with some extra fields tacked on that is *only* used for mail location info? Or some other and simple way? My apologies if this is a Stupid Question............. -- ==== Once upon a time, the Internet was a friendly, neighbors-helping-neighbors small town, and no one locked their doors. Now it's like an apartment in Bed-Stuy: you need three heavy duty pick-proof locks, one of those braces that goes from the lock to the floor, and bars on the windows.... ==== Stewart Dean, Unix System Admin, Bard College, New York 12504 sdean(a)bard.edu voice: 845-758-7475, fax: 845-758-7035

2 1

[Dovecot] Compilation error
by Heiko Schlichting 24 Jan '10

24 Jan '10

Hi, the latest revision of dovecot 1.1 tree (576020ceda60) produces errors during compilation on Debian Lenny: [...] Making all in quota make[4]: Entering directory `/scratch/heiko/dovecot/dovecot-1-1-576020ceda60/src/plugins/quota' if /bin/sh ../../../libtool --tag=CC --mode=compile gcc -DHAVE_CONFIG_H -I. -I. -I../../.. -I../../../src/lib -I../../../src/lib-dict -I../../../src/lib-index -I../../../src/lib-mail -I../../../src/lib-storage -I../../../src/lib-storage/index -I../../../src/lib-storage/index/maildir -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -Wstrict-aliasing=2 -MT quota-storage.lo -MD -MP -MF ".deps/quota-storage.Tpo" -c -o quota-storage.lo quota-storage.c; \ then mv -f ".deps/quota-storage.Tpo" ".deps/quota-storage.Plo"; else rm -f ".deps/quota-storage.Tpo"; exit 1; fi gcc -DHAVE_CONFIG_H -I. -I. -I../../.. -I../../../src/lib -I../../../src/lib-dict -I../../../src/lib-index -I../../../src/lib-mail -I../../../src/lib-storage -I../../../src/lib-storage/index -I../../../src/lib-storage/index/maildir -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -Wstrict-aliasing=2 -MT quota-storage.lo -MD -MP -MF .deps/quota-storage.Tpo -c quota-storage.c -fPIC -DPIC -o .libs/quota-storage.o quota-storage.c: In function 'quota_mailbox_sync_notify': quota-storage.c:339: error: 'namespaces' undeclared (first use in this function) quota-storage.c:339: error: (Each undeclared identifier is reported only once quota-storage.c:339: error: for each function it appears in.) Previous revision (af6526158608, 1.1.20) compiles without problems. Heiko Heiko Schlichting Freie Universität Berlin heiko(a)CIS.FU-Berlin.DE Zentraleinrichtung für Datenverarbeitung (ZEDAT) Telefon +49 30 838-54327 Fabeckstraße 32 Telefax +49 30 838454327 14195 Berlin

2 1

[Dovecot] Dovecot 1.2 & Thunderbird 3.0
by Proskurin Kirill 24 Jan '10

24 Jan '10

Hello. After updating to TB-3.0 I notice what sometimes messages in IMAP folder lost "seen flag". Entire folder star to be unseen fully. It happen often then I chose(click on it) some folder . Has some one have this bug too? root@mail [~]dovecot -n # 1.2.4: /usr/local/etc/dovecot.conf # OS: FreeBSD 7.1-RELEASE-p7 i386 ufs base_dir: /var/run/dovecot/ log_path: /var/log/dovecot/dovecot.log info_log_path: /var/log/dovecot/dovecot-debug.log protocols: imap imaps pop3 pop3s managesieve listen(default): * listen(imap): * listen(pop3): * listen(managesieve): *:2000 ssl_ca_file: /usr/local/etc/certs/GlobalSignCA.crt ssl_cert_file: /usr/local/etc/certs/fxclub_org.crt ssl_key_file: /usr/local/etc/certs/fxclub_org.key ssl_cipher_list: ALL:!LOW:!SSLv2 login_dir: /var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_executable(managesieve): /usr/local/libexec/dovecot/managesieve-login login_process_size: 128 login_processes_count: 20 login_max_processes_count: 512 mail_max_userip_connections(default): 256 mail_max_userip_connections(imap): 256 mail_max_userip_connections(pop3): 20 mail_max_userip_connections(managesieve): 10 verbose_proctitle: yes first_valid_gid: 0 mail_privileged_group: mail mail_uid: dmail mail_gid: dmail mail_location: maildir:/var/spool/dovecot/domains/%d/%n mail_debug: yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_executable(managesieve): /usr/local/libexec/dovecot/managesieve mail_process_size: 512 mail_plugins(default): quota imap_quota autocreate mail_log mail_plugins(imap): quota imap_quota autocreate mail_log mail_plugins(pop3): quota mail_plugins(managesieve): mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 mail_plugin_dir(managesieve): /usr/local/lib/dovecot/managesieve imap_client_workarounds(default): delay-newmail tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail tb-extra-mailbox-sep imap_client_workarounds(pop3): imap_client_workarounds(managesieve): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh pop3_client_workarounds(managesieve): lda: postmaster_address: postmaster(a)fxclub.org hostname: mail.fxclub.org mail_plugins: sieve quota mail_plugin_dir: /usr/local/lib/dovecot/lda quota_full_tempfail: yes deliver_log_format: msgid=%m: %$ %f %s log_path: /var/log/dovecot/deliver.log info_log_path: /var/log/dovecot/deliver.log sendmail_path: /usr/sbin/sendmail rejection_reason: Your message to <%t> was automatically rejected:%n%r auth_socket_path: /var/run/dovecot/auth-master auth default: mechanisms: plain login user: dovecot-auth username_format: %Lu worker_max_count: 100 passdb: driver: ldap args: /usr/local/etc/dovecot-ldap.conf userdb: driver: ldap args: /usr/local/etc/dovecot-ldap.conf socket: type: listen client: path: /var/run/dovecot/auth-client mode: 432 user: exim master: path: /var/run/dovecot/auth-master mode: 384 user: dmail plugin: quota: maildir quota_rule: *:storage=1024M quota_rule2: Trash:storage=1256M quota_rule3: SPAM:ignore quota_warning: storage=95%% /usr/local/bin/quota-warning.sh 95 quota_warning2: storage=80%% /usr/local/bin/quota-warning.sh 80 autocreate: Trash autocreate2: Sent autocreate3: Spam autosubscribe: Trash autosubscribe2: Sent autosubscribe3: Spam sieve_dir: ~/sieve sieve: ~/.dovecot.sieve sieve_global_path: /var/spool/dovecot/global.sieve mail_log_events: delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields: uid box msgid size mail_log_max_lines_per_sec: 0 -- Best regards. Proskurin Kirill

5 7

[Dovecot] SpamAssassin and i;ascii-numeric comparator
by Julian Cowley 24 Jan '10

24 Jan '10

Hi Stephan, I noticed that you changed i;ascii-numeric comparator recently (<http://hg.rename-it.nl/dovecot-1.2-sieve/rev/17fb38aee85f>) to correct a small bug. I have an interest in this because I use the comparator to check for SpamAssassin scores. Before the fix, this was all that was necessary to check for scores above a certain value: header :value "ge" :comparator "i;ascii-numeric" "X-Spam-Score" "5" Since SpamAssassin includes negative scores and the i;ascii-numeric comparator doesn't recognize negative numbers, all negative scores are actually treated as positive infinity after the fix. Of course, this means mail which has a negative score then gets counted as spam. Now an additional test is necessary, something like this: allof(not header :matches "X-Spam-Score" "-*", header :value "ge" :comparator "i;ascii-numeric" "X-Spam-Score" "5") I thought I'd mention this because other people may get affected by this once 0.1.15 comes out. Here is a patch that makes further tests for the comparator between numeric and non-numeric values. Hope you can use it. -=- julian

2 1

[Dovecot] how to create maildir on local mail delivery
by Sebastian Logar 24 Jan '10

24 Jan '10

Hi! I am using Dovecot 1.0.10 with LDA/postfix option reading user data from ldap, but the problem would be nonexistent maildir. Connection with ldap should be fine since reading proper maildir folder. Is it possible to auto creating maildir folders even on received mail since the you can auto create when user login with mail_executable scripts as it's seen from configuration I am doing for pop3 and imap. Jan 23 00:23:17 dovecot postfix/qmgr[14579]: 75AADD212F: from=<someuser(a)domain.tld>, size=354, nrcpt=1 (queue active) Jan 23 00:23:17 dovecot deliver(erikp): Loading modules from directory: /usr/lib/dovecot/modules/lda Jan 23 00:23:17 dovecot deliver(erikp): Module loaded: /usr/lib/dovecot/modules/lda/lib10_quota_plugin.so Jan 23 00:23:17 dovecot deliver(erikp): auth input: erikp Jan 23 00:23:17 dovecot deliver(erikp): auth input: home=/nas/5b/7d/5f/erikp/www Jan 23 00:23:17 dovecot deliver(erikp): auth input: uid=5000 Jan 23 00:23:17 dovecot deliver(erikp): auth input: gid=5000 Jan 23 00:23:17 dovecot deliver(erikp): auth input: mail=/nas/5b/7d/5f/erikp/Maildir/ Jan 23 00:23:17 dovecot deliver(erikp): auth input: quota=maildir:storage=100000000 Jan 23 00:23:17 dovecot deliver(erikp): Home dir not found: /nas/5b/7d/5f/erikp/www Jan 23 00:23:17 dovecot deliver(erikp): maildir autodetect: stat(/nas/5b/7d/5f/erikp/Maildir//cur) failed: No such file or directory Jan 23 00:23:17 dovecot deliver(erikp): mbox autodetect: data=/nas/5b/7d/5f/erikp/Maildir/ Jan 23 00:23:17 dovecot deliver(erikp): mbox autodetect: INBOX file: stat(/nas/5b/7d/5f/erikp/Maildir/) failed: No such file or directory Jan 23 00:23:17 dovecot deliver(erikp): mbox autodetect: has .imap/: stat(/nas/5b/7d/5f/erikp/Maildir//.imap) failed: No such file or directory Jan 23 00:23:17 dovecot deliver(erikp): mbox autodetect: has inbox: stat(/nas/5b/7d/5f/erikp/Maildir//inbox) failed: No such file or directory Jan 23 00:23:17 dovecot deliver(erikp): mbox autodetect: has mbox: stat(/nas/5b/7d/5f/erikp/Maildir//mbox) failed: No such file or directory Jan 23 00:23:17 dovecot deliver(erikp): Ambiguous mail location setting, don't know what to do with it: /nas/5b/7d/5f/erikp/Maildir/ (try prefixing it with mbox: or maildir:) Jan 23 00:23:17 dovecot deliver(erikp): Failed to create storage for 'erikp' with mail '/nas/5b/7d/5f/erikp/Maildir/' Jan 23 00:23:17 dovecot postfix/pipe[15537]: 75AADD212F: to=<erikp(a)somelocaldomain.tld>, relay=dovecot, delay=2146, delays=2146/0.02/0/0.02, dsn=4.3.0, status=deferred (temporary failure) dovecot -n # 1.0.10: /etc/dovecot/dovecot.conf log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap pop3 disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login mail_privileged_group: mail mail_debug: yes mail_executable(default): /usr/lib/dovecot/imap.sh mail_executable(imap): /usr/lib/dovecot/imap.sh mail_executable(pop3): /usr/lib/dovecot/pop3.sh mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): quota mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %08Xu%08Xv auth default: passdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf userdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf socket: type: listen client: path: /var/run/dovecot/auth-client mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: vmail group: vmail plugin: quota: maildir:storage=100000 Regards, Sebastian

2 5

[Dovecot] feature question: local delivery from SMTP
by Phil Howard 23 Jan '10

23 Jan '10

Does Dovecot really need a separate MTA for inbound mail? Or can it receive SMTP directly if there is no forwarding to do? What about spam/virus filtering in that case? -- Phil Howard KA9WGN - ka9wgn(a)gmail.com

6 7

[Dovecot] Mail process plans: multiple connections in a process + idle processes
by Timo Sirainen 23 Jan '10

23 Jan '10

Maybe for v2.1: imap and pop3 processes can currently handle multiple connections, but they're assigned pretty much randomly to processes. It would be better if it was possible to: a) Require that a process handles only a specific user's connections b) Require that a process handles only a specific UNIX UID's connections (e.g. if each domain has a separate UID) c) Prefer to put user's connections to same process, but don't require it. To do this, there needs to be a process between imap/pop3-login and imap/pop3. Let's call it imap/pop3-tracker process (or aggregator? or any suggestions?). This process accepts all connections coming from login processes when they've finished authenticating a connection. Internally it figures out if the connection should go to a new or an existing process. It keeps track of username -> { mail_process[], cookie (see idle processes below) } mail_process -> { unix_socket_fd, connection_count } So there's a connection to each mail process. This connection is used to send connection fds for the process to handle. It's also used to receive notifications when a connection is closed. The mail process sockets could also be used to communicate to a specific process. For example doveadm could use this in future to ask what a specific user or process is currently doing, by connecting to imap-tracker, which forwards the request to wanted process(es). The above isn't really anything new, just a more specific plan about what I had been thinking for a long time. A new and more interesting idea is to gather IDLEing imap connections under a few imap-idle processes: When a connection has been IDLEing for a few minutes (or something), and there's no special state in the connection (e.g. CONTEXT=SEARCH searches), the connection could be moved to a separate imap-idle process that simply waits for something to happen. When something does happen, it'll move the connection back to imap process, which restores state and continues. The idea would be to reduce the number of idling imap processes that are wasting memory. The state that needs to be saved and restored is: - selected mailbox name, GUID, UIDVALIDITY (for reliably selecting back the original mailbox, or reliably fail if it's gone) - flag: mailbox is EXAMINEd, not SELECTed - highest seen modseq - UIDs of \Recent messages - SEARCHRES extension: last saved SEARCH result - List of keywords that had been advertised in FLAGS/PERMANENTFLAGS reply to client. Or probably MD5 sum of it would be enough. If MD5 had changed, the list would be re-sent to client. - connection fd - paths that are being monitored with [id]notify/kqueue Connection is moved back when a) new command is received from connection fd, b) one of the monitored files changes. The connections are moved back via imap-tracker process, by sending the saved state along the request. For security there's a per-user security cookie (128 bits of randomness), which is sent to imap processes, and when restoring connection from imap-idle, the request must provide the correct cookie or imap-tracker fails the login. (Normally new post-login imap/pop3 connections can't be created without having authenticated first via dovecot-auth. They verify it.) So when connection comes back, imap process opens the mailbox based on saved information. If this fails for some reason (e.g. mailbox deleted), client gets disconnected. Next Dovecot gets a list of changes to mailbox since the saved modseq, and based on that sends the missing FETCH, EXPUNGE, EXISTS and RECENT events. Again if it somehow fails, the client gets disconnected. At least initially this would only be done for connections that are running IDLE command, because non-IDLE connections are a lot more difficult to restore to their original state. This is mainly because if a message gets expunged, it's still visible to the connection until it issues a command that allows sending EXPUNGE event. To handle that, there would have to be code that allows building a view of mailbox where there are some expunged messages. Also it can be difficult to find out the expunged messages' flags, unless they're also part of the saved state.

1 1

[Dovecot] format of file dict
by Frank Cusack 22 Jan '10

22 Jan '10

For shared (between users) mailboxes, I am using a file dict. plugin { acl_shared_dict = file:/etc/dovecot/acl_shared_dict/shared.db } What is the format of this file? I would like to manage it directly rather than have SETACL update it. I see lines which describe a sharing entry (the format of those looks obvious) but also lines with just a '1'. Do I just need to separate entries by lines with just '1' in them? -frank

2 1