- dovecot - dovecot.org

[Dovecot] Doveadm expunge purge optimize
by Thiago Henrique 30 Sep '10

30 Sep '10

Hello, I'm testing Dovecot 2.0.3. I plan to use Dovecot with 10 thousands domains per server (~50 thousands accounts). I use 'mdbox' as mailbox format. So, I have two cron jobs before backup: ################################################################################ 01 22 * * * root nice -n 19 /usr/bin/doveadm expunge -A mailbox SPAM BEFORE 60d 01 00 * * * root nice -n 19 /usr/bin/doveadm purge -A 01 02 * * * root nice -n 19 My_Backup_aplication ################################################################################ Each doveadm command walks through the whole file system. Is there a way to run the two operations into a single walk? Does anyone have a suggestion that helps optimize this? Thank you in advance. Best Regards My confs : ################################################################################ root@server:# dovecot -n # 2.0.3 (02a9cf90ad02): /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-24-server x86_64 Ubuntu 10.04.1 LTS auth_cache_negative_ttl = 3600 s auth_cache_size = 33554432 auth_master_user_separator = * auth_mechanisms = plain login auth_username_chars = abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@= auth_worker_max_count = 10 disable_plaintext_auth = no listen = server.com login_greeting = Dovecot server ! mail_gid = dovemail mail_plugins = $mail_plugins quota mail_uid = dovemail managesieve_sieve_capability = fileinto reject envelope vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include imapflags notify mmap_disable = yes passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } passdb { args = /etc/dovecot/dovecot-sql-master.conf.ext driver = sql master = yes pass = yes } plugin { autocreate = SPAM autosubscribe = SPAM quota = dict:User quota::file:/var/lib/imap/user/%2.256RHn/% n/dovecot-quota quota_rule = *:storage=1GB sieve = /var/lib/imap/sieve/%2.256RHn/%n/phpscript.script sieve_dir = /var/lib/imap/sieve/%2.256RHn/%n sieve_extensions = comparator-i;ascii-numeric copy envelope fileinto imapflags include notify regex reject relational subaddress vacation sieve_max_script_size = 512KB sieve_quota_max_scripts = 2 } protocols = imap pop3 lmtp sieve service auth-worker { user = $default_internal_user } service auth { process_limit = 1 process_min_avail = 1 } service imap-login { inet_listener imap { address = server.com port = 143 } } service imap { process_limit = 1024 process_min_avail = 10 } service lmtp { inet_listener { address = server.com port = 2003 } process_limit = 256 process_min_avail = 10 } service managesieve-login { inet_listener sieve { address = server.com port = 4190 } inet_listener sieve_deprecated { address = server.com port = 2000 } } service managesieve { process_limit = 20 process_min_avail = 10 } service pop3-login { inet_listener pop3 { address = server.com port = 110 } } service pop3 { process_limit = 256 process_min_avail = 10 } ssl = no userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } verbose_proctitle = yes protocol imap { imap_idle_notify_interval = 120 s imap_max_line_length = 65536 mail_max_userip_connections = 10 mail_plugins = $mail_plugins quota imap_quota autocreate } protocol lmtp { mail_plugins = $mail_plugins sieve quota autocreate } protocol sieve { mail_plugins = $mail_plugins sieve managesieve_implementation_string = Dovecot ManageSieve Pigeonhole server managesieve_logout_format = bytes=%i/%o managesieve_max_line_length = 65536 managesieve_sieve_capability = comparator-i;ascii-numeric copy envelope fileinto imapflags include notify regex reject relational subaddress vacation } protocol pop3 { mail_plugins = $mail_plugins quota autocreate } root@server:# ################################################################################ -- []'s Thiago Henrique Network Administration Digirati Networks K8 Networks

2 1

[Dovecot] Problem with dovecot-acl
by dss 30 Sep '10

30 Sep '10

I have a problem with dovecot-acl. Some of our users need to use the same Mailbox with all folders: Inbox (with subfolders), Outbox, Send and Deleted, (some users need in full righs, some - readonly) so I choosed Symlinking mailboxes and tried to use dovecot-acl file. cat dovecot-acl: user=t1 lrwsti user=operolegs lrwsti user=operantona lrwsti user=operdss lr User operdss have lrwsti rights in this shared mailbox unstead of lr! But if I comment out other users in the dovecot-acl: #user=t1 lrwsti #user=operolegs lrwsti #user=operantona lrwsti user=operdss lr User operdss have lr rights. Whats wrong? It seems, that dovecot-acl is working only for one user. How can I fix it? === Here is my configs. imap:~# dovecot -n # 1.2.13: /etc/dovecot/dovecot.conf # OS: Linux 2.6.26-2-686 i686 Debian 5.0.6 log_timestamp: %Y-%m-%d %H:%M:%S disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login mail_privileged_group: mail mbox_write_locks: fcntl dotlock mail_plugins: acl imap_acl auth default: passdb: driver: pam userdb: driver: passwd plugin: acl: vfile ---- imap:~# ls -l /home/t1/Maildir lrwxrwxrwx 1 root root 21 2010-09-22 16:03 /home/t1/Maildir -> /var/mail/720/Maildir imap:~# ls -l /home/operolegs/Maildir lrwxrwxrwx 1 root root 21 2010-09-23 16:00 /home/operolegs/Maildir -> /var/mail/720/Maildir imap:~# ls -l /home/operantona/Maildir lrwxrwxrwx 1 root root 21 2010-09-23 16:00 /home/operantona/Maildir -> /var/mail/720/Maildir imap:~# ls -l /home/operdss/Maildir lrwxrwxrwx 1 root root 16 2010-09-28 16:32 /home/operdss/Maildir -> /home/t1/Maildir --- imap:/home/t1/Maildir# ls -l total 112 drwxrws--- 2 t1 mshare 4096 2010-09-27 10:46 cur -rw-rw---- 1 t1 mshare 99 2010-09-29 15:56 dovecot-acl -rw-rw---- 1 operdss mshare 312 2010-09-29 16:43 dovecot-acl-list -rw-rw---- 1 operolegs mshare 1144 2010-09-24 12:16 dovecot.index -rw-rw---- 1 t1 mshare 41984 2010-09-28 16:39 dovecot.index.cache -rw-rw---- 1 t1 mshare 25068 2010-09-28 16:38 dovecot.index.log -rw-rw---- 1 operantona mshare 17 2010-09-23 16:41 dovecot-keywords -rw-rw---- 1 operantona mshare 1941 2010-09-27 10:46 dovecot-uidlist -rw-rw---- 1 t1 mshare 8 2010-09-29 16:43 dovecot-uidvalidity -rw-rw---- 1 t1 mshare 0 2010-09-22 10:54 dovecot-uidvalidity.4c99a82f drwxrws--- 2 t1 mshare 4096 2010-09-27 10:46 new -rw-rw---- 1 operdss mshare 327 2010-09-29 16:43 subscriptions drwxrws--- 2 t1 mshare 4096 2010-09-27 10:46 tmp ----- imap:/home/t1/Maildir# dpkg --list|grep dovecot ii dovecot-common 1:1.2.13-1~bpo50+1 secure mail server that supports mbox and maildir mailboxes ii dovecot-imapd 1:1.2.13-1~bpo50+1 secure IMAP server that supports mbox and maildir mailboxes dovecot packages - from backports --- Linux: Debian Lenny up2date

2 1

[Dovecot] problems and dovecot & manegesieve
by Jose Luis Faria 29 Sep '10

29 Sep '10

Hello, my server is working with dovecot-2.0.2+dovecot-2.0-pigeonhole-0.2.0. but if activate managesieve, is not listening in 4190! any help? I setup this: ---------------------------------- ## ## ManageSieve specific settings ## # Service definitions service managesieve-login { inet_listener sieve { port = 4190 } #inet_listener sieve_deprecated { # port = 2000 #} # Number of connections to handle before starting a new process. Typically # the only useful values are 0 (unlimited) or 1. 1 is more secure, but 0 # is faster. <doc/wiki/LoginProcess.txt> #service_count = 1 # Number of processes to always keep waiting for more connections. #process_min_avail = 0 # If you set service_count=0, you probably need to grow this. #vsz_limit = 64M } service managesieve { # Max. number of ManageSieve processes (connections) #process_count = 1024 } # Service configuration protocol sieve { # Maximum ManageSieve command line length in bytes. ManageSieve usually does # not involve overly long command lines, so this setting will not normally need # adjustment #managesieve_max_line_length = 65536 # Maximum number of ManageSieve connections allowed for a user from each IP address. # NOTE: The username is compared case-sensitively. #mail_max_userip_connections = 10 # Space separated list of plugins to load (none known to be useful so far). Do NOT # try to load IMAP plugins here. #mail_plugins = # MANAGESIEVE logout format string: # %i - total number of bytes read from client # %o - total number of bytes sent to client #managesieve_logout_format = bytes=%i/%o # To fool ManageSieve clients that are focused on CMU's timesieved you can specify # the IMPLEMENTATION capability that the dovecot reports to clients. # For example: 'Cyrus timsieved v2.2.13' #managesieve_implementation_string = Dovecot Pigeonhole # Explicitly specify the SIEVE and NOTIFY capability reported by the server before # login. If left unassigned these will be reported dynamically according to what # the Sieve interpreter supports by default (after login this may differ depending # on the user). #managesieve_sieve_capability = #managesieve_notify_capability = # The maximum number of compile errors that are returned to the client upon script # upload or script verification. #managesieve_max_compile_errors = 5 # Refer to 90-sieve.conf for script quota configuration and configuration of # Sieve execution limits. } -- :) cumprimentos ---------------------- José Luís Faria Network Eng./Administrador de Sistemas Departamento de Informática Universidade do Minho Braga, Portugal

2 3

Re: [Dovecot] Sieve during read or login?
by Rick Romero 29 Sep '10

29 Sep '10

Sent from my iPhone On Sep 28, 2010, at 6:43 PM, Stephan Bosch <stephan(a)rename-it.nl> wrote: > Op 28-9-2010 23:02, Rick Romero schreef: >> >> I was wondering if anyone thought of applying filters to email post >> delivery, pre-read. >> >> Basically the idea would be to head off Spam, Malware or Phishing >> for already delivered email. Malware would probably be the least >> likely target, as (knock on wood) user workstations would be >> updated, but a targeted phishing scam would not create a public >> signature that would be downloaded, yet an admin may have a regex >> that could be used to remove that email before it left the server. >> >> I used to run find and grep on my Maildirs, but that's no longer >> practical. I think maybe an 'on connect', or 'on read' might be an >> option. >> > I am not sure I understand the benefit of filtering things like spam > and scams post-delivery as opposed to filtering on-delivery as it is > now. > > Please explain further. If you assume the user retrieves their mail soon after delivery, it doesn't make sense. :) I think the biggest benefit to my service is the catching is phisjing scams aimed at my users. I usually get a copy (dolts), and I will block the reply to addresses, but it would be better to remove it cpmpletely. Another possible use might be URL scanning for updated malware sites and labeling it accordingly -but modifying an email might a little excessive for this function. Rick

1 0

[Dovecot] Sieve during read or login?
by Rick Romero 29 Sep '10

29 Sep '10

I was wondering if anyone thought of applying filters to email post delivery, pre-read. Basically the idea would be to head off Spam, Malware or Phishing for already delivered email. Malware would probably be the least likely target, as (knock on wood) user workstations would be updated, but a targeted phishing scam would not create a public signature that would be downloaded, yet an admin may have a regex that could be used to remove that email before it left the server. I used to run find and grep on my Maildirs, but that's no longer practical. I think maybe an 'on connect', or 'on read' might be an option. Thoughts? Rick

2 1

[Dovecot] auth: Fatal: Unknown passdb driver 'mysql'
by Vaidas Jablonskis 29 Sep '10

29 Sep '10

Hi People, I am setting up a new dovecot server for testing first prior production upgrade from 1.2.x to 2.0.x. I used the RPMs from ATrpms: dovecot-2.0.0-1_117.el5.x86_64.rpm The errors I am getting: ----------------------------- Aug 27 18:15:29 testbox dovecot: auth: Debug: Loading modules from directory: /usr/lib64/dovecot/auth Aug 27 18:15:29 testbox dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libauthdb_ldap.so Aug 27 18:15:29 testbox dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_mysql.so Aug 27 18:15:29 testbox dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_pgsql.so Aug 27 18:15:29 testbox dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_sqlite.so Aug 27 18:15:29 testbox dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libmech_gssapi.so Aug 27 18:15:29 testbox dovecot: auth: Fatal: Unknown passdb driver 'mysql' Aug 27 18:15:29 testbox dovecot: master: Error: service(auth): command startup failed, throttling Aug 27 18:15:59 testbox dovecot: imap-login: Error: Timeout waiting for handshake from auth server. my pid=4323, input bytes=0 ------------------------------ # dovecot --build-options Build options: ioloop=epoll notify=inotify ipv6 openssl io_block_size=8192 Mail storages: cydir maildir mbox mdbox raw sdbox shared SQL driver plugins: mysql postgresql sqlite Passdb: checkpassword ldap pam passwd passwd-file shadow sql Userdb: checkpassword ldap(plugin) nss passwd prefetch passwd-file sql # ls -l /usr/lib64/dovecot/*sql* -rwxr-xr-x 1 root root 15704 Aug 20 16:51 /usr/lib64/dovecot/libdriver_mysql.so -rwxr-xr-x 1 root root 21464 Aug 20 16:51 /usr/lib64/dovecot/libdriver_pgsql.so -rwxr-xr-x 1 root root 11848 Aug 20 16:51 /usr/lib64/dovecot/libdriver_sqlite.so It is clearly seen that mysql drivers are installed and being loaded during dovecot startup. ----------------------- /etc/dovecot/conf.d/auth-sql.conf.ext passdb { driver = mysql args = /etc/dovecot/dovecot-sql.conf.ext } userdb { driver = prefetch } userdb { driver = mysql args = /etc/dovecot/dovecot-sql.conf.ext } ------------------------- Any ideas what else could be wrong? Thanks, Vaidas

2 2

[Dovecot] Doubts with email copying
by Alex Baule 28 Sep '10

28 Sep '10

Hi Timo..... Trying to resolve my problem with the references in copying a email between Folders (when i move from inbox -> sent for example), i got some doubt. My plugin create a new ostream in v->save_begin, and i start a function from my library to create the reference, but when the email is been copying, the new email don't pass in this function, and i don't start my function to create a reference. My doubt is, if copying a email is a "copy + paste", why the s->save_begin it's not called ? I search in the iostream-internal.h to rewrite some "open stream" but the only one available is the close. There is a place to call my function every time that one ostream is opened, including the copy ?

1 0

[Dovecot] v2.0.4 released
by Timo Sirainen 28 Sep '10

28 Sep '10

http://dovecot.org/releases/2.0/dovecot-2.0.4.tar.gz http://dovecot.org/releases/2.0/dovecot-2.0.4.tar.gz.sig multi-dbox users: Be careful about the INDEX change. Maildir users: I hope v2.0 is now finally stable. * multi-dbox: If :INDEX=path is specified, keep storage/dovecot.map.index* files also in the index path rather than in the main storage directory. WARNING: if you specified :INDEX= with earlier mdbox installation, you must now manually move the storage indexes to the expected directory! Otherwise Dovecot won't see them and will rebuild the indexes, possibly unexpunging some mails. - Maildir: Copying messages with hard links sometimes caused the source maildir's entire tmp/ directory to be renamed to destination maildir as if it were a message. - Maildir: v2.0.3 broke expunging copied messages sometimes - Maildir: INBOX whose tmp/ directory was lost couldn't be opened - single-dbox: Messages weren't copied with hard links - vpopmail support is hopefully working again. - dsync: POP3 UIDLs weren't copied with Maildir - dict file: Fixed fd leak (showed up easily with LMTP + quota)

8 17

[Dovecot] dsync is seriously broken when syncing maildir and mdbox
by interfaSys sàrl 28 Sep '10

28 Sep '10

Hello, I thought mdbox was production ready, but it seems to me that (in 2.0.4) it's quite broken. 1) The documentation only running this to convert from maildir to mdbox: *dsync mirror maildir:~/Maildir* but based on my experience and on posts on the mailing list, it's not enough. A namespace has to be defined and it's not clear whether / or . should be used as a separator. I tried with a dot first and the INBOX folders were empty. It seemed to work better with / 2) After having defined a namespace, running dsync again makes it spit tons of errors Error: Can't rename mailbox INBOX_28c716242e53784cc9030100d3b51c5c to INBOX: Target mailbox already exists Error: Mailboxes don't have unique GUIDs: 4536121fce3ca14cf8c40000d3b51c5c is shared by INBOX and INBOX_4536121fce3ca14cf8c40c Info: INBOX/spam: only in dest Info: INBOX: only in source Each run will create more folders with GUIDs attached to the folder name. 3) Deleting these folders after having moved their content to the properly named ones seems impossible. I see a long list of folders in the bin and when I hit "Empty bin" in Thunderbird, nothing happens. There must must be a caching issue, because if I click on the folder, I'm told these folders don't exist. If I dsync again, I still have conflicts, with folders that are in the bin and then with new copies of INBOX Error: Mailboxes don't have unique GUIDs: 4536121fce3ca14cf8c40000d3b51c5c is shared by INBOX and Trash/INBOX_4536121fce3ca14c Error: Mailboxes don't have unique GUIDs: 4536121fce3ca14cf8c40000d3b51c5c is shared by INBOX_4536121fce3ca14cf8c40000d3b51c5c At that stage, the newly created INBOXes cannot be deleted because they already exist in the bin. I renamed those folders, moved them to the bin, emptied the bin And it's still not fixed when running dsync Error: Mailboxes don't have unique GUIDs: 1a6f000a9751784c12030100d3b51c5c is shared by Sent and Trash/5 Info: Trash_INBOX_bb088f159336a14cc6bf0000d3b51c5c: only in dest Error: Can't rename mailbox INBOX to Trash_3: Renaming INBOX isn't supported. Why can't folder properly be deleted? I never had that problem with Maildir. Cheers, Olivier

2 3

[Dovecot] Command to get proxy connection count
by Brad Davidson 28 Sep '10

28 Sep '10

Timo, I'm trying to get a count of active proxy sessions on a given Director. I can of course enable verbose_proctitle and parse the 'N connections' string out of ps output or /proc/pid/cmdline. Is there a better way to do that, perhaps with doveadm? Goes back to needing a command for proxy and director ring status, I guess. -Brad

2 1