- dovecot - dovecot.org

[Dovecot] current quota in mysql issue
by stefan＠webetc.de 16 Mar '08

16 Mar '08

hi all, i have a problem with storing the current quota in mysql. the configuration of the dictionary quota mostly looks like the example from the wiki. the dirsize quota limit is read correctly from the user_query, but nothing stored with quotadict in the quota table. i wonder that there is nothing like a "dict" in the logfile. did i configured anything wrong? regars stefan logfile from a imap login: Mar 15 14:12:18 mx01 dovecot: IMAP(me(a)mydomain.de): Effective uid=150, gid=8 Mar 15 14:12:18 mx01 dovecot: IMAP(me(a)mydomain.de): Loading modules from directory: /usr/lib/dovecot/modules/imap Mar 15 14:12:18 mx01 dovecot: IMAP(me(a)mydomain.de): Module loaded: /usr/lib/dovecot/modules/imap/lib01_quota_plugin.so Mar 15 14:12:18 mx01 dovecot: IMAP(me(a)mydomain.de): Module loaded: /usr/lib/dovecot/modules/imap/lib02_imap_quota_plugin.so Mar 15 14:12:18 mx01 dovecot: IMAP(me(a)mydomain.de): Namespace: type=private, prefix=, sep=/, inbox=yes, hidden=no, subscriptions=no Mar 15 14:12:18 mx01 dovecot: IMAP(me(a)mydomain.de): maildir: data=/var/vmail/mydomain.de/me/Maildir Mar 15 14:12:18 mx01 dovecot: IMAP(me(a)mydomain.de): maildir: root=/var/vmail/mydomain.de/me/Maildir, index=/var/vmail/mydomain.de/me/Maildir, control=, inbox= Mar 15 14:12:18 mx01 dovecot: IMAP(me(a)mydomain.de): dirsize quota limit = 20000000kB Mar 15 14:12:18 mx01 dovecot: imap-login: Login: user=<me(a)mydomain.de>, method=PLAIN, rip=10.1.1.147, lip=10.1.1.146 here is my current config: package from debian etch (1.0.rc15) ### # file dovecot.conf disable_plaintext_auth = no base_dir = /var/run/dovecot/ protocols = imap imaps pop3 pop3s protocol imap { listen = mx01.int.example.net:143 ssl_listen = mx01.int.example.net:993 } protocol pop3 { listen = mx01.int.example.net:110 ssl_listen = mx01.int.example.net:995 } log_timestamp = .%Y-%m-%d %H:%M:%S . syslog_facility = mail ssl_cert_file = /etc/ssl/example.net/mailserver/mail-cert.pem ssl_key_file = /etc/ssl/example.net/mailserver/mail-key.pem ssl_ca_file = /etc/ssl/example.net/mailserver/ca.pem ssl_parameters_regenerate = 168 verbose_ssl = no mail_extra_groups = mail mail_debug = yes auth_verbose = no auth_debug = no auth_debug_passwords = no first_valid_uid = 150 last_valid_uid = 150 first_valid_gid = 8 last_valid_gid = 8 maildir_copy_with_hardlinks = yes protocol imap { login_executable = /usr/lib/dovecot/imap-login mail_executable = /usr/lib/dovecot/imap imap_client_workarounds = outlook-idle imap_max_line_length = 65536 mail_plugins = quota imap_quota } protocol pop3 { login_executable = /usr/lib/dovecot/pop3-login mail_executable = /usr/lib/dovecot/pop3 mail_plugins = quota } protocol lda { postmaster_address = postmaster(a)mydomain.com sendmail_path = /usr/lib/sendmail auth_socket_path = /var/run/dovecot/auth-master mail_plugins = cmusieve quota } auth_username_translation = %Lu auth default { mechanisms = plain passdb sql { args = /etc/dovecot/dovecot-sql.conf } userdb sql { args = /etc/dovecot/dovecot-sql.conf } user = nobody socket listen { master { path = /var/run/dovecot/auth-master mode = 0660 user = vmail group = mail } client { path = /var/spool/postfix/private/auth mode = 0660 user = postfix group = postfix } } } namespace private { separator = / prefix = inbox = yes } plugin { quota = dict::: proxy::quotadict } dict { quotadict = mysql:/etc/dovecot/dovecot-sql-quota-dict.conf } ### # file dovecot-sql.conf driver = mysql connect = host=mx01.int.example.net dbname=db_mail user=dovecot password=******** default_pass_scheme = PLAIN user_query = select concat('/var/vmail/%d/%n/Maildir') as home, concat('maildir:/var/vmail/%d/%n/Maildir') as mail, 150 as uid, 8 as gid, quota from qry_dovecot where user = '%u' password_query = select user, password, concat('/var/vmail/%d/%n') as userdb_home, concat('maildir:/var/vmail/%d/%n') as userdb_mail, 150 as userdb_uid, 8 as userdb_gid from qry_dovecot where user = '%u' ### # file dovecot-sql-quota-dict.conf connect = host=db01.int.example.net dbname=db_mail user=quota password==******** table = quota select_field = current where_field = path username_field = username (don't wonder about the different database hosts. mx01 is a readonly slave from db01)

1 1

[Dovecot] CONDSTORE + QRESYNC extensions
by Timo Sirainen 16 Mar '08

16 Mar '08

I wrote a mostly-working CONDSTORE support for Dovecot today. You can try it with: hg clone http://hg.dovecot.org/dovecot-condstore/ There are a few problems left: - STORE FLAGS.SILENT should be sending FETCH MODSEQ updates - When SELECTing a mailbox while CONDSTORE hasn't yet been enabled in the session, Dovecot returns a higher HIGHESTMODSEQ than what's used after CONDSTORE is enabled. This is because modseqs aren't tracked until client has told us that it wants them. So Dovecot doesn't waste time trying to figure out the correct HIGHESTMODSEQ.. Something probably should be done about this. - STORE (UNCHANGEDSINCE xx) doesn't work correctly. The full fix would require adding a new transaction log record type containing the modseq, but currently it doesn't even bother refreshing the mailbox state before checking what the modseqs are. The modseq numbers are calculated as: modseq = ((indexid + log_file_seq) << 32) | log_file_offset Where: - indexid = A growing unique index file ID, usually the same as the UNIX timestamp of index file creation. - log_file_seq = dovecot.index.log file sequence. When the .log is rotated to .log.2 the new .log file's sequence is increased (so indexid and log_file_seq uniquely identify a log file) - log_file_offset = offset in dovecot.index.log where the flag change record was written. The numbers are a bit large, but this way if index files are deleted the modseqs always grow (so nothing breaks), because the newly created index file will have a larger indexid. The modseqs are also stored to dovecot.index file in "modseq" extension records. The highest modseq is stored in header extension. QRESYNC would require keeping track of expunges. This could be implemented by just going through records in log files to find out what messages have been expunged since the given modseq (= log seq+offset). Although I'm not sure if it would be better to have a separate expunge log. To allow rarely (e.g. once a week?) syncing clients the .log files may have to be rotated less often, so they would take more space. Also reading through them to find expunges would be slower than reading a separate log having only expunges. But writing a separate expunge log would add extra writes and there's no guarantee that it's ever even read. Other than that QRESYNC should be easy to implement.

2 3

[Dovecot] Virtual mailboxes
by Timo Sirainen 15 Mar '08

15 Mar '08

Virtual mailbox support can be tested with: hg clone http://hg.dovecot.org/dovecot-virtualboxes/ The code is still pretty non-optimized and I've only done some small tests, but at least it appears to work. Messages can't yet saved to virtual mailboxes, but I was thinking that the first configured mailbox could be used as the save destination. Configuration goes like: mail_plugins = virtual namespace private { .. prefix = virtual/ location = virtual:~/virtual-boxes } ~/virtual-boxes then contains a filesystem-layout view of all virtual mailboxes. Virtual mailboxes are configured in "dovecot-virtual" files. For example for virtual/unseen you'd create ~/virtual-boxes/unseen/dovecot-virtual file: INBOX Other mailbox unseen So the format goes like: <mailbox name> [<more mailbox names>] <search rule> [<search rule continues>] [<another mailbox name>] [<another mailbox's search rule>] Currently mailbox name wildcards aren't supported. The search rules are defined in exactly the same way as IMAP SEARCH command. So a few examples: - all - unseen - or keyword $Label1 or keyword $Label2 $Label3 - from domain.org subject hello Each time the mailbox is synchronized the mailbox search is ran for all the configured mailboxes. For simple rules this should be pretty fast, but for e.g. body searches it's a bad idea. I'll fix this in future so that it'll do searches only for newly seen messages. Virtual mailboxes don't have dovecot.index.cache files. All mail accesses (except uid/flag/keyword) go through the real mailbox and its cache file is used/updated. Messages that no longer match the search rule aren't removed until mailbox is either reopened or EXPUNGE command is sent. This allows creating a virtual mailbox with unseen messages, but without the message getting lost immediately after it's opened. Although perhaps it would be useful for a virtual mailbox with only non-deleted messages .. Maybe I should make it configurable separately for each vmailbox. I guess that's all.

5 6

[Dovecot] Thanks to all who responded on Blackberry & IMAP
by Stewart Dean 14 Mar '08

14 Mar '08

Many good suggestions and comments. But while I was trying to do it right (silly me), the brass hat got it working with whatever is on the phone and I am told that everything is fine (until it isn't). Thanks to all who responded -- ==== Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 sdean(a)bard.edu voice: 845-758-7475, fax: 845-758-7035

1 0

[Dovecot] Help! OT: Blackberry IMAP client suggestions/experience needed
by Stewart Dean 14 Mar '08

14 Mar '08

The CFO of our college, a most formidable man, had decided to go Blackberry and Something Functional Must Be Done. We've had some users who we've not supported (and things got better for them when we switched from UWIMAP to Dovecot). BB, of course, has their half-baked sorta-IMAP-compliant client (and we do NOT want the BB Enterprise Server) that persistently keeps grabbing the mailbox and breaking the mailbox lock, causing no end of grief for the secretaries (plural, more than one) would also work with the mailbox. 1) Does anyone have recommendations and experience with a genuine BB IMAP client? Googling shows up LogicMail.... 2) I have been avoiding the plunge in multiple-access mailbox and just let the early BB adapter users thrash but I suppose it is time to do what I can with DC. We are running 1.0.12 with mbox format. Would some kind person <grovel,grovel> tell me where I should start reading plus any warnings. BB DC experience info would be a big help. Our CFO has a legendary temper and I would like to get as much as possible right the first time out........... -- ==== Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 sdean(a)bard.edu voice: 845-758-7475, fax: 845-758-7035

11 21

[Dovecot] Feature request: dovecot -d option to output only/all 'defaults' of current version
by Charles Marcus 14 Mar '08

14 Mar '08

It would be nice to be able to do 'dovecot -d' that outputs only/all of the 'default' values of the currently running version, regardless of what is explicitly set. Postfix currently has this option, and it is very useful for one thing... to compare settings that have been explicitly set to what would be the default values. I used this recently on a postfix install to remove a whole bunch of values that had been explicitly set, and therefore showed up when postconf -n command was issued - but that would have been the default values anyway had they not been explicitly set - thus providing a much cleaner postconf -n output. Thanks Timo for dovecot!! -- Best regards, Charles

1 0

[Dovecot] Hardlinking with Sieve
by Anders 14 Mar '08

14 Mar '08

I have a simple Sieve rule to protect me from accidentally deleting mail: fileinto :copy "backup"; Should I expect this backup to be hardlinked to the ordinary one? Obviously, that would make the backup be almost for free in terms of storage, but currently I do not see any linking. Using Maildir, by the way, and I have not touched the maildir_copy_with_hardlinks setting. TIA, Anders.

2 1

[Dovecot] A message, when moved by multiple clients with same account and same filters, can be duplicated by filters on destination imap folder.
by Diego Liziero 14 Mar '08

14 Mar '08

I'm still collecting user feedback after moving from uw-imap to dovecot development release 1.1.rc3. What said in the subject seems the obvious result of an improper configuration. Office emails are configured and accessed on multiple clients with the same automatic filters, and sometimes the filtered emails get duplicated on the destination folder. The fact is that this was perfectly working with wu-imap (without any duplication/triplication of emails). I'm looking if there is some workaround to keep this client misuse working with dovecot. Could an email have a sort of "primary key" that forbids it's duplication in the same imap folder? Regards, Diego.

3 2

[Dovecot] LDA log_path
by jalal 13 Mar '08

13 Mar '08

Hi all I've just transferred a server from one machine to another. The only remaining dovecot problem I have is that the dovecot deliver program isn't writing a log file. I have this in the conf file: protocol lda { ..... mail_plugins = cmusieve mail_plugin_dir = /usr/lib64/dovecot/lda ..... # setup log files: log_path = /var/log/dovecot-deliver.log } but that file doesn't get written. The dovecot.log and dovecot_info.log files do get written and I've tried creating/touching the deliver log, but that doesn't seem to help at all. If I don't create /var/log/dovecot-deliver.log it doesn't get created by dovecot. If I use 'log_path = /tmp/dovecot-deliver.log' the file will get created but will remain empty. Anyone have an idea on how I can track this down? I like to have logs :) dovecot 1.0.12, CentOS 5/64 bit on a Virtuozzo VPS. TIA

1 0

[Dovecot] imap sent-mail folder sometimes dosen't get updated when used by more than a mailer at the same time.
by Diego Liziero 13 Mar '08

13 Mar '08

Hi, I'm collecting users feedback of latest dovecot 1.1.rc3 development release. Some users are complaining that their sent mails sometimes don't get written to imap Sent-mail folder. It seems that all these users were using multiple istances of imap processes to read their mail (thunderbird+horde-imp, evolution+horde-imp or multiple thunderbird istances). No error message is written in dovecot.log, no user feedback in horde-imp/evolution. Only thunderbird says it can't update Sent folder. Has anyone had similar issues? Diego.

6 10