- dovecot - dovecot.org

[Dovecot] general advice sought
by Alan Brown 12 Sep '11

12 Sep '11

I'd like to hear the thoughts of list members on which type of storage method seems "best" for inboxes and for folders. The filesystem is GFS2 and for various reasons I can't change it. Inboxes - currently Mbox format. Some users have upwards of 5000 messages in there (the largest is about 18k entries) and thanks to attachments some inboxes are 40-200Mb with a few sitting at 2-3Gb. (Suicidal, I know but enforcing rules is politik-laden and getting academics to behave sensibly is like herding cats) Folders: Mdir format. Thanks to GFS2 filesystem limitations(*) I'm currently enforcing a limit of 4000 messages/folder. It'd be nice to have a "better" way of storing these which doesn't drive up backup loads tremendously. The mail spool has around 6 million files in the folders, covering about 400Gb. GFS2 filesystem limitations are painful. While there are no hard limits, It really doesn't cope well with a lot of files in any given directory thanks to limitations in the way that cluster locking is propagated, There are marked slowdowns about 100 files, this becomes awful above 1000 and effectively unusable above about 8000 entries as the entire IO system gets halted momentarily when such directories are opened and the directory may take up to 5 minutes to return a "ls" result. Some users had upwards of 80k files in their mail folders (~40k messages) and accessing these brought the entire system to a halt. If I migrate to other formats (eg mdbox), then it needs to be able to be done on the fly. (Taking the mailservers down for a day won't go down well, even an hour raises howls). Any suggestions?

2 1

[Dovecot] 2.1: imapc LIST problem / usage question
by Lutz Preßler 12 Sep '11

12 Sep '11

----- Forwarded message from SerNet Support Lutz Preßler <support(a)SerNet.DE> ----- From: SerNet Support Lutz Preßler <support(a)SerNet.DE> Subject: 2.1: imapc LIST problem / usage question To: dovecot(a)dovecot.org Date: Fri, 9 Sep 2011 12:00:46 +0200 Organization: SerNet Service Network GmbH Hello, 2.1.alpha1 (latest Debian auto build on amd64) As a test, namespace for gmail integration set up by userdb with userdb_namespace=gmail userdb_namespace/gmail/list=yes userdb_namespace/gmail/subscriptions=no userdb_namespace/gmail/separator=. userdb_namespace/gmail/prefix=INBOX.gmail. userdb_namespace/gmail/location=imapc: userdb_imapc_host=imap.gmail.com userdb_imapc_user=ixxxxx(a)gmail.com userdb_imapc_password=xxxxx userdb_imapc_ssl=imaps userdb_imapc_ssl_ca_dir=/etc/ssl/certs userdb_imapc_port=993 (but having the namespace set up in config file makes no difference). This works in principle. I can e.g. 0 select "INBOX.gmail.[Gmail].Alle Nachrichten" * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 31 EXISTS * 0 RECENT * OK [UNSEEN 1] First unseen. * OK [UIDVALIDITY 1] UIDs valid * OK [UIDNEXT 19689] Predicted next UID * OK [NOMODSEQ] No permanent modsequences 0 OK [READ-WRITE] Select completed. and even use the gmail mailboxes within dovecot-virtual files! But: LIST seems broken: 0 list "" "*" * LIST (\HasChildren) "." "INBOX" * LIST (\HasNoChildren) "." "INBOX.privat" * LIST (\HasChildren) "." "INBOX.test" * LIST (\HasNoChildren) "." "INBOX.test.test2" * LIST (\HasNoChildren) "." "INBOX.Trash" * LIST (\HasNoChildren) "." "INBOX.in2009" [...] * LIST (\Noselect \HasChildren) "." "INBOX.gmail" * LIST (\HasNoChildren) "." "Arbeit" * LIST (\HasNoChildren) "." "Belege" * LIST (\HasNoChildren) "." "Privat" * LIST (\HasNoChildren) "." "Reisen" * LIST (\Noselect \HasNoChildren) "." "[Gmail]" * LIST (\HasNoChildren) "." "[Gmail]/Alle Nachrichten" * LIST (\HasNoChildren) "." "[Gmail]/Entw&-APw-rfe" * LIST (\HasNoChildren) "." "[Gmail]/Gesendet" * LIST (\HasNoChildren) "." "[Gmail]/Markiert" * LIST (\HasNoChildren) "." "[Gmail]/Papierkorb" * LIST (\HasNoChildren) "." "[Gmail]/Spam" * LIST (\HasNoChildren) "." "[Gmail]/Wichtig" * LIST (\HasChildren) "." "INBOX.virtual" * LIST (\HasNoChildren) "." "INBOX.virtual.week" * LIST (\HasNoChildren) "." "INBOX.virtual.sent" * LIST (\HasNoChildren) "." "INBOX.virtual.allin" 0 OK List completed. For the Gmail mailboxe the INBOX.gmail prefix is missing and / is used as separator. Second question: Is there a way to include multiple imapc instances/ namespaces with e.g. different destinations servers? I don't see how because imapc_* parameters seem to be global (now), but it would be a very useful feature. Greetings, Lutz

2 5

[Dovecot] Read-only mbox files
by Tim Bishop 12 Sep '11

12 Sep '11

Hi all, I'm using Dovecot 1.2.16 (I can upgrade to 2.0 if need be) and I'm having trouble stopping Dovecot from modifying mbox files. The setup is that my main namespace points at my Maildir mail folders. In addition to this I have a second namespace that points at some old archived mbox folders. I rarely need to access these folders, but when I do Dovecot modifies the files (adding UID headers, etc). What I'd like to do is make it so that Dovecot can't change these files. I thought there might be a setting to mark a mail_location as read-only, but I can't find anything like that. I've looked at ACLs too, but they seem to be more about user access that what Dovecot can do to files. I could just do this at the filesystem level, but I'd feel a bit happier about working with Dovecot rather than trying to work around it. Does anyone have any suggestions? Thank you for reading. Tim. -- Tim Bishop http://www.bishnet.net/tim/ PGP Key: 0x5AE7D984

2 1

[Dovecot] setacl on complete mailbox
by Tobias Hachmer 12 Sep '11

12 Sep '11

Hi List, how can I grant a user full control on another mailbox (the complete mailbox with all folder and subfolders). With the setacl command I could do this but first I have to list all folders and then I have to do one setacl command for each folder. Is there a command to this in one line? Also for new created folders? Greetz, Tobias

2 1

[Dovecot] NO Unknown subscription namespace.
by mailing lists 12 Sep '11

12 Sep '11

Hello, what this message means? "NO Unknown subscription namespace." the shared namespace is visible and I can fetch messages from it, but subscription fails with the above message. (user002 is sharing the folder named docs-users002 with user user001) # telnet localhost 143 Trying ::1... Connected to localhost. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN] Dovecot ready. . login user001 secret . OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS ACL RIGHTS=texk] Logged in . list "shared." "*" * LIST (\Noselect \HasChildren) "." "shared.user002" . OK List completed. . list "shared.user002." "*" * LIST (\HasNoChildren) "." "shared.user002.docs-user002" . OK List completed. . list "shared.user002.docs-user002." "*" . OK List completed. . select "shared.user002.docs-user002" * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft)] Flags permitted. * 2 EXISTS * 0 RECENT * OK [UIDVALIDITY 1315765265] UIDs valid * OK [UIDNEXT 3] Predicted next UID * OK [HIGHESTMODSEQ 3] Highest . OK [READ-WRITE] Select completed. . fetch 1 all * 1 FETCH (FLAGS (\Seen) INTERNALDATE "24-Nov-2009 11:58:34 +0100" RFC822.SIZE 3734 ENVELOPE ("Tue, 24 Nov 2009 07:58:34 -0400 (AST)" "Thank you for registering for the Red Hat Virtual Experience" (("support(a)virtualevents365.com" NIL "support" "virtualevents365.com")) (("support(a)virtualevents365.com" NIL "support" "virtualevents365.com")) (("support(a)virtualevents365.com" NIL "support" "virtualevents365.com")) (("damocles-(a)hotmail.com" NIL "damocles-" "hotmail.com")) NIL NIL NIL "<6955854.2731259063914762.JavaMail.root(a)app130.vs.int.cgsinc.ca>")) . OK Fetch completed. . subscribe "shared.user002.docs-user002" . NO Unknown subscription namespace. . logout * BYE Logging out . OK Logout completed. Connection closed by foreign host. /----------------/ namespace { inbox = yes location = prefix = INBOX. separator = . subscriptions = yes } namespace { list = yes location = maildir:/var/virtual-maildir/%%n prefix = shared.%%n. separator = . subscriptions = no type = shared }

2 1

[Dovecot] Quota fs (ignore mount)
by Peter Ignatov 12 Sep '11

12 Sep '11

>> Well .. I'm not entirely sure if the current behavior is good or not, but what you need to do to get it working is to add two quota roots. One for /home/pit/mail (i.e. without specifying mount=) and another for the INBOX's /var/spool/mail. > Don't work... :-( After I installed version 2.0.13 - mount is correct: # doveadm -Dv quota get -u pit doveadm(pit): Debug: auth input: pit system_groups_user=pit uid=500 gid=500 home=/home/pit doveadm(pit): Debug: Effective uid=500, gid=500, home=/home/pit doveadm(pit): Debug: Quota root: name=INBOX backend=fs args=mount=/var/spool/mail doveadm(pit): Debug: Quota rule: root=INBOX mailbox=* bytes=19922944 messages=0 doveadm(pit): Debug: Quota warning: bytes=3984588 (20%) messages=0 reverse=no command=quota-warning 20 pit doveadm(pit): Debug: fs: root=/home/pit/mail, index=, control=, inbox=/var/spool/mail/pit doveadm(pit): Debug: fs quota add mailbox dir = /var/spool/mail doveadm(pit): Debug: fs quota block device = /dev/mapper/mpath1p1 doveadm(pit): Debug: fs quota mount point = /var/spool/mail doveadm(pit): Debug: fs quota mount type = ext2 Quota name Type Value Limit % INBOX STORAGE 4824 19456 24 But now don't work script quota-warning.sh: #!/bin/sh PERCENT=$1 USER=$2 cat << EOF | /usr/libexec/dovecot/dovecot-lda -d $USER -o "plugin/quota=fs:INBOX:mount=/var/spool/mail:noenforcing" From: postmaster(a)domen.org Subject: quota warning Your mailbox is now $PERCENT% full. EOF #dovecot -n # 2.0.13: /etc/dovecot/dovecot.conf # OS: Linux 2.6.18-274.3.1.el5.asp121 x86_64 Red Hat Enterprise Linux Server release 5.6 (Tikanga) disable_plaintext_auth = no listen = * log_path = /var/log/dovecot.log mail_debug = yes mail_location = mbox:~/mail:INBOX=/var/spool/mail/%u mail_plugins = quota mail_privileged_group = mail mbox_write_locks = fcntl passdb { driver = pam } plugin { quota = fs:INBOX:mount=/var/spool/mail quota_rule = *:storage=19456 quota_warning = storage=20%% quota-warning 20 %u } protocols = pop3 service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { mode = 0666 } user = root } ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { driver = passwd } verbose_proctitle = yes protocol lda { mail_plugins = quota } protocol imap { mail_plugins = quota imap_quota } protocol pop3 { mail_plugins = quota }

1 0

[Dovecot] Sieve envelope :detail "to" "xxx" does not deliver to fileinto destination
by Aleksandar Lazic 11 Sep '11

11 Sep '11

Dear Listmember. I try to migrate from my current courier-mta setup fo postfix dovecot setup. I use the following scirpt to filter to the destination mailbox. ### /var/vmail/none.at/al/sieve/lists.sieve require ["fileinto", "subaddress", "envelope" ]; if envelope :detail "to" "pdnsusers" { fileinto "Lists.pdnsusers"; } ### postfix/master ### dovecot unix - n n - - pipe flags=DRhu user=vmail:vmail argv=/usr/lib/dovecot/deliver -f ${sender} -d ${user}@${nexthop} -a ${original_recipient} # flags=DRhu user=vmail:vmail argv=/usr/lib/dovecot/deliver -f ${sender} -d ${user}@${nexthop} -m ${extension} -a ${original_recipient} ### Log ### Sep 11 21:47:48 lvps46-163-74-15 postfix/smtpd[7788]: connect from Sep 11 21:48:12 lvps46-163-74-15 postfix/smtpd[7788]: 495EF9FECAF9: Sep 11 21:48:27 lvps46-163-74-15 postfix/cleanup[7795]: 495EF9FECAF9: message-id=<> Sep 11 21:48:27 lvps46-163-74-15 postfix/qmgr[7785]: 495EF9FECAF9: from=<al(a)bitrace.net>, size=268, nrcpt=1 (queue active) Sep 11 21:48:27 lvps46-163-74-15 dovecot: lda: Debug: Loading modules from directory: /usr/lib/dovecot/modules Sep 11 21:48:27 lvps46-163-74-15 dovecot: lda: Debug: Module loaded: /usr/lib/dovecot/modules/lib90_sieve_plugin.so Sep 11 21:48:27 lvps46-163-74-15 dovecot: lda: Debug: auth input: al(a)none.at uid=5000 gid=5000 home=/var/vmail/none.at/al Sep 11 21:48:27 lvps46-163-74-15 dovecot: lda(al(a)none.at): Debug: Effective uid=5000, gid=5000, home=/var/vmail/none.at/al Sep 11 21:48:27 lvps46-163-74-15 dovecot: lda(al(a)none.at): Debug: maildir: root exists (/var/vmail/none.at/al/Maildir) Sep 11 21:48:27 lvps46-163-74-15 dovecot: lda(al(a)none.at): Debug: maildir++: root=/var/vmail/none.at/al/Maildir, index=, control=, inbox=/var/vmail/none.at/al/Maildir, alt= Sep 11 21:48:27 lvps46-163-74-15 dovecot: lda(al(a)none.at): Debug: none: root=, index=, control=, inbox=, alt= Sep 11 21:48:27 lvps46-163-74-15 dovecot: lda(al(a)none.at): Debug: Destination address: al-pdnsuser(a)none.at (source: -a parameter) Sep 11 21:48:27 lvps46-163-74-15 dovecot: lda(al(a)none.at): Debug: sieve: using sieve path for user's script: /var/vmail/none.at/al/.dovecot.sieve Sep 11 21:48:27 lvps46-163-74-15 dovecot: lda(al(a)none.at): Debug: sieve: opening script /var/vmail/none.at/al/.dovecot.sieve Sep 11 21:48:27 lvps46-163-74-15 dovecot: lda(al(a)none.at): Debug: sieve: script binary /var/vmail/none.at/al/.dovecot.svbin successfully loaded Sep 11 21:48:27 lvps46-163-74-15 dovecot: lda(al(a)none.at): Debug: sieve: binary save: not saving binary /var/vmail/none.at/al/.dovecot.svbin, because it is already stored Sep 11 21:48:27 lvps46-163-74-15 dovecot: lda(al(a)none.at): Debug: sieve: executing script from /var/vmail/none.at/al/.dovecot.svbin Sep 11 21:48:27 lvps46-163-74-15 dovecot: lda(al(a)none.at): sieve: msgid=unspecified: stored mail into mailbox 'INBOX' Sep 11 21:48:27 lvps46-163-74-15 postfix/pipe[7797]: 495EF9FECAF9: to=<al-pdnsuser(a)none.at>, relay=dovecot, delay=28, delays=28/0.02/0/0.22, dsn=2.0.0, status=sent (delivered via dovecot service) Sep 11 21:48:27 lvps46-163-74-15 postfix/qmgr[7785]: 495EF9FECAF9: removed Sep 11 21:48:28 lvps46-163-74-15 postfix/smtpd[7788]: disconnect from xxx ### dovecot -n => attachment dovecot_-n Due to the fact that I'am new to dovecot and sieve I hope anybody can help the solve this issue. My target is to filter the mailinglists based on address extention or is it better to filter on to header? Is there a 'log' or 'print' command in the sieve filter or how can I write a message to the log file? Many thanks for your help BR Aleks

1 0

[Dovecot] Filter Mail to Pipe to External Program
by Andriy Moraru 11 Sep '11

11 Sep '11

Hello all! How do I add a filter that would pipe the mail message (containing a certain "To:" field) to some other program? I am running Dovecot 1.0.15. Thanks!

2 1

[Dovecot] sieve and pattern matching
by David Newman 11 Sep '11

11 Sep '11

Dovecot 1.2.17 What is the sieve syntax for matching text somewhere in a subject line, but not at the beginning of the line? Background: Multiple machines each send a message with the subject of "<hostname> operations run" to a mail server. The <hostname> value is different for each sender. This sieve filter does not match any message: require ["fileinto","envelope","reject","vacation","imapflags","relational","co mparator-i;ascii-numeric","regex","notify"]; require ["body", "fileinto", "regex"]; # currentops reports if header :contains "Subject" ".* operations run" { fileinto "currentops"; stop; } However, a similar filter will match if, and only if, the string occurs at the beginning of the subject line. The various sieve help pages I've found suggest that pattern matching anywhere in the subject line should work, not just at the beginning. How to achieve this? TIA dn

2 2

[Dovecot] Annoying "feature" in dovecot/pidgeonhole - include depth limitation
by Mihai Moldovan 11 Sep '11

11 Sep '11

Hi all, I'm using dovecot 2.0.14 build on Debian. The maintainers obviously patch the dovecot source so that it uses the pidgeonhole sieve system. Today I ran into a very annoying issue: I created several sieve scripts and interlinked via the include command, only to find dovecot spewing this error message at me: SWREG Newsletter: line 14: error: cannot nest includes deeper than 10 levels. As far as I could see this limitation is hardcoded to a depth of 10 and can only be changed at compile time. Why is it in place? I understand that you CAN create loops via the include command and limiting the inclusion depth is a way to circumvent loops - but ten is a very low value and the fact that you can't change it via a config file or sorta is even worse. My "fix" so far has been ignoring this, i.e. not returning false. I'm pretty sure that's not the best way to do it but it seems to be working so far. I'd really like to hear your opinion on this issue. Best regards, Mihai **

3 3