- dovecot - dovecot.org

Dovecot plugin and Push Mail
by Steffan Cline 08 Oct '15

08 Oct '15

I’m posting this here and will in a couple other places to see if anyone has any experience with this and knows what I can do. My setup is CentOS 6 with postfix, procmail and dovecot administered via Virtualmin. Postfix of course receives the email. Procmail uses it’s hooks to run the email through spam assassin and clamd. After than procmail hands it off to dovecot/deliver to drop it in the user’s mail box. I use the following plugin for dovecot with the daemon to provide Apple push mail for iPhones. https://github.com/st3fan/dovecot-xaps-daemon https://github.com/st3fan/dovecot-xaps-plugin For the most part, this works awesome but have run into a bit of a race issue with notification of mail in a particular instance. On my computer I use Outlook for Mac which says it supports IDLE but is broken. When an email comes in, I ALWAYS get the notification via the dovecpt plugin for a push since Outlook is checking IMAP every 2 minutes. On a buddy’s setup, he uses Apple Mail which supports IDLE that actually works. When his email client is connected from his laptop, it does actually maintain a persistent connection and NEVER receives a notification from the dovecot plugin because I’m guessing dovecot/deliver sees that the email was received by the desktop client. I’m not sure how to make the plugin ALWAYS give a push. Is it a dovecot config? A bug in the plugin? I’m not sure. Suggestions? Thank you, Steffan Cline 602-793-0014

1 1

how to treat synonymous domain names as one
by Nikolai Krot 08 Oct '15

08 Oct '15

Hallo List Users, I am curious if there is a way to rewrite domain name to another domain name. My goal is to provide authentication and mailboxes for the synonymous domains in a single source while keeping all other domains separate. I have setup: auth_username_format = %Lu mail_location = /var/vmail/%d/%u/Maildir in userdb/passdb (passwd-file): /etc/dovecot/%d/users Say I have two synonymous domain names my-domain-1.com my-long-named-domain-1.com I want both to resolve to my-domain-1.com when %d variable is used in Dovecot configs, so that passwd-file is /etc/dovecot/my-domain-1.com/users mailbox is /var/vmail/my-domain-1.com/user/Maildir while keeping other domains unchanged my-other-domain-2.com should resolve to: passwd-file is /etc/dovecot/my-other-domain-2.com/users mailbox is /var/vmail/my-other-domain-2.com/user/Maildir thanks, Nikolai

2 2

bug report: dovecot-imapd core dump
by Tamas Papp 07 Oct '15

07 Oct '15

Typical log message: Oct 7 11:39:36 hostname dovecot: imap(username): Fatal: master: service(imap): child 14864 killed with signal 11 (core dumped) What triggers the problem: User moving multiple messages to a subfolder via IMAP (from another account, on another server, client: Thunderbird). Moving single messages either does not trigger the problem, or with much lower probability (could not reproduce). Version: $ dpkg -l 'dovecot*' Desired=Unknown/Install/Remove/Purge/Hold | Status=Not/Inst/Conf-files/Unpacked/halF-conf/Half-inst/trig-aWait/Trig-pend |/ Err?=(none)/Reinst-required (Status,Err: uppercase=bad) ||/ Name Version Architecture Description +++-=====================================-=======================-=======================-================================================================================ un dovecot-common <none> <none> (no description available) ii dovecot-core 1:2.2.9-1ubuntu5 amd64 secure POP3/IMAP server - core files un dovecot-gssapi <none> <none> (no description available) ii dovecot-imapd 1:2.2.9-1ubuntu5 amd64 secure POP3/IMAP server - IMAP daemon un dovecot-ldap <none> <none> (no description available) un dovecot-lmtpd <none> <none> (no description available) un dovecot-managesieved <none> <none> (no description available) un dovecot-mysql <none> <none> (no description available) un dovecot-pgsql <none> <none> (no description available) un dovecot-pop3d <none> <none> (no description available) un dovecot-sieve <none> <none> (no description available) un dovecot-solr <none> <none> (no description available) un dovecot-sqlite <none> <none> (no description available) tamas@szob:~$ lsb_release -a No LSB modules are available. Distributor ID: Ubuntu Description: Ubuntu 15.04 Release: 15.04 Codename: vivid Also tried 2.2.18 from Ubuntu wiley, same results. Backtrace (I am not sure this is useful, extraced core from Ubuntu's Apport): (gdb) bt full #0 0x00007f404e58e3b6 in mail_index_keywords_unref () from /usr/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #1 0x00007f404ea254ad in _start () No symbol table info available. Any help would be appreciated, I am happy to provide more info if necessary. Tamas

1 0

separate passdb for unix_listener
by Damon 07 Oct '15

07 Oct '15

I want to use a separate passed for the unix_listener (postfix smtp-auth) so i can limit access to the smtp server by user/domain using the postfixadmin database. I want to let users access map to receive email but not be able to send. Any ideas? Thanks Damon

3 2

Dovecot don't erase mails from storage.
by Carlos Baptista 05 Oct '15

05 Oct '15

Hi, I have a dovecot installation with a strange problem: all the mails stays in storage after deleted from users mailbox. If user logon after the mails are deleted, they don't receive them any more, but the m.## files aren’t deleted. This happens with pop3 (default for this installation) and/or imap. The dovecot is installed along postfix with mysql and multi-domains support Here's the dovecot conf ######################## dovecot -n # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-042stab111.11 x86_64 Debian 7.9 auth_mechanisms = plain login first_valid_uid = 111 last_valid_uid = 111 lda_mailbox_autocreate = yes mail_debug = yes mail_gid = vmail mail_plugins = " quota" mail_privileged_group = vmail mail_uid = vmail namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } plugin { mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size quota = dict:User quota::file:%h/mail/dovecot-quota quota_rule = *:storage=500MB } postmaster_address = sysadmin(a)inside.pt protocols = " imap pop3" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } ssl_cert = </etc/dovecot/dovecot.pem ssl_key = </etc/dovecot/private/dovecot.pem userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } protocol lmtp { mail_plugins = " quota sieve" } protocol lda { mail_plugins = " quota" } protocol imap { mail_plugins = " quota imap_quota" } ############################### Here is an example of log file with debug Oct 02 17:50:38 auth: Debug: auth client connected (pid=11621) Oct 02 17:50:38 auth: Debug: client in: AUTH 1 PLAIN service=pop3 secured session=Xiif9iEhmgBV80+u lip=xxx.xxx.xxx.xxx rip=xxx.xxx.xxx.xxx lport=995 rport=53914 resp=<hidden> Oct 02 17:50:38 auth-worker(11561): Debug: sql(carla.franjoso(a)xxxxxxx.xx,xxx.xxx.xxx.xxx): query: /* dovecot-sql.conf password_query */ SELECT '/var/vmail/xxxxxx.xx/carla.franjoso' AS userdb_home, 'mdbox:~/mail' AS userdb_mail, 111 AS userdb_uid, 114 AS userdb_gid, CONCAT('*:bytes=', CAST(m.quota AS CHAR)) AS userdb_quota_rule, CONCAT(m.local_part, '@', d.name) AS user, m.password AS password FROM mailboxes AS m LEFT JOIN domains AS d ON m.domain_id = d.id WHERE m.local_part = 'carla.franjoso' AND d.name = 'xxxxxxx.xx' AND m.is_active AND d.is_active Oct 02 17:50:38 auth: Debug: client out: OK 1 user=carla.franjoso(a)xxxxxx.xx Oct 02 17:50:38 auth: Debug: master in: REQUEST 3537633281 11621 1 41ef179d4a37a603ce38c43fab768f78 Oct 02 17:50:38 auth: Debug: prefetch(carla.franjoso(a)xxxxxx.xx,xxx.xxx.xxx.xxx,<Xiif9iEhmgBV80+u>): success Oct 02 17:50:38 auth: Debug: master out: USER 3537633281 carla.franjoso(a)xxxxx.xx home=/var/vmail/xxxxxxxx/carla.franjoso mail=mdbox:~/mail uid=1 11 gid=114 quota_rule=*:bytes=104857600 Oct 02 17:50:38 pop3: Debug: Loading modules from directory: /usr/lib/dovecot/modules Oct 02 17:50:38 pop3: Debug: Module loaded: /usr/lib/dovecot/modules/lib10_quota_plugin.so Oct 02 17:50:38 pop3: Debug: Added userdb setting: mail=mdbox:~/mail Oct 02 17:50:38 pop3: Debug: Added userdb setting: plugin/quota_rule=*:bytes=104857600 Oct 02 17:50:38 pop3(carla.franjoso(a)xxxxx.xx): Debug: Effective uid=111, gid=114, home=/var/vmail/xxxxxxxx.xx/carla.franjoso Oct 02 17:50:38 pop3(carla.franjoso(a)xxxxx.xx): Debug: Quota root: name=User quota backend=dict args=:file:/var/vmail/xxxxxxxxx.xx/carla.franjoso/mail/dovecot-quota Oct 02 17:50:38 pop3(carla.franjoso(a)xxxxx.xx): Debug: Quota rule: root=User quota mailbox=* bytes=104857600 messages=0 Oct 02 17:50:38 pop3(carla.franjoso(a)xxxxx.xx): Debug: dict quota: user=carla.franjoso(a)xxxx.xx, uri=file:/var/vmail/xxxxxx,xx/carla.franjoso/mail/dovecot-quot a, noenforcing=0 Oct 02 17:50:38 pop3(carla.franjoso(a)xxxxx.xx): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes locatio n=mdbox:~/mail Oct 02 17:50:38 pop3(carla.franjoso(a)xxxxx.xx): Debug: fs: root=/var/vmail/ assis.pt/carla.franjoso/mail, index=, control=, inbox=, alt= Oct 02 17:50:38 pop3(carla.franjoso(a)xxxxx.xx): Debug: Namespace : Using permissions from /var/vmail/xxxxxxx.xx/carla.franjoso/mail: mode=0700 gid=-1 What is "gid=-1" at the end of the log? Can anyone help? Thanks Carlos Baptista

2 1

Compiling v2.2.19 - internal compiler error: segmentation fault (test-timing.c -> int64_t issue?)
by Guest-X 05 Oct '15

05 Oct '15

Hi, I am trying to compile a 64-build of the latest dovecot v2.2.19 on my SuSE Linux Enterprise Server 10 (x64) system. I've run ./configure with two parameters, the --prefix one and the --with-ssldir one. During the make stage, I am getting the following 'internal compiler error' message : --------------------------------------------- [...] gcc -DHAVE_CONFIG_H -I. -I../.. -I../../src/lib-test -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict-aliasing=2 -MT test_lib-test-timing.o -MD -MP -MF .deps/test_lib-test-timing.Tpo -c -o test_lib-test-timing.o `test -f 'test-timing.c' || echo './'`test-timing.c test-timing.c: In function ‘test_timing’: test-timing.c:48: internal compiler error: Segmentation fault Please submit a full bug report, with preprocessed source if appropriate. See <URL:http://bugs.opensuse.org> for instructions. make[4]: *** [test_lib-test-timing.o] Error 1 ---------------------------------------------- The lines that seem to be causing the problem are the following ( from src/lib/test-timing.c ) : 45: void test_timing(void) 46: { 47: static int64_t test_input1[] = { 48: 20, 19, 18, 1, 2, 3, 4, 5, 6, 7, 8, 49: 9, 10, 11, 12, 13, 14, 15, 16, 17, -1 50: }; This is the first time that any version of dovecot (the v2.2 branch) couldn't compile on my system, and I've literally compiled every single release up to now. My gcc version is a very old one (4.1.2) : ---------------------------------------------- Using built-in specs. Target: x86_64-suse-linux Configured with: ../configure --enable-threads=posix --prefix=/usr --with-local-prefix=/usr/local --infodir=/usr/share/info --mandir=/usr/share/man --libdir=/usr/lib64 --libexecdir=/usr/lib64 --enable-languages=c,c++,objc,fortran,obj-c++,java,ada --enable-checking=release --with-gxx-include-dir=/usr/include/c++/4.1.2 --enable-ssp --disable-libssp --disable-libgcj --with-slibdir=/lib64 --with-system-zlib --enable-shared --enable-__cxa_atexit --enable-libstdcxx-allocator=new --program-suffix= --enable-version-specific-runtime-libs --without-system-libunwind --with-cpu=generic --host=x86_64-suse-linux Thread model: posix gcc version 4.1.2 20070115 (prerelease) (SUSE Linux) ----------------------------------------------- Don't know whether this helps, but I've noticed that if I change the int64_t to uint64_t in the following lines of the same file : 61: static int64_t *test_inputs[] = { 62: test_input1, test_input2, test_input3 63: }; ..then compilation finishes without errors, but I'm not certain what the practical consequences of this action might be. Can somebody help me please ? Thank you for your time.

1 0

Released Pigeonhole v0.4.9 for Dovecot v2.2.19
by Stephan Bosch 05 Oct '15

05 Oct '15

Hello Dovecot users, Here is the definitive 0.4.9 release. Only a few minor fixes were done since RC1. Changelog v0.4.9: * Properly implemented checking of ABI version for Sieve interpreter plugins, much like Dovecot itself does for plugins. This will prevent plugin ABI mismatches. + Implemented a vnd.dovecot.environment extension. This builds upon the standard environment extension and adds a few more environment items, such as username and default mailbox. It also creates a variables namespace so that environment items can be accessed directly. I am still thinking about more environment items that can be added. + Sieve extprograms plugin: Made line endings of the input passed to the external programs configurable. This can be configured separately for each of the three extensions. + ManageSieve: Implemented proxy XCLIENT support. This allows the proxy to pass client information to the back-end. - ManageSieve: Fixed an assert failure occurring when a client disconnects during the GETSCRIPT command. - doveadm sieve plugin: Fixed incorrect initialization of mail user. This caused a few memory leaks. - sieve-filter command line tool: Fixed handling of failure-related implicit keep when there is an explicit default destination folder. This caused message duplication. - lib-sieve: Fixed bug in RFC5322 header folding. Words longer than the optimal line length caused empty lines in the output, which would break the resulting message header. This surfaced in References: headers with very long message IDs. The release is available as follows: http://pigeonhole.dovecot.org/releases/2.2/dovecot-2.2-pigeonhole-0.4.9.tar… http://pigeonhole.dovecot.org/releases/2.2/dovecot-2.2-pigeonhole-0.4.9.tar… Refer to http://pigeonhole.dovecot.org and the Dovecot v2.x wiki for more information. Have fun testing this new release and don't hesitate to notify me when there are any problems. Regards, -- Stephan Bosch stephan(a)rename-it.nl

1 0

v2.2.19 released
by Timo Sirainen 03 Oct '15

03 Oct '15

http://dovecot.org/releases/2.2/dovecot-2.2.19.tar.gz http://dovecot.org/releases/2.2/dovecot-2.2.19.tar.gz.sig * pop3_deleted_flag has been broken since v2.2.10. Using it would cause buffer overflows, which could be exploitable. However, this bug would have become visible quite soon after users had deleted some POP3 mails, because the pop3 processes would have started crashing all the time even in normal use. * "doveadm director flush" command has a changed meaning now: It safely moves users to their wanted backends, instead of simply forgetting the mapping entirely and leaving the existing connections untouched. Use -F parameter to get the original unsafe behavior. + Added imap-hibernate processes (see imap_hibernate_timeout setting). IDLEing IMAP connections can be hibernated, which saves memory. + Optimized tracking mailboxes' vsizes (= sum of all messages' sizes). If mailbox_list_index=yes, it's also stored in there. This makes it very efficient to look up vsizes for all mailboxes. + Added a quota "count" backend, which uses the mailbox vsizes to get the current quota usage. It requires using the new quota_vsizes=yes setting, which tracks the messages' "virtual sizes" rather than "physical sizes". Their distiction is minor and mostly irrelevant nowadays (if mail sizes should be counted with LF or CRLF newlines). + "doveadm director up/down" commands added. The monitoring script should be using these commands instead of changing the vhost count. This allows admin to manually disable a server by changing the vhost count to 0 without the monitoring script changing it back. + Added support for HAProxy protocol: http://wiki2.dovecot.org/HAProxy + Added push-notification plugin framework, which can be used to easily implement push notifications to various backends. Implemented "ox" backend for notifying Open-Xchange via HTTP/json. + imap_logout_format supports more variables now, e.g. number of deleted messages. + pop3: Added pop3_delete_type setting (related to pop3_deleted_flag). + plugin { fts_enforced=yes } setting now fails body searches unless it can be done via the full text search engine. + Added %{passdb:*} and %{userdb:*} variables to various places + auth: Added ":protected" suffix for passdb and userdb fields. If used, the field doesn't overwrite an existing field. + IMAP/POP3 proxy: If a backend server dies, avoid client reconnection spikes by slowly disconnecting clients over time. This is enabled by setting login_proxy_max_disconnect_delay=secs passdb extra field. + imap: Added new read-only METADATA entries: /private/specialuse, /shared/comment, /shared/admin + imap: If client disconnects in the middle of a command, log how long the command had been running. - mdbox: Rebuilding could have caused message's reference count to overflow the 16bit number in some situations, causing problems when trying to expunge the duplicates. - Various search fixes (fts, solr, tika, lib-charset, indexer) - Various virtual plugin fixes - Various fixes and optimizations to dsync, imapc and pop3-migration - imap: Various RFC compliancy and crash fixes to NOTIFY

3 6

Re: dovecot quota service for postfix
by Michael Peter 03 Oct '15

03 Oct '15

Hello, Thanks for the clarifications plugin { quota = maildir:User quota quota_rule = *:storage=1G quota_grace = 10%% # 10% is the default quota_status_success = DUNNO quota_status_nouser = DUNNO quota_status_overquota = "552 5.2.2 Mailbox is full" } The above configurations is my default for all users. but my mail system is using mbox format and not maildir.... so what should i change in the above configuration to use mbox INSTEAD of maildir ?? Also for the quota paramater, can i use (myquota = maildir:User quota) INSTEAD of (quota = maildir:User quota) ?? or it must "QUOTA =" and not any thing else to work ? same for quota_rule parameter, should i add (_rule) after quota to work ??? can i add for example qouta_restriction INSTEAD of quota_rules ?? i am asking this question to better understand how dovecot work.. also last question when i use the following command to get quota for existing system user called michael , it gives me an error as follow, so why dovecot is not able to get the quota for the system users? doveadm quota get -u michael doveadm(michael): Fatal: User doesn't exist Many thanks >> Incase user is underquota, then the email is returned back to postfix for >> processing and delivering email to user mbox, incase user has no sufficient quota then dovecot will inform postfix to reject email. Please confirm if what i mentioned above is correct and that i >> understand >> correctly how dove-cot policy works with postfix. > Your understanding is mor or less correct, except that postfix never passes the email itself to dovecot when performing the quota check. It simply sends a message to the quota policy service asking if the recipient is over quota. If the recipient is over quota, dovecot provides postfix with the response configured in quota_status_overquota. If the recipient is under quota, dovecot provides postfix with the response configured in quota_status_success. If dovecot does not know the user, it provides postfix with the response configured in > quota_status_nouser. >> Kindly check my configuration below and advise the missing parts to add... > I don't see anything wrong with your configuration on first appraisal, but if it isn't working I would recommend you perform the following troubleshooting steps. > 1. Verify the user's mailbox is over or under quota in alignment with your expectations > - `doveadm quota -u $RECIPIENT` > 2. Test that the quota service provides the response you expect it to > - `echo "recipient=$RECIPIENT" | nc -q1 localhost 12340` > On 09/26/2015 01:40 AM, Michael Peter wrote: >> Hello, >> I am trying to use dovecot quota service for postfix in order set quota for some users. >> i configure postfix policy service to ask dovecot if user quota is sufficient to accept the email or not. >> (dovecot in this case acts only as policy server to postfix as it only ACCEPT/REJECT email according to user quota, but it is not used to deliver >> email , because postfix will deliver the email to user mailbox) Incase user is underquota, then the email is returned back to postfix for >> processing and delivering email to user mbox, incase user has no sufficient quota then dovecot will inform postfix to reject email. Please confirm if what i mentioned above is correct and that i >> understand >> correctly how dove-cot policy works with postfix. >> Kindly check my configuration below and advise the missing parts to add... >> plugin { >> quota_rule = *:storage=1G >> quota_grace = 10%% >> # 10% is the default >> quota_status_success = DUNNO >> quota_status_nouser = DUNNO >> quota_status_overquota = "552 5.2.2 Mailbox is full" >> ... >> } >> The above configurations is for all users which is not override by quota >> rules in userdb's extra fields in my password file below. >> Is the above configuration missing some thing ? i am using mbox format for >> emails storage. do you i have to add (quota= SOMETHING) before >> (quote_rule >> = *:storage=1G) and what to do add to make dovecot support mbox quota? smtpd_recipient_restrictions = >> check_policy_service inet:SERVER-HIDDEN-FOR-SECRUITY.com:12340 >> service quota-status { >> executable = quota-status -p postfix >> inet_listener { >> port = 12340 >> } >> client_limit = 1 >> } >> now in order to configure dovecot specific quota for user named (user1) i >> use passwd-file as follow >> user1:{plain}pass3:1002:1002::/home/user1::userdb_mail=mbox:~/mymail:INBOX=/var/mail/user1 userdb_quota_rule=*:bytes=300M >> All other users except users1 should have 1GB storage according to this configuration. which user1 will only have 300MB >> Please advise what is my configuration is missing and if i need to add any >> thing to run without issues. >> Many thanks >> Michael Peter

1 0

imap_logout_format improvements / ideas
by Timo Sirainen 03 Oct '15

03 Oct '15

http://hg.dovecot.org/dovecot-2.2/rev/93bba97afb2a http://hg.dovecot.org/dovecot-2.2/rev/e0a17714f0c9 So all in all, you can now add to imap_logout_format: # %i - total number of bytes read from client # %o - total number of bytes sent to client # %{fetch_hdr_count} - Number of mails with mail header data sent to client # %{fetch_hdr_bytes} - Number of bytes with mail header data sent to client # %{fetch_body_count} - Number of mails with mail body data sent to client # %{fetch_body_bytes} - Number of bytes with mail body data sent to client # %{deleted} - Number of mails where client added \Deleted flag # %{expunged} - Number of mails that client expunged # %{trashed} - Number of mails that client copied/moved to the # special_use=\Trash mailbox. Any thoughts on what else would be useful? I was also thinking about separating (deletes and) expunges from Trash vs non-Trash, but I'm not sure how useful that would be (and what would it be called?) It's also a bit annoying that a copy+expunge to a Trash will return expunged=1 trashed=1, but a move to Trash (via IMAP MOVE) will return expunged=0 trashed=1. But trying to fix that would be too much trouble.

4 4