December 2012 - dovecot

[Dovecot] Missing Emails
by David Morsberger 28 Dec '12

28 Dec '12

I reported a problem with disappearing emails on my Apple Mountain Lion server. Not sure if it ever stopped but I do know it is happening again. Help!!!! This is a company email server. They live and die by their emails. Emails show up in inbox and then disappear. Anyone know why our emails are disappearing? I see a reference to it in the dovecot.index.cache file (last item) ^@^@^@Q^@^@^@0^@^@^@^@^@^@^@Message-ID: <1356660917.93498.YahooMailNeo(a)web163605.mail.gq1.yahoo.com> ^@^@^@^M^@^@^@7^@^@^@4^@^@^@^@^@^@^@Subject: Funeral program for Eileen Zbignewich ^@^E^@^@^@^@^@^@^@^F^@^@^@Z^@^@^@7^@^@^@^@^@^@^@Content-Type: multipart/mixed; boundary="-1578497492-264297203-1356660917=:93498" ^@^@^G^@^@^@4^@^@^@1^@^@^@^@^@^@^@Date: Thu, 27 Dec 2012 18:15:17 -0800 (PST) ^@^@^@^@^@^@^@^K^@^@^@^@^@^@^@^L^@^@^@^@^@^@^@^N^@^@^@8^@^@^@5^@^@^@^@^@^@^@To: "info(a)mmpcrofton.com" <info(a)mmpcrofton.com> I searched the filesystem and cannot find them. bash-3.2# find . -exec grep Zbignewich {} \; -print Dec 04 00:30:26 master: Info: Dovecot v2.0.19apple1 starting up (core dumps disabled) I believe I turned on all debug and info messages. Here is what I see in postfix log: Dec 27 21:15:39 mini.mmpcrofton.com postfix/smtpd[20081]: 3CE164F4420: client=pascal.junkemailfilter.com[184.105.182.188] Dec 27 21:15:39 mini.mmpcrofton.com postfix/cleanup[20086]: 3CE164F4420: message-id=<1356660917.93498.YahooMailNeo(a)web163605.mail.gq1.yahoo.com> Dec 27 21:15:40 mini.mmpcrofton.com postfix/qmgr[95]: 3CE164F4420: from=<hagermary(a)yahoo.com>, size=307659, nrcpt=1 (queue active) Dec 27 21:15:40 mini.mmpcrofton.com postfix/smtpd[20081]: disconnect from pascal.junkemailfilter.com[184.105.182.188] Dec 27 21:15:40 mini.mmpcrofton.com postfix/smtpd[20106]: connect from localhost[127.0.0.1] Dec 27 21:15:40 mini.mmpcrofton.com postfix/smtpd[20106]: 5168E4F4447: client=localhost[127.0.0.1] Dec 27 21:15:40 mini.mmpcrofton.com postfix/cleanup[20086]: 5168E4F4447: message-id=<1356660917.93498.YahooMailNeo(a)web163605.mail.gq1.yahoo.com> Dec 27 21:15:40 mini.mmpcrofton.com postfix/smtpd[20106]: disconnect from localhost[127.0.0.1] Dec 27 21:15:40 mini.mmpcrofton.com postfix/qmgr[95]: 5168E4F4447: from=<hagermary(a)yahoo.com>, size=308299, nrcpt=1 (queue active) Dec 27 21:15:40 mini.mmpcrofton.com postfix/smtp[20102]: 3CE164F4420: to=<info(a)mmpcrofton.com>, relay=127.0.0.1[127.0.0.1]:10024, delay=1.1, delays=0.85/0.01/0/0.27, dsn=2.0.0, status=sent (250 2.0.0 from MTA(smtp:[127.0.0.1]:10025): 250 2.0.0 Ok: queued as 5168E4F4447) Dec 27 21:15:40 mini.mmpcrofton.com postfix/qmgr[95]: 3CE164F4420: removed Dec 27 21:15:40 mini.mmpcrofton.com postfix/pipe[20110]: 5168E4F4447: to=<graphicartist(a)mini.mmpcrofton.com>, orig_to=<info(a)mmpcrofton.com>, relay=dovecot, delay=0.39, delays=0.03/0.01/0/0.35, dsn=2.0.0, status=sent (delivered via dovecot service) Dec 27 21:15:41 mini.mmpcrofton.com postfix/qmgr[95]: 5168E4F4447: removed dovecot_info.log Dec 27 21:15:40 lda(pid 20111 user graphicartist): Info: msgid=<1356660917.93498.YahooMailNeo(a)web163605.mail.gq1.yahoo.com>: saved mail to INBOX Dec 27 21:15:40 lda(pid 20111 user graphicartist): Info: push-notify: push notification enabled Dec 27 21:15:40 lda(pid 20111 user graphicartist): Info: push-notify: notify: graphicartist Dec 27 21:15:40 lda(pid 20111 user graphicartist): Info: push-notify: data sent: 1680 dovecot_debug.log Dec 27 21:15:40 lda: Debug: Loading modules from directory: /Applications/Server.app/Contents/ServerRoot/usr/lib/dovecot Dec 27 21:15:40 lda: Debug: Module loaded: /Applications/Server.app/Contents/ServerRoot/usr/lib/dovecot/lib10_quota_plugin.so Dec 27 21:15:40 lda: Debug: Module loaded: /Applications/Server.app/Contents/ServerRoot/usr/lib/dovecot/lib20_fts_plugin.so Dec 27 21:15:40 lda: Debug: Module loaded: /Applications/Server.app/Contents/ServerRoot/usr/lib/dovecot/lib20_push_notify_plugin.so Dec 27 21:15:40 lda: Debug: Module loaded: /Applications/Server.app/Contents/ServerRoot/usr/lib/dovecot/lib20_zlib_plugin.so Dec 27 21:15:40 lda: Debug: Module loaded: /Applications/Server.app/Contents/ServerRoot/usr/lib/dovecot/lib21_fts_sk_plugin.so Dec 27 21:15:40 lda: Debug: Module loaded: /Applications/Server.app/Contents/ServerRoot/usr/lib/dovecot/lib90_sieve_plugin.so Dec 27 21:15:40 lda: Debug: auth input: graphicartist uid=214 gid=6 quota=maildir:User quota:noenforcing quota_rule=*:storage=0 mail=maildir:/Library/Server/Mail/Data/mail/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 mail_location=maildir:/Library/Server/Mail/Data/mail/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 sieve=/Library/Server/Mail/Data/rules/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6/dovecot.sieve sieve_dir=/Library/Server/Mail/Data/rules/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 sieve_storage=/Library/Server/Mail/Data/rules/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 Dec 27 21:15:40 lda: Debug: Added userdb setting: plugin/quota=maildir:User quota:noenforcing Dec 27 21:15:40 lda: Debug: Added userdb setting: plugin/quota_rule=*:storage=0 Dec 27 21:15:40 lda: Debug: Added userdb setting: mail=maildir:/Library/Server/Mail/Data/mail/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 Dec 27 21:15:40 lda: Debug: Added userdb setting: mail_location=maildir:/Library/Server/Mail/Data/mail/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 Dec 27 21:15:40 lda: Debug: Added userdb setting: plugin/sieve=/Library/Server/Mail/Data/rules/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6/dovecot.sieve Dec 27 21:15:40 lda: Debug: Added userdb setting: plugin/sieve_dir=/Library/Server/Mail/Data/rules/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 Dec 27 21:15:40 lda: Debug: Added userdb setting: plugin/sieve_storage=/Library/Server/Mail/Data/rules/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: Effective uid=214, gid=6, home= Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: Quota root: name=User quota backend=maildir args=noenforcing Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: Quota rule: root=User quota mailbox=* bytes=0 messages=0 Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: Quota warning: bytes=0 (100%) messages=0 reverse=no command=quota-exceeded graphicartist Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: maildir++: root=/Library/Server/Mail/Data/mail/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6, index=, control=, inbox=/Library/Server/Mail/Data/mail/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6, alt= Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: Quota root: name=User quota backend=maildir args= Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: Quota warning: bytes=0 (100%) messages=0 reverse=no command=quota-exceeded graphicartist Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: none: root=, index=, control=, inbox=, alt= Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: fts_sk: Disabled with in-memory indexes Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: fts: No backends enabled by the fts setting Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: Destination address: graphicartist(a)mini.mmpcrofton.com (source: user@hostname) Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: auth input: graphicartist uid=214 gid=6 quota=maildir:User quota:noenforcing quota_rule=*:storage=0 mail=maildir:/Library/Server/Mail/Data/mail/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 mail_location=maildir:/Library/Server/Mail/Data/mail/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 sieve=/Library/Server/Mail/Data/rules/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6/dovecot.sieve sieve_dir=/Library/Server/Mail/Data/rules/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 sieve_storage=/Library/Server/Mail/Data/rules/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: sieve: include: sieve_global_dir is not set; it is currently not possible to include `:global' scripts. Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: sieve: user's script path /Library/Server/Mail/Data/rules/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6/dovecot.sieve doesn't exist (using global script path in stead) Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: sieve: user has no valid personal script Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: sieve: no scripts to execute: reverting to default delivery. Anyone know why our emails are disappearing?

2 2

[Dovecot] Using -module flag on sieve libs
by Dimitri 26 Dec '12

26 Dec '12

Some modern distros (Mageia, Mandriva) use -no-undefined as a default linker flag for building software. However, undefined symbols are OK if the binary being linked is a plugin. To detect plugins, build system looks for presence of "-module" libtool flag in makefiles. There are two libraries in Pigeonhole that couldn't be linked with -no-undefined: src/lib-sieve/plugins/mailbox/libsieve_ext_mailbox.la src/lib-sieve/libdovecot-sieve.la These modules do contain undefined symbols, but they are not linked against library that provides them. It would be good if corresponding makefiles contained "-module" flags, so that build system could selectively turn off that -no-undefined linker flag. Please see proposed patch (attached). Thanks, Dimitri Mageia Linux packager

2 4

Re: [Dovecot] Dovecot 1.2.7 and Roundcube LIST-EXTENDED commands
by Aristidis Fesarlis 25 Dec '12

25 Dec '12

Anyone?

1 0

[Dovecot] Postfix/mysql/dovecot - Understanding password encryption
by Robert Moskowitz 25 Dec '12

25 Dec '12

I am switching from a fedora/postfix/mysql/couriermail/squirrelmail to Centos/.../dovecot/roundcubemail and adding postfixadmin to the mix. My tutorial before was an earlier version (on F14) of: http://www.howtoforge.com/virtual-users-and-domains-with-postfix-courier-my… Now I am using http://www.campworld.net/thewiki/pmwiki.php/LinuxServersCentOS/Cent6VirtMai… to get me started. I am up to roundcubemail setup and am stumbling to understand what the author here is doing with encrypted passwords, so felt it was time to delve deeper into this. My old setup uses mysql-crypt for the password. MYSQL_CRYPT_PWFIELD password and users could be added to the table with: INSERT INTO `users` (`email`, `password`, `quota`) VALUES ('sales(a)example.com', ENCRYPT('secret'), 10485760); But where this was all simple and no choices, I get to figure out what to do with my dovecot setup. Some of the 'secret' is hinted at in postfixadmin's config.inc.php: // Encrypt // In what way do you want the passwords to be crypted? // md5crypt = internal postfix admin md5 // md5 = md5 sum of the password // system = whatever you have set as your PHP system default // cleartext = clear text passwords (ouch!) // mysql_encrypt = useful for PAM integration // authlib = support for courier-authlib style passwords // dovecot:CRYPT-METHOD = use dovecotpw -s 'CRYPT-METHOD'. Example: dovecot:CRAM-MD5 $CONF['encrypt'] = 'md5crypt'; Where is there information on the different choices and how to choose. Is it as 'simple' as setting up postfixadmin to control the password encryption format then 'inform' dovecot in the dovecot-mysql.conf with default_pass_scheme = MD5-CRYPT Thank you for any pointers.

2 3

[Dovecot] Undeserved permissions error with g+s folder permissions
by tlhackque 24 Dec '12

24 Dec '12

I have a (mbox/IMAP) directory under my mail directory with these permissions: drwxrws--- 4 tlhackque mail 4096 Dec 1 10:34 Vendors/ It contains a subdirectory: -rw-rw---- 1 thlackque mail 84805345 Dec 1 10:34 Vendors/AVendor If I try to rename the AVendor folder (client is Thunderbird 17.0), I get this error: Unable to rename across conflicting directory permisssions If I chmod g-s Vendors, the RENAME command succeeds. I shouldn't have to do this... Version and configuration information: dovecot --version 2.1.10 # OS: Linux 2.6.22.14-72.fc6 i686 Fedora Core release 6 (Zod) first_valid_gid = 4000 first_valid_uid = 4000 hostname = example.net login_greeting = Dovecot ready. Unauthorized access is prohibited. mail_access_groups = mail mail_location = mbox:~/mail:INBOX=/var/mail/%n mail_privileged_group = mail namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / } passdb { driver = pam } plugin { autocreate = Trash autocreate2 = Train As Spam autocreate3 = Train As Ham autocreate4 = Train As Forgotten autosubscribe = Trash autosubscribe2 = Train As Spam autosubscribe3 = Train As Ham autosubscribe4 = Train As Forgotten } service imap-login { inet_listener imap { address = imap.v4.example.net imap.v6.example.net port = 143 } inet_listener imaps { address = imap.v4.example.net imap.v6.example.net port = 993 ssl = yes } } service pop3-login { inet_listener pop3 { address = pop.v4.example.net pop.v6.example.net port = 110 } inet_listener pop3s { address = pop.v4.example.net pop.v6.example.net port = 995 ssl = yes } } ssl_ca = </etc/pki/tls/certs/example_net_ca-cert-crl.pem ssl_cert = </etc/pki/tls/certs/servers-example-net.pem ssl_key = </etc/pki/tls/private/servers-example-net.pmk userdb { driver = passwd } protocol imap { imap_client_workarounds = tb-extra-mailbox-sep tb-lsub-flags mail_plugins = " autocreate" } protocol pop3 { mail_plugins = " autocreate" pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_uidl_format = %08Xu%08Xv } -- This communication may not represent my employer's views, if any, on the matters discussed.

3 5

[Dovecot] Understanding Sockets
by Tim Smith 22 Dec '12

22 Dec '12

Hi, Just trying to consolidate my knowledge of Dovecot and I want to understand various things rather than just key out lines of config in dovecot.conf with the hope of it working. What I wanted to clarify is my understanding the "socket listen" section of the config file. From my limited understanding, this section details how other processes can access the userdb defined in Dovecot. The master socket is used for "internal" processes which is mainly dovecot-lda so that when Dovecot receives mail it knows where to deliver it and client is defined for "external" processes, for example Postfix who would use the info to determine if a user existed. Would you say this is a fair (albeit) dumbed down!!) synopsis of sockets and their purpose? Thanks in advance! Tim

6 10

[Dovecot] [Antispam]rev 990a43d44c73 breaks compilation for dovecot 2.1
by Simone Caruso 22 Dec '12

22 Dec '12

Dovecot 2.1.12 and antispam-plugin 0319240072d8 bash-# make Entering directory src. signature-log.c: In function 'signature_log_transaction_begin': signature-log.c:122: error: too many arguments to function 'dict_init' Failed to compile signature-log.c (plugin)! make[3]: *** [signature-log.plugin.o] Error 1 make[2]: *** [all] Error 2 make[1]: *** [src] Error 2 make: *** [all] Error 2 Reversing the deff the builing process ends with no error. -- Simone Caruso IT Consultant +39 349 65 90 805

1 0

Re: [Dovecot] migration to dovecot pop3
by Joseph Tam 21 Dec '12

21 Dec '12

Rajesh M writes: > i am planning to migrate from qmail pop3 to dovecot pop3 > > the number of users on the server is large over 5000 > ... > also data volume is large - over 3.5 tb -- ie many users several 1000s of > emails in their inbox If you stay on the list, you might find some people here whose mail metrics are several orders of magnitude larger than this. > 1) will the migration cause all the emails on the server to re-download > ... > 4) has anybody migrated from qmail pop3 to dovecot pop3 successfully > without emails being downloaded again A proper migration will avoid this. Google is your friend http://lmgtfy.com/q=POP+qmail+to+dovecot+migration The top hits provide exactly what you're looking for. > 2) can dovecot be configured to allow only one download at a time - pop3 > locking with time out setting that can be customized > > 3) can dovecot pop3 be configured so that it will allow download of emails > only of the last say 15 days ie even if the same pop3 user is configure on > another machine it will download only messages of the last 15 days I can't answer this, but if this is an attempt to prevent mass download, the answer to 1+4 makes these questions irrelevant. Joseph Tam <jtam.home(a)gmail.com>

3 2

Re: [Dovecot] dovecot Digest, Vol 116, Issue 38
by Douglas Mortensen 21 Dec '12

21 Dec '12

Austinator, What's the JLG maintenance schedule? I should show you how to setup a CW Service Template & then you can have it as a weekly ticket. :-) - Doug Mortensen Impala Networks Sent from my Windows Phone ________________________________ From: dovecot-request(a)dovecot.org<mailto:dovecot-request@dovecot.org> Sent: ‎12/‎21/‎2012 1:44 AM To: dovecot(a)dovecot.org<mailto:dovecot@dovecot.org> Subject: dovecot Digest, Vol 116, Issue 38 Send dovecot mailing list submissions to dovecot(a)dovecot.org To subscribe or unsubscribe via the World Wide Web, visit http://dovecot.org/cgi-bin/mailman/listinfo/dovecot or, via email, send a message with subject or body 'help' to dovecot-request(a)dovecot.org You can reach the person managing the list at dovecot-owner(a)dovecot.org When replying, please edit your Subject line so it is more specific than "Re: Contents of dovecot digest..."

1 0

[Dovecot] Non-dovecot user looking for feedback
by Chris Ross 21 Dec '12

21 Dec '12

I've been using UW-IMAPd for neigh on forever (at least since 2001). But, as it's basically stalled, and I'm about to update the hardware that is my mail server, I thought it was time to review existing open-source IMAP servers. Dovecot is the top three in my looking. The other of the top three candidates, because I know of people who've used it, is Cyrus IMAP. So, I should note that my thoughts are "uw-imapd, because I already know how to use it", "Cyrus, because someone I know/trust liked it years ago", and dovecot, because "it seems stable, professional, and to meet all of my needs". I guess the biggest question I have is how files/folders are stored in the filesystem. uw-imapd has a "mbx" format that all of my folders are in, and also has support for mbox and maildir (i think). mbx had some advantages for speed access, which would be unimportant I assume with dovecot's indexes, but IIRC there was also some reason the mbox format coped poorly with multiple clients accessing the same folder at the same time. So, am I right that dovecot supports only the "one big full file" mbox format, and the maildir format? And if so, is it known to allow multiple simultaneous IMAP clients to access and monitor and/or modify the same folder simultaneously? After those questions, it's just a "what do you think the pros and cons of each are?" I know asking in this forum, that I will get most if not all votes for Dovecot. And that's fine, as long as you have specific reasons why it would be better for someone with only a handful of users and minimal time available to administer the systems in question. Thanks! I appreciate any and all feedback. - Chris

5 5