August 2012 - dovecot

[Dovecot] Just trying to make dovecot work.
by Peter Snow 06 Aug '12

06 Aug '12

Hi, I have to say that Dovecot is certainly the most challenging piece of software I've ever had the pleasure of setting up (due mainly to the reams of largely unhelpful documentation). After 36 almost non-stop hours reading and trying, I finally end up here. :-) I really would appreciate your help - and many thanks in advance! *************************************************************** /var/log/dovecot.info.log (showing unsuccessful login) *************************************************************** Aug 04 21:32:36 auth: Debug: Loading modules from directory: /usr/lib64/dovecot/auth Aug 04 21:32:36 auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libauthdb_ldap.so Aug 04 21:32:36 auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_sqlite.so Aug 04 21:32:36 auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libmech_gssapi.so Aug 04 21:32:36 auth: Debug: passwd-file /usr/local/etc/dovecot.passdb: Read 1 users Aug 04 21:32:36 auth: Debug: auth client connected (pid=24769) Aug 04 21:32:41 auth: Debug: client in: AUTH 1 PLAIN service=imap securedlip=::1 rip=::1 lport=143 rport=52551 resp=AHBldGVyAGZ1YXNpbjU0MTRz Aug 04 21:32:41 auth: Debug: passwd-file(peter,::1): lookup: user=peter file=/usr/local/etc/dovecot.passdb Aug 04 21:32:41 auth: Debug: client out: OK 1 user=peter Aug 04 21:32:41 auth: Debug: master in: REQUEST 1417805825 24769 1 44a3aec60ec6eaec6eff0efb99971eee Aug 04 21:32:41 auth: Debug: master out: USER 1417805825 peter Aug 04 21:32:41 imap-login: Info: Login: user=<peter>, method=PLAIN, rip=::1, lip=::1, mpid=24772, secured *************************************************************** END *************************************************************** *************************************************************** /var/log/dovecot.log (showing unsuccessful login) *************************************************************** Aug 04 21:32:41 IMAP(peter): Error: user peter: Couldn't drop privileges: User is missing UID (see mail_uid setting) Aug 04 21:32:41 IMAP(peter): Error: Internal error occurred. Refer to server log for more information. *************************************************************** END *************************************************************** *************************************************************** dovecot -n *************************************************************** # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-279.2.1.el6.x86_64 x86_64 CentOS release 6.3 (Final) ext4 auth_debug = yes auth_debug_passwords = yes auth_verbose = yes disable_plaintext_auth = no first_valid_uid = 1000 info_log_path = /var/log/dovecot.info.log last_valid_uid = 5000 log_path = /var/log/dovecot.log login_trusted_networks = 127.0.0.1 mail_debug = yes mail_location = maildir:/var/mail/%u/Maildir mail_log_prefix = "%Us(%u): " passdb { args = /usr/local/etc/dovecot.passdb driver = passwd-file } protocols = imap ssl = no verbose_proctitle = yes *************************************************************** END *************************************************************** *************************************************************** /usr/local/etc/dovecot.passdb *************************************************************** peter:{CRYPT}BrtgyyOEX33w6:1000:500:Peter Snow:/var/mail/peter:: *************************************************************** END *************************************************************** *************************************************************** cat /etc/passwd | grep peter *************************************************************** peter:x:1000:500::/home/peter:/sbin/nologin *************************************************************** END *************************************************************** Notes: 'peter' does not yet have a system password, since I'm testing this for users which will only be virtual users. I made the password for 'peter' in the dovecot.passdb using "doveadm pw -s crypt" although once I've got it working I'd like to change the encryption to something as strong as possible - any suggestions please? Hope you can help and many thanks. Kind regards, Peter

4 6

Re: [Dovecot] getting rid of old spam from +spam Maildir ?
by Joseph Tam 06 Aug '12

06 Aug '12

Charles Marcus <CMarcus(a)Media-Brokers.com> writes: > On 2012-08-03 6:33 PM, Voytek Eymont <voytek(a)sbt.net.au> wrote: >> don't know, looking this morning it shows like below, the 00:05:05 is >> probably last time I did 'ls'? I was doing 'ls' or web mail refresh, to >> see what gets removed from 'spam' box, before and after each attempt to >> expunge : >> >> date.saved: 2012-08-03 00:05:05 > > The 'date.saved:' is the date/time that the message was moved into that > folder. Perhaps this related thread starting at http://dovecot.org/list/dovecot/2012-July/067199.html and ending with the patch by Timo http://dovecot.org/list/dovecot/2012-July/067423.html may be of interest to the OP. Joseph Tam <jtam.home(a)gmail.com>

1 0

[Dovecot] getting rid of old spam from +spam Maildir ?
by Voytek Eymont 06 Aug '12

06 Aug '12

I'm trying to setup per user '+spam' delivery from amavis tags, so that each user gets any mails tagged as spam to 'spam' Maildir via +spam Dovecot lmtp delivery. after say 7 days I want to delete all spams older than 7 days, if I simply delete mail files from the file system, is that a 'bad thing' ? what is a proper way to do that, and scripts ? for removing/archiving old uncollected emails in main INBOX I use archivemail from sf, but, don't think I can do subfoldrs with archivemail any pointers (and scripts) welcomed, thanks -- Voytek

6 19

[Dovecot] ot: mysql auth worker failure ?
by Voytek Eymont 05 Aug '12

05 Aug '12

looking through logs I noticed this today: grep mysql /var/log/maillog | grep fail Aug 3 17:35:25 dovecot: auth-worker(28335): Error: mysql: Query failed, retrying: Table 'postfix.users' doesn't exist Aug 3 17:35:57 dovecot: auth-worker(28335): Error: mysql: Query failed, retrying: Table 'postfix.users' doesn't exist Aug 3 17:36:02 dovecot: auth-worker(28335): Error: mysql: Query failed, retrying: Table 'postfix.users' doesn't exist Aug 3 17:36:23 dovecot: auth-worker(28335): Error: mysql: Query failed, retrying: Table 'postfix.users' doesn't exist Aug 3 17:36:40 dovecot: auth-worker(28335): Error: mysql: Query failed, retrying: Table 'postfix.users' doesn't exist Aug 3 17:36:50 dovecot: auth-worker(28335): Error: mysql: Query failed, retrying: Table 'postfix.users' doesn't exist Aug 3 17:40:04 dovecot: auth-worker(28335): Error: mysql: Query failed, retrying: Table 'postfix.users' doesn't exist Aug 3 17:41:04 dovecot: auth-worker(29721): Error: mysql: Query failed, retrying: Table 'postfix.users' doesn't exist Aug 3 17:41:19 dovecot: auth-worker(29721): Error: mysql: Query failed, retrying: Table 'postfix.users' doesn't exist Aug 3 17:41:38 dovecot: auth-worker(29721): Error: mysql: Query failed, retrying: Table 'postfix.users' doesn't exist looking at mysqld.log, all i see is: 120721 17:58:44 InnoDB: Shutdown completed; log sequence number 0 76814 120721 17:58:44 [Note] /usr/libexec/mysqld: Shutdown complete 120721 17:58:44 mysqld_safe mysqld from pid file /var/run/mysqld/mysqld.pid ended 120721 17:59:53 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql 120721 17:59:54 InnoDB: Initializing buffer pool, size = 8.0M 120721 17:59:54 InnoDB: Completed initialization of buffer pool 120721 17:59:54 InnoDB: Started; log sequence number 0 76814 120721 17:59:54 [Note] Event Scheduler: Loaded 0 events 120721 17:59:54 [Note] /usr/libexec/mysqld: ready for connections. Version: '5.1.61' socket: '/var/lib/mysql/mysql.sock' port: 3306 Source distribution no failure were noticed or reported, except for log items any thoughts ? I might have been importing (phpmyadmin) some 3 or 4 databases around that time, surely that wouldn't cause such issue ? -- Voytek Eymont

4 6

[Dovecot] disable auth-worker logging
by Gmail-teopro 04 Aug '12

04 Aug '12

Hello all, Can someone please give me a hint about how can I disable such messages to be inserted into log file(maillog this case as syslog_facility = mail)? >> dovecot: auth-worker(13377): mysql(localhost): Connected to database postfix All the '_debug' and '_verbose' statements bear the 'no' value. Thank you. -- Best regards, Gmail-teopro mailto:teopro@gmail.com

2 1

[Dovecot] authenticate plain and utf-8 with special chars
by Matthias Lay 04 Aug '12

04 Aug '12

Hi, I experienced some problems with authenticate. seems like the mail clients like thunderbird send their base64 string in ISO- encoding, which doesnt work on my dovecot setup if there are some Umlauts I am not able to login as "ömer" for example If I authenticate from telnet with an base64 encoded utf-8 string like 'echo -en "\0ömer\0Start12" |base64' everything works fine -dovecot 2.1.7 -userdb is an openldap which queries an windows AD so results are in utf8, I think. any clues at which point to fix this are welcome ;)

2 1

[Dovecot] zlib plugin maildir broken ?/ Cached message size smaller than expected
by Robert Schetterer 03 Aug '12

03 Aug '12

Hi Timo, by having errors like Cached message size smaller than expected and Maildir filename has wrong S value and Corrupted index cache file in dove 2.1.8 i can reproduce the problem with tb 14 with 2 nat machines connected to the same server the problem relates with create new folder then copy some uncompressed and compressed mail to it, the i.e open it by other client sometime this happens at once , sometime after a few copy actions however thunderbird ,then errors above apear, sometimes no mail is shown, sometimes only uncompressed or only compressed so funktion read both formats gets lost somehow any idea, you need a better debug ? -- Best Regards MfG Robert Schetterer

2 13

[Dovecot] Overriding inbox= in userdb extra fields
by Bret Martin 03 Aug '12

03 Aug '12

Hello, I'm trying to set up an alternate user with a different inbox using passwd-file and userdb extra fields and the extra field settings don't seem to be taking effect. I've used auth_debug and mail_debug and I'm unclear how I can further troubleshoot this. Is it possible to have inbox=yes in one namespace globally and then override this for one user by setting inbox=no for that namespace and then inbox=yes for another? My doveconf -n is below. I would like to have inbox=yes for the inbox namespace, inbox=no for the virtual namespace, and then be able to invert these for selected users using userdb extra fields. My attempt at doing this so far looks like bam-ios:[REDACTED]:500:500::/home/bam::user=bam namespace/inbox/inbox=no namespace/virtual/inbox=yes Changing the user with user= seems to work fine, but the inbox= changes don't. Here is some relevant log data. Aug 2 11:37:29 new-miranda dovecot: auth: Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Aug 2 11:37:29 new-miranda dovecot: auth: Debug: passwd-file /etc/dovecot/users: Read 1 users in 0 secs Aug 2 11:37:29 new-miranda dovecot: auth: Debug: auth client connected (pid=14967) Aug 2 11:37:29 new-miranda dovecot: auth: Debug: client in: AUTH#0111#011PLAIN#011service=imap#011secured#011session=Rgx2MErG4wBAd51y#011lip=216.93.241.245#011rip=64.119.157.114#011lport=993#011rport=38115#011resp=<hidden> Aug 2 11:37:29 new-miranda dovecot: auth: Debug: passwd-file(bam-ios,64.119.157.114,<Rgx2MErG4wBAd51y>): lookup: user=bam-ios file=/etc/dovecot/users Aug 2 11:37:29 new-miranda dovecot: auth: Debug: auth(bam-ios,64.119.157.114,<Rgx2MErG4wBAd51y>): username changed bam-ios -> bam Aug 2 11:37:29 new-miranda dovecot: auth: Debug: client out: OK#0111#011user=bam#011namespace/inbox/inbox=no#011namespace/virtual/inbox=yes Aug 2 11:37:29 new-miranda dovecot: auth: Debug: master in: REQUEST#[REDACTED] Aug 2 11:37:29 new-miranda dovecot: auth: Debug: passwd-file(bam,64.119.157.114,<Rgx2MErG4wBAd51y>): lookup: user=bam file=/etc/dovecot/users Aug 2 11:37:29 new-miranda dovecot: auth: passwd-file(bam,64.119.157.114,<Rgx2MErG4wBAd51y>): unknown user Aug 2 11:37:29 new-miranda dovecot: auth: Debug: passwd(bam,64.119.157.114,<Rgx2MErG4wBAd51y>): lookup Aug 2 11:37:29 new-miranda dovecot: auth: Debug: master out: USER#0111425670145#011bam#011system_groups_user=bam#011uid=500#011gid=500#011home=/home/bam Aug 2 11:37:29 new-miranda dovecot: imap-login: Login: user=<bam>, method=PLAIN, rip=64.119.157.114, lip=216.93.241.245, mpid=14970, TLS, session=<Rgx2MErG4wBAd51y> Aug 2 11:37:29 new-miranda dovecot: imap: Debug: Loading modules from directory: /usr/lib/dovecot/modules Aug 2 11:37:29 new-miranda dovecot: imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_virtual_plugin.so Aug 2 11:37:29 new-miranda dovecot: imap(bam): Debug: Effective uid=500, gid=500, home=/home/bam Aug 2 11:37:29 new-miranda dovecot: imap(bam): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mdbox:/srv/mail/bam/mdbox Aug 2 11:37:29 new-miranda dovecot: imap(bam): Debug: fs: root=/srv/mail/bam/mdbox, index=, control=, inbox=, alt= Aug 2 11:37:29 new-miranda dovecot: imap(bam): Debug: Namespace : Using permissions from /srv/mail/bam/mdbox: mode=0700 gid=-1 Aug 2 11:37:29 new-miranda dovecot: imap(bam): Debug: Namespace virtual: type=private, prefix=virtual/, sep=/, inbox=no, hidden=yes, list=no, subscriptions=yes location=virtual:/srv/mail/bam/virtual Aug 2 11:37:29 new-miranda dovecot: imap(bam): Debug: fs: root=/srv/mail/bam/virtual, index=, control=, inbox=, alt= Aug 2 11:37:29 new-miranda dovecot: imap(bam): Debug: Namespace mdbox: type=private, prefix=mdbox/, sep=/, inbox=no, hidden=yes, list=no, subscriptions=yes location=mdbox:/srv/mail/bam/mdbox Aug 2 11:37:29 new-miranda dovecot: imap(bam): Debug: fs: root=/srv/mail/bam/mdbox, index=, control=, inbox=, alt= I also tried not having inbox=yes anywhere in the global configurations, but then I get Aug 2 11:52:22 new-miranda dovecot: imap(bam): Error: user bam: Initialization failed: namespace configuration error: inbox=yes namespace missing I'm having great luck with the virtual plugin, but I only want to use it for the inbox on some clients. Any ideas on why my inbox=yes/no overrides aren't taking effect? Thanks, --Bret # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.5 ext4 mail_location = mdbox:/srv/mail/%u/mdbox mail_plugins = " virtual" namespace inbox { inbox = no location = prefix = } namespace mdbox { hidden = yes list = no location = prefix = mdbox/ separator = / } namespace virtual { hidden = yes inbox = yes list = no location = virtual:/srv/mail/%u/virtual prefix = virtual/ separator = / } passdb { args = scheme=SSHA512 username_format=%u /etc/dovecot/users driver = passwd-file } passdb { driver = pam } protocols = " imap" service imap-login { inet_listener imap { port = 0 } } ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { args = username_format=%u /etc/dovecot/users driver = passwd-file } userdb { driver = passwd }

2 2

[Dovecot] v2.1.9 released
by Timo Sirainen 03 Aug '12

03 Aug '12

http://dovecot.org/releases/2.1/dovecot-2.1.9.tar.gz http://dovecot.org/releases/2.1/dovecot-2.1.9.tar.gz.sig I've again mostly finished reading and answering most of the mails in Dovecot mailing list. There are a couple annoyingly difficult / time consuming bugreport mails that I haven't replied to yet, but if anyone thinks I should have replied to something already feel free to resend the mail. For the new Redis/memcached dict stuff see http://master.wiki2.dovecot.org/AuthDatabase/Dict and http://master.wiki2.dovecot.org/Quota/Dict I'm thinking about removing the new quota_ignore_save_errors=yes setting in v2.2 and just forcing it enabled always. Thoughts? (I didn't want to change v2.1 behavior by doing this.) The most important changes since v2.1.8: * mail-log plugin: Log mailbox names with UTF-8 everywhere (instead of mUTF-7 in some places and UTF-8 in other places) * director: Changed director_username_hash setting's default from %u to %Lu (= lowercase usernames). This doesn't break any existing installations, but might fix some of them. + doveadm: Added "auth cache flush [<username>]" command. + Implemented dict passdb/userdb + Implemented Redis and memcached dict backends, which can be used as auth backends. Redis can also be used as dict-quota backend. + Added plugin { quota_ignore_save_errors=yes } setting to allow saving a mail when quota lookup fails with temporary failure. - Full text search indexing might have failed for some messages, always causing indexer-worker process to run out of memory. - fts-lucene: Fixed handling SEARCH HEADER FROM/TO/SUBJECT/CC/BCC when the header wasn't lowercased. - fts-squat: Fixed crash when searching a virtual mailbox. - pop3: Fixed assert crash when doing UIDL on empty mailbox on some setups. - auth: GSSAPI RFC compliancy and error handling fixes. - Various fixes related to handling shared namespaces

3 4

[Dovecot] Antispam only when LMTP delivers some specific messages
by Sandro Tosi 03 Aug '12

03 Aug '12

Hello, we're setting up a weird platform where every incoming email is passed from the MTA directly to a tool that then uses dovecot LMTP to deliver the message into the user mailbox. We are legally *not* allowed to run antispam on all the incoming messages, but only on some of them, as they are recognized by the aforementioned tool; but given that tool directly uses LMTP to delivers the mail we need to find a way to parse the messages passing thru LMTP and run spamassassin only on those matching some regex on subject and mail body. Is is possible to do that with some dovecot LMTP feature? i've read a lot of documentation about how to possibly implement it and it *seems* there would be a way using pigeonhole sieve and extprograms - what do you think? The idea I have in mind is something like: 1. identify the mails we want to scan with spamassassin (using regex or whatever else to precisely pin-point them) 2. run SA on those 3. in case it's spam, rewrite the subject (or similar) Do you think it's something doable with dovecot? Thanks in advance, -- Sandro Tosi Product Engineer Shared Hosting Products R&D | Dada.pro eml sandro.tosi(a)register.it

3 3