- dovecot - dovecot.org

[Dovecot] I stream read - stale NFS file handle
by Joe 16 Mar '10

16 Mar '10

Hi, I am running dovecot/postfix/amavisd within a jail on freebsd. I have a nullfs mounted within the jail that links back to an NFS server. I am constantly getting these errors and my mail never gets delivered. I am hoping someone has a fix for me! Mar 15 18:26:02 deliver(boomer(a)vximultimedia.com): Error: copy: i_stream_read() failed: Stale NFS file handle Mar 15 18:26:02 deliver(boomer(a)vximultimedia.com): Info: msgid=<5b7860d51003151439y3c06e019y4bf5992b220b8150(a)mail.gmail.com>: save failed to INBOX: Internal error occurred. Refer to server log for more information. [2010-03-15 18:26:01]

4 4

[Dovecot] Courier to dovecot migrations
by Daniel Grilo 16 Mar '10

16 Mar '10

Dear All, I saw some topics discussed in forums about this, but none with my problems :( Currently we have a mailserver postfix with courier-imap-4.1.1, and courier-pop3 and courier-authlib. Our Maildir's are written in the users home directory (ex: ~/Maildir) I'm now migrating the mailserver to other cluster and installing with dovecot. We're also moving the Maildir's to other directory (ex: /opt/mailboxes/%u) I've ran your perl script courier-dovecot-migrate-1.0.pl which worked just great (as far as I can tell from the OK messages) .. but when configuring my mail client for this account I get the following: Mar 16 09:49:27 magenta dovecot: auth(default): master out: USER 69 scanner system_user=scanner uid=734 gid=100 home=/home/scanner Mar 16 09:49:27 magenta dovecot: imap-login: Login: user=<scanner>, method=PLAIN, rip=::ffff:192.168.1.210, lip=::ffff:192.168.1.110 Mar 16 09:49:27 magenta dovecot: IMAP(scanner): Effective uid=734, gid=100, home=/home/scanner Mar 16 09:49:27 magenta dovecot: IMAP(scanner): maildir: data=/opt/mailboxes/scanner Mar 16 09:49:27 magenta dovecot: IMAP(scanner): maildir: root=/opt/mailboxes/scanner, index=/opt/mailboxes/scanner, control=, inbox= Mar 16 09:49:27 magenta dovecot: IMAP(scanner): stat(/opt/mailboxes/scanner/cur) failed: Permission denied Mar 16 09:49:27 magenta dovecot: IMAP(scanner): stat(/opt/mailboxes/scanner/cur) failed: Permission denied [root@magenta ~]# ls -la /opt/mailboxes/ total 36 drwxrwx--- 4 root dovecot 4096 Mar 15 11:49 . drwxr-xr-x 6 root dovecot 4096 Mar 9 2009 .. drwxrwx--- 2 root root 16384 Feb 10 15:55 lost+found drwx------ 9 scanner users 4096 Mar 15 11:56 scanner The second problem is between postfix / dovecot.. When I send an email to this user I get the following: Mar 16 09:52:11 magenta postfix/local[19065]: warning: connect #1 to subsystem private/dovecot: Connection refused Mar 16 09:52:12 magenta postfix/local[19064]: warning: connect #5 to subsystem private/dovecot: Connection refused I've the following on my /etc/postfix/main.cf ## deliver with dovecot dovecot_destination_recipient_limit = 1 mailbox_transport = dovecot smtpd_sasl_auth_enable = yes smtpd_client_restrictions = permit_sasl_authenticated I hope you can give me a hand on this :) If you need further information, please let me know (perhaps I forgot something) Best Regards Daniel -- Daniel Grilo Partner of Grupo PDM Av. Conde Valbom 30, 3o 1050-068 Lisboa (Portugal) web: http://www.pdmfc.com Tel: +351 21 357 20 29 // mobile: +351 91 388 94 39 (ext: 716) Fax: +351 21 357 20 31 Your mode of life will be changed for the better because of good news soon.

3 5

[Dovecot] public folders grayed out
by Harald Dunkel 16 Mar '10

16 Mar '10

Hi folks, I have configured a public folder as described on the Wiki (more or less; see below), but in TB3 I see the "Public" folder grayed out. I cannot subscribe. Toggling the subscriptions flag doesn't help. What did I miss here? Any helpful comment would be highly appreciated. If this is a TB3 problem: Which MUA would you suggest? Regards Harri ------------------------------------------------------------ # 1.2.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-trunk-amd64 x86_64 Debian squeeze/sid log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap imaps pop3 pop3s managesieve login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login login_executable(managesieve): /usr/lib/dovecot/managesieve-login mail_privileged_group: mail mail_debug: yes mmap_disable: yes mail_nfs_storage: yes mail_nfs_index: yes mbox_write_locks: fcntl dotlock mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_executable(managesieve): /usr/lib/dovecot/managesieve mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 mail_plugin_dir(managesieve): /usr/lib/dovecot/modules/managesieve imap_capability(default): CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH imap_capability(imap): CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH imap_capability(pop3): imap_capability(managesieve): imap_client_workarounds(default): delay-newmail netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(pop3): imap_client_workarounds(managesieve): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh pop3_client_workarounds(managesieve): namespace: type: private separator: / location: maildir:/var/spool/imap/%u:LAYOUT=fs inbox: yes list: yes subscriptions: yes namespace: type: public separator: / prefix: Public/ location: maildir:/var/spool/imap/public:LAYOUT=fs list: yes auth default: passdb: driver: pam userdb: driver: passwd

2 3

Re: [Dovecot] imap support for attachement deletion?
by Louis-David Mitterrand 16 Mar '10

16 Mar '10

On Sat, Mar 13, 2010 at 12:25:49PM +0100, Oliver Eales wrote: > > Am 13.03.2010 um 11:26 schrieb Louis-David Mitterrand: > > > Hi, > > > > Does dovecot support in-place attachement deletion? > > > > Mutt currently uploads a new message after deleting attachements. Is > > there a better, imap way to do it? > > Hello, > no, this is the IMAP way to do it. > Via IMAP you can't modify a message, only its attributes (flags) On the mutt-dev list someone pointed out the APPEND spec from the IMAP4rev1 standard: If a date-time is specified, the internal date SHOULD be set in the resulting message; otherwise, the internal date of the resulting message is set to the current date and time by default. Does dovecot honor a date-time passed during APPEND?

2 1

[Dovecot] Disconnected BUG Unknown internal error bytes
by Clovis Tristao 15 Mar '10

15 Mar '10

Hi, I'm using dovecot current version 1.2.11, and is showing the following error when users connect via IMAP. dovecot: IMAP(<user>): Disconnected: BUG: Unknown internal error bytes=77/773 What's happen? How to solve this problem? Thanks a lot, Clóvis -- Clovis Tristao - UNICAMP/Faculdade de Engenharia Agricola Administrador de Redes - Secao de Informatica (SINFO) E-mail: clovis(a)feagri.unicamp.br http://www.feagri.unicamp.br Fone(0xx19) 35211031-35211038-91173116 ou FAX(55xx19) 35211005/35211010

3 7

[Dovecot] deleted_to_trash 0.2 cannot compile on ubuntu 8.1 with dovecot 1.1.4
by Chan, Philip Lee Kwok 15 Mar '10

15 Mar '10

Hi, Is there any trick to make it compile? Thanks a lot. Regards, Philip 15/F, 2 IFC Tel: +852 39838782 This email and any attachments are confidential and may also be privileged. If you are not the addressee, do not disclose, copy, circulate or in any other way use or rely on the information contained in this email or any attachments. If received in error, notify the sender immediately and delete this email and any attachments from your system. Emails cannot be guaranteed to be secure or error free as the message and any attachments could be intercepted, corrupted, lost, delayed, incomplete or amended. Standard Chartered PLC and its subsidiaries do not accept liability for damage caused by this email or any attachments and may monitor email traffic. Standard Chartered PLC is incorporated in England with limited liability under company number 966425 and has its registered office at 1 Aldermanbury Square, London, EC2V 7SB. Standard Chartered Bank ("SCB") is incorporated in England with limited liability by Royal Charter 1853, under reference ZC18. The Principal Office of SCB is situated in England at 1 Aldermanbury Square, London EC2V 7SB. In the United Kingdom, SCB is authorised and regulated by the Financial Services Authority under FSA register number 114276. If you are receiving this email from SCB outside the UK, please click http://www.standardchartered.com/global/email_disclaimer.html to refer to the information on other jurisdictions.

1 0

[Dovecot] Fatal: open() failed for /var/run/dovecot/login: Permission denied
by Andy Yen 15 Mar '10

15 Mar '10

I keep getting this message when I try to start dovecot using the -F option. Fatal: open() failed for /var/run/dovecot/login: Permission denied Checking /var/run/dovecot/login folder permissions does not seem to indicate anything wrong as root has all the permissions it needs. If I am not mistaken, dovecot can run as root while in the login directory correct? When I try to start the dovecot service, it fails with the message: dovecot dead but subsys locked. Can anybody help me resolve this issue? I am running RHEL5.4. Thanks in advance.

2 1

[Dovecot] Extra Imap processes
by Dominique St-Amand 15 Mar '10

15 Mar '10

Hello fellow dovecot users! I have a question for you guys. I have a server running dovecot/exim and I allow both pop/pops and imap/imaps. When I look at the running processes, I see a lot of imap processes that look like the following: imap [user(a)domain.tld USER_IP] Sometimes, there are duplicates imap [user(a)domain.tld USER_IP] processes. I was wondering, how come those processes don't quit and stick around in the system? Should they quit after the user issued the disconnect command from its mail client? Also, is there any way to actually make them to quit or should I make a shell script that runs at a certain period of time and actually kill those processes? Thanks

2 1

[Dovecot] dovecot dead but subsys locked: auth process died to early, error 127
by Andy Yen 15 Mar '10

15 Mar '10

I am having trouble starting up dovecot on my RHEL5 server. When starting the dovecot service, I get: dovecot dead but subsys locked Looking into the mail logs, I find: dovecot: Auth process died too early - shutting down dovecot: child 4165 (auth) returned error 127 Does anybody know how I can fix this? Thanks in advance.

2 1

[Dovecot] Status update
by Timo Sirainen 14 Mar '10

14 Mar '10

Looks like I'm pretty badly lagged behind emails in mailing list and in my INBOX. I should read and do something about maybe 150 messages. The good thing at least is that v2.0 is getting closer. Only 3 larger things left besides bug fixing: 1. config handling is too slow 2. I just noticed auth cache is only for passdb. it really should be changed to cache userdb too. 3. fts-solr should optionally use mailbox GUIDs instead of mailbox names And 2 and 3 are actually old problems..

1 0

[Dovecot] Dovecot 2.0beta3: Auth changes in Mercurial
by Thomas Leuxner 14 Mar '10

14 Mar '10

Hi Timo, are the latest 'Auth-Changes' supposed to be complete? They break 'alias(a)domain.tld' logins for me. Regards Thomas

2 4

[Dovecot] bug or feature?
by zhong ming wu 14 Mar '10

14 Mar '10

Dear List If ssl_username_from_cert = yes then setting of auth_username_chars is not respected. (It may be that anything goes in that case) Also how can I include space (0x20) in auth_username_chars if I don't use ssl_username_from_cert = yes Thanks mr.wu

2 1

[Dovecot] I need IMAP stress testing tool with SEARCH command
by Ernesto Revilla 14 Mar '10

14 Mar '10

Hi. Does anyone know of a good imap stress testing tool? And one which supports SEARCH commands? I have to compare Courier and Dovecot. I already did some tests using a modified postal/rabid package. I would be thankfully for any hints. Best regards. Erny Yaco Sistemas Spain

2 2

[Dovecot] Bug in driver-mysql.c + fix
by Alain Williams 13 Mar '10

13 Mar '10

I tried to use MySQL stored procedures from dovecot: password_query = CALL user_pass_check('%n', '%d', '%w') user_query = CALL user_info('%n', '%d') This failed with the message: User query failed: PROCEDURE imap.user_info can't return a result set in the given context The root of this problem is that mysql_real_connect() needs to be called with option CLIENT_MULTI_RESULTS and mysql_next_result() called to retrieve extra results (that will not exist in the way that we use it). I attach a patch that fixes this problem -- the patch is against dovecot-1.2.10. This works for me ... but could probably do with testing by other people. BTW: I got the same problem with exim this morning, wrote a patch that has now been accepted. The dovecot patch is similar. I am looking to use mysql procedures, there are some interesting things that can be done. Two suggestions that I have will help with this: 1) There be variable (say) %o - this be the obscured password, ie what password_query returns. 2) that dovecot look for either ''password_query'' as above, or ''password_check''. password_check would NOT return a password, but would be given %o and determine itself if the password is correct. It would return the other values (user, userdb_home, ...) and auth_result that would encode success/retry/fail (0, 1, 2 - or maybe more structured [**]) and auth_reason some human readable reason. The ''nologin'' value encodes some of this. The motivation for this is that my stored procedure will record the number of successive login failures and lock the account after 3 of them. It would also be possible to do time based restrictions & the such. Also: by passing %o the password is not sent in plain to the database server - which will increase security. I will publish my stored procedures when done. Regards [**] eg taking ideas from the HTTP codes: 200 - OK 300 5 - try again in 5 minutes 301 2 9 - try again on tuesday at 9am 400 - Login forbidden, no reason given 401 - bad username and/or password 402 - account locked administratively 403 - too many failed login attempts 500 - authentication system error The above would allow a native language version of auth_reason to be produced -- Alain Williams Linux/GNU Consultant - Mail systems, Web sites, Networking, Programmer, IT Lecturer. +44 (0) 787 668 0256 http://www.phcomp.co.uk/ Parliament Hill Computers Ltd. Registration Information: http://www.phcomp.co.uk/contact.php Past chairman of UKUUG: http://www.ukuug.org/ #include <std_disclaimer.h>

2 5

[Dovecot] Plugin like zlib
by Alex Baule 13 Mar '10

13 Mar '10

Hi everyone. I rebuild a plugin, based on zlib plugin. The changes between this plugin and zlib, is the zlib stuffs is replaced by open, read, lseek, close. With "plain-text" files, its works ok. So, my file is encrypt, and the result from decrypt file is different from fread. Like zlib, i read from fread the size variable, but the value added in seek_offset and pos is the result from decrypt, and it can be dfferent from fread. Like zlib, my file size is different from email. In zlib the file is smaller than the email. In my file, the file is bigger than the email. OK, lets go to the problem now. when the email arrives in the new folder, by imap, the stat (read my file by "while (i_stream_emexis_read(stream) > 0)" like zlib) and the seek works fine....the email is readed and the final stat size is the decrypted size of my email (smaller than original file). When I receive the email, clicking in "Send/Receive", The read function is aborted because the size to read (like zlib) is negative. I put some debug in my plugin, and print some stuffs about the functions. Email decryt size = 49556 Email encrypt size = 49568 Attachements: mail-arrived, is when the email arrives, and it's ok the read. mail-receive, is when the email is received, and have the error. maillog is the /var/log/mail The bigger difference from zlib is the i_stream_zlib_read part.... do { ret = read(zstream->fd ,crypttext, size); fprintf(zstream->debug,"DENTRO DA READ RET = %d -- ERRNO = %d -- STR = |%s|\n", ret, errno, strerror(errno)); if(ret > 0){ EVP_DecryptUpdate(&ctx, plaintext, &plain_len, crypttext, ret); memcpy(stream->w_buffer + stream->pos , plaintext, plain_len); bzero (plaintext, DEFAULT_MAX_BUFFER_SIZE); EVP_DecryptFinal(&ctx, plaintext, &plain_len_final); memcpy(stream->w_buffer + stream->pos + plain_len , plaintext, plain_len_final); } } while (ret < 0 && errno == EINTR && stream->istream.blocking); *retc *= plain_len + plain_len_final; if (ret == 0 ) { /* EOF */ stream->istream.eof = TRUE; return -1; } if (ret < 0) { if (errno == EAGAIN) { i_assert(!stream->istream.blocking); ret = 0; // } else { // i_assert(errno != 0); // stream->istream.stream_errno = errno; // return -1; } } fprintf(zstream->debug,"READ RET = %d -- ERRNO = %d -- STR = |%s|\n", ret, errno, strerror(errno)); fprintf(zstream->debug,"stream->pos = %d -- zstream->seek_offset = %d\n", stream->pos, zstream->seek_offset); zstream->seek_offset += *retc*; stream->pos += *retc*; i_assert(ret > 0); fprintf(zstream->debug,"READ RET DECRYPT = %d -- stream->pos = %d -- zstream->seek_offset = %d\n", ret, stream->pos, zstream->seek_offset); fprintf(zstream->debug,"********************** FINISH READ *********************\n"); fflush(zstream->debug); return *retc;* The* retc* is the result from decrypt. In mail-receive file (line 38), there is the error, at some point along the read/send email, the stream->pos (its returned by i_stream_compress, with stream->pos -= stream->skip) is changed out from context and the size to read is negative, but i don't understand why. Someone can help me find out what happens ?

2 1

[Dovecot] Sendmail / Dovecot Config
by John Moorhouse 13 Mar '10

13 Mar '10

I'm trying to set up dovecot on a Fedora box for about 5 users, I have a raid 5 array that is used for home folders etc mounted on /home, and I've created a directory /home/mail, which I have used a sym link to map /var/mail to. I've created folders for each of the users with relevant permissions and edited the dovecote config with:- namespace private { separator = / prefix = "#dbox/" location = dbox:~/mail:INBOX=/var/mail/%u inbox = yes hidden = yes list = no # for v1.1+ } namespace private { separator = / prefix = location = dbox:/var/mail/%u/mail } I was hoping that this would create a inbox in the root of each users folder in the mail directory and a sub folder to hold any user created folders. This all seems to work as I can create folders, copy emails to them r-arrange the folders etc as I want via a mail client using imap on 143. My only problem is that I have also configured send mail as best as I know to listen on port 25 as an SMPT client but any emails sent to it to one of the email addresses are saved by sendmail to /var/spool/mail/username and not picked up by dovecot Thanks John

2 2

[Dovecot] imap support for attachement deletion?
by Louis-David Mitterrand 13 Mar '10

13 Mar '10

Hi, Does dovecot support in-place attachement deletion? Mutt currently uploads a new message after deleting attachements. Is there a better, imap way to do it?

1 0

[Dovecot] how quotas works with postfix and dovecot
by Wilberth Pérez 13 Mar '10

13 Mar '10

Hi everybody any one knows, how i could edit dovecot to assign user quotas ? I have now configured my dovecot.conf on this way: protocol imap { listen = *:143 mail_plugins = quota imap_quota } protocol pop3 { listen = *:110 mail_plugins = quota } plugin { quota = fs:INBOX:mount=/ quota_warning = storage=95%% /usr/local/bin/quota-warning.sh 95 } however when a test my quota: quota -v user1 Disk quotas for user1 (uid 107): Filesystem *usage* *quota* limit timeleft files quota limit timeleft /var/mail 16911 10240 20480 NOT STARTED 49 1000 1500 dovecot or postfix (i don't know who really should sendme the messsage) never sendme an quota warning someone knows what happen ? -- -------------------------------------------------------- LCC Wilberth de Jesús Pérez Segura CCSA- Administración de Servicios y Seguridad de las TI Correo:wilberth.perez@uady.mx Universidad Autónoma de Yucatán Secretaría General Coordinación Administrativa de Tecnologías de Información RIUADY C-59 x Av. Itzáes (999)923-74-28 Ext. 1117 Mérida, Yucatán, México 2010 -------------------------------------------------------- -- -------------------------------------------------------- LCC Wilberth de Jesús Pérez Segura CCSA- Administración de Servicios y Seguridad de las TI Correo: wilberth.perez(a)uady.mx Universidad Autónoma de Yucatán Secretaría General Coordinación Administrativa de Tecnologías de Información RIUADY C-59 x Av. Itzáes (999)923-74-28 Ext. 1117 Mérida, Yucatán, México 2010 --------------------------------------------------------

3 5

[Dovecot] Emails Disappearing -- Mystery
by Mario Antonio 12 Mar '10

12 Mar '10

I got a case that I haven't been able to resolve. I hope somebody can give me some hints. One of our users is reporting emails disappearing in front of his eyes, (Right ... emails filters at the client side ....) Server does not have global sieve filter enabled (no file present), even though this configuration is present: sieve_global_path=/vmail/globalsieverc User does not have any sieve scripts enabled at the server side. Ok, 1) The user shuts down his apple mail software, his Iphone, and the Web interface: 2010-03-11 15:52:57 IMAP(my_user(a)mydomain.com): Info: Connection closed bytes=2188/6499 2010-03-11 15:52:57 IMAP(my_user(a)mydomain.com): Info: Connection closed bytes=3887/7336 2010-03-11 15:52:57 IMAP(my_user(a)mydomain.com): Info: Connection closed bytes=5873/68309 2010-03-11 15:52:57 IMAP(my_user(a)mydomain.com): Info: Disconnected in IDLE bytes=4514/547136 2) He generates the troublesome emails from a notification system in Craiglist .... We can see the email hitting the inbox (we also see in Postfix this email going to Dovecot) 2010-03-11 15:54:48 deliver(my_user(a)mydomain.com): Info: From=noreply(a)craigslist.org : msgid=<20100311205447.0C0FE118B04(a)web8p.int.craigslist.org> : saved mail to INBOX 3) Email is deleted !!! 2010-03-11 15:54:49 IMAP(my_user(a)mydomain.com): Info: delete: uid=10719, flags=(\Deleted \Recent $Junk), msgid=<20100311205447.0C0FE118B04(a)web8p.int.craigslist.org>, from=craigslist.org <noreply(a)craigslist.org>, subject=POST/EDIT/DELETE : (accounting/financejobs) Test Post 2010-03-11 15:54:49 IMAP(my_user(a)mydomain.com): Info: expunge: uid=10719, flags=(\Deleted \Recent $Junk), msgid=<20100311205447.0C0FE118B04(a)web8p.int.craigslist.org>, from=craigslist.org <noreply(a)craigslist.org>, subject=POST/EDIT/DELETE : (accounting/finance jobs) Test Post , size=2776 Who is deleting this email ? I can see the flag $Junk ... perhaps some filter somewhere is seeing that flag and proceeding to delete it. If I understand sieve filters at the server side, they will act in the deliver process. So once the email is saved into INBOX, sieve filters will not count. Am I right? Any Hints? # 1.2.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.26-2-686-bigmem i686 Debian 5.0.4 xfs Regards, Mario Antonio

2 2

Re: [Dovecot] nosql (it was mogilefs)
by fernando＠dfcom.com.br 12 Mar '10

12 Mar '10

Yes, I´ve read these doc. I was just considering if someone had any experience with Mogile in email environment. Well, actually I´m trying to figure out if one of those nosql systems can store and scale email systems (ie, mailboxes - instead of maildir). I know mysql is always quoted as an option and discussed sometimes in the list. I think it´s an unnecessary overhead and bottleneck. As brainstorm. How about Cassandra, Tokyo-Tirant, Redis, and so on. Have you ever worked or tested one of them at production or even testing environment ? What do you think ? Best Regards, Fernando >---- Original Message ---- >From: Robert Schetterer <robert(a)schetterer.org> >To: dovecot(a)dovecot.org >Sent: Qua, Mar 10, 2010, 4:46 PM >Subject: Re: [Dovecot] mogilefs > >Am 10.03.2010 20:23, schrieb fernando(a)dfcom.com.br: >> Hi list, >> >> Have you ever heard or tried mogilefs? (http://danga.com/mogilefs/) >> >> Do you think suitable for dovecot/mail environments ? >> >> Regards, >> Fernando >> > >sounds not ready for mail > >MogileFS is not: > > * POSIX Compliant -- you don't run regular Unix applications or >databases against MogileFS. It's meant for archiving write-once files >and doing only sequential reads. (though you can modify a file by way of >overwriting it with a new version) Notes: > o Yes, this means your application has to specifically use a >MogileFS client library to store and retrieve files. The steps in >general are 1) talk to a tracker about what you want to put or get, 2) >read/write to one of the places it told you you could (it'll pick >storage node(s) for you as part of its load balancing), using HTTP GET/PUT > o We've prototyped a FUSE binding, so you could use MogileFS >without application support, but it's not production-ready. > > >-- >Best Regards > >MfG Robert Schetterer > >Germany/Munich/Bavaria

2 1

[Dovecot] patch: allow proxy to lookup host by name
by Martin F. Foster 12 Mar '10

12 Mar '10

This patch allows the dovecot proxy processes to lookup the destination host by name instead of IP address. Tested agains 1.2.10, expected to work against 1.2.11. The patch is pretty straightforward, it's making it work within the restrictions of the login process that's more interesting. I have made some changes to the wiki (pending approval) to - enhance the discussion of proxy with LDAP http://wiki.dovecot.org/PasswordDatabase/ExtraFields/Proxy - discuss the implication of this patch w.r.t. the login_chroot configuration parameter: http://wiki.dovecot.org/PasswordDatabase/ExtraFields/Proxy/HostLookup Feedback is appreciated, particulary from a security standpoint. Cheers, -Martin Foster martin_foster(a)netlog.net dump of wiki info, for the lazy. It will look better if viewed from the URL: http://wiki.dovecot.org/PasswordDatabase/ExtraFields/Proxy/HostLookup For all released versions of Dovecot, the "host" referred to in a proxy or proxy_maybe lookup must be an IP address see: the main PasswordDatabase/ExtraFields/Proxy <http://wiki.dovecot.org/PasswordDatabase/ExtraFields/Proxy> page for more info A patch is available to enable lookups, but it has some imporant caveats due to the nature of the LoginProcess <http://wiki.dovecot.org/LoginProcess> that the proxy function is a part of. This page exists to discuss these. The Problem Proxying is done from the dovecot login processes, both pop3-login & imap-login call code in src/login-common/login-proxy.c to handle the proxying to the given host. If the host is not an IP address, name resolution must be done. Two options from dovecot's configuration: 1. Dovecot running with roots Dovecot is started as root and drops privileges later; this is the recommended way of running Dovecot. Set by the config option: login_chroot = yes. In this mode, the login process is chrooted to login_dir, from which the proposed patch adds name resolution. Resolution is done via dovecot's net_gethostbyname() function - a wrapper for getaddrinfo/gethostbyname depending on compile-time platform support. These functions need access to the name service switch configuration, then whatever dependencies are required to consult the host resolution databases stipulated. so, if the /etc/nsswitch.conf hosts entry is: hosts: dns files Then the system will need access to /etc/resolv.conf and the nss_dns libraries for "dns" lookup, and /etc/hosts for "files" lookup. The exact files will vary by platform/operating system, but these all need to be available in the chroot for the lookup to succeed. and, if dovecot.conf has: login_chroot = yes login_dir = /var/run/dovecot/login login_user = dovecotuser Then for the nsswitch.conf entry above, the following files need to be copied (not symbolically linked!) to the chroot. This example is for a 64-bit RHEL5 system, with 64-bit dovecot daemon. Ownership of the new directories must be set to whatever the login_user is set to. mkdir /var/run/dovecot/login/etc mkdir /var/run/dovecot/login/lib64 cp /etc/nsswitch.conf /etc/resolv.conf /etc/hosts /var/run/dovecot/login/etc cp /lib64/libnss_dns.so.2 /var/run/dovecot/login/lib64 chown -R dovecotuser:dovecotuser /var/run/dovecot/login/etc chown -R dovecotuser:dovecotuser /var/run/dovecot/login/lib64 Remember that the ownership of the login_dir itself *must not* be changed. So: # ls -ld /var/run/dovecot/login/ drwxr-x--- 4 root dovecotuser 4096 Mar 12 06:48 /var/run/dovecot/login/ Troubleshooting If the lookup fails because of a perceived lookup-in-chroot issue, an error message of this form will be printed to the logs dovecot: pop3-login: proxy(test(a)domain1.test): cannot resolve mailhost.domain1.test. If name resolution is working outside dovecot, it may be a chroot issue. See LoginProcess on wiki, and login_dir& login_chroot in config. Clients will receive a much less descript general error message, for example with POP3: -ERR [IN-USE] Account is temporarily unavailable. Things to check 1. does name resolution work for normal users? the dovecot user? 2. are all the files required by the Name Service Switch's configuration available? Use a process tracing tool such as strace or truss against the pop3-login or imap-login processes to check. 3. are other security measures interfering? eg: 1. SELinux <http://en.wikipedia.org/wiki/Security-Enhanced_Linux> (RedHat <http://www.redhat.com/rhel/> EL, CentOS, Oracle EL) 2. AppArmor <http://en.wikipedia.org/wiki/AppArmor> (SuSE, Ubuntu?) 3. RBAC (Solaris, OpenSolaris <http://en.wikipedia.org/wiki/Open_Solaris>) Caveats This procedure allows the chroot'ed login to do something, which forms a security risk if the libraries in the chroot are exploitable. It will be up to the operator to ensure that the copy of the files in the chroot get updated whenver the copies in the real filesystem do. On systems where the chroot is on the same filesystem/partition that the original file copies are, hard links (again: no soft links!) could be used to accomplish this. 2. Dovecot running without roots (RootLess) Dovecot is started as whatever user/group is used to start the master daemon. See the discussion on Rootless <http://wiki.dovecot.org/HowTo/Rootless> for reasons why this is not the recommended way of running Dovecot, which includes a discussion on how this is more likely to be less secure. In dovecot.conf, rootless is selected by setting: login_chroot = no In this mode, the login process will have access to the required Name Service Switch configuration files and their dependencies if the user that started dovecot did. No further configuration is required for the proxy process to lookup hostnames.

4 3

[Dovecot] Scalability plans: Abstract out filesystem and make it someone else's problem
by Timo Sirainen 12 Mar '10

12 Mar '10

This is something I figured out a few months ago, mainly because this one guy at work (hi, Stu) kept telling me my multi-master replication plan sucked and we should use some existing scalable database. (I guess it didn't go exactly like that, but that's the result anyway.) So, my current plan is based on a couple of observations: * Index files are really more like memory dumps. They're already in an optimal format for keeping them in memory, so they can be just mmap()ed and used. Doing some kind of translation to another format would just make it more complex and slower. * I can change all indexing and dbox code to not require any locks or overwriting files. I just need very few filesystem operations, primarily the ability to atomically append to a file. * Index and mail data is very different. Index data is accessed constantly and it must be very low latency or performance will be horrible. It practically should be in memory in local machine and there shouldn't normally be any network lookups when accessing it. * Mail data on the other hand is just written once and usually read maybe once or a couple of times. Caching mail data in memory probably doesn't help all that much. Latency isn't such a horrible issue as long as multiple mails can be fetched at once / in parallel, so there's only a single latency wait. So the high level plan is: 1. Change the index/cache/log file formats in a way that allows lockless writes. 2. Abstract out filesystem accessing in index and dbox code and implement a regular POSIX filesystem support. 3. Make lib-storage able to access mails in parallel and send multiple "get mail" requests in advance. (3.5. Implement async I/O filesystem backend.) 4. Implement a multi-master filesystem backend for index files. The idea would be that all servers accessing the same mailbox must be talking to each others via network and every time something is changed, push the change to other servers. This is actually very similar to my previous multi-master plan. One of the servers accessing the mailbox would still act as a master and handle conflict resolution and writing indexes to disk more or less often. 5. Implement filesystem backend for dbox and permanent index storage using some scalable distributed database, such as maybe Cassandra. This is the part I've thought the least about, but it's also the part I hope to (mostly) outsource to someone else. I'm not going to write a distributed database from scratch.. This actually should solve several issues: * Scalability, of course. It'll be as scalable as the distributed database being used to store mails. * NFS reliability! Even if you don't care about any of these alternative databases, this still solves NFS caching problems. You'd keep using the regular POSIX FS API (or async FS api) but with the in-memory index "cache", so only a single server is writing to mailbox indexes at the same time. * Shared mailboxes. The filesystem API is abstracted, so it should be possible to easily add another layer to handle accessing other users' mails from both local and remote servers. This should finally make it possible to easily support shared mailboxes with system users.

17 82

[Dovecot] troubles with expire plugin
by Denis Fateyev 11 Mar '10

11 Mar '10

Hello there, Now I'm using `expire` plugin and getting troubles with cronjob (from user `exim`): /usr/sbin/dovecot --exec-mail ext /usr/libexec/dovecot/expire-tool.sh Fatal: setgid(12(mail)) failed with euid=93(exim), gid=93(exim), egid=93(exim): Operation not permitted (This binary should probably be called with process group set to 12(mail) instead of 93(exim)) The same error occurs when I run this command from `exim` user with sudo. My dovecot v1.2.11 configuration: dovecot.conf ----------------- ... socket listen { master { path = /var/run/dovecot/auth-master mode = 0660 user = exim group = mail } client { path = /var/spool/exim/private-auth mode = 0660 user = exim group = mail } } ... userdb-sql.conf ------------------------ # exim uid: 93, mail gid: 12 user_query = SELECT CONCAT('/var/mail/', maildir) AS home, \ CONCAT('maildir:/var/mail/', maildir) AS mail, 93 AS uid, 12 AS gid, \ CONCAT('*:storage=', quota, 'B') AS quota_rule, \ 'storage=90%% /usr/libexec/dovecot/quota_warning.sh 90' AS quota_warning \ FROM mailbox WHERE username = '%u' AND active = '1' password_query = SELECT username AS user, password, \ CONCAT('/var/mail/', maildir) AS userdb_home, \ CONCAT('maildir:/var/mail/', maildir) AS userdb_mail, \ 93 AS userdb_uid, 12 AS userdb_gid, \ CONCAT('*:storage=', quota, 'B') AS userdb_quota_rule, \ 'storage=90%% /usr/libexec/dovecot/quota_warning.sh 90' AS userdb_quota_warning \ FROM mailbox WHERE username = '%u' AND active = '1' ( maybe, is any additional information required? ) All working fine with dovecot except this issue with `expire` plugin. How to avoid it? As I see, it's working if I run this command from `root` instead of `exim`, but I don't think it will be right to leave it in the root's crontab. Thanks, --- wbr, Denis.

1 0

[Dovecot] uid fetch/store always use the last uid when range is invalid
by Jean-Baptiste Vignaud 11 Mar '10

11 Mar '10

hello all; one colleague found a strange behavior, that can be annoying : -bash-3.1$ telnet 0 143 Trying 0.0.0.0... Connected to 0 (0.0.0.0). Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE AUTH=PLAIN AUTH=CRAM-MD5] Dovecot ready. l login login pass l OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS QUOTA] Logged in l select inbox * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 281 EXISTS * 0 RECENT * OK [UNSEEN 7] First unseen. * OK [UIDVALIDITY 1223038537] UIDs valid * OK [UIDNEXT 363] Predicted next UID * OK [HIGHESTMODSEQ 1] Highest l OK [READ-WRITE] Select completed. l uid fetch 363:* rfc822.size * 281 FETCH (UID 362 RFC822.SIZE 1559) l OK Fetch completed. and more annoying: l uid store 1000000:* +flags (\Seen \Deleted) * 281 FETCH (UID 362 FLAGS (\Deleted \Seen)) l OK Store completed. # 1.2.10: /xam/dovecot/etc/dovecot.conf # OS: Linux 2.6.22.14-72.fc6 i686 Fedora Core release 6 (Zod) ext3 base_dir: /opt/dovecot/var/run log_path: /opt/logs/dovecot/dovecot.log info_log_path: /opt/logs/dovecot-info.log protocols: imap pop3 managesieve listen(default): * listen(imap): * listen(pop3): * listen(managesieve): *:2000 ssl: no disable_plaintext_auth: no login_dir: /opt/dovecot/var/run/login login_executable(default): /xam/dovecot/libexec/dovecot/imap-login login_executable(imap): /xam/dovecot/libexec/dovecot/imap-login login_executable(pop3): /xam/dovecot/libexec/dovecot/pop3-login login_executable(managesieve): /xam/dovecot/libexec/dovecot/managesieve-login login_user: dovelog mail_location: maildir:/opt/vmail/%d/%n mail_cache_fields: imap.bodystructure, imap.body, mime.parts, flags, date.sent, date.received, size.virtual, size.physical mail_executable(default): /xam/dovecot/libexec/dovecot/imap mail_executable(imap): /xam/dovecot/libexec/dovecot/imap mail_executable(pop3): /xam/dovecot/libexec/dovecot/pop3 mail_executable(managesieve): /xam/dovecot/libexec/dovecot/managesieve mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): quota mail_plugins(managesieve): mail_plugin_dir(default): /xam/dovecot/lib/dovecot/imap mail_plugin_dir(imap): /xam/dovecot/lib/dovecot/imap mail_plugin_dir(pop3): /xam/dovecot/lib/dovecot/pop3 mail_plugin_dir(managesieve): /xam/dovecot/lib/dovecot/managesieve lda: postmaster_address: postmaster(a)linux15.xandmail.com sendmail_path: /opt/postfix/usr/sbin/sendmail auth_socket_path: /opt/dovecot/var/run/dovecot/auth-master sendmail_path: /xam/postfix/usr/sbin/sendmail mail_plugins: quota sieve log_path: /xam/logs/deliver/deliver.log info_log_path: /xam/logs/deliver/deliver.log auth default: mechanisms: plain cram-md5 apop user: dovecot passdb: driver: sql args: /opt/dovecot/etc/dovecot-mysql.conf userdb: driver: sql args: /opt/dovecot/etc/dovecot-mysql.conf socket: type: listen client: path: /opt/dovecot/var/run/dovecot/auth-client mode: 432 user: postfix group: postfix master: path: /opt/dovecot/var/run/dovecot/auth-master mode: 384 user: vmail group: vmail plugin: quota: dict:user::proxy::quotadict quota_rule: *:storage=100M quota_rule2: *:messages=1000000 sieve: %h/sieve/dovecot.sieve sieve_global_path: /xam/dovecot/etc/sieve/default sieve_global_dir: /xam/dovecot/etc/sieve sieve_dir: %h/sieve/ mail_log_max_lines_per_sec: 0 mail_log_group_events: no mail_log_events: delete undelete expunge copy mail_log_fields: uid box msgid size dict: quotadict: mysql:/opt/dovecot/etc/dovecot-dict-quota.conf path: /opt/dovecot/var/run/dict-server

2 3

[Dovecot] Howto disable imap listener in dovecot 2.0
by Erik Logtenberg 11 Mar '10

11 Mar '10

Hi, How do I disable the imap listener in dovecot 2.0-beta-3? I only want to enable the imaps listener. In previous dovecot versions I could specify: prototols = imaps But in dovecot 2.0 this is no longer possible (imap and imaps are now both enabled with "protocols = imap"). I already made ssl a requirement with: ssl = required This is in the global section. I commented out the imap listener in master.conf, but "dovecot -a" still shows the config for the imap listener, so I suppose it's default configuration. Can I explicitly tell dovecot to not open an imap listener, but only an imaps listener? Kind regards, Erik.

3 6

[Dovecot] mogilefs
by fernando＠dfcom.com.br 10 Mar '10

10 Mar '10

Hi list, Have you ever heard or tried mogilefs? (http://danga.com/mogilefs/) Do you think suitable for dovecot/mail environments ? Regards, Fernando

2 1

[Dovecot] Limit login attempts per connection?
by Tony Nelson 10 Mar '10

10 Mar '10

Dovecot allows a large number of login attempts per connection. I'd like to reduce that number to, say, 1, and let my firewall keep the ducks at bay, but I can't find anything in /etc/dovecot.conf or by googling. How do I do it? Do I need to patch the source? dovecot-1.1.10-1.x86_64 on CentOS 5.4 -- ____________________________________________________________________ TonyN.:' <mailto:tonynelson@georgeanelson.com> ' <http://www.georgeanelson.com/>

10 17

[Dovecot] Mailing list's prefix
by Timo Sirainen 10 Mar '10

10 Mar '10

Do you think I'd break a lot of people's filters if I removed the prefix? :) Anyone strongly for/against removing it? It seems kind of annoying to me whenever I happen to think about it.

31 52

[Dovecot] vacation script
by Papp Tamás 10 Mar '10

10 Mar '10

hi All, One of my users created this sieve script via roundcube's avelsieve implementation: # This script has been automatically generated by avelsieve # (Sieve Mail Filters Plugin for Squirrelmail) # Warning: If you edit this manually, then the changes will not # be reflected in the users' front-end! #AVELSIEVE_VERSIONYTo0OntzOjU6Im1ham9yIjtpOjE7czo1OiJtaW5vciI7aTo5O3M6NzoicmVsZWFzZSI7aTo3O3M6Njoic3RyaW5nIjtzOjU6IjEuOS43Ijt9 #AVELSIEVE_CREATED1268148005 #AVELSIEVE_MODIFIED1268148005 require ["fileinto","envelope","reject","vacation","relational","comparator-i;ascii-numeric","regex","body"]; if #START_SIEVE_RULEYTo2OntzOjQ6ImNvbmQiO2E6MTp7aTowO2E6MTp7czo0OiJ0eXBlIjtzOjM6ImFsbCI7fX1zOjQ6InR5cGUiO3M6MToiMSI7czo2OiJhY3Rpb24iO3M6MToiNiI7czoxMzoidmFjX2FkZHJlc3NlcyI7czoyMToic2lrZXQuZ2Fib3JAY2VudGVyLmh1IjtzOjg6InZhY19kYXlzIjtzOjE6IjciO3M6MTE6InZhY19tZXNzYWdlIjtzOjUzNzoiMjAxMC4gbeFyY2l1cyA5IC0gMTkga%2FZ69nR0IHN6YWJhZHPhZ29uIHZhZ3lvaywgDQpsZXZlbGVpbWV0IGxlZ2hhbWFyYWJiIG3hcmNpdXMgMjIt6W4gZm9nb20gb2x2YXNuaS4NCg0KVOF2b2xs6XRlbSBhbGF0dCBr6XJlbSwgaG9neSBz%2FHJn9XMgZXNldGJlbiBrb2xs6WfhaW1hdCBrZXJlc3NlLg0KDQpDc%2BFraSBab2x04W4gLSD8emVtZWx0ZXTpcw0KdGVsOiAwNiAxIDk5OSA0NDYwDQplLW1haWw6IGNzYWtpLnpvbHRhbkBjZW50ZXIuaHUNCg0KS2VyZXNrZWRlbG1pIPxneWVrYmVuIGtvbGzpZ%2BFpbSBhIGtlcmVza2VkZWxlbUBjZW50ZXIuaHUgZW1haWwgY%2B1tZW4sDQppbGxldHZlIGEgMDYgMSA5OTkgNDQ2MCB0ZWxlZm9uc3rhbW9uIOFsbG5hayByZW5kZWxrZXrpc%2BlyZS4gDQoNCg0K3GR29npsZXR0ZWw6DQpTaWtldCBH4WJvcg0KDQpDRU5URVIuSFUgS2Z0Lg0KIA0KSXJvZGE6IDExMzMgQnVkYXBlc3QsIFbhZyB1LiAxMy4NClRlbDogKDM2MSkgOTk5IDQ0NjAsIDk5OSA0NDYxDQpGYXg6ICgzNjEpIDk5OSA0NDYyLCA5OTkgNDQ5OQ0KIjt9END_SIEVE_RULE true { vacation :days 7 :addresses ["user(a)domain.hu"] text: 2010. mA(A;rcius 9 - 19 kA(s'zA(s'tt szabadsA(A;gon vagyok, ^M leveleimet leghamarabb mA(A;rcius 22-A(n fogom olvasni.^M [...some more text...] ^M TA(A;vollA(tem alatt kA(rem, hogy sA(z'rgL's esetben kollA(gA(A;imat keresse.^M ^M ^M .^M ; } The text is in hungarian. The autoreply function is wors fine, but the email address are not saved, so when the sender sents more mail, an autoreply email is received again and again. Dovecot version is 1.2.10-0~auto+106 from http://xi.rename-it.nl/debian/ . Is this a bug or maybe I miss something? Is there any dovecot option about this? Thank you, tamas

4 4

[Dovecot] fchown error upgrading from 0.99 to 1.2
by Erick Perez 09 Mar '10

09 Mar '10

Hi there, after upgrading from 0.99 to 1.2, the following errors appear in the error log: Mar 09 15:50:23 POP3(cwchbodega): Error: fchown(/home/cwchbodega/mail/.imap/INBOX/dovecot.index.log.newlock, -1, 12(mail)) failed: Operation not permitted (egid=653(cwchbodega), group based on /var/mail/cwchbodega) Mar 09 15:50:53 POP3(cwchbodega): Error: fchown(/home/cwchbodega/mail/.imap/INBOX/dovecot.index.tmp, -1, 12(mail)) failed: Operation not permitted (egid=653(cwchbodega), group based on /var/mail/cwchbodega) Mar 09 15:50:53 POP3(cwchbodega): Error: fchown(/home/cwchbodega/mail/.imap/INBOX/dovecot.index.cache.lock, -1, 12(mail)) failed: Operation not permitted (egid=653(cwchbodega), group based on /var/mail/cwchbodega) As I check the perms on the files, i see that: /var/mail/cwchbodega -rw-rw---- 1 cwchbodega mail and /home/cwchbodega/mail/.imap/INBOX/ [root@mail INBOX]# ls -la /home/cwchbodega/mail/.imap/INBOX/ total 280 drwx------ 2 cwchbodega cwchbodega 4096 Mar 9 15:50 . drwx------ 3 cwchbodega cwchbodega 4096 Dec 4 00:40 .. -rw------- 1 cwchbodega cwchbodega 5 Dec 4 00:40 .customflags -rw------- 1 cwchbodega cwchbodega 17312 Mar 9 15:50 dovecot.index -rw------- 1 cwchbodega cwchbodega 26624 Mar 9 15:56 dovecot.index.cache -rw------- 1 cwchbodega cwchbodega 26128 Mar 9 15:56 dovecot.index.log -rw------- 1 cwchbodega cwchbodega 17016 Mar 9 08:43 .imap.index -rw------- 1 cwchbodega cwchbodega 143422 Mar 6 08:54 .imap.index.data -rw------- 1 cwchbodega cwchbodega 7696 Feb 22 08:26 .imap.index.log -rw------- 1 cwchbodega cwchbodega 13028 Mar 6 08:54 .imap.index.tree [root@mail INBOX]# Should I chown user:mail the contents of the INBOX folder? and use perms of 0600 ? thanks, -- ------------------------------------------------------------ Erick Perez Cel +(507) 6675-5083 ------------------------------------------------------------

2 1

[Dovecot] Timeout while waiting for release of fcntl() lock for mbox file /var/mail/mailbox
by Erick Perez 09 Mar '10

09 Mar '10

Hi there, im currently using dovecot 0.99.11 (dovecot-0.99.11-4.EL4) on Centos 4.4 i386 /var/log/maillog has started to produce several times per minute this entry: Mar 9 14:52:44 mail pop3(albrook): Timeout while waiting for release of fcntl() lock for mbox file /var/mail/albrook when this happens, users cannot receive email properly, but eventually (maybe a few minutes or a few hours) the email gets delivered. is this a problem in the 0.99 version? can i safely upgrade to 1.2? thanks,

2 2

[Dovecot] Cannot create auth-master file
by Greg Frith 09 Mar '10

09 Mar '10

Hi all, I'm trying to get postfix and dovecot working nicely together to process and store mail for both local (system) on one domain and virtual users and a few different domains. I've got postfix up and running quite nicely, but am having a few problems with Dovecot. Every time postfix tried to delivery a message to a virtual user using dovecot I get an error like the following in /var/log/mail.log: Mar 8 21:53:58 rhy postfix/pipe[6616]: 89C94846E: to=<gregf(a)gregsfamily.com>, orig_to=<greg(a)gregsfamily.com>, relay=dovecot, delay=8795, delays=8794/0.01/0/0.61, dsn=4.3.0, status=deferred (temporary failure) At the same instant, in my dovecot log I'll get this error: deliver(gregf(a)gregsfamily.com): 2010-03-08 21:53:58 Error: Can't connect to auth server at /var/run/dovecot/auth-master: Connection refused So, I'm guessing that this is a permissions issue (somewhere) and that the dovecot process is not able to create the file /var/run/dovecot/auth-master. The permissions on this folder are as follows: gregf@rhy:/etc/dovecot$ ls -al /var/run/dovecot/ total 0 drwxr-xr-x 3 root root 100 2010-03-08 21:44 . drwxr-xr-x 15 root root 660 2010-03-08 22:00 .. srw------- 1 vmail root 0 2010-03-08 21:43 auth-master srwxrwxrwx 1 root root 0 2010-03-08 21:43 dict-server drwxr-x--- 2 root dovecot 60 2010-03-08 21:44 login I've searched around for hours, found several threads describing similar issues, but no solutions that have worked for me. If anyone is able to give me any pointers or suggestions I would be most grateful. My dovecot configuration is: gregf@rhy:/etc/dovecot$ sudo dovecot -n # 1.1.11: /etc/dovecot/dovecot.conf # OS: Linux 2.6.28-18-generic x86_64 Ubuntu 9.04 ext3 log_timestamp: %Y-%m-%d %H:%M:%S protocols: imaps pop3s imap pop3 login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login mail_privileged_group: mail mail_location: maildir:/home/vmail/%d/%u mail_debug: yes mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 auth default: mechanisms: plain login user: vmail debug: yes debug_passwords: yes passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: static args: uid=5000 gid=5000 home=/home/vmail/%d/%n allow_all_users=yes socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: vmail :wq G

3 5

[Dovecot] Using MySQL For Mailboxes?
by Carlos Mennens 09 Mar '10

09 Mar '10

I have always seen some people indicate they use MySQL for mailboxes in Postfix and I wondered how difficult something like this would be? I have 300 users on my company Postfix server right now. I am just using Postfix, Dovecot (IMAP4 only), & Roundcube (Webmail). I have MySQL loaded on the machine that runs Postfix but only to manage the database for Roundcube. Do you think that 300+ users is recommended for a MySQL database for mailboxes? Secondly, how difficult is it to configure this? Right now everyone user has a home directory and a mailbox in their private home folder. Is it hard to configure Postfix & Dovecot to use MySQL mailboxes? Just looking for some suggestions since I couldn't find a log of info via Google. *PS* I was told that Dovecot doesn't support MySQL mailboxes. I think it does. Am I wrong? http://howtoforge.com/forums/showthread.php?p=221396#post221396

8 15

[Dovecot] Solaris + Postfix + Dovecot
by Zilon X 09 Mar '10

09 Mar '10

Please, Where can I find a tutorial or sample config for Dovecot on Solaris? Thank you for any help!

3 4

[Dovecot] Dovecot 2.0beta3: Latest HG crashed upon LMTP Delivery
by Thomas Leuxner 09 Mar '10

09 Mar '10

Hi, unsure how to provide more useful information, as I can not get LMTP to create a core dump. With the latest changes from Mercurial it dies upon message delivery: ==> /var/log/dovecot.log <== Mar 8 20:03:33 spectre dovecot: lmtp(11690): Connect from local Mar 8 20:03:33 spectre dovecot: lmtp(11690): Connect from local Mar 8 20:03:33 spectre dovecot: lmtp(11690): Connect from local Mar 8 20:03:33 spectre dovecot: master: service(lmtp): child 11690 killed with signal 11 (core not dumped) Mar 8 20:03:33 spectre dovecot: master: service(lmtp): command startup failed, throttling Thomas

3 9

[Dovecot] Panic: file istream-raw-mbox.c: line 583 (istream_raw_mbox_get_body_size): assertion failed: (rstream->body_offset != (uoff_t)-1)
by mailinglists＠belfin.ch 09 Mar '10

09 Mar '10

Hi We run dovecot 1.2.10 on Solaris 10 and had a few days ago this error message in the logs: Mar 6 21:48:55 dovecot: [ID 583609 mail.crit] IMAP(username): Panic: file istream-raw-mbox.c: line 583 (istream_raw_mbox_get_body_size): assertion failed: (rstream->body_offset != (uoff_t)-1) Mar 6 21:48:55 dovecot: [ID 583609 mail.error] IMAP(username): Raw backtrace: 0xb1064 -> 0xb0aa0 -> 0x552a8 -> 0x554fc -> 0x55768 -> 0x55d90 -> 0x57590 -> 0x57ac4 -> 0x715e0 -> 0x642c4 -> 0x57bd4 -> 0x7138c -> 0x68478 -> 0x76c4c -> 0x76c80 -> 0x25a5c -> 0x2b028 -> 0x2bf38 -> 0x2bef4 -> 0x2c24c -> 0x2cba0 -> 0xb9660 -> 0xb8f10 -> 0x352e8 -> 0x2473c Mar 6 21:48:55 dovecot: [ID 583609 mail.error] dovecot: child 25520 (imap) killed with signal 6 (core dumps disabled) Thanks, Philipp

2 1

[Dovecot] Pigeonhole Sieve date extension
by Edgar Fuß 09 Mar '10

09 Mar '10

Probably I'm doing something stupidly wrong. I have dovecot 1.2.7 and sieve 0.1.13. I have a sieve script starting with # <some comment> require ["vacation", "date", "relational"]; I get main_script: line 2: error: require command: unknown Sieve capability 'date'. Just to make sure I haven't messed up the dovecot package: $ strings /usr/pkg/lib/dovecot/lda/lib90_sieve_plugin.a | fgrep date_extension date_extension date_extension date_extension date_extension date_extension What's going on? It's probably some totally stupid typo on my side.

2 3

[Dovecot] force to recalculate quotadict
by Andre Hübner 08 Mar '10

08 Mar '10

Hello, i use working quotasystem with sql-quotadict. The values stored in db are used to realize also a quotasystem in postfix to reject mails if they are bigger then remaining quota. if dataset in quotadict is missing for some reasons, postfix can't calculate quota and mail gets delivered even if user is already over quota. I am looking for a way to force dovecot/lda to recalculate users bytes/messages with command xy and not to wait for incomming mail. Currently i use: deliver -d $user -n -m folderwithunspeakablenamesonobodyusesthis and send a small message which gets lost but starts the calculation. This works but seems not to be the finest way. Is there a better way or my current procedure acceptable? Thanks, Andre

3 2

[Dovecot] Dovecot Proxy - auth on proxy
by BaQs 08 Mar '10

08 Mar '10

Good afternoon list, I'm really struggling making this feature work: http://wiki.dovecot.org/PasswordDatabase/ExtraFields/Proxy

1 0

Re: [Dovecot] force to recalculate quotadict
by Andre Hübner 08 Mar '10

08 Mar '10

Hello, > 1. remove the quota in the DB, > 2. make same changes. hmm, i see. but unfortunately this is not a way i can do. it would be acceptable in private scope but not for bussinesscustomers. to make a change i would manipulate customers maildata which is not allowed this way. a simple command to update complete quota for the single user would be the best way. now i tried to connect per telnet and use command Getquotaroot, seems also to work. this should be scriptable... ok thanks, i will try something... Andre

3 2

[Dovecot] Saving Sent Messages to Sent Folder
by Charles Marcus 08 Mar '10

08 Mar '10

Hi Timo, There was another thread (it has come up at least a few times in the past few years I've been lurking) on the postfix list about having some kind of automatic 'Save to Sent' option to avoid the users mail client from having to upload messages twice (obviously the only ones of concern are ones with large attachments) - once to send it, and once to save the copy in the sent folder. I know and understand that doing this is not generally the job of the MTA, but hopefully most people can at least admit that there would be a (potentially huge, in the case of any large company that deals with a lot of large attachments in their email) savings in bandwidth (and user frustration) if a way could be found to do this reliably and at little to no 'cost' in terms of CPU/Disk IO, so I have a question about how this might be done... Given: Postfix can be configured to use the Dovecot LDA for delivering mail incoming. My question is simply, why wouldn't it be possible to create a Dovecot LSA ('submission agent'), that could be defined in postfix's master.cf file, which could then be configured to a) pipe the message to postfix, and b) if message is successfully sent, save a copy to the users Sent folder? Obviously, there would be some caveats - ie, postfix and dovecot would both have to be running on the same box (or at a minimum on the same local network)... Anyway, this is just something that really bugs me (and has for many, many years) every time I send a message with a large attachment, and have to watch it slowly process the message sending it, then again to save it to the Sent folder, so Ijust wanted to get your take on if this is even remotely feasible... -- Best regards, Charles

5 27

[Dovecot] 2.0 beta 3 w/o libwrap?
by Scott Ellis 08 Mar '10

08 Mar '10

I'm trying to kickstart 2.0b3 on my NetBSD system (where 1.2.x works great!), and keep hitting: Fatal: service(tcpwrap) access(/software/dovecot-2.0beta3/libexec/dovecot/tcpwrap) failed: No such file or directory Indeed, that file doesn't exist...but I don't have nor want libwrap. It appears that doveconf includes tcpwrap... service tcpwrap { chroot = client_limit = 1 drop_priv_before_exec = no executable = tcpwrap extra_groups = group = privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = user = $default_internal_user vsz_limit = 4294967295 } ...but nothing else seems to. Running configure with --without-libwrap doesn't make any difference (configure doesn't find libwrap anyway). What am I missing here? How can I use dovecot 2.0 w/tcp wrappers? ScottE

2 1

[Dovecot] Could use some help setting Dovecot up for the first time
by joe 08 Mar '10

08 Mar '10

Hi Everyone, I've managed to get most of postfix and dovecot running using the howto located on dovecot.org. So, I went to go test sending a email locally and i am getting this error which i cannot seem to resolve. Any help would be welcomed. Mar 07 19:14:55 deliver(test(a)fasti.net): Info: auth input: home=/var/vmail/test(a)fasti.net/ Mar 07 19:14:55 deliver(test(a)fasti.net): Info: auth input: mail=maildir:/var/vmail/test@fasti.net/ Mar 07 19:14:55 deliver(test(a)fasti.net): Info: auth input: uid=101 Mar 07 19:14:55 deliver(test(a)fasti.net): Info: auth input: gid=12 Mar 07 19:14:55 deliver(test(a)fasti.net): Info: auth input: quota=maildir:storage=0 Mar 07 19:14:55 deliver(test(a)fasti.net): Fatal: setgid(12) failed with euid=101(vmail), gid=6(mail), egid=6(mail): Operation not permitted -- This message has been scanned for viruses and dangerous content by MailScanner, and is believed to be clean.

4 7

[Dovecot] Simple authentication problem
by David Ramsey 06 Mar '10

06 Mar '10

I'm trying to configure dovecot on a SUSE system, and having trouble with the simplest possible authentication scheme: using the standard Linux users and passwords. My configuration is: dovecot -n # 1.1.7: /etc/dovecot/dovecot.conf # OS: Linux 2.6.27.45-0.1-pae i686 openSUSE 11.1 (i586) protocols: imap pop3 ssl_listen: * ssl_disable: yes disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 auth default: default_realm: renomustangcarclub.com passdb: driver: pam userdb: driver: passwd Attempts to log in: 99-26-248-100:~ dramsey$ telnet renomustangcarclub.com pop3 Trying 99.26.248.108... Connected to renomustangcarclub.com. Escape character is '^]'. +OK Dovecot ready. user dramsey +OK pass raskin -ERR Authentication failed. Looking in the mail log file: Mar 5 16:40:55 Microstar dovecot: pop3-login: Disconnected (auth failed, 1 attempts): user=<dramsey(a)renomustangcarclub.com>, method=PLAIN, rip=99.26.248.100, lip=99.26.248.108 Any ideas?

2 2

Re: [Dovecot] Number of users for one Solr instance
by Lee 05 Mar '10

05 Mar '10

Hi, This is my first mail, fyi. I dont know internals of the plugin but it depends more on Solr than Dovecot. Also the activity level and "real-timeness" of the index is important. Assuming this as the search only machine and relatively moderate usage, a big box with lots of RAM and 4-way server may work in your case. Lee

1 0

[Dovecot] Number of users for one Solr instance
by Ernesto Revilla 05 Mar '10

05 Mar '10

Dear all. (I'm new to the list.) Our regional government is considering, due to our proposal, migrate from Courier to Dovecot. 70k mailboxes. One of the most attractive features for them is the usage of indexes, and especially Solr FTS plugin. Their question is: How many users (range of users) could support one Solr instance used as index and search backend? Are there any deployment examples? I think, it would be easy to split users into different Solr instances, but it's not that easy to reorganize them, as we have to reindex if one user is moved from one instance to another. Regards. Erny Yaco Sistemas

1 0

[Dovecot] plugin Again
by Alex Baule 04 Mar '10

04 Mar '10

Hello.... Someone know ho work the istream-concat ? I made a copy of istream-concat, and use to manipulate my encrypted body. But i got some questions about the stream->pos, stream->skip and position of the message and pointer to buffer. My messages have the W= with the email size decrypted, and it is a little lass that the email size crypto. For exemple: I have a email with 6000k in crypto and decrypto the size is 5985 k: The buffer from istream-concat is 4096, i read 4096 from get_stream_data, but the result of this read is minor , lets say 4080, but the next read must be from 4096. The "send to client" must be 4080, to send the correctly data decrypted. My Question is, what the variable used in istream-concat, to send the data to client ? I need to update the stream->pos with my data length ?? I dont know if i made understand my question.....

2 1

[Dovecot] Dovecot 2.0.beta3: mdbox mailbox crashes upon login
by Thomas Leuxner 04 Mar '10

04 Mar '10

Hi, converted my personal mailbox from 'maildir' to 'mdbox' for testing today: # dsync convert -u user@domain mdbox:~/mdbox Set mail location to mdbox in 'mail.conf' and restarted server: mail_location = mdbox:~/mdbox Dovecot panicked instantly upon login with different clients. Tried to disable several plugins to no avail: Feb 28 14:43:02 spectre dovecot: imap(user@domain): Panic: file mailbox-list-fs.c: line 170 (fs_list_get_path): assertion failed: (mailbox_list_is_valid_pattern(_list, name)) Feb 28 14:43:02 spectre dovecot: imap(user@domain): Raw backtrace: /usr/lib/dovecot/libdovecot.so.0 [0x7f0a0d891e72] -> /usr/lib/dovecot/libdovecot.so.0 [0x7f0a0d891eda] -> /usr/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f0a0d892283] -> /usr/lib/dovecot/libdovecot-storage.so.0 [0x7f0a0db2b2c3] -> /usr/lib/dovecot/modules/lib01_acl_plugin.so [0x7f0a0ccd70c3] -> /usr/lib/dovecot/modules/lib01_acl_plugin.so(acl_mailbox_list_have_right+0x5c) [0x7f0a0ccdadbc] -> /usr/lib/dovecot/modules/lib01_acl_plugin.so [0x7f0a0ccdb12c] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_list_iter_next+0xa) [0x7f0a0dafc4da] -> /usr/lib/dovecot/modules/lib01_acl_plugin.so [0x7f0a0ccdaa2a] -> /usr/lib/dovecot/modules/lib01_acl_plugin.so [0x7f0a0ccdb252] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_list_iter_next+0xa) [0x7f0a0dafc4da] -> dovecot/imap [user@domain 84.58.106.99 LIST] [0x40b549] -> dovecot/imap [user@domain 84.58.106.99 LIST](cmd_list_full+0x4e6) [0x40c446] -> dovecot/imap [user@domain 84.58.106.99 LIST] [0x40f9bc] -> dovecot/imap [user@domain 84.58.106.99 LIST] [0x40fa6d] -> dovecot/imap [user@domain 84.58.106.99 LIST](client_handle_input+0x45) [0x40fbe5] -> dovecot/imap [user@domain 84.58.106.99 LIST](client_input+0x62) [0x410622] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xcb) [0x7f0a0d89c8fb] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x18) [0x7f0a0d89ba78] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f0a0d88be33] -> dovecot/imap [user@domain 84.58.106.99 LIST](main+0x191) [0x418661] -> /lib/libc.so.6(__libc_start_main+0xe6) [0x7f0a0d1191a6] -> dovecot/imap [user@domain 84.58.106.99 LIST] [0x4084e9] Feb 28 14:43:02 spectre dovecot: master: service(imap): child 10202 killed with signal 6 (core dumps disabled) Regards Thomas

2 5

Re: [Dovecot] A dovecot book ?
by Carsten Laun-De Lellis 04 Mar '10

04 Mar '10

Am 03.03.2010 23:55, schrieb Curtis Maloney: > On 03/04/10 09:10, Noel Butler wrote: >> There is only one authoritative source who should be writing it if a >> book is to be written and we all know who that author should be. > > I disagree. In the time I've been watching/using Dovecot (since the > 0.99 series) Timo has had many cases of improving Dovecot [even if > it's just a config option name] because of the points of view of other > people. > > For many reasons, I thinks it would be better if someone else > [preferably someone with a long history with Dovecot, of course] were > to write the book, and Timo signed off on it. > >> But for what version, as 1.x is in wide usage and will be for a long >> time, 2.0 is almost upon us, much of 1.x is not applicable to 2.x , so >> should Timo be writing 2 books? One excessively big book? Where is he >> to find time to write this whilst developing dovecot, and heaven forbid, >> enjoy the outside world with a real life :) > > Given a sizable portion of understanding Dovecot is understanding > email in general, I wonder just how much of the book would bifurcate > for covering the differing versions... > > -- > Curtis Maloney Hi all I have never thought on so many comments to my question and i am surely surprised about the direction how this discussion went. I totally agree with the one of you who mentioned the online documentation and the wiki. I know that it exists and i used it for setting up my mail server, but ... as i said, i am old fashioned and i can better work with books. It's just a personal preferrence. Well, i also know that many developers are still working on dovecot, especially Timo and that always new features, configuration options and so on are added, but ... it's the same with other applications in the community (e.g. postfix, apache, OpenLDAP, samba ....) and for all those applications books are available, and that was the reason, why i asked for a book. And to be honest. When i go thru the documentation part, most of the documents were not changed for at least 6 months. I am sure that between the writing and the publishing of a book new dovecot features will be introduced and not covered in the book. But everyone working with books knows that they can't be up to date, but they are a real good basis for me to start with the fundamentals and then add this information by new data from the web. And guys just to mention one big advantage of a book is, you can read it offline easily!! But there is one thing i want to mention at this point. Even if you agree with me about having a book or not. What i really like is the discussion about and the chance to do so, because dovecot is opensource. And for me this is in the end the result behind the idea of open source. Everyone has the chance to contribute, either by code, by suggestions, by comments ..... And that for me is more important than to have a book or not. Thank you all for your comments. Regards, -- Mit freundlichem Gruß Carsten Laun-De Lellis Dipl.-Ing. Elektrotechnik Certified Information Systems Auditor (CISA) Hauptstrasse 13 D-67705 Trippstadt Phone: +49 (6306) 992140 Mobile: +49 (151) 27530865 email: carsten.delellis(a)delellis.net

1 0

[Dovecot] A dovecot book ?
by Carsten Laun-De Lellis 04 Mar '10

04 Mar '10

Hi all I am using dovecot at home for privat use and i found a lot of documentation here on the web. But you know, i am an old fashion guy and i like books. Is there a book on the market that will help me with understanding dovecot more and the configuration options ? Thanks in advance for any suggestions. -- Regards, Carsten Laun-De Lellis Dipl.-Ing. Elektrotechnik Certified Information Systems Auditor (CISA) Hauptstrasse 13 D-67705 Trippstadt Phone: +49 (6306) 992140 Mobile: +49 (151) 27530865 email: carsten.delellis(a)delellis.net

9 11