- dovecot - dovecot.org

[Dovecot] Replication problem I have. And how I think I can get around problem.
by Peter Dolding 04 Jul '11

04 Jul '11

I have two servers in two different locations. Neither what you would call 100 percent safe from being turned off. Most staff use web based email. This backs onto imap server. I do know I will have to deal with contact lists and other items. in that client. Worst part is the link between them may get broken so both servers may be receiving email and back active at the same time. I can see 1 very clear way around this problem. If I accept that the imap ids at each of the server will be that server only. Since users are mostly using webbased they are not going to notice. If they do notice because they have connected to a different domain address stiff bad luck. Now what I need to be able to deal with the problem. 1 a unique server id on each message for the server the message was received on. 1 a unique server receive id for each message as imap like id for service recieved messages for message received directly not synced. 1 logs for messages deleted and changes that are not current server server id. This should be pritty simple todo. Basically 1 log per server flushed when synced with the server it owns to. 1 a sync function that deletes and changes messages that have been deleted or changed at other locations and compares other servers current messages against copies retained at the mirroring location. Now with this. Each new message to each store gets the next imap id along with system wide unique combination of sever id and service receive id. No modifications of already recieved messages ids. Since I am not careing if the imap id are matched between servers. Fairly much able to use a custom for of imap syncing working off the server id's and server receive ids. Of course this solution should be fairly fault torrent. Since each server can directly store any message they receive. Also it should be possible to trace back to what server the message came from in case of spam problems or equal. Now my biggest problem can I attach my own custom attributes to incoming mail to the store and access that information effectively. Since with that information I will be able to do a form of live synced storage. Personally I see imap id design as a defect in protocal since it never allowed server id along with it this is why imap 100 percent synced message stores cannot be run on independent servers with unstable network connects well. Nothing comes without a price. This solution does not require clustered file systems or a constant active connection between servers so able to operate in areas of disruption. It does not block the servers from receiving emails at any time either. Problem is of course is if someone connects a client directly from 1 server to another. Mail will have to be re-downloaded. Also I have to check of z-push/ActiveSync depends on the imap ids being dependable across the network if not most hand held devices will not be a problem. If it don't then only imap has a problem. I can live with that. Ie if local email server down use web mail until local mail server is fixed. Old rule of networking 40 to 50 percent functional network staff can normally still get stuff done. 0 percent functional you have downtime. Now if I can get the email storage fault torrent and to remain operational in case of fault I then can focus on getting the web base applications using a equal system for contacts and other things. So each location can remain fairly operational no matter what. This way if a server disappeared for good only thing that would have to be changed is syncing. Wise move is to allow servers to be defined more than 1 server id. Ie a server gone for good remaining server gets told to take over responsibility for the old servers id messages. New replacement server given a new id and everything keeps on going nice. Anyone else with a better idea or advice how to add my own custom ids in a way they cannot be distrupted and are simple to search. If it works push for server id's in imap5? Ie imap5 clients being able to cope with the event that an email store is spreed between multi servers that may not be connected all the time. Peter Dolding

2 1

[Dovecot] Dovecot error on rhel 6.1 using GFS2(bug)
by Aliet Santiesteban Sifontes 04 Jul '11

04 Jul '11

Hi, just to let you know to all the people testing dovecot in a RHEL 6.1 setup where nodes are Active/Active and sharing a GFS2 filesystem that there is a bug on latest rhel6.1 GFS2 kernel modules, and latest updates in 6.0 wich makes dovecot crash a GFS2 filesystem, with a corruption and other related errors, redhat people have posted a fix for the kernel wich is in QA: https://bugzilla.redhat.com/show_bug.cgi?id=712139 Just hope this helps somebody to don't waste many nights looking for a problem in dovecot config :) as I did... best regards, Aliet

1 0

[Dovecot] Invitation to connect on LinkedIn
by Marcelo Salhab Brogliato via LinkedIn 03 Jul '11

03 Jul '11

LinkedIn ------------ Marcelo Salhab Brogliato requested to add you as a connection on LinkedIn: ------------------------------------------ Michael A., I'd like to add you to my professional network on LinkedIn. - Marcelo Salhab Accept invitation from Marcelo Salhab Brogliato http://www.linkedin.com/e/458g9e-gpoedy6h-6q/V7LnuFRIQXpYNGb2yum6IE4IQU3ZkP… View invitation from Marcelo Salhab Brogliato http://www.linkedin.com/e/458g9e-gpoedy6h-6q/V7LnuFRIQXpYNGb2yum6IE4IQU3ZkP… ------------------------------------------ DID YOU KNOW that LinkedIn can find the answers to your most difficult questions? Post those vexing questions on LinkedIn Answers to tap into the knowledge of the world's foremost business experts: http://www.linkedin.com/e/458g9e-gpoedy6h-6q/ask/inv-23/ -- (c) 2011, LinkedIn Corporation

1 0

[Dovecot] auth error using director
by Angel L. Mateo 01 Jul '11

01 Jul '11

Hello, I am trying to configure director as described at http://wiki2.dovecot.org/Director. I have previously tried the proxy and it worked. The problem I have is that whenever I try to connect I get the error: Jul 1 11:41:41 myotis40 dovecot: pop3-login: Error: auth: connect(director) failed: No such file or directory This is my doveconf -n: # 2.0.13: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-4-amd64 x86_64 Ubuntu 10.04.2 LTS auth_cache_size = 1 k auth_debug = yes auth_verbose = yes default_process_limit = 256 director_mail_servers = 155.54.211.161 155.54.211.169 director_servers = 155.54.211.170 disable_plaintext_auth = no dotlock_use_excl = no hostname = myotis30 log_timestamp = %Y-%m-%d %H:%M:%S mail_debug = yes mail_fsync = always mail_location = maildir:~/Maildir:INDEX=/var/indexes/%n mail_nfs_storage = yes mail_privileged_group = mail maildir_stat_dirs = yes mdbox_rotate_size = 20 M namespace { inbox = yes location = prefix = separator = / } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve zlib_save = gz zlib_save_level = 6 } postmaster_address = postmaster(a)um.es protocols = " pop3" service auth { unix_listener auth-userdb { mode = 0666 } } service imap-login { executable = imap-login director } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix user = postfix } } service pop3-login { executable = pop3-login director } ssl = no ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } protocol lda { mail_plugins = " sieve" } -- Angel L. Mateo Martínez Sección de Telemática Área de Tecnologías de la Información _o) y las Comunicaciones Aplicadas (ATICA) / \\ http://www.um.es/atica _(___V Tfo: 868887590 Fax: 868888337

1 1

[Dovecot] ldapsearch dump for passwd file: base64 encoded passwords
by Denny Schierz 01 Jul '11

01 Jul '11

hi, is there a way, to let Dovecot2 uses the base64 encoded passwords from a ldapsearch output, without decode them first? cu denny

2 2

[Dovecot] Dovecot 2.0, mysql and quota
by Claudio Prono 01 Jul '11

01 Jul '11

Hello all, I have some troubles to make the quota_check working with dovecot 2.0. My config is the following: postfix, dovecot as lda, mysql as virtual mailuser backend, and postfixadmin for the mailuser administration. Previously i have a working setup with dovecot 1.x, now with the 2.0 something is wrong about the quota, but i don't know what... Here is my config: # 2.0.13: /etc/dovecot/dovecot.conf # OS: Linux 2.6.37.6-0.5-desktop x86_64 openSUSE 11.4 (x86_64) ext3 auth_mechanisms = plain login first_valid_gid = 51 first_valid_uid = 51 info_log_path = /var/log/dovecot-inf.log last_valid_gid = 51 last_valid_uid = 51 log_path = /var/log/dovecot-err.log mail_home = /var/mail/virtual/%d/%u/ mail_location = maildir:/var/mail/virtual/%d/%u managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date namespace { hidden = no inbox = yes list = yes location = prefix = INBOX. subscriptions = yes type = private } passdb { args = /etc/dovecot/dovecot-mysql.conf driver = sql } plugin { quota = maildir:User quota quota_warning = storage=80%% /usr/bin/quota_warning.sh 80 quota_warning2 = storage=90%% /usr/bin/quota_warning.sh 90 quota_warning3 = storage=99%% /usr/bin/quota_warning.sh 90 sieve = /var/mail/virtual/%d/%u/.dovecot.sieve sieve_storage = /var/mail/virtual/%d/%u/sieve } protocols = imap pop3 sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { mode = 0600 } unix_listener auth-userdb { group = nobody mode = 0660 user = postfix } } service imap-login { inet_listener imap { address = 127.0.0.1 port = 143 } } service managesieve-login { executable = /usr/lib/dovecot/managesieve-login } service managesieve { executable = /usr/lib/dovecot/managesieve } service quota-warning { executable = script /usr/bin/quota_warning.sh user = postfix } ssl = no userdb { driver = passwd } userdb { args = /etc/dovecot/dovecot-mysql.conf driver = sql } protocol imap { imap_client_workarounds = mail_plugins = quota imap_quota } protocol sieve { managesieve_max_line_length = 65536 plugin { sieve = /var/mail/virtual/%d/%u/.dovecot.sieve sieve_storage = /var/mail/virtual/%d/%u/sieve } } protocol pop3 { mail_plugins = quota pop3_uidl_format = UID%u-%v } protocol lda { auth_socket_path = /var/run/dovecot/auth-master log_path = /var/log/dovecot-lda.log mail_debug = yes mail_plugins = quota sieve postmaster_address = postmaster(a)mediaservice.net } My user query for mysql is the following: user_query = SELECT maildir, 51 AS uid, 51 AS gid, CONCAT('*:bytes=', mailbox.quota ) AS quota_rule FROM mailbox WHERE username = '%u' AND active = '1' I have made some test, with a test mailbox, with the quota setted to 1 Mb, in fact the maildirsize file contains: 1024000S When i write a mail, something strange is happening: with the debug mail of dovecot active i see this: Jun 29 17:42:19 lda: Debug: Loading modules from directory: /usr/lib64/dovecot/modules Jun 29 17:42:19 lda: Debug: Module loaded: /usr/lib64/dovecot/modules/lib10_quota_plugin.so Jun 29 17:42:19 lda: Debug: Module loaded: /usr/lib64/dovecot/modules/lib90_sieve_plugin.so Jun 29 17:42:19 auth: Info: mysql(127.0.0.1): Connected to database postfix Jun 29 17:42:19 lda: Debug: auth input: testquota(a)mediaservice.pri maildir=mediaservice.pri/testquota/ uid=51 gid=51 quota_rule=*:bytes=1024000 Jun 29 17:42:19 lda: Debug: Added userdb setting: plugin/maildir=mediaservice.pri/testquota/ Jun 29 17:42:19 lda: Debug: Added userdb setting: plugin/quota_rule=*:bytes=1024000 Jun 29 17:42:19 lda(testquota(a)mediaservice.pri): Debug: Effective uid=51, gid=51, home=/var/mail/virtual/mediaservice.pri/testquota(a)mediaservice.pri/ Jun 29 17:42:19 lda(testquota(a)mediaservice.pri): Debug: Quota root: name=User quota backend=maildir args= Jun 29 17:42:19 lda(testquota(a)mediaservice.pri): Debug: Quota rule: root=User quota mailbox=* bytes=1024000 messages=0 Jun 29 17:42:19 lda(testquota(a)mediaservice.pri): Debug: Quota warning: bytes=819200 (80%) messages=0 reverse=no command=/usr/bin/quota_warning.sh 80 Jun 29 17:42:19 lda(testquota(a)mediaservice.pri): Debug: Quota warning: bytes=921600 (90%) messages=0 reverse=no command=/usr/bin/quota_warning.sh 90 Jun 29 17:42:19 lda(testquota(a)mediaservice.pri): Debug: Quota warning: bytes=1013760 (99%) messages=0 reverse=no command=/usr/bin/quota_warning.sh 90 Jun 29 17:42:19 lda(testquota(a)mediaservice.pri): Debug: Namespace : type=private, prefix=INBOX., sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/var/mail/virtual/mediaservice.pri/testquota@mediaservice.pri Jun 29 17:42:19 lda(testquota(a)mediaservice.pri): Debug: maildir++: root=/var/mail/virtual/mediaservice.pri/testquota(a)mediaservice.pri, index=, control=, inbox=/var/mail/virtual/mediaservice.pri/testquota(a)mediaservice.pri Jun 29 17:42:19 lda(testquota(a)mediaservice.pri): Debug: Quota root: name=User quota backend=maildir args= Jun 29 17:42:19 lda(testquota(a)mediaservice.pri): Debug: Quota warning: bytes=0 (80%) messages=0 reverse=no command=/usr/bin/quota_warning.sh 80 Jun 29 17:42:19 lda(testquota(a)mediaservice.pri): Debug: Quota warning: bytes=0 (90%) messages=0 reverse=no command=/usr/bin/quota_warning.sh 90 Jun 29 17:42:19 lda(testquota(a)mediaservice.pri): Debug: Quota warning: bytes=0 (99%) messages=0 reverse=no command=/usr/bin/quota_warning.sh 90 Jun 29 17:42:19 lda(testquota(a)mediaservice.pri): Debug: none: root=, index=, control=, inbox= Jun 29 17:42:19 lda(testquota(a)mediaservice.pri): Debug: Destination address: testquota(a)mediaservice.pri (source: user@hostname) Jun 29 17:42:19 lda(testquota(a)mediaservice.pri): Debug: sieve: user's script path /var/mail/virtual/mediaservice.pri/testquota(a)mediaservice.pri/.dovecot.sieve doesn't exist (using global script path in stead) Jun 29 17:42:19 lda(testquota(a)mediaservice.pri): Debug: sieve: user has no valid personal script Jun 29 17:42:19 lda(testquota(a)mediaservice.pri): Debug: sieve: no scripts to execute: reverting to default delivery. Jun 29 17:42:19 lda(testquota(a)mediaservice.pri): Info: msgid=<4E0B47DA.9030607(a)atpss.net>: saved mail to INBOX First question: why i see two times the quota warning check? Anyway, if the 80% or 90% of the quota is fullfilled, no warning pops out.... I have also checked the query it does to mysql, is the following SELECT maildir, 51 AS uid, 51 AS gid, CONCAT('*:bytes=', mailbox.quota ) AS quota_rule FROM mailbox WHERE username = 'testquota(a)mediaservice.pri' AND active = '1' And the result, is the following: +-----------------------------+-----+-----+-----------------+ | maildir | uid | gid | quota_rule | +-----------------------------+-----+-----+-----------------+ | mediaservice.pri/testquota/ | 51 | 51 | *:bytes=1024000 | +-----------------------------+-----+-----+-----------------+ Seems right to me...but it is not working.... why? Ah, this is the content of the quota_warning.sh: #!/bin/sh PERCENT=$1 USER=$2 cat << EOF | /usr/local/libexec/dovecot/dovecot-lda -d $USER -o "plugin/quota=maildir:User quota:noenforcing" From: postmaster(a)mediaservice.pri Subject: quota warning Your mailbox is now $PERCENT% full. EOF Any hint about what is not working? Thanks, Claudio Prono. -- -------------------------------------------------------------------------------- Claudio Prono OPST System Developer Gsm: +39-349-54.33.258 @PSS Srl Tel: +39-011-32.72.100 Via San Bernardino, 17 Fax: +39-011-32.46.497 10141 Torino - ITALY http://atpss.net/disclaimer -------------------------------------------------------------------------------- PGP Key - http://keys.atpss.net/c_prono.asc

2 3

[Dovecot] rsync.dovecot.org
by Timo Sirainen 01 Jul '11

01 Jul '11

Looks like at least some people still want to rsync their own local dovecot.org mirrors, so I've now added rsync support back. Use rsync.dovecot.org as the host. You can rsync: hg dovecotweb dovecotwiki dovecotwiki2 and mbox files of mailing list archives: dovecotmail dovecotnewsmail dovecotcvsmail So for example: rsync -az rsync://rsync.dovecot.org/dovecotweb dovecotweb

1 0

[Dovecot] NFS mail storage
by Daniel L. Miller 30 Jun '11

30 Jun '11

The parameters listed for nfs installations (mmap_disable, doctlock_use_excl, mail_nfs_storage, mail_nfs_index) - are they necessary for data integrity, and/or do they compensate for NFS latency and improve performance? My understanding is the indexes are a critical part of a dbox storage, but on the other hand having local indexes is a major performance consideration. Is maildir a "better" choice under NFS than dbox? -- Daniel

5 7

[Dovecot] Fwd: share an IMAP folder ?
by Frank Bonnet 30 Jun '11

30 Jun '11

Aoops I forgot to write I use MBOX format but thinking to convert to the right format to be able to use shared mailboxes. ( any advices about this convertion welcome ! ) -------- Original Message -------- Subject: [Dovecot] share an IMAP folder ? Date: Thu, 30 Jun 2011 17:03:52 +0200 From: Frank Bonnet <f.bonnet(a)esiee.fr> To: dovecot(a)dovecot.org Hello Is it possible to share an Imap folder for a user with another one ? user a> imap-folder1 ^ user b>------| Could user a share his folder "imap-folder1" with user b in readonly mode ? I use "real" users ( not virtuals ) Thanks a lot.

1 0

[Dovecot] dovecot, mdbox and indexes
by Angel L. Mateo 30 Jun '11

30 Jun '11

Hello everybody, We are updating our old dovecot 1.1 servers to 2.0. We have a farm os servers, with users in nfs filesystems and indexes in local fs. Mail is stored in maildir format. We don't warrant that a user is always directed to the same server, although our load balancer sends all request from one IP to the same server (during a session time with a inactivity timeout). This is the second scenario described at http://wiki2.dovecot.org/NFS. We are now trying to migrate to the third scenario and using mdbox. As an intermediate step, we have configured this second scenario, but with indexes in NFS filesystems. The configuration is: * mmap_disable = yes * dotlock_use_excl = no * mail_nfs_storage = yes * mail_nfs_index = yes * lock_method = fcntl (we have also tried with dotlock) This configuration works without any problems with few users, but with high load, we have a lot of lock timeouts error like: Jun 29 10:24:04 myotis34 dovecot: imap(mpm): Error: Timeout (180s) while waiting for lock for transaction log file /home/pas/01/014601/maildir_indexes/.INBOX/dovecot.index.log These errors cause a corrupted index and we have to manually delete the user's index so he could read his mail again. So we are planning to configure the third scenario. In this configuration, we don't have any problem during our tests if we use maildir format. But if we use mdbox one, we have problems when we have to change the final server for the server (We allways send the user to the same final server, but sometimes, if the server is down, for example, this is not possible). The tests we have done (with POP) are: * I connect to "my" server. There's no problem. I have my mail. I delete a mail. * I connect then to a server that have no index for me. The only problem is that the previously deleted mail appears again. * I connect then to a server with an outdated index: this is the problem. I have only the messages in that outdated index. The mail received since then has disappeared (although I could receive new mail). How could I solve this problem? Is this really a problem? Should I use a shared storage for indexes? What is the best configuration for a high availability service? -- Angel L. Mateo Martínez Sección de Telemática Área de Tecnologías de la Información _o) y las Comunicaciones Aplicadas (ATICA) / \\ http://www.um.es/atica _(___V Tfo: 868887590 Fax: 868888337

2 2