- dovecot - dovecot.org

[Dovecot] NoSQL Storage Backend
by Marten Lehmann 14 Feb '11

14 Feb '11

Hello, I found a posting on the mailing list from 2008 "Adding new storage backend to Dovecot" while searching for POP3 and IMAP servers, that allow to use a NoSQL backend rather than a traditional file system. The problem with traditional filesystems is, that they are very limited. You cannot easily extend it, even with RAID 10 all messages may be lost due to a RAID controller failure and just-in-time backups of a heavy loaded system with consistently changing messages folders are virtually impossible. Modern object stores like Scality, CouchDB or MongoDB can be very handy, as they easily allow to keep an arbitrary amount of copies of each message on different servers, you can simply add a storage node and new storage is immediately available and mailboxes aren't bound to a certain server any longer, but messages are evenly distributed across all storage nodes, thus distributing load as well. Since the original posting was dated 2008 I was in good hope, that someone worked on that already, but at least in dovecot-2.0.9/src/lib-storage I couldn't find anything relating to NoSQL message stores. Isn't this option of big interest for every bigger mailbox provider? How hard would it be to develop? Would it be possible to get this developed on a paid basis by the dovecot core team? Kind regards Marten

10 11

[Dovecot] Dsync parallel conversion warning
by Frank Bonnet 14 Feb '11

14 Feb '11

Hello When I run multiple dsync processes in parallel I sometime get this warning message (xxxxxxxx): Warning: Transaction log file /user/xxxxxxxx/mail/.imap/INBOX/dovecot.index.log was locked for xxx seconds "xxx seconds" is variable Is it a problem or just a real warning ? Thanks

2 4

Re: [Dovecot] critical feature from version 1 not migrated to version 2 = authentication configuration database per IP
by DaLiV＠apollo.lv 14 Feb '11

14 Feb '11

Timo Sirainen wrote: >> - another way (possible that will be more easiest, and good enough for >> advanced configurations) = single variable that may be set in block >> of exact ip listener configuration , as for provided before example >> may set variable "auth_db_suffix" = string("dc=domain1,dc=tld") for >> definition "local mail.domain1.tld" and that variable are inserted in >> auth block via variable inserting mechanism ... >> > Again not possible, because config parsing is done much earlier. > think for realization can take idea from that patch : --------------------------------- --- src/auth/auth-request.c.orig 2010-12-30 11:42:54.000000000 +0200 --- src/auth/auth-request.c.orig 2010-12-30 11:42:54.000000000 +0200 @@ -1547,6 +1547,7 @@ auth_request_get_var_expand_table(const { '\0', NULL, "login_user" }, { '\0', NULL, "login_username" }, { '\0', NULL, "login_domain" }, + { 'x', NULL, NULL }, { '\0', NULL, NULL } }; struct var_expand_table *tab; @@ -1600,6 +1601,15 @@ auth_request_get_var_expand_table(const auth_request); } } + const char *lip2user[][2] = {{"127.0.0.3","dc=domain1,dc=tld1"},{"127.0.0.1","localhost"},{"127.0.0.2","dc=domain2,dc=tld2"}}; + int arrsize=sizeof( lip2user ) / sizeof( lip2user[0]); + tab[18].value = ""; // default expanded to - emty string + int i; + for(i=0;i<arrsize;i++) { + if (strcmp(net_ip2addr(&auth_request->local_ip),(lip2user[i][0]))==0) { + tab[18].value = lip2user[i][1]; + } + } return tab; } --------------------------------- and there need only possibility to define pairs in config file for lip2user array initialization - then macro/variable %x will be available for substitution in all modules - as for ldap , as for filename-based parameters. in exaple patch created static table to match lip to suffix 127.0.0.3 = "dc=domain1,dc=tld1" 127.0.0.1 = "localhost" 127.0.0.2 = "dc=domain2,dc=tld2" how to initialize arrays from config - i'm was not explored for currently used coding structures may create this array more complex = not as simple pair - but as for selective conversion: %x1 lip to text1, %x2 lip to text2, %x3 lip to text3 ... - then diffirent advanced configurations will be possible ...

1 0

[Dovecot] SIS generating 2 different hashes for the same mail and attachment
by Nick Rosier 14 Feb '11

14 Feb '11

Hi, I've been testing SIS over the weekend as it seems to be a nifty feature. I don't have that many users and mailboxes but still... I only added the following line to my configuration: mail_attachment_dir = /var/spool/vmail/attachments As a test I sent a mail from GMail to 2 mailboxes (1 To and 1 CC). The attachment got saved to the attachment directory (on ZFS): # find . ./04 ./04/78 ./04/78/0478b28c2a4c235370bb3cef4bc0482bb6000dae-b8819638a60e574d5b530100bde47b1f-2088e7301f9e3c4dc97e0000bde47b1f-244 ./04/78/0478b28c2a4c235370bb3cef4bc0482bb6000dae-007dcd01a70e574d5c530100bde47b1f-98d08416e4712b4d75310100bde47b1f-192 # ls -l total 519 -rw------- 1 vmail vmail 242866 Feb 12 23:50 0478b28c2a4c235370bb3cef4bc0482bb6000dae-007dcd01a70e574d5c530100bde47b1f-98d08416e4712b4d75310100bde47b1f-192 -rw------- 1 vmail vmail 242866 Feb 12 23:50 0478b28c2a4c235370bb3cef4bc0482bb6000dae-b8819638a60e574d5b530100bde47b1f-2088e7301f9e3c4dc97e0000bde47b1f-244 So these files are not hardlinks, they are 2 seperate files. Checksums are the same: # sum * 58522 238 0478b28c2a4c235370bb3cef4bc0482bb6000dae-007dcd01a70e574d5c530100bde47b1f-98d08416e4712b4d75310100bde47b1f-192 58522 238 0478b28c2a4c235370bb3cef4bc0482bb6000dae-b8819638a60e574d5b530100bde47b1f-2088e7301f9e3c4dc97e0000bde47b1f-244 # md5 * MD5 (0478b28c2a4c235370bb3cef4bc0482bb6000dae-007dcd01a70e574d5c530100bde47b1f-98d08416e4712b4d75310100bde47b1f-192) = 684863b31dad701857642caedcdbf20a MD5 (0478b28c2a4c235370bb3cef4bc0482bb6000dae-b8819638a60e574d5b530100bde47b1f-2088e7301f9e3c4dc97e0000bde47b1f-244) = 684863b31dad701857642caedcdbf20a Did I miss something? I would have expected the file once in the attachment_dir. Rgds, N.

1 0

[Dovecot] Question about mdbox_preallocate_space and ext4
by Javier de Miguel Rodríguez 14 Feb '11

14 Feb '11

Hello Can anyone explain about mdbox_preallocate_space and ext4? Regards Javier

2 1

[Dovecot] Can't connect to auth server
by Phill Edwards 13 Feb '11

13 Feb '11

I'm trying to phase out procmail and move to dovecot-sieve instead. It ain't proving easy. I'll describe my setup: - Centos 5.2 box with dovecot 1.1.4 and dovecot-sieve 1.1.6 from ATrpms. - A single user account is used to store all our email (the account is called maildb). - Getmail is being used to fetch the email from various ISP mailboxes. I want to deliver mail to different folders in maildb's Maildir/ depending on who the email is addressed to (the procmail recipes currently do that). - Getmail destination section looks like this: [destination] type = MDA_external path = /usr/libexec/dovecot/deliver arguments = ("-d", "maildb") allow_root_commands = true - When I run getmail I get this error in dovecot.log: deliver(maildb): May 04 22:15:26 Error: Can't connect to auth server at /var/run/dovecot/auth-master: No such file or directory It's true that I don't have a file called auth-master. I guess I should have but until I started this dovecot-sieve work it was never a problem. I have no idea what that file should look like. As I installed from binary RPMs I would have thought one would have come with the install. Can anyone help? Regards, Phill

4 6

[Dovecot] lmtp logging to separate file
by Nikita Koshikov 12 Feb '11

12 Feb '11

Hello list, Testing lmtp deliver I can't constrain it to log all activity to separate file, like dovecot-lda does. Here is config: protocol lmtp { info_log_path = /var/log/dovecot/dovecot-deliver.log log_path = /var/log/dovecot/dovecot-deliver.log mail_plugins = acl quota trash virtual zlib expire sieve } protocol lda { info_log_path = /var/log/dovecot/dovecot-deliver.log log_path = /var/log/dovecot/dovecot-deliver.log mail_plugins = acl quota trash virtual zlib expire sieve } When message is proceed via protocol lda - record appear in /var/log/dovecot/dovecot-deliver.log, but when message arrives by protocol lmtp - logs got to /var/log/dovecot.log file. Is this settings suppose to be overwritten ?

2 4

[Dovecot] dsync parallel conversions ?
by Frank Bonnet 12 Feb '11

12 Feb '11

Hello Would it be possible to run multiple dsync command in parallel ? I have 4000 mailboxes to convert nad it takes a LOT of time to do so when running dsync one by one ... Thanks

2 2

[Dovecot] preserving \Recent when moving messages
by Mark Hedges 12 Feb '11

12 Feb '11

Is there any way to preserve \Recent, or am I out of luck? Some people have reported that my script which shuffles around expired or oversized mail also causes their clients to report it as already read. I guess those clients check \Recent instead of \Seen when they download. I wish I knew which clients. With Mail::IMAPClient I tried using move(), copy(), and migrate() but the result is the same-- once it looks at the source message, \Recent is gone. (I tried patching it where it greps out the \Recent flag before appending the messages, but that causes a silent error.) Directly appending to the destination folder does not help either, since I would lose any flags set by the user, and if I tried to preserve those, then I would lose the \Recent flag when I read through the destination folder to figure out which messages were which. RFC5301 says \Recent can never be set... but does its prohibition include the case of migrating mail, where the intent is to retain them intact? It would be nice if Dovecot offered a migration feature which would move a message from folder to folder without unsetting \Recent. Mark

2 1

[Dovecot] Connection refused. Mail Client Error: 800ccccd9. Please help :-))))
by michael＠lattari.eu 12 Feb '11

12 Feb '11

Hi! I cannot connect to the dovecot server :-( I get Windows Mail Client Error: 800ccccd9. Please help :-)))) # 2.0.beta6 (3156315704ef): /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-71.el6.x86_64 x86_64 Scientific Linux release 6.0 (Carbon) auth_debug = yes auth_debug_passwords = yes auth_verbose = yes auth_verbose_passwords = plain debug_log_path = /var/log/dovecot.log disable_plaintext_auth = no info_log_path = /var/log/dovecot.log listen = * log_path = /var/log/dovecot.log login_trusted_networks = 192.168.0./24 mail_debug = yes mbox_write_locks = fcntl passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocols = imap service imap-login { inet_listener imap { port = 143 } } ssl = no syslog_facility = local6 userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } verbose_proctitle = yes verbose_ssl = yes dovecot.log (very poor info on what happened - connections are not logged.... ): Feb 10 09:50:25 master: Info: Dovecot v2.0.beta6 (3156315704ef) starting up (core dumps disabled) Feb 10 10:07:07 master: Warning: Killed with signal 15 (by pid=7048 uid=0 code=kill) Feb 10 10:07:08 master: Info: Dovecot v2.0.beta6 (3156315704ef) starting up (core dumps disabled) Feb 10 10:08:04 doveadm: Debug: This is Dovecot's debug log (1297328884) Feb 10 10:08:04 doveadm: Info: This is Dovecot's info log (1297328884) Feb 10 10:08:04 doveadm: Warning: This is Dovecot's warning log (1297328884) Feb 10 10:08:04 doveadm: Error: This is Dovecot's error log (1297328884) Feb 10 10:08:04 doveadm: Fatal: This is Dovecot's fatal log (1297328884) Feb 10 10:47:24 master: Warning: Killed with signal 15 (by pid=7160 uid=0 code=kill) Feb 10 10:47:56 master: Info: Dovecot v2.0.beta6 (3156315704ef) starting up (core dumps disabled) Feb 10 10:47:57 master: Warning: Killed with signal 15 (by pid=7194 uid=0 code=kill) Feb 10 10:47:58 master: Info: Dovecot v2.0.beta6 (3156315704ef) starting up (core dumps disabled) Feb 10 10:50:45 master: Warning: Killed with signal 15 (by pid=7218 uid=0 code=kill) Feb 10 10:50:46 master: Info: Dovecot v2.0.beta6 (3156315704ef) starting up (core dumps disabled) Feb 10 10:56:38 master: Warning: Killed with signal 15 (by pid=7254 uid=0 code=kill) Feb 10 10:56:39 master: Info: Dovecot v2.0.beta6 (3156315704ef) starting up (core dumps disabled) [root@filemon conf.d]# ls -al /var/run/dovecot total 20 drwxr-xr-x 4 dovecot dovecot 4096 Feb 10 10:56 . drwxr-xr-x 15 root root 4096 Feb 10 10:02 .. srw------- 1 root root 0 Feb 10 10:56 anvil srw------- 1 root root 0 Feb 10 10:56 anvil-auth-penalty srw------- 1 root root 0 Feb 10 10:56 auth-client srw------- 1 dovecot root 0 Feb 10 10:56 auth-login srw------- 1 root root 0 Feb 10 10:56 auth-master srw------- 1 root root 0 Feb 10 10:56 auth-userdb srw------- 1 dovecot root 0 Feb 10 10:56 auth-worker srw------- 1 root root 0 Feb 10 10:56 config srw------- 1 root root 0 Feb 10 10:56 dict srw------- 1 root root 0 Feb 10 10:56 director-admin srw-rw-rw- 1 root root 0 Feb 10 10:56 dns-client lrwxrwxrwx 1 root root 25 Feb 10 10:56 dovecot.conf -> /etc/dovecot/dovecot.conf drwxr-xr-x 2 root root 4096 Nov 23 03:34 empty drwxr-x--- 2 root dovenull 4096 Feb 10 10:56 login -rw------- 1 root root 5 Feb 10 10:56 master.pid -rw------- 1 root root 0 Feb 9 23:57 rsyslog auth-sql.conf.ext: passdb { driver = sql args = /etc/dovecot/dovecot-sql.conf.ext } userdb { driver = sql args = /etc/dovecot/dovecot-sql.conf.ext } /dovecot/dovecot-sql.conf.ext: driver = mysql connect = host=localhost dbname=dovecot user=dovecot password=123test default_pass_scheme = MD5 password_query = \ SELECT username AS user, password, \ home AS userdb_home, uid AS userdb_uid, gid AS userdb_gid \ FROM users WHERE username = '%u' and domain='%n' Thanks for the HELP !!!

4 3