- dovecot - dovecot.org

[Dovecot] Again ACL Postgres dict trouble, no update and raw backtrace
by Steffen Kaiser 24 Jan '13

24 Jan '13

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi, I have ACL-dict-postgres trouble again. Eventually a session does not update the ACL dictionary no longer. I execute (for testing) this script: for a in $(seq 1 ${1-4}); do echo 3-$a deleteAcl Junk dvtest1 sleep 30 echo 3-$a SetAcl Junk dvtest1 kxilrsc sleep 30 done It works two loops 2013-01-24 11:07:59 dict: Info: pgsql(localhost): Connected to database dovecot 2013-01-24 11:07:59 dict: Info: pgsql(localhost): Connected to database dovecot 2013-01-24 11:07:59 dict: Info: pgsql(localhost): Connected to database dovecot 2013-01-24 11:08:59 dict: Info: pgsql(localhost): Connected to database dovecot 2013-01-24 11:09:29 dict: Info: pgsql(localhost): Connected to database dovecot , then dies with: 2013-01-24 11:09:59 dict: Error: dict sql iterate failed: Not connected to database 2013-01-24 11:09:59 IMAP(dvtest6) [22740]: Error: acl: dict iteration failed, can't update dict 2013-01-24 11:10:02 IMAP(dvtest6) [22740]: Info: Connection closed in=159 out=572 2013-01-24 11:11:00 dict: Panic: file driver-pgsql.c: line 84 (driver_pgsql_set_state): assertion failed: (state == SQL_DB_STATE_BUSY || db->cur_result == NULL) 2013-01-24 11:11:00 dict: Error: Raw backtrace: /usr/local/dovecot-2.1.13/lib/dovecot/libdovecot.so.0(+0x4881a) [0x7f465693181a] -> /usr/local/dovecot-2.1.13/lib/dovecot/libdovecot.so.0(+0x48866) [0x7f4656931866] -> /usr/local/dovecot-2.1.13/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f4656904f7f] -> dovecot2.1/dict() [0x40aa36] -> dovecot2.1/dict() [0x40aa91] -> dovecot2.1/dict() [0x40bed3] -> dovecot2.1/dict() [0x409504] -> dovecot2.1/dict(sql_db_cache_deinit+0x20) [0x408a60] -> dovecot2.1/dict(main+0x169) [0x405a59] -> /lib/libc.so.6(__libc_start_main+0xfd) [0x7f465637cc8d] -> dovecot2.1/dict() [0x404bb9] 2013-01-24 11:11:00 dict: Fatal: master: service(dict): child 22744 killed with signal 6 (core not dumped) There are two different Panic messages: Panic: file driver-pgsql.c: line 587: unreached Panic: file driver-pgsql.c: line 84 (driver_pgsql_set_state): assertion failed: (state == SQL_DB_STATE_BUSY || db->cur_result == NULL) I have ulimit -c unlimited set, at start up Dovecot says: 2013-01-23 16:33:20 master: Info: Dovecot v2.1.13 (6eabf0c738d7) starting up but I do not get no core dumps. The last SQL statement executed by Posgres is (log level debug5): 2013-01-24 11:09:59 CET DEBUG: StartTransactionCommand 2013-01-24 11:09:59 CET STATEMENT: SELECT dummy,to_user,from_user FROM user_shares 2013-01-24 11:09:59 CET DEBUG: StartTransaction 2013-01-24 11:09:59 CET STATEMENT: SELECT dummy,to_user,from_user FROM user_shares 2013-01-24 11:09:59 CET DEBUG: name: unnamed; blockState: DEFAULT; state: INPROGR, xid/subid/cid: 0/1/0, nestlvl: 1, children: 2013-01-24 11:09:59 CET STATEMENT: SELECT dummy,to_user,from_user FROM user_shares 2013-01-24 11:09:59 CET LOG: statement: SELECT dummy,to_user,from_user FROM user_shares 2013-01-24 11:09:59 CET DEBUG: CommitTransactionCommand 2013-01-24 11:09:59 CET STATEMENT: SELECT dummy,to_user,from_user FROM user_shares 2013-01-24 11:09:59 CET DEBUG: CommitTransaction 2013-01-24 11:09:59 CET STATEMENT: SELECT dummy,to_user,from_user FROM user_shares 2013-01-24 11:09:59 CET DEBUG: name: unnamed; blockState: STARTED; state: INPROGR, xid/subid/cid: 0/1/0, nestlvl: 1, children: 2013-01-24 11:09:59 CET STATEMENT: SELECT dummy,to_user,from_user FROM user_shares 2013-01-24 11:09:59 CET LOG: duration: 0.205 ms Dovecot conf: SQL /usr/local/dovecot-2.1.13/etc/dovecot/dovecot-dict-sql.conf.ext connect = host=localhost dbname=dovecot user=dovecot pass=XYZ # CREATE TABLE user_shares ( # from_user varchar(100) not null, # to_user varchar(100) not null, # dummy char(1) DEFAULT '1', -- always '1' currently # primary key (from_user, to_user) # ); # COMMENT ON TABLE user_shares IS 'User from_user shares folders to user to_user.'; # # CREATE INDEX to_user # ON user_shares (to_user); -- because we always search for to_user # # CREATE TABLE anyone_shares ( # from_user varchar(100) not null, # dummy char(1) DEFAULT '1', -- always '1' currently # primary key (from_user) # ); # COMMENT ON TABLE anyone_shares IS 'User from_user shares folders to anyone.'; map { pattern = shared/shared-boxes/user/$to/$from table = user_shares value_field = dummy fields { from_user = $from to_user = $to } } map { pattern = shared/shared-boxes/anyone/$from table = anyone_shares value_field = dummy fields { from_user = $from } } # 2.1.13 (6eabf0c738d7): /usr/local/dovecot-2.1.13/etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.6 auth_cache_size = 10 M auth_debug = yes auth_mechanisms = plain login auth_verbose = yes base_dir = /var/run/dovecot2.1/ deliver_log_format = msgid=%m: %$ %p/%w "%f" "%s" dict { acl = pgsql:/usr/local/dovecot-2.1.13/etc/dovecot/dovecot-dict-sql.conf.ext quota = pgsql:/usr/local/dovecot-2.1.13/etc/dovecot/dovecot-dict-sql.conf.ext } instance_name = dovecot2.1 lda_mailbox_autocreate = yes lmtp_save_to_detail_mailbox = yes log_path = /var/log/dovecot/dovecot2.1.log log_timestamp = "%F %H:%M:%S " mail_debug = yes mail_gid = vmail mail_log_prefix = "%Us(%u) [%p]: " mail_plugins = " quota notify mail_log zlib acl" mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave imapflags namespace { list = children location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u prefix = users.%%u. separator = . type = shared } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /usr/local/dovecot-2.1.13/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile acl_shared_dict = proxy::acl antispam_allow_append_to_spam = true antispam_backend = spool2dir antispam_spam = SPAM+ReportAsSPAM antispam_spool2dir_notspam = /tmp/spamspool/%%020lu-%%05lu-%u-H antispam_spool2dir_spam = /tmp/spamspool/%%020lu-%%05lu-%u-S antispam_trash = trash;TRASH;Trash;spam;SPAM;Spam;junk;JUNK;Junk;Deleted Items;Deleted Messages;Gel&APY-schte Elemente;Gel&APY-schte Objekte;Junk E-mail;Junk-E-Mail;INBOX.Trash;INBOX.TRASH;INBOX.trash mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size vsize from subject quota = dict:User quota::proxy::quota quota_rule = *:storage=300MB quota_rule2 = Trash:storage=+30M recipient_delimiter = + sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +imapflags sieve_max_actions = 0 sieve_quota_max_storage = 3M } protocols = imap pop3 lmtp sieve quota_full_tempfail = yes service auth { unix_listener auth-userdb { mode = 0766 user = vmail } } service dict { unix_listener dict { group = vmail mode = 0660 user = vmail } } service doveadm { unix_listener doveadm-server { mode = 0666 } } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } ssl_ca = </etc/ssl/certs/ca.crt ssl_cert = </etc/ssl/certs/imap.pem ssl_key = </etc/ssl/private/imap.key userdb { driver = prefetch } userdb { args = /usr/local/dovecot-2.1.13/etc/dovecot/dovecot-ldap.conf.ext default_fields = home=/home/%u driver = ldap } verbose_proctitle = yes verbose_ssl = yes protocol lmtp { mail_plugins = " quota notify mail_log zlib acl quota sieve" } protocol lda { mail_plugins = " quota notify mail_log zlib acl quota sieve" } protocol imap { mail_plugins = " quota notify mail_log zlib acl imap_quota imap_zlib imap_acl antispam" } - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUQEQdF3r2wJMiz2NAQL62AgAsXfP01TYvGjsu9Tcny8vCHMEOhBw0QVO rvx7YDdYgyVLb/JwHQseq5XGPzRHh6PFn5HrrUFpnG87E52ZKTH1rkwYiuyM8fso HAsUM0mlz9fGGPucMa9HoTbw5turbqbjVags8x6Om4W4sgp+RITd4UZq/Qcu/ShF jfI5KDEK9bnPh9WwVKV6Yfd/1auZH+SCacb69Bb/cyVDiwbxOUTAEZikgWYgFOG2 /B1KzUPrjtumAS9myswIJxEG/4DmEt0In5fgQLM7cDdbGQl400JzR2rEa4bd3C1b 3DImA3J/YUfLpuqGS60rhx1rpSfad61Us2dh5kGgbswtbwKj2FtnTg== =Jpqg -----END PGP SIGNATURE-----

1 0

[Dovecot] Permissions when running `dovecot --exec-mail imap`
by Tim Marston 24 Jan '13

24 Jan '13

Hi, I'm running dovecot 1.2.15, on Debian squeeze. /var/mail is owned by group "mail" with permissions "g+rwxs,o=". The mail_privileged_group setting is set to "mail". I am trying to access mail on a remote machine with mutt by tunnelling mutt though ssh and running `dovecot --exec-mail imap` on the mail server. But I frequently get errors in the mail server's logs about not being able to create dotlock files when accessing my INBOX this way. This makes sense -- I'm running dovecot as a regular user, so it isn't able to write to /var/mail as group "mail". I notice that on the dovecot wiki[1] it is suggested that sudo is used to set uid/gid before running `dovecot --exec-mail imap`. But I don't actually want to set the uid, just the gid. And I also have sudo disabled at the moment. So I was wondering about another solution... Would it be acceptable to setgid the dovecot executable and change it's group to "mail" (i.e., `chgrp mail dovecot` and `chmod g+s dovecot`)? Would this pose some kind of security risk? Would this actualy do what I want, or am I missing a bigger picture? Kind regards, [1] http://wiki.dovecot.org/PreAuth -- Tim Marston ed.am

2 3

[Dovecot] warning regarding quota and mboxes
by Andreas Meyer 23 Jan '13

23 Jan '13

Hello! We drive mboxes and maildirs and the dovecot-server is running very well and everthing is fine, but I get the following warning in the dovecot-lda-errors.log when a mail is delivered to a mbox. Jan 10 16:29:24 lda(archiv(a)bitcorner.de): Warning: quota: Namespace '' is not Maildir, skipping for Maildir++ quota This is what I defined in the dovecot.conf: mail_home = /var/spool/vhosts/%d/%n mail_location = mbox:~/:maildir:~/ mail_plugins = quota plugin { quota = maildir:User quota quota_rule = *:storage=500MB quota_rule2 = Trash:storage=+10%% } Can I avoid the error above somehow? Namespaces are a bit mysterious for me at the moment. Greetings Andreas

3 3

[Dovecot] speed up dovecot IMAP server
by Bernics Gábor | Penta Unió Zrt. 23 Jan '13

23 Jan '13

Hello, I upgraded my dovecot server (1.2 -> 2.1), from debian backport because it was a little slow (wait 5-6 sec) when I opened some mail (but not every mail). Unfortunately, the mail open speed didn't increase. I think it's an index problem. Have you idea for fixing? My conf: http://pastebin.com/FNLusi51 [1] (HP Microserver with 6 Gbyte RAM - entry level server with small load and small (max. 40) concurrent connection) Best regards, Gabor Links: ------ [1] http://pastebin.com/FNLusi51

2 4

[Dovecot] dovecot nightly 20130117: dsync does returns "Name or service not known"
by Evgeny Basov 23 Jan '13

23 Jan '13

Hello. I have this settings of imapc: # doveconf -a | grep imapc imapc_features = imapc_host = imapc_list_prefix = imapc_master_user = imapc_max_idle_time = 29 mins imapc_password = imapc_port = 143 imapc_rawlog_dir = imapc_ssl = no imapc_ssl_ca_dir = imapc_ssl_verify = yes imapc_user = %u and try to sync mailbox on old server and new one: $ dsync -o imapc_user="user(a)example.org" -o imapc_password="pass" -o imapc_host=imap.example.org -o imapc_features=rfc822.size -o mailbox_list_index=no backup -R -f -u "user(a)example.org" imapc: get this error: ssh: Could not resolve hostname remote: Name or service not known dsync-local(basov(a)megagroup.ru): Error: read(remote) failed: EOF dsync-local(basov(a)megagroup.ru): Error: Remote command returned error 255 In this time new dovecot finds local user: 2013-01-17T17:21:29.837415+04:00 imap1 dovecot: auth: Debug: userdb out: USER#0111#011user@example.org#011home=/var/vmail/example.org/user/#011quota2_rule=*:storage=40M#011nodelay=Y#011uid=999#011gid=999 I don't understand what's mean under 'hostname remote'. What hostname? Is it bug or incorrect settings?

2 4

[Dovecot] Fixing bad maildir message sizes
by Richard Platel 23 Jan '13

23 Jan '13

Hello. As stated in my previous message, we have some old compressed maildir messages with incorrect sizes in the filename. These messages cause dovecot 2.x problems. I'm trying to write a script to crawl all our messages, check the actual message size and if necessary, fix the filename. However, when I do this, dovecot gives the message a new UID on next login. If I change the filename in dovecot-uidlist, dovecot still gives a new UID on next login. If I change dovecot-uidlist and delete the index, then the UID is preserved. Re-indexing our millions of mailboxes is not a great solution for us. Is there a good way to fix this?

2 2

[Dovecot] question on "doveadm user" and pass/userdb
by Gábor Lénárt 22 Jan '13

22 Jan '13

Hi, I'm about getting to know dovecot in details, I am about the command "doveadm user". The man page shows this example: userdb: jane uid : 8001 gid : 8001 home : /home/jane mail : sdbox:~/sdbox plugins : sieve quota_rule: *:storage=150M It seems to be nice, however I never got this only: ~# doveadm user lgb@office userdb: lgb@office That's all. The dovecot test configuration works otherwise via IMAP/POP3/LMTP nicely. What I guess that the lack of extra information (which would be needed by some scripts of mine, eg for getting user's home easily from shell scripts, as it's hash based, etc) is caused because I don't pass home (and/or other settings) back from userdb and/or passdb. However I do have these in global scope: mail_home = /mailstorage/%Ld/%Ln (yes, this is not hashed at all at the momement but it will be soon) mail_location = maildir:~/Maildir mail_uid = vmail mail_gid = vmail (... and also some global quota stuffs configured in plugin section) Now, I am a bit confused: even with passdb/userdb does not return with user home or GID/UID, dovecot knows these in case of pop3/imap/lmtp access, since these information can be "composed" from those settings. But then, wouldn't it possible so "doveadm user" shows those as well, like lmtp/pop3/imap can resolve those too? Honestly, it's a bit redundant to put needed information into user and pass attrs in every dbs (I have some) when dovecot knows those otherwise ... If I interpret "doveadm user"'s goal wrong (it's just for userdb/passdb query tool nothing more), is there any tool which works in this config, displaying extra information (at least user's home), or should I create some script which just repeats the functionality of dovecot's configured mail_home resolution? Thanks.

3 5

[Dovecot] namespace o shared folder, deleting index no message
by R. G. 22 Jan '13

22 Jan '13

when I set up namespace or shared folder, I need to delete the mail from the mailbox of the user who does not want to see him, but not the rest of the users. Is this possible in dovecot?.

2 1

[Dovecot] Fts Search
by Makarov Alex 22 Jan '13

22 Jan '13

Hello, i'm trying to search in mails which are in russian language. Search works fine for UTF-8 mails, but it ignores KOI8-R ones. For english in any mails it also works fine. How i can solve it? I have dovecot 1.2.17 and following config for fts: protocol imap { ..... mail_plugins = quota imap_quota autocreate fts fts_squat } plugin { ... fts = squat fts_squat = partial=4 full=10 }

1 0

[Dovecot] Mail logger question
by Hungerburg 21 Jan '13

21 Jan '13

I use Dovecot simply as a way, to provide an e-mail archive for people on the LAN, where they can move messages into from within thunderbird. Mails are stored in a maildir of one system user where all the people know the password of. This was very easy to setup in ubuntu 12. Today I started using the mail_log plugin to provide an audit trail. Now I am looking for a light way, to get the log reflect the different people or principals. One way is, to create users with the same ID in the passwd and shadow files, but I'd rather have them in a separate file, something like a list of aliases for the system user. Can you suggest a simple way, without going virtual users? Below the relevant info on dovecot: $ dovecot --version 2.0.19 $ dovecot -n # 2.0.19: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-35-generic x86_64 Ubuntu 12.04.1 LTS mail_plugins = " fts fts_squat mail_log notify" passdb { driver = pam } plugin { fts = squat fts_squat = partial=4 full=10 mail_log_events = save delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size from subject } protocols = " imap" ssl_cert = </etc/ssl/certs/ssl-cert-snakeoil.pem ssl_key = </etc/ssl/private/ssl-cert-snakeoil.key userdb { driver = passwd } Thank you all -- peter

1 1