October 2012 - dovecot

Re: [Dovecot] still having difficulties with per-user quotas
by Daniel Parthey 21 Oct '12

21 Oct '12

Hi Dave, David Mehler wrote: > Thanks for all your help so far. I have per-user quotas now working, I > had to also alter my dict config file as well. I am having two > outstanding issues, actually one outstanding issue and one question. > > Here's the question, given that the userdb sql query returns a default > quota entry for rows of zero in quota and quota_messages is the > default quota section needed in 90-quota.conf? > > plugin { > quota_rule = *:storage=1G > quota_rule2 = Trash:storage=+100M > } You need quota_rule2 to give the user some additional space in the Trash folder if he/she wants to delete messages when over quota. The dict is also needed for quota lookup from the database. The only thing which might be omitted is the global quota_rule since it is returned by the userdb/passwd in any case, but I'm not sure what happens if you only configure a "quota_rule2" without configuring a "quota_rule". > My outstanding issue is whenever I as the root mysql user update a > user's quota the other user also gets an update, I noticed with one > the messages column on the other user went from 0 to 2, another time > the quota value went up from 0 to 3500 it seems random. You should not be accounting the actual mailbox usage in the same virtual_users table as the quota is read from. Use *different* column or table name in your dict file where dovecot may write the current storage/message count. > dovecot-dict-sql.conf.ext > > map { > pattern = priv/quota/storage > table = virtual_users > username_field = user > value_field = quota value_field should be current_quota_storage (writable column) > } > map { > pattern = priv/quota/messages > table = virtual_users > username_field = user > value_field = quota_messages value_field should be current_quota_messages (writable column) > I'd like to know why these columns are updating. Dovecot stores the current storage and mailcount in there. These columns should be different from the columns defining the maximum limit. Regards Daniel

1 0

[Dovecot] fstat() failed with file */dovecot.index.log
by Nicolás 21 Oct '12

21 Oct '12

Hi list! I'm using Dovecot along with Postfix (with MySQL) and I'm having some curious error messages in the mail log. Everything runs normally and suddenly I start viewing messages like these: Oct 12 14:24:23 dovecot: last message repeated 5 times Oct 12 14:25:23 dovecot: last message repeated 6 times Oct 12 14:26:23 dovecot: last message repeated 6 times Oct 12 14:27:23 dovecot: last message repeated 6 times Oct 12 14:29:22 mail dovecot: imap(nicolas(a)devels.es): Error: fstat() failed with file /home/vmail/devels.es/nicolas/Maildir/dovecot.index.log: No such file or directory Oct 12 14:30:23 dovecot: last message repeated 5 times Oct 12 14:31:23 dovecot: last message repeated 6 times Oct 12 14:33:22 mail dovecot: imap(nicolas(a)devels.es): Error: fstat() failed with file /home/vmail/devels.es/nicolas/Maildir/dovecot.index.log: No such file or directory Oct 12 14:34:23 dovecot: last message repeated 5 times Oct 12 14:35:23 dovecot: last message repeated 6 times Oct 12 14:36:01 mail dovecot: imap(nicolas(a)devels.es): Error: fstat() failed with file /home/vmail/devels.es/nicolas/Maildir/dovecot.index.log: No such file or directory This file which Dovecot references to indeed exists, is accesible, etc. Once I get the first of these messages, the user stops receiving e-mails (the mail server keeps receiving them normally, though) until he restarts the mail client. Then the error msg is gone and he receives all their unreceived messages. This error appears in 6-12h. intervals once the user starts their client. Version is 2.0.19, and dovecot -n is: root@mail:~# dovecot -n # 2.0.19: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-32-generic-pae i686 Ubuntu 12.04.1 LTS ext4 disable_plaintext_auth = no log_timestamp = "%Y-%m-%d %H:%M:%S " mail_location = maildir:/home/vmail/%d/%n/Maildir mailbox_idle_check_interval = 2 mins namespace { inbox = yes location = prefix = INBOX. separator = . type = private } passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } protocols = imap pop3 service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { mode = 0600 user = vmail } user = root } ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { args = uid=5000 gid=5000 home=/home/vmail/%d/%n allow_all_users=yes driver = static } protocol lda { auth_socket_path = /var/run/dovecot/auth-master log_path = /home/vmail/dovecot-deliver.log postmaster_address = postmaster(a)devels.es } protocol pop3 { pop3_uidl_format = %08Xu%08Xv } Thanks so much for any help! Nicolás

2 5

Re: [Dovecot] still having difficulties with per-user quotas
by Daniel Parthey 20 Oct '12

20 Oct '12

David Mehler wrote: > Thanks for your reply. So with the extending of the query to return a > default quota rule, do you have an example of that by the way, does > that mean I only have to put the overrided users in the quota table? Assuming that quota values are in the dovecot_users table... # passdb with userdb prefetch and default quota of 1024M for quota=0 rows # The userdb_ prefix is for prefetch userdb entries in password_query password_query = SELECT username AS user, \ password AS password, \ home AS userdb_home, \ uid AS userdb_uid, \ gid AS userdb_gid, \ CASE quota \ WHEN 0 \ THEN '*:bytes=1024M:messages=0' \ ELSE \ CONCAT('*:bytes=', CAST(quota AS CHAR), 'M:messages=', CAST(quota_message AS CHAR)) \ END AS `userdb_quota_rule` \ FROM dovecot_users \ WHERE username='%u'; # user_query with default quota of 1024M for quota=0 rows user_query = SELECT username AS user, \ home AS home, \ uid AS uid, \ gid as gid, \ CASE quota \ WHEN 0 \ THEN '*:bytes=1024M:messages=0' \ ELSE \ CONCAT('*:bytes=', CAST(quota AS CHAR), 'M:messages=', CAST(quota_message AS CHAR)) \ END AS `quota_rule` \ FROM dovecot_users \ WHERE username='%u'; Your user_query needs to return a row if the user exists, otherwise dovecot will assume that the user does not exist and the mail or user will be rejected. Regards Daniel -- https://plus.google.com/103021802792276734820

1 0

[Dovecot] still having difficulties with per-user quotas
by David Mehler 20 Oct '12

20 Oct '12

Hello, I am trying to get per-user quotas working. My thanks to all who have helped so far. To recap I am running Dovecot 2.1 and Mysql where I've got my virtual users. All virtual users are under the system user vmail with a UID and GID of 5000. Looking over the wiki docs I've added a quota table and got the dict service working, I am not having problems with permissions or the login username and password, all that is working fine. Here's my current doveconf -n output it is producing the following debug error related to the userdb sql query: # 2.1.10: /etc/dovecot/dovecot.conf # XXX dict { quota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } first_valid_gid = 5000 first_valid_uid = 5000 hostname = XXX last_valid_gid = 5000 last_valid_uid = 5000 mail_location = maildir:/home/vmail/%d/%n:LAYOUT=fs mail_plugins = " quota" namespace inbox { inbox = yes location = prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { quota = dict:User quota::proxy::quota quota_rule = *:storage=1G quota_rule2 = Trash:storage=+100M quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u } protocols = imap service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { mode = 0600 user = vmail } } service dict { unix_listener dict { mode = 0600 user = vmail } } service imap-login { inet_listener imap { address = 127.0.0.1 ::1 } inet_listener imaps { address = xxx xxxx ssl = yes } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh user = vmail } ssl_cert = </etc/ssl/certs/server.crt ssl_key = </etc/ssl/private/server.key userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol imap { mail_plugins = " quota imap_quota" } Oct 19 15:23:52 auth-worker(29279): Info: mysql(/var/run/mysqld/mysqld.sock): Connected to database mail Oct 19 15:23:52 auth-worker(29279): Debug: sql(xxx,::1): query: SELECT user as user, password FROM virtual_users WHERE user='xxx@domain'; Oct 19 15:23:52 auth: Debug: client passdb out: OK 1 user=xxx Oct 19 15:23:52 auth: Debug: master in: REQUEST 3523346433 29276 1 f5cd16e3f5e078c28d850749e42c86cc Oct 19 15:23:52 auth-worker(29279): Debug: sql(xxx,::1): SELECT concat('*:storage=', bytes, 'M') as quota_rule FROM quota WHERE username='xxx'; Oct 19 15:23:52 auth: Debug: master userdb out: USER 3523346433 xxx quota_rule=*:storage=368485M Oct 19 15:23:52 imap-login: Info: Login: user=<xxx>, method=PLAIN, rip=::1, lip=::1, mpid=29282, secured, session=</xKpcW7MFgAAAAAAAAAAAAAAAAAAAAAB> Oct 19 15:23:52 imap(xxx): Error: user xxx: Couldn't drop privileges: User is missing UID (see mail_uid setting) Oct 19 15:23:52 imap(xxx): Error: Internal error occurred. Refer to server log for more information. I am wanting a majority of my users to have the global 1GB quota, but the users in the quota table to have given quotas. Here's what the virtual_users and quota tables look like: mysql> describe virtual_users; +-----------+--------------+------+-----+---------+----------------+ | Field | Type | Null | Key | Default | Extra | +-----------+--------------+------+-----+---------+----------------+ | id | int(11) | NO | PRI | NULL | auto_increment | | domain_id | int(11) | NO | MUL | NULL | | | user | varchar(40) | NO | | NULL | | | password | varchar(128) | NO | | NULL | | +-----------+--------------+------+-----+---------+----------------+ 4 rows in set (0.00 sec) mysql> describe quota; +----------+--------------+------+-----+---------+-------+ | Field | Type | Null | Key | Default | Extra | +----------+--------------+------+-----+---------+-------+ | username | varchar(100) | NO | PRI | NULL | | | bytes | bigint(20) | NO | | 0 | | | messages | int(11) | NO | | 0 | | +----------+--------------+------+-----+---------+-------+ 3 rows in set (0.00 sec) I'd appreciate any help. Thanks. Dave.

2 3

[Dovecot] Dovecot 2 and TCP-Keepalive
by Sven Hartge 20 Oct '12

20 Oct '12

Hi! I am about to migrate a perdition-based IMAP/POP3 proxy to Dovecot. Unfortunately some users are behind a firewall/NAT setup which throws away seemingly idle TCP connections sooner than the established default of 24 hours (more likely after 30 minutes ...) resulting in all kinds of weird client behavior. And unfortunately² this firewall/NAT setup is outside of my control and I have no means of correcting this (in my opinion) flawed configuration. Now, with perdition I was able to use the --tcp_keepalive option which totally solved the mentioned weird client behavior. My question is: does Dovecot2 use TCP-Keepalive on its sockets per default or do I need to enable it some way I have not yet discovered? The manual and wiki only talk about "keepalive" in connection with the IMAP protocol and IDLE and my C-fu is too weak to understand the source code. Grüße, Sven. -- Sigmentation fault. Core dumped.

2 2

[Dovecot] Dovecot 2 quota limit and actual size (mysql)
by wamp 20 Oct '12

20 Oct '12

Hello, Can You explain to me how dovecot-lda knows actual size of virtual user directory? I want to keep max size of user directory in mysql - should I also use some kind of script to upgrade actual size information in mysql ? I read docs from wiki but still dont know it. thanks -- View this message in context: http://dovecot.2317879.n4.nabble.com/Dovecot-2-quota-limit-and-actual-size-… Sent from the Dovecot mailing list archive at Nabble.com.

2 1

[Dovecot] Question about salted hashes
by Tobias Maffert 19 Oct '12

19 Oct '12

Hello. I'm switching from b1gmail to my own setup which consists of Postfix+Dovecot+MySQL (and maybe VBoxAdm). There are two problems: - b1gmail is using unsalted MD5 hashes. Is there any good way to make my new setup backward compatible? So I don't have to force all of my 50k users to change their password. - How do I change my setup to salted SHA256 (or an even better algorithm). And how do I make the hashes compatible between Postfix, Dovecot, MySQL (and maybe VBoxAdm)? My system: Debian Squeeze Postfix version: 2.7.1 Dovecot version: 1.2.15 ----------------------------------------------- dovecot -n # 1.2.15: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-686 i686 Debian 6.0.6 protocols: imap pop3 disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login mail_access_groups: vmail mail_debug: yes mbox_write_locks: fcntl dotlock mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): quota mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 pop3_uidl_format(default): %08Xu%08Xv pop3_uidl_format(imap): %08Xu%08Xv pop3_uidl_format(pop3): UID%u-%v lda: postmaster_address: <postmaster-address> auth_socket_path: /var/run/dovecot/auth-master mail_plugins: quota sendmail_path: /usr/sbin/sendmail auth default: mechanisms: plain login user: vmail passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: prefetch userdb: driver: sql args: /etc/dovecot/dovecot-sql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 432 user: vmail group: vmail plugin: quota: maildir ----------------------------------------------- driver = mysql connect = host=127.0.0.1 dbname=smail user=smail password=mypw default_pass_scheme = CRYPT password_query = SELECT username AS user, password_enc AS password, CONCAT(homedir, maildir) AS userdb_home, uid AS userdb_uid, gid AS userdb_gid, CONCAT('maildir:', homedir, maildir) AS userdb_mail, CONCAT('maildir:storage=', (quota*1024)) as userdb_quota FROM mail_users WHERE (username = '%u' OR email = '%u') AND ((imap = 1 AND '%Ls' = 'imap') OR (pop3 = 1 AND '%Ls' = 'pop3') OR '%Ls' = 'smtp') user_query = SELECT CONCAT(homedir, maildir) AS home, CONCAT('maildir:', homedir, maildir) AS mail, uid, gid, CONCAT('*:storage=', (quota*1024)) as quota_rule FROM mail_users WHERE (username = '%u' OR email = '%u') ----------------------------------------------- Regards, Tobi M.

2 1

[Dovecot] Add S=<size> to maildirfile
by Alessio Cecchi 19 Oct '12

19 Oct '12

Hi, in some old Maildir/ I have file without the S=<size> in file name. Is possibile to add the size to the file name with some tools like doveadm? Are there other methods to update these file? Thanks -- Alessio Cecchi is: @ ILS -> http://www.linux.it/~alessice/ on LinkedIn -> http://www.linkedin.com/in/alessice Assistenza Sistemi GNU/Linux -> http://www.cecchi.biz/ @ PLUG -> ex-Presidente, adesso senatore a vita, http://www.prato.linux.it

4 4

[Dovecot] Emails from invalid local accounts
by Steven Kiehl 19 Oct '12

19 Oct '12

Hi, I'm using dovecot 1.2.9 in a postfix/dovecot setup and I'm having issues with receiving spam where the "from" header contains an address like accounting(a)mydomain.com. Is there some way I can filter out these emails coming from outside our network with an account associated with our network which doesn't exist? Do I just need to configure some custom process to evaluate these addresses, or is there some way either in dovecot or spamassassin to do this? Thanks, Steve K

3 4

[Dovecot] dovecot-core, dovecot-mysql for Debian squeeze
by Ricardo 18 Oct '12

18 Oct '12

Hello list apologize in advance for my bad English, this is the first time I write to a list if I mistake Excuse me I want to implement mail server with MySQL database, Postfix and Postfixadmin, dovecot-core, dovecot-mysql dovecot-imapd dovecot-pop3d for multiple domains. I have problems installing the daemon dovecot-core, dovecot-mysql dovecot-imapd dovecot-pop3d Debian squeeze, I'm using the repositories: deb http://ftp.ccc.uba.ar/pub/linux/debian/debian/ squeeze main deb-src http://ftp.ccc.uba.ar/pub/linux/debian/debian/ squeeze main deb http://security.debian.org/ squeeze/updates main deb-src http://security.debian.org/ squeeze/updates main # squeeze-updates, previously known as 'volatile' deb http://ftp.ccc.uba.ar/pub/linux/debian/debian/ squeeze-updates main deb-src http://ftp.ccc.uba.ar/pub/linux/debian/debian/ squeeze-updates main deb http://packages.dotdeb.org squeeze all deb-src http://packages.dotdeb.org squeeze all deb http://backports.debian.org/debian-backports squeeze-backports main to install dovecot-core, dovecot-mysql, install it without problems is the version (2.1.7-2 ~ bpo60 +1) of both packages, now wanting to install dovecot-imapd dovecot-pop3d (version 1.2.15-7) breaks the dovecot-core, dovecot-mysql, apparently must be the same version all packages. Debian Wheezy, installs without problems but installs the version (dovecot-core_2.1.7-2 ~ ppa12.04 +1 _i386.deb) all packets are the same version. What is the correct version for Debian squeeze? Look for San Google but eh had success. Can anybody help? Ricardo

3 2