- dovecot - dovecot.org

doveadm sync -1 -R
by Lukas Kolbe 07 Apr '16

07 Apr '16

Hi, I’m migrating an old Zarafa-installation to a dovecot using mdbox and sis on Debian Jessie. To copy over the emails, I use doveadm backup on the new box - or more precisely: vmail# doveadm -v -o imapc_user=$user -o imapc_password=$pass -o imapc_host=$host -o imapc_features=rfc822.size -o imapc_port=993 -o mailbox_list_index=no -o imapc_ssl_verify=no backup -R -x "Public folders*" -x "Public folders/*" -u $user imapc: For each invoke of doveadm backup -R, the local (new) mailbox gets wiped and all mails are retransferred - so far, so good. I’d like to use "doveadm sync -1“ as per the manpage to keep the downtime short, however sync doesn’t like the -R option: sync: invalid option -- 'R' doveadm sync [-u <user>|-A] [-S <socket_path>] [-1fPU] [-l <secs>] [-r <rawlog path>] [-m <mailbox>] [-g <mailbox_guid>] [-n <namespace> | -N] [-x <exclude>] [-s <state>] -d|<dest> If I understand it correctly, without -R it would mean that doveadm sync would incorporate the changes from the local dovecot-mailbox into the remote imapc:-Mailbox, which is the opposite of what I want. Dovecot version is current head as of yesterday. Is what I’m trying to do even possible with doveadm sync? Kind regards, Lukas

2 2

[help]enotify "mail to" run fine edit via managesieve 0.4.4 complied failed
by wuwei 07 Apr '16

07 Apr '16

hi all edit via vi editor to change dovecot.sieve and enotify works fine.but when I telnet 4190 port via managesieve to edit it with the same code,the managesieve said "NO "Error in MANAGESIEVE command CHECKSCRIPT: "", find many topic in wiki and maillist but not solved. need you help!thanks!!dovecot version 2.2.15,pigonhole version 0.4.4 here are more infos below: *managesieve cmds:* "IMPLEMENTATION" "Dovecot Pigeonhole" "SIEVE" "fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave duplicate vacation-seconds" "NOTIFY" "mailto" "SASL" "PLAIN LOGIN" "VERSION" "1.0" OK "Dovecot ready." listscripts NO "Error in MANAGESIEVE command received by server." AUTHENTICATE "PLAIN" "AGFuZ196aGFAdG9tLmNvbQAxMTExMTE=" OK "Logged in." listscripts "blackwhitelist" "rulefilter" ACTIVE OK "Listscripts completed." getscript "rulefilter" {471} require ["reject","fileinto","imap4flags","vacation","regex","encoded-character","include","copy","enotify","variables"]; if header :matches "Subject" "*" { set "Subject" "${1}"; } if header :matches "From" "*" { set "From" "${1}"; } if header :matches "Message-ID" "*" { set "msg_id" "${1}"; } if header :matches "To" "*" { set "To" "${1}"; } if header :matches "Date" "*" { set "Date" "${1}"; } notify "mailto:wuweiwwd@tom.com"; OK "Getscript completed." checkscript {471} require ["reject","fileinto","imap4flags","vacation","regex","encoded-character","include","copy","enotify","variables"]; if header :matches "Subject" "*" { set "Subject" "${1}"; } if header :matches "From" "*" { set "From" "${1}"; } if header :matches "Message-ID" "*" { set "msg_id" "${1}"; } if header :matches "To" "*" { set "To" "${1}"; } if header :matches "Date" "*" { set "Date" "${1}"; } notify "mailto:wuweiwwd@tom.com"; *NO "Error in MANAGESIEVE command CHECKSCRIPT: "* BYE "Disconnected for inactivity" Connection closed by foreign host. *sieve code:* require ["reject","fileinto","imap4flags","vacation","regex","encoded-character","include","copy","enotify","variables"]; if header :matches "Subject" "*" { set "Subject" "${1}"; } if header :matches "From" "*" { set "From" "${1}"; } if header :matches "Message-ID" "*" { set "msg_id" "${1}"; } if header :matches "To" "*" { set "To" "${1}"; } if header :matches "Date" "*" { set "Date" "${1}"; } notify "mailto:wuweiwwd@tom.com"; *dovecot.conf ./dovecot -n* # 2.2.15: /home/mail/dovecot/etc/dovecot/dovecot.conf doveconf: Warning: service auth { client_limit=80960 } is lower than required under max. load (300000) doveconf: Warning: service anvil { client_limit=60000 } is lower than required under max. load (240003) # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.2 auth_cache_negative_ttl = 1 days auth_cache_size = 1000 k auth_cache_ttl = 1 days auth_debug = yes auth_debug_passwords = yes auth_master_user_separator = * auth_mechanisms = plain login debug_log_path = /home/mail/dovecot/logs/dovecot.log default_client_limit = 60000 default_internal_user = vmail default_login_user = dovecotauth default_process_limit = 60000 disable_plaintext_auth = no first_valid_gid = 1007 first_valid_uid = 1007 imapc_features = rfc822.size fetch-headers imapc_host = 172.24.173.212 imapc_password = tom123VipIMAP587 imapc_user = %u info_log_path = /home/mail/dovecot/logs/dovecot.log log_path = /home/mail/dovecot/logs/dovecot.log mail_debug = yes mail_fsync = never mail_plugins = fts fts_lucene mail_log notify quota zlib mail_prefetch_count = 20 maildir_very_dirty_syncs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave duplicate vacation-seconds namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox "Junk E-mail" { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Items" { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = . } passdb { args = /home/mail/dovecot/etc/dovecot/passwd.masterusers driver = passwd-file master = yes } passdb { args = /home/mail/dovecot/bin/CheckPassword driver = checkpassword } plugin { fts = lucene fts_lucene = whitespace_chars=@. mail_debug = yes mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename append mail_log_fields = uid box msgid size quota = dict:%u::redis:host=127.0.0.1:prefix=user_quota/ quota_rule2 = Trash:storage=+80%% quota_warning = storage=90%% quota-warning 90 %u quota_warning2 = storage=80%% quota-warning 80 %u quota_warning3 = storage=70%% quota-warning 70 %u quota_warning4 = storage=60%% quota-warning 60 %u sieve = ~/sieve/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +vacation-seconds sieve_max_redirects = 10 sieve_redirect_envelope_from = orig_recipient sieve_vacation_default_period = 0 sieve_vacation_max_period = 0 sieve_vacation_min_period = 0 welcome_letter_path = /home/mail/dovecot/etc/welcome welcome_letter_url = http://202.108.252.162:8080/domainmail zlib_save = gz zlib_save_level = 6 } pop3_fast_size_lookups = yes pop3_no_flag_updates = yes postmaster_address = postmastar@%d protocols = imap pop3 sieve lmtp service auth-worker { user = dovecotauth } service auth { client_limit = 80960 unix_listener /home/mail/postfix/var/spool/postfix/private/auth-client { group = postfix mode = 0660 user = postfix } } service imap-login { inet_listener imap { port = 143 } service_count = 0 vsz_limit = 256 M } service imap { executable = imap postlogin process_limit = 60240 } service lmtp { inet_listener { port = 11000 } } service managesieve-login { inet_listener sieve { port = 4190 } service_count = 0 vsz_limit = 256 M } service managesieve { process_limit = 80960 } service pop { executable = imap postlogin process_limit = 60240 } service pop3-login { inet_listener pop3 { port = 110 } service_count = 0 vsz_limit = 256 M } service postlogin { executable = script-login -d rawlog -b -t } service quota-warning { executable = script /home/mail/dovecot/bin/quota-warning.sh unix_listener quota-warning { user = vmail } user = vmail } ssl = no submission_host = 172.24.140.52:26 userdb { driver = prefetch } userdb { args = /home/mail/dovecot/etc/dovecot/dovecot-dict-auth.conf.ext driver = dict } protocol imap { imap_logout_format = bytes=%i/%o mail_plugins = fts fts_lucene mail_log notify quota zlib imap_quota imap_zlib } protocol pop3 { pop3_logout_format = bytes=%i/%o, top=%t/%p, retr=%r/%b, del=%d/%m, size=%s } protocol lmtp { mail_plugins = fts fts_lucene mail_log notify quota zlib quota sieve } protocol sieve { mail_max_userip_connections = 1000 mail_plugins = fts fts_lucene mail_log notify quota zlib quota managesieve_implementation_string = Dovecot Pigeonhole managesieve_logout_format = bytes=%i/%o managesieve_max_compile_errors = 10 managesieve_max_line_length = 65536 } -- View this message in context: http://dovecot.2317879.n4.nabble.com/help-enotify-mail-to-run-fine-edit-via… Sent from the Dovecot mailing list archive at Nabble.com.

2 2

What is dovecot.socket and do i need it?
by Hamy 07 Apr '16

07 Apr '16

Helloafter rebooting the server, i keep getting these errors in mail.err : Apr 7 06:08:09 main dovecot: master: Error: systemd listens on port 143, but it's not configured in Dovecot. Closing. Apr 7 06:08:09 main dovecot: master: Error: systemd listens on port 993, but it's not configured in Dovecot. Closing. Apr 7 06:08:09 main dovecot: master: Error: systemd listens on port 993, but it's not configured in Dovecot. Closing. And then dovecot refuses any connection. the problem is solved if i do a manual restart of dovecot.service. After some search, i found 2 different solutions, one suggesting disabling dovecot.socket completely, the other one adjusting its settings: https://sowhatisthesolution.wordpress.com/2015/04/27/upgrading-dovecot-debi… I also found an old thread in the mailing list that might be relevant: http://dovecot.org/list/dovecot/2012-March/134376.html The errors indeed seem to go away if i disable dovecot.socket . I would be grateful is someone could help me understand the role of dovecot.socket , and why that error happens and what is the right way to solve it? PS: I am using Ubuntu server 15.10 and dovecot package v2.2.18 Best Regards,

1 0

RE: State for dsync not working
by Simon Pierre Desrosiers 07 Apr '16

07 Apr '16

No one will answer, so I will provide my own answer for posterity. The -s flag does not accept a file, but a string. So a correct for loop would be the following : for user in $userlist ; do state=$(cat "/Users/_dovecot/.bin/syncStates/syncstate$user" ) doveadm sync -u $user -s $state tcp:xxx.xxx.xxx.xxx > "/Users/_dovecot/.bin/syncStates/syncstate$user" done Hope it helps someone. > > ------------------------------ > > Message: 3 > Date: Fri, 25 Mar 2016 19:26:11 -0400 > From: Simon Pierre Desrosiers <simonpie(a)cs.mcgill.ca> > To: dovecot(a)dovecot.org > Subject: State for dsync not working. > Message-ID: <CAF2F45A-3F6A-4540-8C32-6551C6F27F7C(a)cs.mcgill.ca> > Content-Type: text/plain; charset=us-ascii > > Hello, > > Since replication does not seem to work on Mac OSX, I will run doveadm sync by hand every few minutes. > > In order to improve efficiency, I would like to use state. I have tried a few ways, but I always get the following error > doveadm(user): Error: Saved sync state is invalid, falling back to full sync: Invalid base64 data > KBtMOd0181bQ/wAAoQsxE90181YBAAAAAQAAAAAAAAAAAAAAAAAAABtI+mg= > > > Here is the code I use to sync : > for user in $userlist ; do > doveadm sync -u $user -s "/Users/_dovecot/.bin/syncStates/syncstate$user" tcp:xxx.xxx.xxx.xxx > "/Users/_dovecot/.bin/syncStates/syncstate$user" > done > > Any idea on how I can correct the encoding error ? > > Thank you > > ------------------------------ > > Message: 4 > Date: Sat, 26 Mar 2016 13:30:03 +1000 > From: Noel Butler <noel.butler(a)ausics.net> > To: dovecot(a)dovecot.org > Subject: Re: NetApp NFS vs. ZFS and NFS for Maildir > Message-ID: <79e7f44d74014b5c83d370d74e02205b(a)ausics.net> > Content-Type: text/plain; charset=US-ASCII; format=flowed > > It seems its troll time again on this list, ohh maybe its Harry in > disguise... So I will play along, for today anyway :) > > > On 19/03/2016 18:11, Stephan von Krawczynski wrote: >> On Sat, 19 Mar 2016 17:37:04 +1000 >> Noel Butler <noel.butler(a)ausics.net> wrote: >> >>> On 14/03/2016 18:49, Stephan von Krawczynski wrote: >>>> >>>>> >>>>> and you've never seen these cause problems with FS? then you must be >>>>> a >>>>> newbie, in over 25 years I've seen it happen several times - yes even >>>>> after an apparent controlled shutdown. >>>> >>>> Maybe you're doing something wrong then. because in my last 21 years >>>> working >>>> exactly in this business I've not seen a single deadly fs-crash because >>>> of a >>>> power-outage. Not one. And we had of course several, all backed by UPS. >>> >>> Consider yourself lucky, Most network admins whove been around large >>> busy ISP DC's have seen this in their lifetime, to not have seen one >>> is >>> rare, go buy yourself a lotto ticket :) >>> >>>> >>>> If your servers get drowned with water during a fire your fs is >>>> probably the >>>> least of your worries. You don't really plan to re-enable servers with >>>> water- or fire-damage, do you? That's probably why there shouldn't be a >>>> fireman pouring water in the first place. >>> >>> This shows you dont understand structural engineering, the fire does >>> not >>> have to be on your floor, it can be far away as two or so levels >>> above, >>> with the high pressure water used - equating to a shitload of water, >>> there are ducts, shafts, other risers and so on that with a shit-tone >>> of >>> water can easily penetrate fireblocks of floors below - dont take my >>> work, go ask a fireman, or maybe watch the nightly news sometime >>> (building fire - many levels water affected blah blah blah)... so >>> keeping those boxes on via UPS's is asking for lots of charcoaled >>> boards >>> and fried drives. IOW, total stupidity. >>> >>> Should those machines be depowered as required by our building codes, >>> well, might take a few days of drying out but at least they will power >>> back up without error - yes, done it in risk assessments. >> > >> Obviously you must work for people that have not the slightest idea >> about >> using hardware in a correct way and don't know when the time has come >> to throw > >> it away. Man, there is no way to let a drowned box survive. It is not >> back to > > Wow, how long did you allege to have been in network/sys admin? 20 > years? Really? I think you made a typo and and it should have read 20 > minutes, ya know I have refrained from posting no here for a long time > (apart from fact I rarely read the list), and I was not going to feed > the trolls, but sometimes the smart mouthed know nothing, need to bitch > slap upside the head so thats why I am devoting about 60 seconds to you. > > Of course there is, networks dont throw away many hundreds of servers > valued $7K to $10K, nor $100K+ storage systems, or $40K routers, LB's or > switches, just because they got drenched - with power isolated. > > >> normal when it is dry. If you don't get that I am pretty happy to be no >> customer. This can only be an idea born in the sick mind of a >> controller who > > You will never be a customer _or_employee_ of mine, trust me on that > one! > >> didn't want to pay insurance in the first place. We are talking about >> serious > > Got nothing to with insurance, it might take 2 days to dry out and get > back up and running, it will take an awful lot longer to get offsite > backups and restore every last one of them. > > I hope your employer reads this list, because he/she should be seeing > alarm bells from your comments. > >> corrosion effects here let alone that you have a hard time even >> knowning when > > yep, you sure did fail basic engineering > >> your boxes are really dry. Your fireman on the other hand seem to be >> stuck in >> the 80ths. Today there are solar panels almost everywhere _which you >> cannot >> turn off_. > > Wow, you really are clutching the fantasy straws arnt you, perhaps your > country lacks modernisation, I can go to the side of my house and > isolate the panels with a flick of a switch, strangely enough and I > guess in your eyes horrifyingly called "solar isolator" that stops the > panels providing power to my electrical circuits, yes, there might be > power from panels to it, but thats not going to affect my power circuits > or equipment > > > > -- > If you have the urge to reply to all rather than reply to list, you best > first read http://members.ausics.net/qwerty/ > > > ------------------------------ > > Message: 5 > Date: Sat, 26 Mar 2016 13:34:34 +1000 > From: Noel Butler <noel.butler(a)ausics.net> > To: dovecot(a)dovecot.org > Subject: Re: Email hosting provider > Message-ID: <2b1abc9c94e3f1322753d7547cb991e4(a)ausics.net> > Content-Type: text/plain; charset=UTF-8; format=flowed > > On 21/03/2016 17:06, Andre Rodier wrote: >> Hello, >> >> Sorry if I am off topic a little. >> >> I am looking for an email host provider that supports dovecot, sieve >> and manage sieve. Ideally with the roundcube webmail and managesieve >> plugin >> >> Better if it is in Europe or switzerland. I don't mind paying a little. >> >> Thanks, >> Andr?. > > Hi Andre, > > see www.webhostingtalk.com > > There are a number of reliable and reasonable priced hosts in Germany > (best place if you value your privacy) and Netherlands. > > > -- > If you have the urge to reply to all rather than reply to list, you best > first read http://members.ausics.net/qwerty/ > > > ------------------------------ > > Message: 6 > Date: Sat, 26 Mar 2016 10:52:33 +0530 > From: Joy <pj.netfilter(a)gmail.com> > To: Joseph Tam <jtam.home(a)gmail.com> > Cc: Dovecot Mailing List <dovecot(a)dovecot.org> > Subject: Re: IMAP Idle > Message-ID: > <CALM64LbXF_Nw+7STyxHMnjLNujEcTsc5mEXMA8DXaZuNX4pvpA(a)mail.gmail.com> > Content-Type: text/plain; charset=UTF-8 > > I am ok if connection is closed automatically after 30 min if client is not > responding but connection is not being closed even after 2 days. > > > On Sat, Mar 26, 2016 at 2:52 AM, Joseph Tam <jtam.home(a)gmail.com> wrote: > >> Joy <pj.netfilter(a)gmail.com> wrote: >> >> We have implement imap idle in web mail built by us to have >>> push mail feature. IMAP idle working perfectly with browser notification >>> and we are happy with it but having one issue with users who close the >>> browser directly and never logout in that case there are number of idle >>> connection which are not in use and users are unable to login once IP wise >>> connection limit is reached. >>> >>> Dovecot is not closing connection which are not in use, is there any >>> setting available which can help me to resolve this issue. >>> >> >> I had much the same situation where a user signed up with a roaming >> wireless carrier that assigned a new IP to the client whenever it got >> passed from one access point to another. Good fun when this person >> took a bus ride through the city, leaving orphaned connections in >> its wake. >> >> The IDLE disconnection timeout is hardwired in the Dovecot code >> >> http://wiki.dovecot.org/Timeouts >> >> It's set to the RFC minimum of 30min. You'll have to recompile Dovecot >> to lower this to a non-RFC compliant value. I'm not sure how this this >> will affect clients, but 30min seems to be overly generous. >> >> Joseph Tam <jtam.home(a)gmail.com> >> > > > ------------------------------ > > Message: 7 > Date: Sat, 26 Mar 2016 08:04:33 +0100 > From: Stephan von Krawczynski <skraw(a)ithnet.com> > To: dovecot(a)dovecot.org > Subject: Re: Email hosting provider > Message-ID: <20160326080433.07fcf216.skraw(a)ithnet.com> > Content-Type: text/plain; charset=ISO-8859-1 > > On Sat, 26 Mar 2016 13:34:34 +1000 > Noel Butler <noel.butler(a)ausics.net> wrote: > >> On 21/03/2016 17:06, Andre Rodier wrote: >>> Hello, >>> >>> Sorry if I am off topic a little. >>> >>> I am looking for an email host provider that supports dovecot, sieve >>> and manage sieve. Ideally with the roundcube webmail and managesieve >>> plugin >>> >>> Better if it is in Europe or switzerland. I don't mind paying a little. >>> >>> Thanks, >>> Andr?. >> >> Hi Andre, >> >> see www.webhostingtalk.com >> >> There are a number of reliable and reasonable priced hosts in Germany >> (best place if you value your privacy) and Netherlands. > > You mean "best place if you have no idea of the german laws and whats really > going on" ... > > -- > Regards, > Stephan > > > ------------------------------ > > Message: 8 > Date: Sat, 26 Mar 2016 10:48:47 +0000 > From: michael crane <mick.crane(a)gmail.com> > To: dovecot(a)dovecot.org > Subject: mailbox prefix > Message-ID: > <CACJbxCQ5by9eXKtAMfJ7aa1C2hCkmph=LbyUqn2yv6w=0hVseQ(a)mail.gmail.com> > Content-Type: text/plain; charset=UTF-8 > > dovecot version 2.2.13 > > hello, > I try to make a new server just for me after having old one working for > ages with Dovecot, Fetchmail, Squirrelmail, Procmail > making new one with above plus Postfix using Maildir structure. > I am having a bit of trouble understanding exactly what the namespace and > prefix are. > Is the "private/" prefix an internal thing with Dovecot ? Or is it supposed > to be a real directory ? > I'm not quite sure how to properly address the INBOX in Procmail, > Squirrelmail, Postfix config. > > > for example am I supposed to say inbox is ".private/.INBOX" > > > > cheers > > zemlik > > > ------------------------------ > > Subject: Digest Footer > > _______________________________________________ > dovecot mailing list > dovecot(a)dovecot.org > http://dovecot.org/cgi-bin/mailman/listinfo/dovecot > > ------------------------------ > > End of dovecot Digest, Vol 155, Issue 45 > ****************************************

1 0

"Lost" e-mail after alternate partition offline
by Daniel van Ham Colchete 07 Apr '16

07 Apr '16

Hey guys! I've got a problem here and I wish you could help me. A drive failed here and went offline for some time. This was a alternate storage drive so it took a while (hours) for us to notice. There was a problem with DRBD also, so it didn't move to the redundancy, it just went offline. I was able to recover all the files there, but a few of my users still don't see their old e-mails, the ones that are supposed to be on the alternate storage. >From what I could troubleshoot here file are there, vmail user can access them, so it's not a permission issue, but a doveadm dump on the index file of each mail folder, won't show the e-mail at the alternate storage drive. So, they are there (at the filesystem), but they aren't (from a imap client). Is there a way to rebuild the dovecot.index file, re-adding everything back to each folder? Best, Daniel Colchete

2 1

namespace...mailbox doesn't exist
by Eric 06 Apr '16

06 Apr '16

Hello list, I have a namespace called 'projects' which when clicked in Thunderbird (nonexistent in eM Client) yields the following error: "The current operation on 'projects' did not succeed. The mail server for account user(a)domain.tld responded: mailbox doesn't exist: projects.projects (0.00 + 0.00 secs)." The namespace is configure as follows: # Shared namespace 'projects' namespace { location = maildir:/home/vpopmail/domains/domain.tld/shared/projects prefix = projects. separator = . type = public } This is the log: 1: Apr 04 20:00:30 imap(postmaster(a)domain.tld): Debug: Effective uid=89, gid=89, home=/home/vpopmail/domains/domain.tld/postmaster 2: Apr 04 20:00:30 imap(postmaster(a)domain.tld): Debug: Quota root: name=ignore=Trash backend=maildir args= 3: Apr 04 20:00:30 imap(postmaster(a)domain.tld): Debug: Quota rule: root=ignore=Trash mailbox=? bytes=0 messages=0 4: Apr 04 20:00:30 imap(postmaster(a)domain.tld): Debug: Quota grace: root=ignore=Trash bytes=0 (10%) 5: Apr 04 20:00:30 imap(postmaster(a)domain.tld): Debug: Namespace : type=private, prefix=, sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location= 6: Apr 04 20:00:30 imap(postmaster(a)domain.tld): Debug: mdbox: access(/home/vpopmail/domains/domain.tld/postmaster/mdbox, rwx): failed: No such file or directory 7: Apr 04 20:00:30 imap(postmaster(a)domain.tld): Debug: mdbox: couldn't find root dir 8: Apr 04 20:00:30 imap(postmaster(a)domain.tld): Debug: sdbox: access(/home/vpopmail/domains/domain.tld/postmaster/sdbox, rwx): failed: No such file or directory 9: Apr 04 20:00:30 imap(postmaster(a)domain.tld): Debug: sdbox: couldn't find root dir 10: Apr 04 20:00:30 imap(postmaster(a)domain.tld): Debug: maildir: root exists (/home/vpopmail/domains/domain.tld/postmaster/Maildir) 11: Apr 04 20:00:30 imap(postmaster(a)domain.tld): Debug: maildir++: root=/home/vpopmail/domains/domain.tld/postmaster/Maildir, index=, indexpvt=, control=, inbox=/home/vpopmail/domains/domain.tld/postmaster/Maildir, alt= 12: Apr 04 20:00:30 imap(postmaster(a)domain.tld): Debug: Namespace : type=public, prefix=projects., sep=., inbox=no, hidden=no, list=yes, subscriptions=yes location=maildir:/home/vpopmail/domains/domain.tld/shared/projects 13: Apr 04 20:00:30 imap(postmaster(a)domain.tld): Debug: maildir++: root=/home/vpopmail/domains/domain.tld/shared/projects, index=, indexpvt=, control=, inbox=, alt= This did not happen with other versions of dovecot (I think) but just started happening with the upgrade. While it is not a serious problem and I can live with it, what would be causing it in the new dovecot iteration (2.2.23) ? And, could it be that I'm missing the necessary setting to mitigate this? Please let me know if any additional information is necessary. I'm thinking that the problem lies in lines 6/7 and 8/9 where Dovecot is looking for mdbox/sdbox. Eric

3 5

Migrating from Olde server to Dovecot
by Hendrik Velloen 06 Apr '16

06 Apr '16

Hi I am new to the mailing List, and was hoping to get some assistance migrating from an Old Cucipop + Sendmail server (running on a old Redhat v 7) to a new Dovecot setup. My new installation is Dovecot + Postfix. All is setup and working, however I want to trasnsfer the contents of the mailboxes from my old server to this new Dovecot setup. Please let me know what information will be required to transfer the mailboxes - I have tried a number of things, but with no luck. I think the correct method is the one below, but I am getting UIDL errors and AUTH errors and not sure if this is the right approach ---- PLEASE HELP dsync -u <DOVECOT_USER> mirror mbox:~/mail:INBOX=<MAIL_BOX_COPIED_FROM_OLD_SERVER> ~# dsync -u hendrikv(a)tcmvpn.co.za mirror mbox:~/mail:INBOX=/var/mail/User_mbox/hendrikv dsync(hendrikv(a)tcmvpn.co.za): Error: pop3c(196.26.136.162): AUTH PLAIN failed: -ERR Invalid command, try one of: USER name, PASS string, APOP name digest, QUIT dsync(hendrikv(a)tcmvpn.co.za): Error: pop3c: Disconnected from remote server dsync(hendrikv(a)tcmvpn.co.za): Error: pop3_migration: Couldn't sync mailbox POP3-MIGRATION-NS/INBOX: Internal error occurred. Refer to server log for more information. [2016-04-04 08:27:01] dsync(hendrikv(a)tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send mail GUID=ddbe5c71e58919cfe2a40905bced091d (UID=3054) dsync(hendrikv(a)tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send mail GUID=64087a4c7bf960114cf17ba044047900 (UID=374) dsync(hendrikv(a)tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send mail GUID=fd28baf9e91aedaf06c6e979ca76e96f (UID=2982) dsync(hendrikv(a)tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send mail GUID=607087e611559d2df02c0684de87e10d (UID=991) dsync(hendrikv(a)tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send mail GUID=c6a9aebd1f535f0cd82ed612a42bae77 (UID=1541) dsync(hendrikv(a)tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send mail GUID=4c56ffcfb600c8b216b2f1603383dc13 (UID=1007) dsync(hendrikv(a)tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send mail GUID=96ce5556fab323206f51deb03625be8a (UID=2357) dsync(hendrikv(a)tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send mail GUID=cda74cb161321b7c99973cc65e80a591 (UID=1401) dsync(hendrikv(a)tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send mail GUID=b735acf7ef69b39be157a97223878cdc (UID=642) dsync(hendrikv(a)tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send mail GUID=6d9baedf21198be32152461f96737a1a (UID=481) dsync(hendrikv(a)tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send mail GUID=19f36b934b74ce11f1eda95e32a0b112 (UID=1998) dsync(hendrikv(a)tcmvpn.co.za): Error: Exporting mailbox INBOX failed: Can't lookup pop3-uidl for UID=1: POP3 UIDLs couldn't be synce -- Kind Regards Hendrik

4 3

Internal quota calculation error (redis), double mail delivery
by Tom Sommer 06 Apr '16

06 Apr '16

Sometimes my redis connection times out, both for pop3, imap and lmtp. I have no idea why, when I do a "doveadm quota recalc -u" it works just fine? I'm thinking the connection is lost somehow and not retried? Apr 06 15:42:00 lmtp(xxx(a)xxx.com): Error: redis: Lookup timed out in 30.000 secs Apr 06 15:42:00 lmtp(xxx(a)xxx.com): Error: Internal quota calculation error Apr 06 15:42:00 lmtp(xxx(a)xxx.com): Error: Internal quota calculation error Apr 06 15:42:00 lmtp(xxx(a)xxx.com): Info: xxxx: msgid=<xxxx(a)xxxx.com>: saved mail to INBOX Apr 06 15:49:23 lmtp(xxx(a)xxx.com): Info: xxxx: msgid=<xxxx(a)xxxx.com>: saved mail to INBOX <-- Same mail This happens a lot, and it's really bad, because the mail is actually saved correctly, but the error is reported back to the Director, causing the delivery to be retried by the MTA - so the mail actually lands *twice* in the user's inbox. Thanks -- Tom

2 4

LMTP with alias addresses
by davide marchi 06 Apr '16

06 Apr '16

Hi, my problem is this: if i use lmtp for delivery and lookup for real_virtual_user(a)mydomain.com all function perfectly and mails are delivered correctly (quota and presence of user also) but if i send an email to real_alias_address(a)mydomain.com LMTP service (it's an alias containing several users) dosen't find user. How can i resolve this problem? for completeness my system users is based on vpopmail userdb

2 1

Session ID separator change
by Timo Sirainen 06 Apr '16

06 Apr '16

LMTP is a but troublesome in that a single LMTP session can do multiple RCPT TOs, so the same session will end up delivering mails to multiple different users. This is causing trouble with stats process, because each delivery is using the same session ID for multiple different users, which causes errors about session ID duplication in stats process. So we'll need to make the session IDs unique, while still keeping it clear enough that they're part of the same original LMTP session (which is also visible in th Received: headers). I'm now thinking that the first recipient's delivery will have the original normal session ID (e.g. "ME3ZHCi+A1dUDQAAvAUe3g"), while the following recipients will have :2, :3, etc suffix (e.g. "ME3ZHCi+A1dUDQAAvAUe3g:2"). If somebody cares about parsing the original session ID from logs, they can just cut off the session ID from the first ':' character (because indexer-worker also adds its own :suffix). So now I'm mainly wondering if ':' is a good character? Has somebody already changed mail_log_prefix in a way that these additional ':' chars might break their log parsers (e.g. mail_log_prefix=%u:%s%{session}:%r).

3 3

Unable to login with iPhone?
by Jason Pruim 06 Apr '16

06 Apr '16

Hey Everyone, So I have my dovecot install up and running! I can receive mail from the outside, still dealing with a small issue with sending email, but I think that's an issue off needing to setup a relay... Right now though... My biggest issue is it won't connect to my iPhone... I can login with mail on my computer, and through round cube for webmail... But it gets stuck on "verifying"... I tried addingcram-md5 and digest-md5 to the auth_mechanisms but that didn't work... Any idea what I'm missing? Here is my doveconf -n: [ec2-user@ip-172-31-28-46 postfix]$ doveconf -n # 2.2.10: /etc/dovecot/dovecot.conf # OS: Linux 4.4.5-15.26.amzn1.x86_64 x86_64 ext4 auth_mechanisms = plain login cram-md5 digest-md5 mail_location = maildir:/var/vmail/%d/%n/Maildir managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mbox_write_locks = fcntl namespace inbox { inbox = yes location = prefix = separator = . } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0666 user = vmail } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } ssl = required ssl_cert = </etc/ssl/certs/mailserver.pem ssl_key = </etc/ssl/private/mailserver.pem ssl_protocols = !SSLv2 !SSLv3 userdb { args = uid=vmail gid=vmail home=/var/vmail/%d/%n driver = static } protocol lda { mail_plugins = " sieve" } [ec2-user@ip-172-31-28-46 postfix]$ If I try to telnet to port 993 from my local computer it connects, but won't let me login... Same on port 143... Any ideas? Thanks everyone for your help! I can't wait until I can actually help with the questions instead of just asking them!

3 2

dovecot squatter
by Gabriele Bulfon 05 Apr '16

05 Apr '16

Hi, on cyrus installations we have the squatter utility that can index full message bodies and headers incrementally, allowing to run the squatter from time to time to arrange for index changes. Is there anything similar in Dovecot? This is expecially useful for full searches in body message. Thanks for any help Gabriele ---------------------------------------------------------------------------------------- Sonicle S.r.l. : http://www.sonicle.com Music: http://www.gabrielebulfon.com Quantum Mechanics : http://www.cdbaby.com/cd/gabrielebulfon

2 1

How to delete Dovecot users when using Single Instance Storage
by Jesus Cea 05 Apr '16

05 Apr '16

In case somebody find this useful: https://blog.jcea.es/posts/20160211-delete_users_dovecot.html -- Jesús Cea Avión _/_/ _/_/_/ _/_/_/ jcea(a)jcea.es - http://www.jcea.es/ _/_/ _/_/ _/_/ _/_/ _/_/ Twitter: @jcea _/_/ _/_/ _/_/_/_/_/ jabber / xmpp:jcea@jabber.org _/_/ _/_/ _/_/ _/_/ _/_/ "Things are not so easy" _/_/ _/_/ _/_/ _/_/ _/_/ _/_/ "My name is Dump, Core Dump" _/_/_/ _/_/_/ _/_/ _/_/ "El amor es poner tu felicidad en la felicidad de otro" - Leibniz

2 1

New feature: HTTP API
by aki.tuomi＠dovecot.fi 05 Apr '16

05 Apr '16

Hi all! We are bringing out HTTP API for doveadm-server in master HEAD. This feature is experimental, and can be expected to have bugs in it and might not always work. If you feel like trying it out though, you can enable it in your configuration file: doveadm_api_key = some-string service doveadm { inet_listener http { port = 8080 } } To use the API, you can go to http://host:8080/doveadm. GET request will print out possible commands, along with their parameters. If you have set API KEY, you need to include it in the request as X-API-Key header. This API has been designed to resemble JMAP API since we are planning to implement it in future version. The rule of thumb is that all the commands work as they would on cli, so the parameters are more or less the same. There are few exceptions, like 'field' parameter in some mail/mailbox commands. Commands are executed by POSTin JSON to /doveadm. The JSON format is [ ["command",{"parameter":"value"},"opaque identifier"], ["command",{"parameter":"value"},"opaque identifier"], ["command",{"parameter":"value"},"opaque identifier"], ... ] Be warned though that even if it supports multiple commands, some commands still use i_fatal to terminate the server if they are unhappy. This will mean you will lose the whole result set, and get no output, so at this point it is safest option to run only one command at a time. If you run into problems or discover issues, please report them in the usual manner to us. Kind regards, Aki Tuomi Dovecot Oy

2 3

Environment Variable Expansion
by Tim Evers 04 Apr '16

04 Apr '16

System: Debian Jessie I'm trying to put an environment variable in the sql config like: password_query = SELECT userid AS user, crypt AS password, maildir as userdb_home, 500 as userdb_uid, 500 as userdb_gid FROM local_account WHERE userid = '%u' and mbox_host = '%{env:CLUSTERNAME}' \ and ( ( imap_aktiv='1' and '%s'='imap' ) or ( pop_aktiv='1' and '%s'='pop3' ) or ( sieve_aktiv='1' and '%s'='sieve' ) ) \ and aktiv_abruf='1' My variable is %{env:CLUSTERNAME} CLUSTERNAME is set through /etc/default/dovecot. I tried setting the import_environment config variable to TZ CLUSTERNAME but that changed nothing. When I execute this through a login attempt, I see the following in the tcpflow output: SELECT userid AS user, crypt AS password, maildir as userdb_home, 508 as userdb_uid, 503 as userdb_gid FROM local_account WHERE userid = 'te' and mbox_host = 'env:CLUSTERNAME}' and ( ( imap_aktiv='1' and 'pop3'='imap' ) or ( pop_aktiv='1' and 'pop3'='pop3' ) or ( sieve_aktiv='1' and 'pop3'='sieve' ) ) and aktiv_abruf='1' So %{env:CLUSTERNAME} was parsed to env:CLUSTERNAME} which is not what the doc (http://wiki.dovecot.org/Variables) says, and it also seems like the parser somehow sees this as a short variable (removing %+{). Any hints what might be happening here / how I can make it work. Regards, Tim

1 0

(no subject)
by Hendrik Velloen 04 Apr '16

04 Apr '16

Hi I am new to the mailing List, and was hoping to get some assistance migrating from an Old Cucipop + Sendmail server (running on a old Redhat v 7) to a new Dovecot setup. My new installation is Dovecot + Postfix. All is setup and working, however I want to trasnsfer the contents of the mailboxes from my old server to this new Dovecot setup. Please let me know what information will be required to transfer the mailboxes - I have tried a number of things, but with no luck. I think the correct method is the one below, but I am getting UIDL errors and AUTH errors and not sure if this is the right approach ---- PLEASE HELP dsync -u <DOVECOT_USER> mirror mbox:~/mail:INBOX=<MAIL_BOX_COPIED_FROM_OLD_SERVER> ~# dsync -u hendrikv(a)tcmvpn.co.za mirror mbox:~/mail:INBOX=/var/mail/User_mbox/hendrikv dsync(hendrikv(a)tcmvpn.co.za): Error: pop3c(196.26.136.162): AUTH PLAIN failed: -ERR Invalid command, try one of: USER name, PASS string, APOP name digest, QUIT dsync(hendrikv(a)tcmvpn.co.za): Error: pop3c: Disconnected from remote server dsync(hendrikv(a)tcmvpn.co.za): Error: pop3_migration: Couldn't sync mailbox POP3-MIGRATION-NS/INBOX: Internal error occurred. Refer to server log for more information. [2016-04-04 08:27:01] dsync(hendrikv(a)tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send mail GUID=ddbe5c71e58919cfe2a40905bced091d (UID=3054) dsync(hendrikv(a)tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send mail GUID=64087a4c7bf960114cf17ba044047900 (UID=374) dsync(hendrikv(a)tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send mail GUID=fd28baf9e91aedaf06c6e979ca76e96f (UID=2982) dsync(hendrikv(a)tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send mail GUID=607087e611559d2df02c0684de87e10d (UID=991) dsync(hendrikv(a)tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send mail GUID=c6a9aebd1f535f0cd82ed612a42bae77 (UID=1541) dsync(hendrikv(a)tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send mail GUID=4c56ffcfb600c8b216b2f1603383dc13 (UID=1007) dsync(hendrikv(a)tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send mail GUID=96ce5556fab323206f51deb03625be8a (UID=2357) dsync(hendrikv(a)tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send mail GUID=cda74cb161321b7c99973cc65e80a591 (UID=1401) dsync(hendrikv(a)tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send mail GUID=b735acf7ef69b39be157a97223878cdc (UID=642) dsync(hendrikv(a)tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send mail GUID=6d9baedf21198be32152461f96737a1a (UID=481) dsync(hendrikv(a)tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send mail GUID=19f36b934b74ce11f1eda95e32a0b112 (UID=1998) dsync(hendrikv(a)tcmvpn.co.za): Error: Exporting mailbox INBOX failed: Can't lookup pop3-uidl for UID=1: POP3 UIDLs couldn't be synce -- Kind Regards Hendrik

1 0

How to make quota_status policy to apply to postfix virtual aliases as well?
by Hamy 04 Apr '16

04 Apr '16

HelloI am setting up a postfix+dovecot setup and using quota-status service to reject mails for full mailboxes on smtp session, according to this: https://sys4.de/en/blog/2013/04/08/postfix-dovecot-mailbox-quota/ This is working fine and without any apparent issues. however, Postfix doesn't seem to consult the policy when you're using virtual alias addresses. a virtual alias, is the one that you usually define with virtual_alias_maps . what happens is that Postfix only verifies there is a corresponding value for the given email address and blindly accept it. And it seems smtpd_recipient_restrictions , only applies to the original email address and postfix does not consult that after applying virtual alias. Does any one have any idea how to solve this? is there a setting that i'm missing? or is there a better way to setup email aliases that solve this issue? Best Regards,

1 0

1 last error
by Jason Pruim 03 Apr '16

03 Apr '16

Hey Everyone, I’m down to 1 last error that I know I created on my own but I can’t figure out how to fix it… Here is the error that I’m getting: Apr 3 04:29:37 ip-172-31-24-2 postfix/qmgr[20458]: EFE01423E2: from=<me(a)spike.net>, size=359, nrcpt=1 (queue active) Apr 3 04:29:37 ip-172-31-24-2 dovecot: lda(beth(a)primelashdiva.info): Fatal: setresgid(89(postfix),89(postfix),97(dovecot)) failed with euid=97(dovecot): Operation not permitted Apr 3 04:29:37 ip-172-31-24-2 postfix/pipe[20745]: EFE01423E2: to=<beth(a)primelashdiva.info>, relay=dovecot, delay=22, delays=22/0.01/0/0.01, dsn=4.3.0, status=deferred (temporary failure) So I figure that I messed up the permissions on /etc/dovecot/conf.d I tried to fix it even by setting it way open: drwxrwxrwx 2 dovecot dovecot 4096 Mar 30 00:56 conf.d And it still doesn’t work! doveconf -n: $ doveconf -n # 2.2.10: /etc/dovecot/dovecot.conf # OS: Linux 4.1.17-22.30.amzn1.x86_64 x86_64 ext4 auth_mechanisms = plain login first_valid_uid = 89 hostname = mail.primelashdiva.info mail_location = maildir:/var/vmail/%d/%n/Maildir mail_privileged_group = dovecot mbox_write_locks = fcntl namespace inbox { inbox = yes location = prefix = separator = . } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } postmaster_address = postmaster(a)primelashdiva.info protocols = imap lmtp service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = dovecot mode = 0666 user = dovecot } user = dovecot } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } ssl = no ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem ssl_protocols = !SSLv2 !SSLv3 userdb { args = uid=postfix gid=postfix home=/var/mail/vhosts/%d/%n driver = static } protocol lmtp { mail_plugins = " sieve" } protocol lda { mail_plugins = } [ec2-user@ip-172-31-24-2 dovecot]$ It might be too late for me to concentrate enough to figure it, but my googling isn’t bringing up any info… Any pointers? Thanks Everyone! Jason Pruim pruimj(a)gmail.com 352.234.3175

3 3

Problem with GSSAPI
by Luca Bertoncello 03 Apr '16

03 Apr '16

Hi list! I'm really puzzled... I have a Mailserver with Dovecot 2.2.9 (installed from Ubuntu 14.04-Repositories) and it works well with LDAP-Authentication agains the Active Directory. Now I want to use GSSAPI to allow the clients (with Thunderbird 38.7.1) to read E-Mails without giving a password. I configured Dovecot using these HowTos: http://mindref.blogspot.de/2011/02/dovecot-kerberos.html http://wiki.dovecot.org/Authentication/Kerberos But it does not work... In mail.log I can just see: Apr 3 09:52:26 mail dovecot: auth: Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Apr 3 09:52:26 mail dovecot: auth: Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Apr 3 09:52:26 mail dovecot: auth: Debug: Module loaded: /usr/lib/dovecot/modules/auth/libmech_gssapi.so Apr 3 09:52:26 mail dovecot: auth: Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Apr 3 09:52:26 mail dovecot: auth: Debug: Module loaded: /usr/lib/dovecot/modules/auth/libauthdb_ldap.so Apr 3 09:52:26 mail dovecot: auth: Debug: Read auth token secret from /var/run/dovecot/auth-token-secret.dat Apr 3 09:52:26 mail dovecot: auth: Debug: auth client connected (pid=2300) Apr 3 09:52:26 mail dovecot: imap-login: Disconnected (no auth attempts in 0 secs): user=<>, rip=192.168.50.54, lip=192.168.50.3, session=<x8Sq5I8vsADAqDI2> and Thunderbird says that the Ticket was not accepted and I have to check if I'm logged into the Kerberos/GSSAPI subsystem. I checked with tcpdump and I see that Thunderbird does NOT send at all any request. Could someone help me? Thanks a lot! Luca Bertoncello (lucabert(a)lucabert.de)

2 2

[PATCH 0/7] Fixes for lib-mail message-address
by Pali Rohár 03 Apr '16

03 Apr '16

Hello, I borrowed dovecot parser for email addresses and going to use it in new perl module as replacement for Email::Address. During implementation and testing I found bugs in dovecot parser & generator. So I'm sending my patches together with tests. Pali Rohár (7): lib-mail: message_address_write: Fix generating empty group list lib-mail: message_address_write: Fix generating group list with empty name lib-mail: parse_addr_spec: Like in rfc822_skip_comment() check if last_comment is not NULL lib-mail: parse_addr_spec: Email address without local-part is invalid lib-mail: parse_mailbox: Set display name instead mailbox when parsing failed lib-mail: message_address_write: Quote and escape strings if needed lib-mail: Update tests for message address src/lib-mail/message-address.c | 99 +++++++++++++++++++++++++++++++---- src/lib-mail/test-message-address.c | 11 +++- 2 files changed, 98 insertions(+), 12 deletions(-) -- 1.7.9.5

2 2

Dovecot rest api
by use experience 03 Apr '16

03 Apr '16

Team, Need more information on dovecot rest api. Any detailed information about list of dovecot rest apis other than http://www.dovecot.fi/dovecot-launches-a-gmail-api-compatible-rest-api-to-e… will really helpful.

3 2

Found 4 bugs in latest SquirrelMail related to IMAP and SMTP STARTTLS, Dovecot capabilities
by Tobias 03 Apr '16

03 Apr '16

This is a cross-post from the squirrelmail-devel list. It may be of interest if you want to run SquirrelMail and connect to Dovecot (and Postfix, possibly other servers) on a remote host using STARTTLS. BR Tobias -------- Forwarded Message -------- Subject: [SM-DEVEL] 4 bugs, IMAP and SMTP STARTTLS, Dovecot capabilities Date: Sun, 3 Apr 2016 04:27:56 +0200 From: Tobias <lists.zxinn(a)otaking.se> Reply-To: Squirrelmail Developers Mailing List <squirrelmail-devel(a)lists.sourceforge.net> To: squirrelmail-devel(a)lists.sourceforge.net Hello! I've looked for and have not seen any similar issues reported related to STARTTLS. Sourceforge wouldn't let me create an account or else I could have submitted bug reports directly. I'm using SquirrelMail 1.4.23 installed from latest FreeBSD Ports, together with PHP 5.6. I'm attempting to connect using STARTTLS to Dovecot 2.2.22 and Postfix 3.1.0. I've verified the code is not fixed for any of these four issues in the latest 1.5.2 SVN. Issue 2 is not as much of a problem in 1.5.2 as it is in 1.4.23 when using 'login' authentication. I connect to the IMAP and SMTP servers using their IP, but need to override the 'peer_name' to validate the certificate properly. New in PHP 5.6 is also that verify_peer defaults to TRUE, which means I need to either be able to set the peer_name, or disable verify_peer. I've found three issues in functions/imap_general.php, related to STARTTLS and Dovecot IMAP server, as well as one STARTTLS issue in class/deliver/Deliver_SMTP.class.php, class class Deliver_SMTP, function initStream. Issue 1: Stream options ($imap_stream_options) are not used with STARTTLS ($use_imap_tls = 2) in function sqimap_create_stream. The stream options are only used for $use_imap_tls = 1. How to fix: Add something like this: // set context options to allow for SSL option overrides @stream_context_set_option($imap_stream,$stream_options); Before trying to initiate the TLS session here: functions/imap_general.php :: function sqimap_create_stream 826: // start crypto on connection. suppress function errors. 827: if (@stream_socket_enable_crypto($imap_stream,true,STREAM_CRYPTO_METHOD_TLS_CLIENT)) { Issue 2: IMAP capabilities are only read once in function sqimap_create_stream (and subsequently used in sqimap_login to determine certain login options), however the capability list for Dovecot is not the same before and after STARTTLS. From Dovecot, before STARTTLS (telnet <local-ip> 143): * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE STARTTLS LOGINDISABLED] Dovecot ready. From Dovecot, after successful STARTTLS (openssl s_client -starttls imap -connect <local-ip>:143): <SSL session info> --- . OK Pre-login capabilities listed, post-login capabilities have more. a capability * CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN a OK Pre-login capabilities listed, post-login capabilities have more. How to fix: Issue "capability" command after successful STARTTLS to re-read the capabilities. Either as part of function sqimap_create_stream, or after call to sqimap_create_stream and before login options are checked in function sqimap_login. SquirrelMail 1.4.23 uses the return value with capabilities from function sqimap_create_stream to determine if 'login' is a viable option. Dovecot reports LOGINDISABLED prior to STARTTLS. (1.5.2 does not have this check for 'login'.) Issue 3: Multi-line response from the server to the AUTHENTICATE PLAIN (and likely cram/digest md5, possibly even login) are not accepted. The IMAP protocol allows the server to prefix responses which are incomplete with "*", and Dovecot uses this to report capabilities after successful login, but this is not handled by SquirrelMail's sqimap_login function. SquirrelMail reports: Unknown error: IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE SEARCH=FUZZY SPECIAL-USE QUOTA The full output from Dovecot is: * CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE SEARCH=FUZZY SPECIAL-USE QUOTA A003 OK Logged in How to fix: Check if '*' is the first token in a response, and read another line from the stream. Possibly something similar to this: while (substr($read,0,1) == '*') { // OK so far.. $read = sqimap_fgets($imap_stream); } Issue 4: Identical to issue 1 but for SMTP. $use_smtp_tls = 2 and STARTTLS in class/deliver/Deliver_SMTP.class.php, class class Deliver_SMTP, function initStream, does not honor stream options. BR Tobias ----- squirrelmail-devel mailing list Posting guidelines:http://squirrelmail.org/postingguidelines List address:squirrelmail-devel@lists.sourceforge.net List archives:http://news.gmane.org/gmane.mail.squirrelmail.devel List info (subscribe/unsubscribe/change options):https://lists.sourceforge.net/lists/listinfo/squirrelmail-devel

1 0

Still muddling through with broken auth...
by Jason Pruim 03 Apr '16

03 Apr '16

Hey Everyone, I’m still muddling through my first install… Followed the tutorials on workaround.org <http://workaround.org/> which were very helpful! but don’t include much info if things don’t work 100%… and so far I haven’t been able to pin down where the error is. When I try: telnet localhost 143 this is what shows up in the maillot: Apr 2 21:06:57 ip-172-31-24-2 dovecot: auth: Fatal: Unknown database driver 'sql' Apr 2 21:06:57 ip-172-31-24-2 dovecot: master: Error: service(auth): command startup failed, throttling for 2 secs Apr 2 21:06:57 ip-172-31-24-2 dovecot: imap-login: Disconnected: Auth process broken (disconnected before auth was ready, waited 0 secs): user=<>, rip=127.0.0.1, lip=127.0.0.1, secured, session=<+lw34IYvVgB/AAAB> With the failed driver for the database, I tried mysql and sql both of which produce the same error… I have a few other issues but I think those are related farther upstream… Not being able to sign into round cube for webmail, because of it being unable to connect to the storage container… But I think that’s a round cube issue… I want to get postfix and dovecot playing nicely before I worry too much about things like webmail access… Here is my postconf -n: [ec2-user@ip-172-31-24-2 dovecot]$ postconf -n alias_database = hash:/etc/aliases alias_maps = hash:/etc/aliases command_directory = /usr/sbin config_directory = /etc/postfix daemon_directory = /usr/libexec/postfix data_directory = /var/lib/postfix debug_peer_level = 2 html_directory = no inet_interfaces = localhost inet_protocols = all mail_owner = postfix mailq_path = /usr/bin/mailq.postfix manpage_directory = /usr/share/man mydestination = $myhostname, localhost.$mydomain, localhost newaliases_path = /usr/bin/newaliases.postfix queue_directory = /var/spool/postfix readme_directory = /usr/share/doc/postfix-2.6.6/README_FILES sample_directory = /usr/share/doc/postfix-2.6.6/samples sendmail_path = /usr/sbin/sendmail.postfix setgid_group = postdrop unknown_local_recipient_reject_code = 550 virtual_mailbox_domains = hash:/etc/postfix/virtual_mailbox_domains virtual_mailbox_maps = hash:/etc/postfix/virtual_mailbox_users virtual_transport = dovecot [ec2-user@ip-172-31-24-2 dovecot]$ What else can I provide? Thanks! Jason Pruim pruimj(a)gmail.com 352.234.3175

3 11

Dovecot with LDAP/AD has problem with uid/gid
by Luca Bertoncello 02 Apr '16

02 Apr '16

Hi list! I have a Server connected to an AD and I need to configure Dovecot to authenticate the users against the AD (with password and GSSAPI). Now I'm trying to connect Dovecot to the AD with password. The authentication works, but I always got this error: Apr 2 13:03:49 mail dovecot: pop3-login: Login: user=<lucabert>, method=PLAIN, rip=192.168.50.1, lip=192.168.50.3, mpid=3508, session=<ZWJDc34vDgDAqDIB> Apr 2 13:03:49 mail dovecot: pop3(lucabert): Error: stat(/var/spool/mail/lucabert/tmp) failed: Permission denied (euid=10001(lucabert) egid=10000(domain users) missing +x perm: /var/spool/mail/lucabert, dir owned by 1005:8 mode=0700) Apr 2 13:03:49 mail dovecot: pop3(lucabert): Error: Couldn't open INBOX: Internal error occurred. Refer to server log for more information. [2016-04-02 13:03:49] My configuration: # 2.2.9: /etc/dovecot/dovecot.conf # OS: Linux 3.13.0-83-generic x86_64 Ubuntu 14.04.4 LTS nfs auth_gssapi_hostname = mail.cch.intra auth_mechanisms = plain login cram-md5 gssapi auth_use_winbind = yes auth_username_chars = disable_plaintext_auth = no login_greeting = mail.cch.intra ready. mail_fsync = always mail_gid = 8 mail_location = maildir:/var/spool/mail/%Ln mail_nfs_index = yes mail_uid = 1005 mmap_disable = yes namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } protocols = " imap pop3" ssl_cert = </etc/dovecot/dovecot.pem ssl_key = </etc/dovecot/private/dovecot.pem userdb { driver = passwd } userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap override_fields = uid=1005 gid=8 euid=1005 } userdb { args = uid=1005 gid=8 home=/var/spool/mail/%n allow_all_users=yes driver = passwd-file override_fields = uid=1005 gid=8 euid=1005 } auth-ldap.conf.ext: passdb { driver = ldap # Path for LDAP configuration file, see example-config/dovecot-ldap.conf.ext args = /etc/dovecot/dovecot-ldap.conf.ext } userdb { driver = ldap args = /etc/dovecot/dovecot-ldap.conf.ext # Default fields can be used to specify defaults that LDAP may override #default_fields = home=/home/virtual/%u override_fields = uid=1005 gid=8 euid=1005 } and in my /etc/dovecot/dovecot-ldap.conf.ext I have: user_attrs = \ =uid=1005, \ =gid=8, \ =quota_rule=*:bytes=%{ldap:quotaBytes}, \ =home=/var/spool/mail/%{ldap:sAMAccountName}, \ =mail=maildir:/var/spool/mail/%{ldap:sAMAccountName}/Maildir But it seems that all these settings for uid/gid will be ignored/overwritten... Of course the Mailboxes have user 1005 and group 8. Can someone help me? Thanks Luca Bertoncello (lucabert(a)lucabert.de)

1 1

Save UID & metadata of mail in mysql table
by use experience 02 Apr '16

02 Apr '16

Team, I would like to save UID and metadata of mail in mysql table. I am trying to achieve this using dovecot plugin mail-filter. Also would like to do in the process of mail store (using Dovecot LDA). How can I get UID & metadata through script.

2 3