- dovecot - dovecot.org

[Dovecot] Why p_strdup and other string functions uses loops instead strlen? (dovecot 2.0.rc4)
by Len7hir 10 Aug '10

10 Aug '10

I did Dovecot profiling on huge e-mail system, and p_strdup was very high on list. I do minor change: p_strdup: /* for (len = 0; (str)[len] != '\0'; ) len++; len++; */ len = strlen(str) + 1; p_strndup: /* len = 0; while (len < max_chars && ((const char *) str)[len] != '\0') len++; */ len = strnlen(str, max_chars); And after changes strdup drop down on the profile list. This is output from oprofile: samples % symbol name 28000 10.9764 p_strdup 8507 3.3349 safe_memset 7857 3.0801 .plt 7627 2.9899 buffer_write 6871 2.6935 parse_body_add_block And after (about four times smaller samples, but shows everything): samples % symbol name 9595 26.2625 parse_next_body_to_boundary 8247 22.5729 parse_body_add_block 772 2.1130 .plt 672 1.8393 buffer_write 658 1.8010 __i686.get_pc_thunk.bx 614 1.6806 safe_memset 586 1.6039 pool_alloconly_malloc 559 1.5300 p_strdup 533 1.4589 hash_table_insert_node I wonder why You use loops instead strlen, which is optimalised on every platforms. Redgards, Len7hir

2 1

[Dovecot] maildirsize having incorrect content, how to recreate/correct?
by Thomas von Eyben 10 Aug '10

10 Aug '10

Hi List, I have (otherwise successfull) migrated a server from cyrus to dovecot (Mac OS X Server 10.5.8 to 10.6.4 [dovecotd version to be 1.1.20apple0.5]). There are ca. 300+ users of which a very small handfull (ca. 1 %) are having reported a usage size that is very different to what 'du' reports. How can I rebuild the maildirsize and why might it be wrong in the first place(?) Will the maildirsize files be regenerated if deleted and when will this then happen ( at the next time of the user logging in or…) >From what I can read here: http://www.inter7.com/courierimap/README.maildirquota.html The maildirsize file contains (in linenumber > 1) "bytecount SPACE filecount" I also have one (perhaps more) user with one line having a negative value in maildirsize (-138204393 -2294) how can that happen / be corrected? Here's the info for one user with an much to high reporting of usage: sh-3.2# pwd /Volumes/RAID-06-low/Mail sh-3.2# cat 495827A6-7AF5-4017-9F07-67C0B04546EE/maildirsize 0S 281470373004731 4966 ### <- THIS LOOKS VERY WRONG 12113561 138 20047924 204 13553876 334 8064 1 8308 1 25240 1 26117 1 sh-3.2# du -hc 495827A6-7AF5-4017-9F07-67C0B04546EE 12M 495827A6-7AF5-4017-9F07-67C0B04546EE/.Deleted Messages/cur 0B 495827A6-7AF5-4017-9F07-67C0B04546EE/.Deleted Messages/new 0B 495827A6-7AF5-4017-9F07-67C0B04546EE/.Deleted Messages/tmp 12M 495827A6-7AF5-4017-9F07-67C0B04546EE/.Deleted Messages 0B 495827A6-7AF5-4017-9F07-67C0B04546EE/.Drafts/cur 0B 495827A6-7AF5-4017-9F07-67C0B04546EE/.Drafts/new 0B 495827A6-7AF5-4017-9F07-67C0B04546EE/.Drafts/tmp 4.0K 495827A6-7AF5-4017-9F07-67C0B04546EE/.Drafts 20M 495827A6-7AF5-4017-9F07-67C0B04546EE/.Sent Messages/cur 0B 495827A6-7AF5-4017-9F07-67C0B04546EE/.Sent Messages/new 0B 495827A6-7AF5-4017-9F07-67C0B04546EE/.Sent Messages/tmp 20M 495827A6-7AF5-4017-9F07-67C0B04546EE/.Sent Messages 14M 495827A6-7AF5-4017-9F07-67C0B04546EE/.U&APg-nsket e-mail/cur 0B 495827A6-7AF5-4017-9F07-67C0B04546EE/.U&APg-nsket e-mail/new 0B 495827A6-7AF5-4017-9F07-67C0B04546EE/.U&APg-nsket e-mail/tmp 14M 495827A6-7AF5-4017-9F07-67C0B04546EE/.U&APg-nsket e-mail 747M 495827A6-7AF5-4017-9F07-67C0B04546EE/cur ### <- WHEN COMPARING TO THIS 76K 495827A6-7AF5-4017-9F07-67C0B04546EE/new 0B 495827A6-7AF5-4017-9F07-67C0B04546EE/tmp 792M 495827A6-7AF5-4017-9F07-67C0B04546EE 792M total sh-3.2# ls -l total 352 drwx------ 7 jja mail 238 Aug 7 21:56 .Deleted Messages drwx------ 7 jja mail 238 Aug 7 21:56 .Drafts drwx------ 7 jja mail 238 Aug 7 21:56 .Sent Messages drwx------ 7 jja mail 238 Aug 7 21:56 .U&APg-nsket e-mail drwx------ 4966 jja mail 168844 Aug 7 21:56 cur ### <- AND WHEN COMPARING TO THIS -rw-r--r-- 1 jja mail 11 Aug 7 21:56 dovecot-keywords -rw------- 1 jja mail 108509 Aug 9 15:01 dovecot-uidlist -rw------- 1 jja mail 24808 Aug 9 14:26 dovecot.index -rw------- 1 jja mail 25288 Aug 9 15:01 dovecot.index.log -rw-r--r-- 1 jja mail 147 Aug 9 15:01 maildirsize drwx------ 6 jja mail 204 Aug 9 15:01 new -rw-r--r-- 1 jja mail 76 Aug 7 21:56 subscriptions drwx------ 2 jja mail 68 Aug 9 15:01 tmp - TvE

2 1

[Dovecot] ssl-build-param
by Yves Goergen 10 Aug '10

10 Aug '10

Hello, what does the Dovecot process ssl-build-param do? It has just eaten all my CPU for a minute or so. When I run it myself with "--help", it just does it all again and says "SSL parameters regeneration completed". What parameters? -- Yves Goergen "LonelyPixel" <nospam.list(a)unclassified.de> Visit my web laboratory at http://beta.unclassified.de

2 3

[Dovecot] network_biopair_interop
by Leander S. 09 Aug '10

09 Aug '10

Hi, since I use TLS I'm getting the following waning when I send mail to somebody in the internet:| "warning: network_biopair_interop: error reading 5 bytes from the network: Connection reset by peer|" ... Mail seems to be delivered & sent as usual. I found a post about it: http://de.postfix.org/pipermail/postfix-users/2009-March/000891.html but it didn't help to involve: "smtpd_tls_ask_ccert=no" Did anybody face that issue before? I'm using self signed certs. Regards

2 1

[Dovecot] restricting access by reverse domain name
by Phil Howard 09 Aug '10

09 Aug '10

Is there a feature or plugin to restrict access to IMAP/POP service by the domain name in reverse lookup? It would be even better if this restriction can exclude certain users (e.g. some users can access IMAP from certain networks but other users cannot). -- sHiFt HaPpEnS!

2 2

[Dovecot] Dovecot 2.0.rc4 not generating ssl-parameters.dat on first start
by Andreas M. Kirchwitz 09 Aug '10

09 Aug '10

Dear Dovecot lovers! When starting Dovecot 1.x the first time, it runs "ssl-build-params" to generate a file named "ssl-parameters.dat". This takes a couple of minutes. During this time users have no access to their mail, but this can be planned in advance and users can be notified. This is explained in http://wiki.dovecot.org/SSL/DovecotConfiguration With Dovecot 2.0.rc4, the new command "ssl-params" seems to do this job, but unfortunately it isn't run on first start of Dovecot but the start is delayed until a user connects to port 993 (or does STARTTLS in 143). According to http://wiki2.dovecot.org/SSL/DovecotConfiguration it should behave the same way as Dovecot 1 did. So, with Dovecot 2.0.rc4 it hits the first user who wants to establish a secure connection. It's hard to explain this to users. ;-) Of course, I could simply run "telnet <imaphost> 993" manually after installation. I also tried running "ssl-params" manually before starting Dovecot but it stays in foreground forever and doesn't seem to finish (what is it waiting for?) So it would be really great if Dovecot 2 could do this on its own like Dovecot 1 did. Besides that, Dovecot 2.0 runs like a charm ... Andreas

2 1

[Dovecot] quotactl failed with disk quotas and dovecot 2.0
by Patrick McLean 09 Aug '10

09 Aug '10

Hi, I have a machine running dovecot 2.0 rc4 and I can't seem to get the imap_quota plugin working, every time I try to read the quotas, I get the following in my log: > Aug 7 11:58:43 talyn dovecot: imap(chutz): Error: quotactl(Q_GETQUOTA, rootfs) failed: No such file or directory > Aug 7 11:59:53 talyn dovecot: imap(chutz): Error: quotactl(Q_GETQUOTA, rootfs) failed: No such file or directory > Aug 7 11:59:54 talyn dovecot: imap(chutz): Error: quotactl(Q_GETQUOTA, rootfs) failed: No such file or directory (Once for each try) Here is the output of dovecot -n: > # 2.0.rc4: /etc/dovecot/dovecot.conf > # OS: Linux 2.6.34-gentoo-r3 i686 Gentoo Base System release 2.0.1 > listen = * > mail_location = mdbox:~/.mdbox > mail_plugins = acl quota zlib trash imap_quota > managesieve_notify_capability = mailto > managesieve_sieve_capability = comparator-i;octet comparator-i;ascii-casemap fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date spamtest spamtestplus virustest > passdb { > args = * > driver = pam > } > plugin { > quota = fs:User quota:user > quota_warning = storage=80%% quota-warning 80 %u > sieve = ~/.dovecot.sieve > sieve_dir = ~/.sieve > } > protocols = imap lmtp > service auth { > unix_listener /var/spool/postfix/private/auth { > group = postfix > mode = 0660 > user = postfix > } > } > ssl_cert = </etc/ssl/dovecot/server.pem > ssl_key = </etc/ssl/dovecot/server.key > userdb { > driver = passwd > } > verbose_proctitle = yes > protocol lda { > mail_plugins = sieve quota > }

2 3

[Dovecot] OT Thunderbird
by Benny Pedersen 09 Aug '10

09 Aug '10

some senders on this maillist use a version of thunderbird that adds more then one references header and this imho breaks threading :( -- xpoint

7 14

[Dovecot] IMAP namespace and Courier migration
by Yves Goergen 09 Aug '10

09 Aug '10

Hello, the migration guide from Courier-IMAP to Dovecot says that I should change the folders namespace to "INBOX." if I want a seamless migration. Isn't it that e-mail clients determine that namespace automatically? At least I never needed to enter one in Thunderbird and then it was there. What happens if I copy the database, all the Maildir files, run the migration script to convert the special files and don't change that namespace - will clients show an error message and stop working or will it still work? -- Yves Goergen "LonelyPixel" <nospam.list(a)unclassified.de> Visit my web laboratory at http://beta.unclassified.de

2 1

[Dovecot] Dovecot 2.0.rc4 core dumped with Alpine 2.00
by Andreas M. Kirchwitz 09 Aug '10

09 Aug '10

Hi Timo and all others! The current Dovecot 2.0.rc4 did really well with Mutt 1.5.20 and Thunderbird 3.1.2, but a user with Alpine 2.00 crashed it immediately. I'm running Fedora 13 (Linux) and compiled Dovecot 2.0.rc4 manually like I did before with Dovecot 1.2.13. When switching from 1.2 to 2.0 I removed all those ".imap" folders with internal cache data (didn't know for sure if it's compatible between both version). All folders are in mbox format. When Alpine is started, the first crash happens. Alpine notifies the user that there was a problem connecting the IMAP server. No mail is display. And then the second crash happens. Looks like Alpine starts a second try to connect to the IMAP server before displaying the (empty) screen with (no) folders. Excerpt from syslog: Aug 8 18:07:56 mailserver dovecot: imap-login: Login: user=<mailuser>, method=CRAM-MD5, rip=138.201.2.2, lip=138.201.2.2, mpid=2676, TLS Aug 8 18:07:56 mailserver dovecot: imap(mailuser): Panic: file istream-header-filter.c: line 81 (read_mixed): assertion failed: (pos > 0) Aug 8 18:07:56 mailserver dovecot: imap(mailuser): Error: Raw backtrace: /usr/local/Dovecot-2.0.rc4/lib/dovecot/libdovecot.so.0(+0x350c1) [0xa410c1] -> /usr/local/Dovecot-2.0.rc4/lib/dovecot/libdovecot.so.0(+0x3512f) [0xa4112f] -> /usr/local/Dovecot-2.0.rc4/lib/dovecot/libdovecot.so.0(i_error+0) [0xa1b46e] -> /usr/local/Dovecot-2.0.rc4/lib/dovecot/libdovecot.so.0(+0x1f373) [0xa2b373] -> /usr/local/Dovecot-2.0.rc4/lib/dovecot/libdovecot.so.0(+0x1f4ff) [0xa2b4ff] -> /usr/local/Dovecot-2.0.rc4/lib/dovecot/libdovecot.so.0(i_stream_read+0x77) [0xa47967] -> /usr/local/Dovecot-2.0.rc4/lib/dovecot/libdovecot.so.0(i_stream_read_copy_from_parent+0x9a) [0xa47dfa] -> /usr/local/Dovecot-2.0.rc4/lib/dovecot/libdovecot-storage.so.0(+0x60520) [0x1ef520] -> /usr/local/Dovecot-2.0.rc4/lib/dovecot/libdovecot.so.0(i_stream_read+0x77) [0xa47967] -> /usr/local/Dovecot-2.0.rc4/lib/dovecot/libdovecot.so.0(i_stream_read_data+0x3e) [0xa47c8e] -> /usr/local/Dovecot-2.0.rc4/lib/dovecot/libdovecot.so.0(message_parse_header_next+0x78) [0xa2eb08] -> /usr/local/Dovecot-2.0.rc4/lib/dovecot/libdovecot.so.0(+0x2472a) [0xa3072a] -> /usr/local/Dovecot-2.0.rc4/lib/dovecot/libdovecot.so.0(message_parser_parse_next_block+0x32) [0xa2fc82] -> /usr/local/Dovecot-2.0.rc4/lib/dovecot/libdovecot.so.0(message_parser_parse_header+0x2c) [0xa2fe8c] -> /usr/local/Dovecot-2.0.rc4/lib/dovecot/libdovecot-storage.so.0(index_mail_parse_headers+0x102) [0x1f40d2] -> /usr/local/Dovecot-2.0.rc4/lib/dovecot/libdovecot-storage.so.0(+0x6571a) [0x1f471a] -> /usr/local/Dovecot-2.0.rc4/lib/dovecot/libdovecot-storage.so.0(index_mail_get_first_header+0x3d) [0x1f4a6d] -> /usr/local/Dovecot-2.0.rc4/lib/dovecot/libdovecot-storage.so.0(mail_get_first_header+0x25) [0x1ab2a5] -> /usr/local/Dovecot-2.0.rc4/lib/dovecot/libdovecot-storage.so.0(+0x61a31) [0x1f0a31] -> /usr/local/Dovecot-2.0.rc4/lib/dovecot/libdovecot-storage.so.0(index_mail_get_date+0x68) [0x1f2008] -> /usr/local/Dovecot-2.0.rc4/lib/dovecot/libdovecot-storage.so.0(mail_get_date+0x25) [0x1ab1f5] -> /usr/local/Dovecot-2.0.rc4/lib/dov Aug 8 18:07:56 mailserver dovecot: master: Error: service(imap): child 2676 killed with signal 6 (core dumped) Aug 8 18:08:02 mailserver dovecot: imap-login: Login: user=<mailuser>, method=CRAM-MD5, rip=138.201.2.2, lip=138.201.2.2, mpid=2682, TLS Aug 8 18:08:02 mailserver dovecot: imap(mailuser): Panic: file istream-header-filter.c: line 81 (read_mixed): assertion failed: (pos > 0) Aug 8 18:08:02 mailserver dovecot: imap(mailuser): Error: Raw backtrace: /usr/local/Dovecot-2.0.rc4/lib/dovecot/libdovecot.so.0(+0x350c1) [0x81d0c1] -> /usr/local/Dovecot-2.0.rc4/lib/dovecot/libdovecot.so.0(+0x3512f) [0x81d12f] -> /usr/local/Dovecot-2.0.rc4/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f746e] -> /usr/local/Dovecot-2.0.rc4/lib/dovecot/libdovecot.so.0(+0x1f373) [0x807373] -> /usr/local/Dovecot-2.0.rc4/lib/dovecot/libdovecot.so.0(+0x1f4ff) [0x8074ff] -> /usr/local/Dovecot-2.0.rc4/lib/dovecot/libdovecot.so.0(i_stream_read+0x77) [0x823967] -> /usr/local/Dovecot-2.0.rc4/lib/dovecot/libdovecot.so.0(i_stream_read_copy_from_parent+0x9a) [0x823dfa] -> /usr/local/Dovecot-2.0.rc4/lib/dovecot/libdovecot-storage.so.0(+0x60520) [0x1a1520] -> /usr/local/Dovecot-2.0.rc4/lib/dovecot/libdovecot.so.0(i_stream_read+0x77) [0x823967] -> /usr/local/Dovecot-2.0.rc4/lib/dovecot/libdovecot.so.0(i_stream_read_data+0x3e) [0x823c8e] -> /usr/local/Dovecot-2.0.rc4/lib/dovecot/libdovecot.so.0(message_parse_header_next+0x78) [0x80ab08] -> /usr/local/Dovecot-2.0.rc4/lib/dovecot/libdovecot.so.0(+0x2472a) [0x80c72a] -> /usr/local/Dovecot-2.0.rc4/lib/dovecot/libdovecot.so.0(message_parser_parse_next_block+0x32) [0x80bc82] -> /usr/local/Dovecot-2.0.rc4/lib/dovecot/libdovecot.so.0(message_parser_parse_header+0x2c) [0x80be8c] -> /usr/local/Dovecot-2.0.rc4/lib/dovecot/libdovecot-storage.so.0(index_mail_parse_headers+0x102) [0x1a60d2] -> /usr/local/Dovecot-2.0.rc4/lib/dovecot/libdovecot-storage.so.0(+0x6571a) [0x1a671a] -> /usr/local/Dovecot-2.0.rc4/lib/dovecot/libdovecot-storage.so.0(index_mail_get_first_header+0x3d) [0x1a6a6d] -> /usr/local/Dovecot-2.0.rc4/lib/dovecot/libdovecot-storage.so.0(mail_get_first_header+0x25) [0x15d2a5] -> /usr/local/Dovecot-2.0.rc4/lib/dovecot/libdovecot-storage.so.0(+0x61a31) [0x1a2a31] -> /usr/local/Dovecot-2.0.rc4/lib/dovecot/libdovecot-storage.so.0(index_mail_get_date+0x68) [0x1a4008] -> /usr/local/Dovecot-2.0.rc4/lib/dovecot/libdovecot-storage.so.0(mail_get_date+0x25) [0x15d1f5] -> /usr/local/Dovecot-2.0.rc4/lib/dov Aug 8 18:08:02 mailserver dovecot: master: Error: service(imap): child 2682 killed with signal 6 (core dumped) Is this information enough to track down the problem or do you want me to run additional tests? Just let me know what you need. Greetings, Andreas

2 1