Robert Schetterer schrieb:

Timo Sirainen schrieb:

...

On Sun, 2009-04-26 at 17:49 +0200, Robert Schetterer wrote:

...

using latest dovecot 1.2 and latest thunderbird i noticed if using virtual plugin like here with mysql http://wiki.dovecot.org/Plugins/Virtual everthing works like expected until i add a shared namespace Tb then looses its subscriptions under imap to the private namespace only the shared namespace gets shown up , any idea? I dont see something special in the logs why this happens Does this happen without virtual plugin? I don't really see a connection between them. Anyway dovecot -n output of the broken configuration would be helpful..

no ,without virtual setup all works ok i.e normal private namespace and shared namespace

it works with private and virtual setup but adding shared namespace then i get loose the private namespace with tb, specially subdirs of INBOX

here comes dovecot -n

# 1.2.rc3: /etc/dovecot/dovecot.conf # OS: Linux 2.6.24-23-server i686 Ubuntu 8.04.2 ext3 base_dir: /var/run/dovecot/ log_path: /var/log/dovecot info_log_path: /var/log/dovecot.info protocols: imap pop3 managesieve listen(default): 212.52.224.50:143 listen(imap): 212.52.224.50:143 listen(pop3): 212.52.224.50:110 listen(managesieve): 212.52.224.50:2000 ssl: no disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login login_executable(managesieve): /usr/lib/dovecot/managesieve-login login_greeting: welcome on ... high performance imap an pop server mail_max_userip_connections(default): 10 mail_max_userip_connections(imap): 10 mail_max_userip_connections(pop3): 3 mail_max_userip_connections(managesieve): 10 verbose_proctitle: yes last_valid_uid: 1001 first_valid_gid: 1001 last_valid_gid: 1001 mail_access_groups: vmail mail_privileged_group: vmail mail_uid: 1001 mail_gid: 1001 mail_location(default): maildir:/usr/local/virtual/%d/%u/:CONTROL=/usr/local/virtual/%d/%u/:INDEX=/usr/local/virtual/%d/%u/:INBOX=/usr/local/virtual/%d/%u/ mail_location(imap): maildir:/usr/local/virtual/%d/%u/:CONTROL=/usr/local/virtual/%d/%u/:INDEX=/usr/local/virtual/%d/%u/:INBOX=/usr/local/virtual/%d/%u/ mail_location(pop3): maildir:/usr/local/virtual/%d/%u/:CONTROL=/usr/local/virtual/%d/%u/:INDEX=/usr/local/virtual/%d/%u/:INBOX=/usr/local/virtual/%d/%u/ mail_location(managesieve): maildir:/usr/local/virtual/%d/%u/ mail_debug: yes dbox_rotate_days: 0 mail_drop_priv_before_exec: yes mail_executable(default): /usr/lib/dovecot/rawlog /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/rawlog /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/rawlog /usr/lib/dovecot/pop3 mail_executable(managesieve): /usr/lib/dovecot/managesieve mail_plugins(default): virtual quota imap_quota imap_acl acl fts fts_squat mail_log autocreate mail_plugins(imap): virtual quota imap_quota imap_acl acl fts fts_squat mail_log autocreate mail_plugins(pop3): virtual quota mail_log fts fts_squat mail_plugins(managesieve): mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 mail_plugin_dir(managesieve): /usr/lib/dovecot/modules/managesieve imap_client_workarounds(default): outlook-idle delay-newmail imap_client_workarounds(imap): outlook-idle delay-newmail imap_client_workarounds(pop3): imap_client_workarounds(managesieve): pop3_enable_last(default): no pop3_enable_last(imap): no pop3_enable_last(pop3): yes pop3_enable_last(managesieve): no pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh pop3_client_workarounds(managesieve): managesieve_implementation_string(default): dovecot managesieve_implementation_string(imap): dovecot managesieve_implementation_string(pop3): dovecot managesieve_implementation_string(managesieve): Cyrus timsieved v2.2.13 namespace: type: private separator: / location: maildir:/usr/local/virtual/%d/%u/:CONTROL=/usr/local/virtual/%d/%u/:INDEX=/usr/local/virtual/%d/%u/:INBOX=/usr/local/virtual/%d/%u/ hidden: yes list: yes

subscriptions: yes ---- changing or not have this has no effect

namespace: type: private separator: / prefix: virtual/ location: virtual:/etc/dovecot/virtual:LAYOUT=maildir++ hidden: yes list: no namespace: type: private separator: / prefix: RealMails/ location: maildir:/usr/local/virtual/%d/%u/:CONTROL=/usr/local/virtual/%d/%u/:INDEX=/usr/local/virtual/%d/%u/:INBOX=/usr/local/virtual/%d/%u/ hidden: yes list: no

subscriptions: yes ---- changing or not have this has no effect

namespace: type: shared separator: / prefix: shared/%%d/%%u/ location: maildir:/usr/local/virtual/%d/%%u/:INDEX=~/shared/%%d/%%u/ list: children auth default: username_chars: verbose: yes debug: yes debug_passwords: yes passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf passdb: driver: sql args: /etc/dovecot/dovecot-sql-master.conf pass: yes master: yes userdb: driver: sql args: /etc/dovecot/dovecot-sql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: vmail group: vmail plugin: quota_warning: storage=95%% /usr/local/bin/quota-warning.sh 95 quota_warning2: storage=80%% /usr/local/bin/quota-warning.sh 80 quota: dict:::proxy::quotadict acl: vfile acl_shared_dict: file:/var/lib/dovecot/shared/mailboxes mail_log_events: delete undelete expunge copy mailbox_delete mail_log_fields: uid box msgid size fts: squat sieve: /usr/local/virtual/%d/%u/.dovecot.sieve mail_log_max_lines_per_sec: 0 autocreate: Trash autocreate2: Junk autocreate3: Sent autocreate4: Drafts autocreate5: Templates autosubscribe: Trash autosubscribe2: Junk autosubscribe3: Sent autosubscribe4: Drafts autosubscribe5: Templates home: /usr/local/virtual/%d/%u dict: quotadict: mysql:/etc/dovecot/dovecot-dict-quota.conf

doing a current update i have now dump backtrace no rawlog working still

dovecot: Apr 29 23:04:26 Error: child 25011 (imap) killed with signal 6 (core dumps disabled) dovecot: Apr 29 23:04:26 Error: IMAP(robert@schetterer.com): Raw backtrace: imap [0x80ef731] -> imap [0x80ef7b2] -> imap [0x80ef139] -> imap [0x807641c] -> imap [0x8075aa5] -> imap(mailbox_open+0x36) [0x80b4bc6] -> imap(cmd_select_full+0x1dd) [0x806463d] -> imap(cmd_select+0x19) [0x8064f99] -> imap [0x806714c] -> imap [0x80671f3] -> imap(client_handle_input+0x1d) [0x806781d] -> imap(client_input+0x63) [0x8067cd3] -> imap(io_loop_handler_run+0xe0) [0x80f8140] -> imap(io_loop_run+0x20) [0x80f75d0] -> imap(main+0x5e5) [0x80705f5] -> /lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe5) [0xb7e5c775] -> imap [0x805fbf1] dovecot: Apr 29 23:04:26 Panic: IMAP(robert@schetterer.com): file shared-storage.c: line 196 (shared_storage_get_namespace): assertion failed: (username != NULL) dovecot: Apr 29 23:04:26 Error: child 25014 (imap) killed with signal 6 (core dumps disabled) dovecot: Apr 29 23:04:26 Error: IMAP(robert@schetterer.com): Raw backtrace: imap [0x80ef731] -> imap [0x80ef7b2] -> imap [0x80ef139] -> imap [0x807641c] -> imap [0x8075aa5] -> imap(mailbox_open+0x36) [0x80b4bc6] -> imap(cmd_select_full+0x1dd) [0x806463d] -> imap(cmd_select+0x19) [0x8064f99] -> imap [0x806714c] -> imap [0x80671f3] -> imap(client_handle_input+0x1d) [0x806781d] -> imap(client_input+0x63) [0x8067cd3] -> imap(io_loop_handler_run+0xe0) [0x80f8140] -> imap(io_loop_run+0x20) [0x80f75d0] -> imap(main+0x5e5) [0x80705f5] -> /lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe5) [0xb7da7775] -> imap [0x805fbf1]

Timo Sirainen schrieb:

On Wed, 2009-04-29 at 23:07 +0200, Robert Schetterer wrote:

...

dovecot: Apr 29 23:04:26 Panic: IMAP(robert@schetterer.com): file shared-storage.c: line 196 (shared_storage_get_namespace): assertion failed: (username != NULL)

Fixed: http://hg.dovecot.org/dovecot-1.2/rev/4fd7b98bcff9

Hi Tino ups , i will test and report Regards

On Wed, 2009-04-29 at 20:59 +0200, Robert Schetterer wrote:

no ,without virtual setup all works ok i.e normal private namespace and shared namespace

it works with private and virtual setup but adding shared namespace then i get loose the private namespace with tb, specially subdirs of INBOX

Try talking IMAP directly. What does LIST "" * command show when it works, and what does it show when it doesn't work?

http://wiki.dovecot.org/TestInstallation

Robert Schetterer schrieb:

Timo Sirainen schrieb:

...

On Wed, 2009-04-29 at 20:59 +0200, Robert Schetterer wrote:

...

no ,without virtual setup all works ok i.e normal private namespace and shared namespace

it works with private and virtual setup but adding shared namespace then i get loose the private namespace with tb, specially subdirs of INBOX Try talking IMAP directly. What does LIST "" * command show when it works, and what does it show when it doesn't work?

http://wiki.dovecot.org/TestInstallation

Hi Timo i will do and report, but if it should work its an Tb bug, and whatever i need a workaround then Best Regards Hi Timo telnet looks ok for me, no idea why TB dont likes it

c list "" * thx for your more verbosed debug for rawlog

• LIST (\HasNoChildren) "/" "Templates"
• LIST (\HasNoChildren) "/" "Sent"
• LIST (\HasChildren) "/" "Drafts"
• LIST (\HasNoChildren) "/" "Drafts/kkkk"
• LIST (\HasNoChildren) "/" "Test"
• LIST (\HasChildren) "/" "INBOX"
• LIST (\HasNoChildren) "/" "INBOX/pppp"
• LIST (\HasNoChildren) "/" "Junk"
• LIST (\HasNoChildren) "/" "Trash"
• LIST (\Noselect \HasChildren) "/" "shared/..........com/test@......com"
• LIST (\HasNoChildren) "/" "shared/..........com/test@........com/Trash" c OK List completed.

in just now what ( might ) has hanged with it in my setup the home variable is given from sql its constructed like /usr/local/virtual/domain.de/user@domain.de/ as stated in rawlog example it possible to give home also in the plugin section with home=/usr/local/virtual/%d/%u i have both

rawlog worked with both entries before updates

but now it has rawlog: maildir:/usr/local/virtual/domain.de/user@domain.de//dovecot.rawlog doesn't exist

but

ls /usr/local/virtual/domain.de/user@domain.de//dovecot.rawlog is ok ( in linux // means normally the same as / i.e with ls )

so now i know why rawlog stopped working but i am not clear why it doesnt behave like ls and dont care about double slashes in directory paths, in any case rawlog is more like a plugin and for debug the home variable in the plugin section should be prefered, if home is also stated from elsewhere

Regards

Robert Schetterer schrieb:

Robert Schetterer schrieb:

...

Robert Schetterer schrieb:

...

Timo Sirainen schrieb:

...

On Wed, 2009-04-29 at 20:59 +0200, Robert Schetterer wrote:

...

no ,without virtual setup all works ok i.e normal private namespace and shared namespace

it works with private and virtual setup but adding shared namespace then i get loose the private namespace with tb, specially subdirs of INBOX Try talking IMAP directly. What does LIST "" * command show when it works, and what does it show when it doesn't work?

http://wiki.dovecot.org/TestInstallation

Hi Timo i will do and report, but if it should work its an Tb bug, and whatever i need a workaround then Best Regards Hi Timo telnet looks ok for me, no idea why TB dont likes it

small addition horde webmail imap does not work too, subfolder are not shown

...

c list "" * thx for your more verbosed debug for rawlog

• LIST (\HasNoChildren) "/" "Templates"
• LIST (\HasNoChildren) "/" "Sent"
• LIST (\HasChildren) "/" "Drafts"
• LIST (\HasNoChildren) "/" "Drafts/kkkk"
• LIST (\HasNoChildren) "/" "Test"
• LIST (\HasChildren) "/" "INBOX"
• LIST (\HasNoChildren) "/" "INBOX/pppp"
• LIST (\HasNoChildren) "/" "Junk"
• LIST (\HasNoChildren) "/" "Trash"
• LIST (\Noselect \HasChildren) "/" "shared/..........com/test@......com"
• LIST (\HasNoChildren) "/" "shared/..........com/test@........com/Trash" c OK List completed.

in just now what ( might ) has hanged with it in my setup the home variable is given from sql its constructed like /usr/local/virtual/domain.de/user@domain.de/ as stated in rawlog example it possible to give home also in the plugin section with home=/usr/local/virtual/%d/%u i have both

rawlog worked with both entries before updates

but now it has rawlog: maildir:/usr/local/virtual/domain.de/user@domain.de//dovecot.rawlog doesn't exist

but

ls /usr/local/virtual/domain.de/user@domain.de//dovecot.rawlog is ok ( in linux // means normally the same as / i.e with ls )

so now i know why rawlog stopped working but i am not clear why it doesnt behave like ls and dont care about double slashes in directory paths, in any case rawlog is more like a plugin and for debug the home variable in the plugin section should be prefered, if home is also stated from elsewhere

Regards

after the last update dovecot 1.2 the shared namespace disapeared in total in tb or imp with telnet everything looks ok as ever the subfolders of inbox are still not visable in tb or imp guess last patch http://hg.dovecot.org/dovecot-1.2/rev/e36a9edb5fb0 breaked more then it fixed

-- Best Regards

MfG Robert Schetterer

Germany/Munich/Bavaria

Robert Schetterer schrieb:

Robert Schetterer schrieb:

...

...

Robert Schetterer schrieb:

...

Robert Schetterer schrieb:

...

Timo Sirainen schrieb:

...

On Wed, 2009-04-29 at 20:59 +0200, Robert Schetterer wrote: > no ,without virtual setup all works ok > i.e normal private namespace and shared namespace > > it works with private and virtual setup > but adding shared namespace then i get loose the > private namespace with tb, specially subdirs of INBOX Try talking IMAP directly. What does LIST "" * command show when it works, and what does it show when it doesn't work?

http://wiki.dovecot.org/TestInstallation

Hi Timo i will do and report, but if it should work its an Tb bug, and whatever i need a workaround then Best Regards Hi Timo telnet looks ok for me, no idea why TB dont likes it small addition horde webmail imap does not work too, subfolder are not shown

...

c list "" * thx for your more verbosed debug for rawlog

• LIST (\HasNoChildren) "/" "Templates"
• LIST (\HasNoChildren) "/" "Sent"
• LIST (\HasChildren) "/" "Drafts"
• LIST (\HasNoChildren) "/" "Drafts/kkkk"
• LIST (\HasNoChildren) "/" "Test"
• LIST (\HasChildren) "/" "INBOX"
• LIST (\HasNoChildren) "/" "INBOX/pppp"
• LIST (\HasNoChildren) "/" "Junk"
• LIST (\HasNoChildren) "/" "Trash"
• LIST (\Noselect \HasChildren) "/" "shared/..........com/test@......com"
• LIST (\HasNoChildren) "/" "shared/..........com/test@........com/Trash" c OK List completed.

in just now what ( might ) has hanged with it in my setup the home variable is given from sql its constructed like /usr/local/virtual/domain.de/user@domain.de/ as stated in rawlog example it possible to give home also in the plugin section with home=/usr/local/virtual/%d/%u i have both

rawlog worked with both entries before updates

but now it has rawlog: maildir:/usr/local/virtual/domain.de/user@domain.de//dovecot.rawlog doesn't exist

but

ls /usr/local/virtual/domain.de/user@domain.de//dovecot.rawlog is ok ( in linux // means normally the same as / i.e with ls )

so now i know why rawlog stopped working but i am not clear why it doesnt behave like ls and dont care about double slashes in directory paths, in any case rawlog is more like a plugin and for debug the home variable in the plugin section should be prefered, if home is also stated from elsewhere

Regards after the last update dovecot 1.2

Robert Schetterer schrieb: the shared namespace disapeared in total in tb or imp with telnet everything looks ok as ever the subfolders of inbox are still not visable in tb or imp guess last patch http://hg.dovecot.org/dovecot-1.2/rev/e36a9edb5fb0 breaked more then it fixed

Hi Timo, disabling virtual plugin settings makes dovecot 1.2 work as expected again, subfolders of inbox are shown again as well as shared mailbox namespaces virtual plugin seems to me broken in some way

Hi Timo, i had setup virtual plugin related to the wiki http://wiki.dovecot.org/Plugins/Virtual which says

# The default namespace that is visible to IMAP clients namespace private { prefix = separator = / list = yes hidden = yes }

# Virtual namespace for the virtual INBOX. namespace private { prefix = virtual/ separator = / location = virtual:~/Maildir/virtual list = no hidden = yes }

# Copy of the default namespace. We'll use this in dovecot-virtual file. namespace private { prefix = RealMails/ separator = / list = no hidden = yes }

user_query = SELECT ...,
CASE '%s' WHEN 'pop3' THEN NULL ELSE 'yes' END AS namespace_1_inbox,
CASE '%s' WHEN 'pop3' THEN 'yes' ELSE NULL END AS namespace_2_inbox
WHERE ...

this leads not seeing subfolders of inbox and not seeing shared namespace with imap

my setup is now

namespace private { separator = / prefix = "" location = maildir:/usr/local/virtual/%d/%u/:CONTROL=/usr/local/virtual/%d/%u/:INDEX=/usr/local/virtual/%d/%u/:INBOX=/usr/local/virtual/%d/%u/ list = yes

hidden = no <<<<<this is what i have changed now

subscriptions = yes }

namespace private { prefix = "virtual/" separator = / location = virtual:/etc/dovecot/virtual:LAYOUT=maildir++ hidden = yes list = no subscriptions= no }

namespace private { prefix = "RealMails/" separator = / list = no hidden = yes location = maildir:/usr/local/virtual/%d/%u/:CONTROL=/usr/local/virtual/%d/%u/:INDEX=/usr/local/virtual/%d/%u/:INBOX=/usr/local/virtual/%d/%u/ }

namespace shared { separator = / prefix = "shared/%%d/%%u/" location = maildir:/usr/local/virtual/%d/%%u/:INDEX=~/shared/%%d/%%u/ subscriptions = no list = children inbox = no }

in a few tests now the setup with virtual plugin works now like desired with Thunderbird ( havent tested aggressive all features yet i.e with other plugins acl,autocreate ...)

i am not clear if the wiki should changed here, or exactly why it is working now, perhaps it would be the best to give the hidden = no parameter additionally in i.e. mysql at non pop3 login, but i have no exact idea what syntax it should be then

whats your meaning about all that stuff ?

-- Best Regards

MfG Robert Schetterer

Germany/Munich/Bavaria

Hi Timo ,

Timo Sirainen schrieb:

On Wed, 2009-05-13 at 10:00 +0200, Robert Schetterer wrote:

...

...

Hi Timo, disabling virtual plugin settings makes dovecot 1.2 work as expected again, subfolders of inbox are shown again as well as shared mailbox namespaces virtual plugin seems to me broken in some way

What do you here mean "disabling virtual plugin"? Did you also change all the namespace configuration? Because the issue seems to be that there are no hidden=no namespace, not really anything to do with virtual plugin itself.

as it looks right now, all trouble was based on the bug in the wiki as i couldnt get it to work like described in the wiki i just tested options without virtual plugin, and reenabled "normal" namespaces for testing, as i couldnt thought of a wiki bug, i speculated to a bug in the virtual plugin

...

namespace private { separator = / prefix = "" location = maildir:/usr/local/virtual/%d/%u/:CONTROL=/usr/local/virtual/%d/%u/:INDEX=/usr/local/virtual/%d/%u/:INBOX=/usr/local/virtual/%d/%u/ list = yes

hidden = no <<<<<this is what i have changed now .. in a few tests now the setup with virtual plugin works now like desired with Thunderbird ( havent tested aggressive all features yet i.e with other plugins acl,autocreate ...)

i am not clear if the wiki should changed here, or exactly why it is working now,

If you have hidden=yes in all private namespaces, then Dovecot's NAMESPACE reply doesn't show any namespaces. Apparently TB looks at that and then doesn't show anything.

It was anyway a bug in wiki, I've fixed it now.

Ok i just thought so , like it was a bug in the wiki

-- Best Regards

MfG Robert Schetterer

Germany/Munich/Bavaria