-
Notifications
You must be signed in to change notification settings - Fork 11
Newly added tests failing when run against cyrus 3.0.5 #54
Comments
I've marked the editheader, duplicate and ereject tests as min_version_3_1, so they won't try to run against 3.0 anymore. I think test_rfc5490_mailboxexists_variables may have turned up a bug in the 3.0, so it's correct for that to be failing for now. I'll keep poking around at it and see if I can understand it, and then either fix it or open an issue for Ken. |
Here's another variation on the same issue:
This test sets up a sieve script that looks for the existence of a test mailbox. If the mailbox exists, the message is delivered into a hit mailbox, otherwise the message is delivered into a miss mailbox. Then, the test does the following:
So, it expects to find one message in each folder. But sometimes it's failing because they're both in the first folder it looked in, and sometimes it's failing because neither of them are in the first folder it looked in. I'm not yet sure what significance the order holds, but it seems clear that both messages always deliver to the same folder, which is definitely wrong no matter which folder it was. |
I've opened up cyrusimap/cyrus-imapd#2317 for the mailboxexists-variables test failure |
I guess you can add the Objectid.uniqueid test to the list of things which shouldn't be run on 3.0.
|
Ah yep, and the other Objectid test too from the look of things (I think the only reason it doesn't currently fail on 3.0 is because it doesn't currently test anything....). Fixed in d01f921 |
Thanks! Unfortunately I'm going to be blocked on the requirement for Mail::JMAPTalk 0.11 for a while (since it's required by Cassandane since ab7a87b but doesn't yet exist on CPAN). But I think as a whole my use of Cassandane is in a good place. I'm excluding fewer tests than I was before and I think the intermittent failures are gone. |
Yeah I'm blocked on that too, I install that module from CPAN myself! |
For the record, the test_rfc5490_mailboxexists_variables failure was a cyrus bug (#2317), but it's now fixed in git and will be included in 3.0.6 |
I updated Cassandane and now have a few failing tests when running against 3.0.5. Commit 191b1cc introduced a problem which was fixed by 9aa93b7 but in between the Sieve.editheader test was added, and that errors out because of:
I'm not sure which version of the cyrus code supports that sieve extension, but the test probably needs a :min_version annotation.
There are quite similar failures for Sieve.duplicate (
line 1: Unsupported feature(s) in "require": "duplicate"
) and Sieve.ereject (line 1: Unsupported feature(s) in "require": "ereject"
).Finally, the Sieve.rfc5490_mailboxexists_variables which was also added recently fails, but I'm not entirely sure what's gone wrong. The Cassandane output is below.
Because I'd like that added feature of changing the port base, I'll just skip these failing tests for now.
The text was updated successfully, but these errors were encountered: