Skip to content

Known failures #4

@thesunshade

Description

@thesunshade

Use case:

If there is going to be a main set of tests that is part of the build script, it would be ideal if known failures were especially indicated. That way if a test fails and the developer wants to delay solving the problem, they can create a github issue and mark it as a known failure. Perhaps something like:

[[test-case]]
description = "Find volpage:SN ii 4"
known-failure = "See https://github.com/suttacentral/search-test/issues/3"
selected-languages = ["en", "pli"]
query = "volpage:SN ii 4"
expected.suttaplex = "sn12.3"

Would give this result:

KNOWN ERROR   1259ms Find volpage:SN ii 4
  See https://github.com/suttacentral/search-test/issues/3
  Could not parse JSON response: error decoding response body: data did not match any variant of untagged enum Hit at line 1 column 494

0 passed, 0 failed, 0 error, 1 known error

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions