Skip to content

Get the benchmark tests GitHub action passing again #424

Open
@mattmccutchen-cci

Description

@mattmccutchen-cci

The GitHub action for the benchmark tests has been failing for a long time; John said there is a long-standing known problem with one benchmark. We should get the action passing again so its pass/fail status is useful to us.

If one benchmark is failing, Mike suggested we could just remove it. Alternatively, I suggested we could still run it but exclude it from the overall action status (a concept similar to lit's XFAIL) if we find it useful to view the periodic runs on GitHub rather than manually running the benchmark locally as desired.

Tentatively assigning to John.

Metadata

Metadata

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions