cypress run --spec only runs the first spec if multiple specs are passed

[fazo96]

Current behavior

cypress run --spec file_a.tsx file_b.tsx and also cypress run --spec file_a.tsx,file_b.tsx both end up running only the specs in file_a.tsx

Desired behavior

cypress run --spec file_a.tsx file_b.tsx and also cypress run --spec file_a.tsx,file_b.tsx both result in test_a.tsx and test_b.tsx both being executed by cypress

Test code to reproduce

Any test suite with at least two files can be used to reproduce. Manually specify at least 2 files using --spec but only the first one in the list will be executed by cypress

Cypress Version

9.5.4, 10.3.0

Other

cypress run --spec file_a.tsx file_b.tsx this used to work at some point in our CI pipeline, but it eventually broke silently. We didn't notice because the pipeline was still succeeding, it was just running a small sample of the tests.

I tried upgrading from 9.5.4 to 10.3.0 but the issue persists.

[emilyrohrbough]

@fazo96 Thank you for opening an issue. I took a look at the examples you provided and this does not seem to be an issue. I am able to successfully run multiple specs using the --spec flag once.

What I am noticing though is if I provide an incorrect spec pattern or file path, only one test runs and Cypress does not provide an error to indicate it didn't find a spec matching that pattern. It would be helpful if we logged a message before test ran if a pattern/file path did not match. When no matches are found we log:

Can't run because no spec files were found.

We searched for specs matching these glob patterns:

  > /does_not_exist.cy.js
  > /spec.cy.js

It'd be helpful if we logged something like the following if a pattern had not matches.

⚠ Warning: no spec files were found when we searched this (these) glob pattern(s):

  > /does_not_exist.cy.js