Skip to content

AI test

AI test #392

Manually triggered February 5, 2025 02:54
Status Failure
Total duration 13m 0s
Artifacts 4

ai.yml

on: workflow_dispatch
Matrix: main
Fit to window
Zoom out
Zoom in

Annotations

10 errors
main (18.19.0)
Process completed with exit code 1.
main (18.19.0)
Process completed with exit code 1.
main (18.19.0)
Process completed with exit code 1.
Unhandled error: packages/midscene/src/ai-model/prompt/util.ts#L408
AssertionError: executor is in error state, cannot append task error=Cannot read properties of undefined (reading 'node') TypeError: Cannot read properties of undefined (reading 'node') at dfsTree (/home/runner/work/midscene/midscene/packages/midscene/src/ai-model/prompt/util.ts:408:14) at Module.describeUserPage (/home/runner/work/midscene/midscene/packages/midscene/src/ai-model/prompt/util.ts:416:3) at Module.AiInspectElement (/home/runner/work/midscene/midscene/packages/midscene/src/ai-model/inspect.ts:152:11) at Insight.locate (/home/runner/work/midscene/midscene/packages/midscene/src/insight/index.ts:91:13) at Object.executor (/home/runner/work/midscene/midscene/packages/midscene/tests/unit-test/executor/index.test.ts:36:20) at Executor.flush (/home/runner/work/midscene/midscene/packages/midscene/src/ai-model/action-executor.ts:126:25) at async Promise.all (index 0) at /home/runner/work/midscene/midscene/packages/midscene/tests/unit-test/executor/index.test.ts:133:20 at runTest (file:///home/runner/work/midscene/midscene/node_modules/.pnpm/@vitest[email protected]/node_modules/@vitest/runner/dist/index.js:781:11) at runSuite (file:///home/runner/work/midscene/midscene/node_modules/.pnpm/@vitest[email protected]/node_modules/@vitest/runner/dist/index.js:909:15) - Expected + Received - true + false ❯ dfsTree src/ai-model/prompt/util.ts:408:14 ❯ Module.describeUserPage src/ai-model/prompt/util.ts:416:3 ❯ Module.AiInspectElement src/ai-model/inspect.ts:152:11 ❯ Insight.locate src/insight/index.ts:91:13 ❯ Object.executor tests/unit-test/executor/index.test.ts:36:20 ❯ Executor.flush src/ai-model/action-executor.ts:126:25 ❯ tests/unit-test/executor/index.test.ts:133:20 ❯ Executor.append src/ai-model/action-executor.ts:48:5 ❯ tests/unit-test/executor/index.test.ts:139:22 ❯ tests/unit-test/executor/index.test.ts:133:20 This error originated in "tests/unit-test/executor/index.test.ts" test file. It doesn't mean the error was thrown inside the file itself, but while it was running. The latest test that might've caused the error is "insight - run with error". It might mean one of the following: - The error was thrown, while Vitest was running this test. - If the error occurred after the test had been completed, this was the last documented test before it was thrown.
tests/ai/evaluate/assertion.test.ts > online_order-1: assertion-the 'select option' button is ...: packages/midscene/tests/ai/evaluate/assertion.test.ts#L67
Error: assertion failed: the 'select option' button is yellow expected: true, actual: false, thought: The 'select option' button is not yellow; it appears to be white with black text. ❯ test.timeout tests/ai/evaluate/assertion.test.ts:67:19
tests/unit-test/executor/index.test.ts > executor > insight - basic run: packages/midscene/tests/unit-test/executor/index.test.ts#L81
AssertionError: expected true to be falsy - Expected + Received - true + false ❯ tests/unit-test/executor/index.test.ts:81:39
tests/unit-test/executor/index.test.ts > executor > insight - init and append: packages/midscene/tests/unit-test/executor/index.test.ts#L140
AssertionError: expected 'error' to be 'running' // Object.is equality - Expected + Received - running + error ❯ tests/unit-test/executor/index.test.ts:140:37 ❯ tests/unit-test/executor/index.test.ts:133:20
tests/unit-test/prompt/utils.test.ts > prompt utils > describe context: packages/midscene/tests/unit-test/prompt/utils.test.ts#L16
AssertionError: expected 234.13302752293578 to be less than 160 ❯ tests/unit-test/prompt/utils.test.ts:16:36
main (18.19.0)
Process completed with exit code 1.
main (18.19.0)
Process completed with exit code 1.

Artifacts

Produced during runtime
Name Size
e2e-cache-report
16.4 MB
e2e-report
8.2 MB
e2e-report-output
20 MB
test-ai-output
41.6 MB