AI unit test #2
zhoushawAnnotations
7 errors
|
tests/ai/evaluate/plan/planning.test.ts > automation - planning > basic run:
packages/midscene/tests/ai/evaluate/plan/planning.test.ts#L22
AssertionError: expected 4 to be 3 // Object.is equality
- Expected
+ Received
- 3
+ 4
❯ tests/ai/evaluate/plan/planning.test.ts:22:28
|
|
tests/ai/evaluate/plan/planning.test.ts > automation - planning > scroll page:
packages/midscene/tests/ai/evaluate/plan/planning.test.ts#L74
AssertionError: expected null to be truthy
- Expected:
null
+ Received:
false
❯ tests/ai/evaluate/plan/planning.test.ts:74:31
|
|
tests/ai/web/puppeteer/showcase.test.ts > puppeteer integration > Sauce Demo by Swag Lab:
packages/web-integration/tests/ai/web/puppeteer/showcase.test.ts#L45
AssertionError: expected 0 to be greater than or equal to 2
❯ tests/ai/web/puppeteer/showcase.test.ts:45:28
|
|
tests/ai/web/puppeteer/showcase.test.ts > puppeteer integration > search engine:
packages/web-integration/src/common/tasks.ts#L299
Error: No key to press
AssertionError [ERR_ASSERTION]: No key to press
at Object.executor (/home/runner/work/midscene/midscene/packages/web-integration/src/common/tasks.ts:299:15)
at Object.executor (/home/runner/work/midscene/midscene/packages/web-integration/src/common/tasks.ts:93:40)
at Executor.flush (/home/runner/work/midscene/midscene/packages/midscene/dist/lib/index.js:119:25)
at PageTaskExecutor.action (/home/runner/work/midscene/midscene/packages/web-integration/src/common/tasks.ts:706:16)
at PuppeteerAgent.aiAction (/home/runner/work/midscene/midscene/packages/web-integration/src/common/agent.ts:177:28)
at /home/runner/work/midscene/midscene/packages/web-integration/tests/ai/web/puppeteer/showcase.test.ts:99:7
at runTest (file:///home/runner/work/midscene/midscene/node_modules/.pnpm/@vitest[email protected]/node_modules/@vitest/runner/dist/index.js:781:11)
at runSuite (file:///home/runner/work/midscene/midscene/node_modules/.pnpm/@vitest[email protected]/node_modules/@vitest/runner/dist/index.js:909:15)
at runSuite (file:///home/runner/work/midscene/midscene/node_modules/.pnpm/@vitest[email protected]/node_modules/@vitest/runner/dist/index.js:909:15)
at runFiles (file:///home/runner/work/midscene/midscene/node_modules/.pnpm/@vitest[email protected]/node_modules/@vitest/runner/dist/index.js:958:5)
❯ Object.executor src/common/tasks.ts:299:15
❯ Object.executor src/common/tasks.ts:93:40
❯ PageTaskExecutor.action src/common/tasks.ts:706:16
❯ PuppeteerAgent.aiAction src/common/agent.ts:177:28
❯ tests/ai/web/puppeteer/showcase.test.ts:99:7
❯ PuppeteerAgent.aiAction src/common/agent.ts:185:15
❯ tests/ai/web/puppeteer/showcase.test.ts:99:7
|
|
tests/ai/web/puppeteer/showcase.test.ts > puppeteer integration > scroll:
packages/web-integration/src/common/agent.ts#L220
Error: Assertion failed: the "Horizontal 2", "Horizontal 4" and "Vertical 5" elements are visible
Reason: The elements 'Horizontal 2' and 'Vertical 5' are visible, but 'Horizontal 4' is not present in the provided image.
❯ PuppeteerAgent.aiAssert src/common/agent.ts:220:13
❯ tests/ai/web/puppeteer/showcase.test.ts:114:7
|
|
main (18.19.0)
Process completed with exit code 1.
|
|
main (18.19.0)
Process completed with exit code 1.
|
Artifacts
Produced during runtime
| Name | Size | |
|---|---|---|
|
test-ai-output
|
14.4 MB |
|