Skip to content

AI test

AI test #337

Manually triggered January 23, 2025 09:20
Status Failure
Total duration 18m 11s
Artifacts 4

ai.yml

on: workflow_dispatch
Matrix: main
Fit to window
Zoom out
Zoom in

Annotations

5 errors
main (18.19.0)
Process completed with exit code 1.
tests/ai/web/puppeteer/showcase.test.ts > puppeteer integration > find widgets in antd: packages/web-integration/src/common/tasks.ts#L493
Error: Failed to plan actions: The instruction and page context are irrelevant, there is no password input or demo section on the page. AssertionError [ERR_ASSERTION]: Failed to plan actions: The instruction and page context are irrelevant, there is no password input or demo section on the page. at Module.plan (/home/runner/work/midscene/midscene/packages/midscene/dist/lib/chunk-CERQVVPJ.js:2633:20) at processTicksAndRejections (node:internal/process/task_queues:95:5) at Object.executor (/home/runner/work/midscene/midscene/packages/web-integration/src/common/tasks.ts:493:24) at Executor.flush (/home/runner/work/midscene/midscene/packages/midscene/dist/lib/index.js:119:25) at PageTaskExecutor.action (/home/runner/work/midscene/midscene/packages/web-integration/src/common/tasks.ts:657:46) at PuppeteerAgent.aiAction (/home/runner/work/midscene/midscene/packages/web-integration/src/common/agent.ts:177:28) at /home/runner/work/midscene/midscene/packages/web-integration/tests/ai/web/puppeteer/showcase.test.ts:79:7 at runTest (file:///home/runner/work/midscene/midscene/node_modules/.pnpm/@vitest[email protected]/node_modules/@vitest/runner/dist/index.js:781:11) at runSuite (file:///home/runner/work/midscene/midscene/node_modules/.pnpm/@vitest[email protected]/node_modules/@vitest/runner/dist/index.js:909:15) at runSuite (file:///home/runner/work/midscene/midscene/node_modules/.pnpm/@vitest[email protected]/node_modules/@vitest/runner/dist/index.js:909:15) ❯ Object.executor src/common/tasks.ts:493:24 ❯ PageTaskExecutor.action src/common/tasks.ts:657:46 ❯ PuppeteerAgent.aiAction src/common/agent.ts:177:28 ❯ tests/ai/web/puppeteer/showcase.test.ts:79:7 ❯ PuppeteerAgent.aiAction src/common/agent.ts:185:15 ❯ tests/ai/web/puppeteer/showcase.test.ts:79:7
tests/ai/evaluate/inspect.test.ts > taobao-2-planning: locate element: packages/midscene/tests/ai/evaluate/inspect.test.ts#L142
AssertionError: expected 2 to be less than or equal to 1 ❯ test.timeout tests/ai/evaluate/inspect.test.ts:142:40
main (18.19.0)
Process completed with exit code 1.
main (18.19.0)
Process completed with exit code 1.

Artifacts

Produced during runtime
Name Size
e2e-cache-report Expired
15.9 MB
e2e-report Expired
7.94 MB
e2e-report-output Expired
18.7 MB
test-ai-output Expired
38.4 MB