Skip to content

chore: make tests OS agnostic #1240

chore: make tests OS agnostic

chore: make tests OS agnostic #1240

Triggered via pull request May 8, 2024 08:08
Status Failure
Total duration 10m 39s
Artifacts 2

tests.yml

on: pull_request
Matrix: E2E Tests
Fit to window
Zoom out
Zoom in

Annotations

10 errors, 2 warnings, and 2 notices
[webkit] › conform-validitystate.spec.ts:462:6 › With JS › color input: tests\integrations\conform-validitystate.spec.ts#L472
1) [webkit] › conform-validitystate.spec.ts:462:6 › With JS › color input ──────────────────────── Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected) Locator: locator('body').locator('main p') - Expected - 3 + Received + 1 - Array [ - "", - ] + Array [] Call log: - expect.toHaveText with timeout 5000ms - waiting for locator('body').locator('main p') - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements 470 | 471 | await submit.click(); > 472 | await expect(error).toHaveText(['']); | ^ 473 | 474 | // color input will always have a default value 475 | at D:\a\conform\conform\tests\integrations\conform-validitystate.spec.ts:472:23
[webkit] › conform-validitystate.spec.ts:462:6 › With JS › color input: tests\integrations\conform-validitystate.spec.ts#L472
1) [webkit] › conform-validitystate.spec.ts:462:6 › With JS › color input ──────────────────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected) Locator: locator('body').locator('main p') - Expected - 3 + Received + 1 - Array [ - "", - ] + Array [] Call log: - expect.toHaveText with timeout 5000ms - waiting for locator('body').locator('main p') - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements 470 | 471 | await submit.click(); > 472 | await expect(error).toHaveText(['']); | ^ 473 | 474 | // color input will always have a default value 475 | at D:\a\conform\conform\tests\integrations\conform-validitystate.spec.ts:472:23
[webkit] › conform-validitystate.spec.ts:462:6 › With JS › color input: tests\integrations\conform-validitystate.spec.ts#L472
1) [webkit] › conform-validitystate.spec.ts:462:6 › With JS › color input ──────────────────────── Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected) Locator: locator('body').locator('main p') - Expected - 3 + Received + 1 - Array [ - "", - ] + Array [] Call log: - expect.toHaveText with timeout 5000ms - waiting for locator('body').locator('main p') - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements 470 | 471 | await submit.click(); > 472 | await expect(error).toHaveText(['']); | ^ 473 | 474 | // color input will always have a default value 475 | at D:\a\conform\conform\tests\integrations\conform-validitystate.spec.ts:472:23
[webkit] › conform-validitystate.spec.ts:462:6 › No JS › color input: tests\integrations\conform-validitystate.spec.ts#L472
2) [webkit] › conform-validitystate.spec.ts:462:6 › No JS › color input ────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected) Locator: locator('body').locator('main p') - Expected - 3 + Received + 1 - Array [ - "", - ] + Array [] Call log: - expect.toHaveText with timeout 5000ms - waiting for locator('body').locator('main p') - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements 470 | 471 | await submit.click(); > 472 | await expect(error).toHaveText(['']); | ^ 473 | 474 | // color input will always have a default value 475 | at D:\a\conform\conform\tests\integrations\conform-validitystate.spec.ts:472:23
[webkit] › conform-validitystate.spec.ts:462:6 › No JS › color input: tests\integrations\conform-validitystate.spec.ts#L472
2) [webkit] › conform-validitystate.spec.ts:462:6 › No JS › color input ────────────────────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected) Locator: locator('body').locator('main p') - Expected - 3 + Received + 1 - Array [ - "", - ] + Array [] Call log: - expect.toHaveText with timeout 5000ms - waiting for locator('body').locator('main p') - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements 470 | 471 | await submit.click(); > 472 | await expect(error).toHaveText(['']); | ^ 473 | 474 | // color input will always have a default value 475 | at D:\a\conform\conform\tests\integrations\conform-validitystate.spec.ts:472:23
[webkit] › conform-validitystate.spec.ts:462:6 › No JS › color input: tests\integrations\conform-validitystate.spec.ts#L472
2) [webkit] › conform-validitystate.spec.ts:462:6 › No JS › color input ────────────────────────── Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected) Locator: locator('body').locator('main p') - Expected - 3 + Received + 1 - Array [ - "", - ] + Array [] Call log: - expect.toHaveText with timeout 5000ms - waiting for locator('body').locator('main p') - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements 470 | 471 | await submit.click(); > 472 | await expect(error).toHaveText(['']); | ^ 473 | 474 | // color input will always have a default value 475 | at D:\a\conform\conform\tests\integrations\conform-validitystate.spec.ts:472:23
[webkit] › subscription.spec.ts:297:6 › Subscription › Server Validation: tests\integrations\subscription.spec.ts#L51
3) [webkit] › subscription.spec.ts:297:6 › Subscription › Server Validation ────────────────────── Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected) Locator: locator('body').locator('li') - Expected - 26 + Received + 26 Array [ - "form.id: 1", - "form.errorId: 1", - "form.descriptionId: 1", - "form.initialValue: 1", + "form.id: 2", + "form.errorId: 2", + "form.descriptionId: 2", + "form.initialValue: 2", "form.value: 7", - "form.key: 1", + "form.key: 2", "form.dirty: 2", - "form.valid: 1", - "form.errors: 1", - "form.allErrors: 1", - "name.id: 1", - "name.formId: 1", - "name.errorId: 1", - "name.descriptionId: 1", - "name.initialValue: 1", + "form.valid: 2", + "form.errors: 2", + "form.allErrors: 2", + "name.id: 2", + "name.formId: 2", + "name.errorId: 2", + "name.descriptionId: 2", + "name.initialValue: 2", "name.value: 7", - "name.key: 1", + "name.key: 2", "name.dirty: 2", - "name.valid: 1", - "name.errors: 1", - "message.id: 1", - "message.formId: 1", - "message.errorId: 1", - "message.descriptionId: 1", - "message.initialValue: 1", - "message.value: 1", - "message.key: 1", - "message.dirty: 1", - "message.valid: 1", - "message.errors: 1", + "name.valid: 2", + "name.errors: 2", + "message.id: 2", + "message.formId: 2", + "message.errorId: 2", + "message.descriptionId: 2", + "message.initialValue: 2", + "message.value: 2", + "message.key: 2", + "message.dirty: 2", + "message.valid: 2", + "message.errors: 2", ] Call log: - expect.toHaveText with timeout 5000ms - waiting for locator('body').locator('li') - locator resolved to 30 elements - locator resolved to 30 elements - locator resolved to 30 elements - locator resolved to 30 elements - locator resolved to 30 elements - locator resolved to 30 elements - locator resolved to 30 elements - locator resolved to 30 elements - locator resolved to 30 elements 49 | 50 | await fieldset.name.pressSequentially('Edmund'); > 51 | await expect(fieldset.logs).toHaveText([ | ^ 52 | 'form.id: 1', 53 | 'form.errorId: 1', 54 | 'form.descriptionId: 1', at runTest (D:\a\conform\conform\tests\integrations\subscription.spec.ts:51:30) at D:\a\conform\conform\tests\integrations\subscription.spec.ts:299:3
E2E Tests (windows-latest)
Process completed with exit code 1.
E2E Tests (macos-latest)
The job was canceled because "windows-latest" failed.
E2E Tests (macos-latest)
The operation was canceled.
🎭 Playwright Run Summary
27 skipped 300 passed (4.2m)
🎭 Playwright Run Summary
2 failed [webkit] › conform-validitystate.spec.ts:462:6 › With JS › color input ───────────────────────── [webkit] › conform-validitystate.spec.ts:462:6 › No JS › color input ─────────────────────────── 1 flaky [webkit] › subscription.spec.ts:297:6 › Subscription › Server Validation ─────────────────────── 27 skipped 297 passed (7.3m)
Slow Test: [webkit] › simple-list.spec.ts#L1
[webkit] › simple-list.spec.ts took 20.3s
Slow Test: [webkit] › custom-inputs.spec.ts#L1
[webkit] › custom-inputs.spec.ts took 16.3s

Artifacts

Produced during runtime
Name Size
test-results-Linux Expired
184 Bytes
test-results-Windows Expired
530 KB