Following https://github.com/gpuweb/cts/pull/1836, this will let Chrome's
CTS runner bypass the builtin CTS timeouts in favor of our own harness
timeouts.
Bug: chromium:1340602
Change-Id: I09f25de26f28f4595c6d277050f2a71969566fdb
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/102200
Reviewed-by: Kai Ninomiya <kainino@chromium.org>
Kokoro: Kokoro <noreply+kokoro@google.com>
Commit-Queue: Austin Eng <enga@chromium.org>
Ensure that all actually known flaky tests are marked RetryOnFailure.
Generated with some manual changes, then `./tools/run cts update`
pointing at the Chromium CL to disable retries.
Bug: chromium:1343969, chromium:1344876, chromium:1359106, dawn:1500
Change-Id: Ia92a83e55bd64f39ecd8ff1be194dca95febd9bb
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/101801
Bot-Commit: rubber-stamper@appspot.gserviceaccount.com <rubber-stamper@appspot.gserviceaccount.com>
Commit-Queue: Austin Eng <enga@chromium.org>
Change-Id: I4ce31d6cadd4506385d39b4754347fa4838ea757
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/100501
Auto-Submit: Loko Kung <lokokung@google.com>
Reviewed-by: Austin Eng <enga@chromium.org>
Kokoro: Kokoro <noreply+kokoro@google.com>
Commit-Queue: Austin Eng <enga@chromium.org>
c0c5cce305..27dc745ca1
$ git log c0c5cce30..27dc745ca --date=short --no-merges --format='%ad %ae %s'
2022-08-26 gyuyoung Add sample_count test to buffer_texture_copies.spec.ts (#1800)
2022-08-26 gyuyoung Implement 'texture,device_mismatch' test in writeTexture.spec.ts (#1793)
2022-08-26 gyuyoung Add 'maximum_binding_limit' test to createBindGroupLayout.spec.ts (#1790)
2022-08-25 enga Add global test config (#1801)
2022-08-25 enga Mark root .eslintrc.json as "root: true" (#1802)
2022-08-25 bajones Address Kai's feedback
2022-08-24 tojiro Style fixes
2022-08-24 tojiro Refactor image_copy and unified data generator between the two test files.
2022-08-23 bajones Optimizing GetInitialData function
2022-08-25 kainino fix merge error
2022-08-25 rharrison Clarify comments in ULP code (#1795)
2022-08-23 kainino tweak to make safer against accidental awaits
2022-08-23 bclayton webgpu/shader/execution: Check validation before testing results
2022-08-24 rharrison Linearly spread `f32FullRange` values over possible f32 values (#1786)
2022-08-24 rharrison Implement `remainder (%)` f32 test (#1765)
2022-08-24 rharrison Rename `make*F32IntervalCase` to `make*ToF32IntervalCase` (#1775)
2022-08-24 zhaoming.jiang Revert "Use let declarations for literal input in shader,execution,expression tests (#1788)" (#1789)
2022-08-24 zhaoming.jiang Use let declarations for literal input in shader,execution,expression tests (#1788)
2022-08-24 gyuyoung Add storage_texture,formats test to createBindGroupLayout.spec.ts (#1776)
2022-08-23 rharrison Refactor binary arithmetic tests to use common test values (#1783)
Change-Id: I75a810698616f74d02480ccee369564030aa4a32
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/100462
Auto-Submit: Austin Eng <enga@chromium.org>
Kokoro: Kokoro <noreply+kokoro@google.com>
Reviewed-by: Loko Kung <lokokung@google.com>
Commit-Queue: Loko Kung <lokokung@google.com>
These tests used to be flaky, and now fail consistently after jobs
is set to 1 instead of 4. Suppressing so parallelization can be
disabled to make test results more consistent.
Bug: chromium:1353938
Change-Id: Ia99445ddd43d55d7ac3f67dd8e177b0fd34d51f3
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/99762
Commit-Queue: Austin Eng <enga@chromium.org>
Kokoro: Kokoro <noreply+kokoro@google.com>
Bot-Commit: rubber-stamper@appspot.gserviceaccount.com <rubber-stamper@appspot.gserviceaccount.com>
Heartbeats are rate-limited to 1 every 500ms.
They are sent at the following checkpoints:
- Before a log is recorded in TestCaseRecorder
- Just before an async WebGPU operation
- Immediately following completion of a async WebGPU op
- After a then/catch handler waiting on an async WebGPU op
Bug: chromium:1340602
Change-Id: I4d5c864dabd3f4215dac2e78d7658df0f6a7b0b7
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/99360
Commit-Queue: Austin Eng <enga@chromium.org>
Reviewed-by: Kai Ninomiya <kainino@chromium.org>
Kokoro: Kokoro <noreply+kokoro@google.com>
Adds the generated CTS test list to the existing gn/webgpu-cts group
so that Chromium tests properly include the generated file.
Also updates some existing BUILD.gn file paths to be consistent with
Chromium styling: relative paths without the leading ./ for files
under the current directory and directories before and separate from
individual files.
Bug: dawn:1479
Change-Id: Icce70e7fcee874b6b33c21230c8a4429a1f7ab6c
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/98801
Commit-Queue: Austin Eng <enga@chromium.org>
Auto-Submit: Brian Sheedy <bsheedy@google.com>
Reviewed-by: Austin Eng <enga@chromium.org>
Switches the WebGPU CTS test runner JavaScript code to use the defined
message protocol instead of the ad-hoc solution we were using before.
Bug: chromium:1340602
Change-Id: Ieaf26b5b2409f69d7859d3db4ce7757780de6712
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/98684
Kokoro: Kokoro <noreply+kokoro@google.com>
Reviewed-by: Austin Eng <enga@chromium.org>
Commit-Queue: Austin Eng <enga@chromium.org>
Auto-Submit: Brian Sheedy <bsheedy@google.com>
- Run format on the current expectations file to make it up to date.
- It's a lot easier to read the failures when they are grouped by the bug.
Change-Id: I333a0b237ccd405d204e47809eb7ab723824fddd
No-Try: True
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/98241
Auto-Submit: Loko Kung <lokokung@google.com>
Reviewed-by: Corentin Wallez <cwallez@chromium.org>
Commit-Queue: Loko Kung <lokokung@google.com>
There are many devices in Intel HD630 family, we cannot enumerate all
their device ids in the tag. We want cts to run as expected on other
Intel devices of the same architecture, add generation-based tag
intel-gen-9 to include a broad range of devices in the expectations.
Bug: dawn:1444
Change-Id: I80b6ae64ea2efc41bcc68e1c917919a86ec87f44
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/97760
Kokoro: Kokoro <noreply+kokoro@google.com>
Commit-Queue: Austin Eng <enga@chromium.org>
Reviewed-by: Brian Sheedy <bsheedy@google.com>
Reviewed-by: Austin Eng <enga@chromium.org>
Adds the "type" field to the websocket message sent
by the CTS JavaScript code with a value of
"TEST_FINISHED". This is in preparation for the
switch to using a heartbeat system for test timeouts
instead of a fixed timeout.
Bug: chromium:1340602
Change-Id: I886d89dbdfb1e3946dd8c59ecf23f9b18385b65e
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/97280
Reviewed-by: Austin Eng <enga@chromium.org>
Commit-Queue: Brian Sheedy <bsheedy@google.com>
Auto-Submit: Brian Sheedy <bsheedy@google.com>
Commit-Queue: Austin Eng <enga@chromium.org>
Kokoro: Kokoro <noreply+kokoro@google.com>
Update:
- expectations.txt
- ts_sources.txt
- resource_files.txt
- webtest .html files
a41bc407a8..72e3a22491
- 72e3a2 Expand map_detach test for buffer should detach on device.destroy (#1699)
- d5e662 Enhance val:render_pass_descriptor:depth_stencil_attachment_depth_clear_value (#1674)
- 12b775 Implement val:CopyExternalImageToTexture,destination_texture,dimension (#1695)
- 2834ce Add an out-of-range check to the ranges test in writeBuffer.spec.ts (#1663)
- bee493 Implement val:queue:writeTexture:usage (#1675)
- ea0057 Add GPURenderPassDescriptor.maxDrawCount test plan (#1614)
- d30940 Generate full range of `atan2` cases (#1679)
- 5b9641 Correct the order of params in atan2 message (#1677)
- 228c28 Implement f32 `degrees` tests (#1668)
- 4786c2 Remove obsolete f32 testing infrastructure (#1665)
- 8e1167 Add f32 tests for `pow` (#1658)
- aa0719 Make `render_pass_descriptor:resolveTarget,usage` test a valid case together (#1660)
- 6dfee4 Submit all shader batches before checking for results
- bbd744 Convert `ldexp` tests to use interval framework (#1659)
- 9d3043 Update f32 tests to handle returning undefined for infinity (#1655)
Created with './tools/run cts roll'
Change-Id: Ibdf6a28ea84e2115103c9c9637b3e648a62b8364
Cq-Include-Trybots: luci.chromium.try:dawn-try-win10-x86-rel,linux-dawn-rel,mac-dawn-rel,win-dawn-rel
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/96880
Commit-Queue: Kai Ninomiya <kainino@chromium.org>
Reviewed-by: Austin Eng <enga@chromium.org>
Kokoro: Kokoro <noreply+kokoro@google.com>
Include Optiplex 7080 Linux in the suppressions added in
https://dawn-review.googlesource.com/c/dawn/+/96200
Change-Id: I8f99da7e6e42b675b40e200f0c668e638e2238f2
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/96402
Auto-Submit: Yuly Novikov <ynovikov@chromium.org>
Commit-Queue: Ben Clayton <bclayton@google.com>
Reviewed-by: Ben Clayton <bclayton@google.com>
Kokoro: Kokoro <noreply+kokoro@google.com>
Some web_platform:* tests are crashing due to issues with SharedImage
and canvas formats.
Bug: chromium:1344876
Change-Id: I0a708bad15b3d19299ce614ad43ab58c888e5291
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/96300
Commit-Queue: Austin Eng <enga@chromium.org>
Kokoro: Kokoro <noreply+kokoro@google.com>
Bot-Commit: rubber-stamper@appspot.gserviceaccount.com <rubber-stamper@appspot.gserviceaccount.com>
Update:
- expectations.txt
- ts_sources.txt
- resource_files.txt
- webtest .html files
8cfc317e23..a41bc407a8
- a41bc4 Implement val:render_pass_descriptor:timestampWrite,same_query_index (#1656)
- 167076 Implement val:render_pass_descriptor:timestamp_writes_query_set_type (#1653)
- 06954d Implement val:render_pass_descriptor:timestampWrite,query_index (#1654)
- deec4f Implement val:render_pass_descriptor:occlusion_query_set_type (#1652)
- 3bef26 Succinct the test names of render_pass_descriptor.spec.ts (3/3) (#1651)
- 425fc8 Convert `clamp` f32 tests to use interval framework (#1645)
- 46fce2 Add support for multiple intervals to FP testing framework (#1643)
- 09c7fb Address feedback from Kai
- f803ff Add context configuration tests
- d620a1 Address feedback from Kai
- 77633d Add tests for getCurrentTexture and getPreferredCanvasFormat
- 781ad8 Succinct the test names of render_pass_descriptor.spec.ts (2/n) (#1639)
- d7ca02 Implement val:render_pass_descriptor:timestamp_writes_location (#1630)
- 09793f Test zero levels or layers is invalid in render_pass,resolve:resolve_attachment (#1600)
- daf0da Split shader_stages_and_visibility and add control cases
- 496182 Rewrite usage validation scope tests
- f4e9a3 refactor: split out makeConflictingBindGroups from testValidationScope
- bc278d nits: simplify a few things in this file
- a65914 Implement val:render_pass_descriptor:depth_stencil_attachment_depth_clear_value (#1640)
- a6bab7 Implement api,validation,capability_checks,features,texture_formats:canvas_configuration_view_formats (#1593)
- e7f8fe Succinct the test names of render_pass_descriptor.spec.ts (1/n) (#1619)
- 7f3683 Convert `fract` tests to use interval framework (#1612)
- d8009f Correct logInterval & log2Interval handling of out of bounds inputs (#1629)
Created with './tools/run cts roll'
Change-Id: I10d895c4a11252317619f7ea480c97d821cbf81c
Cq-Include-Trybots: luci.chromium.try:dawn-try-win10-x86-rel,linux-dawn-rel,mac-dawn-rel,win-dawn-rel
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/96200
Commit-Queue: Austin Eng <enga@chromium.org>
Kokoro: Kokoro <noreply+kokoro@google.com>
Reviewed-by: Austin Eng <enga@chromium.org>
Auto-Submit: Ben Clayton <bclayton@google.com>
• Add `intel-hd-630-family` to the list of GPU tags (crbug.com/dawn/1444).
• `[ Skip ]` all the `inputSource="const"` expression tests for now (crbug.com/tint/1613).
• Reorder / normalize the rest of the expectations with `./tools/run cts update`.
Bug: dawn:1444
Bug: tint:1613
Change-Id: I39efc454ecff6e804417bcade744a4251acbda07
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/95842
Reviewed-by: Austin Eng <enga@chromium.org>
Auto-Submit: Ben Clayton <bclayton@google.com>
Kokoro: Kokoro <noreply+kokoro@google.com>
Commit-Queue: Ben Clayton <bclayton@google.com>
Update:
- expectations.txt
- ts_sources.txt
- resource_files.txt
- webtest .html files
7334f06d2b..6c0f3bab40
- 6c0f3b Update the descriptions of the tests of in_pass_encoder.spec.ts (#1598)
- 7c96bd Fix an arithmitic error in memcpy
- 6121d9 Address feedback from Austin
- 145914 Optimized several expensive methods texture tests
- dd6ecd Adjust skip criteria based on suggestion from Austin
- a5c733 Guard against writeTimestamp() calls without the proper feature
- 85f975 Describe each test of the validation tests in render|compute pass encoder (#1573)
- 0bf125 Convert `min` tests to use interval framework (#1596)
- 88a46e Convert multiplication tests to use interval framework (#1591)
- 2379b9 Convert division tests to use interval framework (#1590)
- 7cdef8 Convert `max` tests to use interval framework (#1595)
Created with './tools/run cts roll'
Change-Id: Ife3d6b89275ad66887d037aa4c66b385b2e1acbc
Cq-Include-Trybots: luci.chromium.try:dawn-try-win10-x86-rel,linux-dawn-rel,mac-dawn-rel,win-dawn-rel
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/95480
Auto-Submit: Dan Sinclair <dsinclair@chromium.org>
Commit-Queue: Dan Sinclair <dsinclair@chromium.org>
Commit-Queue: Ryan Harrison <rharrison@chromium.org>
Reviewed-by: Ryan Harrison <rharrison@chromium.org>
Creates worker_test_globs.txt, which is a newline-delimited list
of globs specifying which tests should be run in workers in
addition to the usual test run. By moving the list here instead of
having it in the Chromium-side test harness, Dawn contributors can
make changes without needing a full Chromium checkout.
Chromium-side change is crrev.com/c/3739461.
Change-Id: I59e305ef24d27da7702aeed723e12b3d08847d72
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/95301
Auto-Submit: Brian Sheedy <bsheedy@google.com>
Kokoro: Kokoro <noreply+kokoro@google.com>
Commit-Queue: Austin Eng <enga@chromium.org>
Commit-Queue: Brian Sheedy <bsheedy@google.com>
Reviewed-by: Austin Eng <enga@chromium.org>
Update:
- expectations.txt
- ts_sources.txt
- resource_files.txt
- webtest .html files
https: //chromium.googlesource.com/external/github.com/gpuweb/cts/+log/cef4c7678130..7334f06d2b28
- 7334f0 Convert `atan2` tests to use interval framework (#1586)
- 31b648 Convert addition tests to use interval framework (#1582)
- 4be8db Implement the writeTimestamp test to expect an exception (#1584)
- 8276ee Convert `log2` tests to using new interval framework (#1579)
- a1cde6 Convert `log` tests to using new interval framework (#1578)
- 3d4386 Remove storage write tests (#1585)
- 0d908a Update the createQuerySet test of query_types.spec.ts to expect an exception (#1571)
- 426583 Convert `sin` tests to use interval framework (#1581)
- 33df4b Convert negation tests to new interval framework (#1580)
- 9c96bd Update 'zero_size' test to check 'usage' field (#1575)
- e058d2 Convert `floor` tests to use new interval framework (#1535)
- c9e0c0 Convert `exp2` tests to use new interval framework (#1534)
- a7989f Convert `exp` tests to using new interval framework
- bb12dc Add escape hatch for precisely expressing expectations
- 610b24 Replace `;` with `,` in WGSL structs. (#1577)
- 21e01f Use paramsSubcasesOnly()
- 7ff215 Add tests for container type reflection attributes
- 614d1a Move buffer_texture_copies.spec.ts from encoding/cmds to image_copy path (#1572)
Change-Id: I7ec19f87f049a06f0d24d2981ea941fa717dddf7
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/95281
Reviewed-by: Shrek Shao <shrekshao@google.com>
Commit-Queue: Shrek Shao <shrekshao@google.com>
Auto-Submit: Austin Eng <enga@chromium.org>
Kokoro: Kokoro <noreply+kokoro@google.com>
The issue causing these tests to fail was resolved in
https://chromium-review.googlesource.com/c/chromium/src/+/3716961
Bug: 1069302
Change-Id: Iacf06539a0415431b3355bc4b2345c2eb7cab61a
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/94761
Reviewed-by: Kai Ninomiya <kainino@chromium.org>
Commit-Queue: Brandon Jones <bajones@chromium.org>
Commit-Queue: Austin Eng <enga@chromium.org>
Auto-Submit: Brandon Jones <bajones@chromium.org>
Reviewed-by: Austin Eng <enga@chromium.org>
Commit-Queue: Kai Ninomiya <kainino@chromium.org>
Now that the test harness serves resources from the new path at
BUILD_DIR/gen/third_party/dawn, remove the other import of the
framework/resources.js script from the old path.
Bug: chromium:1338672
Change-Id: I854e8276f30924a50cc1631f1b28520f16bb5558
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/94700
Commit-Queue: Brandon Jones <bajones@chromium.org>
Auto-Submit: Austin Eng <enga@chromium.org>
Kokoro: Kokoro <noreply+kokoro@google.com>
Reviewed-by: Brandon Jones <bajones@chromium.org>
Changes the test page to expect files to be served from BUILD_DIR
to BUILD_DIR/gen/third_party/dawn. Serving only the subdirectory
shaves multiple seconds off of harness startup in local builds.
Bug: chromium:1338672
Change-Id: I29927e8d0928874fe780f9b15910b0d2eed97833
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/94580
Kokoro: Kokoro <noreply+kokoro@google.com>
Reviewed-by: Kai Ninomiya <kainino@chromium.org>
Commit-Queue: Austin Eng <enga@chromium.org>
Reviewed-by: Brian Sheedy <bsheedy@google.com>
Adds the duration of WebGPU CTS tests to the payload sent
to the test harness so that it can be reported to ResultDB.
Bug: chromium:1336333
Change-Id: I06e16be2c51807c8fbe37730008ed2bd68f82f6c
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/94520
Auto-Submit: Brian Sheedy <bsheedy@google.com>
Commit-Queue: Austin Eng <enga@chromium.org>
Commit-Queue: Brian Sheedy <bsheedy@google.com>
Reviewed-by: Austin Eng <enga@chromium.org>
Suppresses failures found when switching from 11.5.2 to 12.4
on the Intel Mac Minis.
Bug: dawn:1461, dawn:1462, dawn:1463, chromium:1334335
Change-Id: Ie0d42a1b4aa81f457145a53eebb1501a5eb77fbe
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/93308
Reviewed-by: Austin Eng <enga@chromium.org>
Auto-Submit: Brian Sheedy <bsheedy@google.com>
Commit-Queue: Brian Sheedy <bsheedy@google.com>
Kokoro: Kokoro <noreply+kokoro@google.com>
Austin Eng
Ben Clayton
Corentin Wallez
Loko Kung
Brian Sheedy
Alexis Hetu
Li Hao
Yuly Novikov
Kai Ninomiya
Dan Sinclair
Zhaoming Jiang
Brandon Jones