Commit Graph

100 Commits

Author SHA1 Message Date
Austin Eng caa9baed54 Send test heartbeats from the CTS runner
Heartbeats are rate-limited to 1 every 500ms.
They are sent at the following checkpoints:
 - Before a log is recorded in TestCaseRecorder
 - Just before an async WebGPU operation
 - Immediately following completion of a async WebGPU op
 - After a then/catch handler waiting on an async WebGPU op

Bug: chromium:1340602
Change-Id: I4d5c864dabd3f4215dac2e78d7658df0f6a7b0b7
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/99360
Commit-Queue: Austin Eng <enga@chromium.org>
Reviewed-by: Kai Ninomiya <kainino@chromium.org>
Kokoro: Kokoro <noreply+kokoro@google.com>
2022-08-18 22:49:10 +00:00
Brian Sheedy ced4c0d2cd Add test list to deps
Adds the generated CTS test list to the existing gn/webgpu-cts group
so that Chromium tests properly include the generated file.

Also updates some existing BUILD.gn file paths to be consistent with
Chromium styling: relative paths without the leading ./ for files
under the current directory and directories before and separate from
individual files.

Bug: dawn:1479
Change-Id: Icce70e7fcee874b6b33c21230c8a4429a1f7ab6c
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/98801
Commit-Queue: Austin Eng <enga@chromium.org>
Auto-Submit: Brian Sheedy <bsheedy@google.com>
Reviewed-by: Austin Eng <enga@chromium.org>
2022-08-11 15:16:38 +00:00
Brian Sheedy 0653501212 Switch to message protocol
Switches the WebGPU CTS test runner JavaScript code to use the defined
message protocol instead of the ad-hoc solution we were using before.

Bug: chromium:1340602
Change-Id: Ieaf26b5b2409f69d7859d3db4ce7757780de6712
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/98684
Kokoro: Kokoro <noreply+kokoro@google.com>
Reviewed-by: Austin Eng <enga@chromium.org>
Commit-Queue: Austin Eng <enga@chromium.org>
Auto-Submit: Brian Sheedy <bsheedy@google.com>
2022-08-11 14:39:51 +00:00
Loko Kung 8812809ea7 Roll third_party/webgpu-cts/ 94fd83896..ed11c6ba3 (3 commits)
Update:
 - expectations.txt
 - ts_sources.txt
 - resource_files.txt
 - webtest .html files

94fd83896c..ed11c6ba35
 - ed11c6 Implement `cosh` f32 tests (#1735)
 - 3fac1b Implement `sinh` f32 tests (#1734)
 - d36896 Implement `sqrt` f32 tests (#1732)

Created with './tools/run cts roll'

Change-Id: I6604dc66ea7d7d43fb441f3f0092e7afd746266f
Cq-Include-Trybots: luci.chromium.try:dawn-try-win10-x86-rel,linux-dawn-rel,mac-dawn-rel,win-dawn-rel
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/98360
Reviewed-by: Austin Eng <enga@chromium.org>
Commit-Queue: Loko Kung <lokokung@google.com>
2022-08-09 18:29:22 +00:00
Loko Kung eaca2ebd4c Update cts expectations to be sorted by bug first.
- Run format on the current expectations file to make it up to date.
- It's a lot easier to read the failures when they are grouped by the bug.

Change-Id: I333a0b237ccd405d204e47809eb7ab723824fddd
No-Try: True
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/98241
Auto-Submit: Loko Kung <lokokung@google.com>
Reviewed-by: Corentin Wallez <cwallez@chromium.org>
Commit-Queue: Loko Kung <lokokung@google.com>
2022-08-09 16:40:32 +00:00
Alexis Hetu c8f03f9f99 Remove unused "swiftshader-gl" tag
This is a follow-up of the chromium side cleanup here:
https://chromium-review.googlesource.com/c/chromium/src/+/3799192

Bug: chromium:1099959
Change-Id: I6cd442d8512afe6b845c1f1e6d06406ed27d61db
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/98261
Commit-Queue: Corentin Wallez <cwallez@chromium.org>
Kokoro: Kokoro <noreply+kokoro@google.com>
Reviewed-by: Corentin Wallez <cwallez@chromium.org>
2022-08-07 11:21:00 +00:00
Austin Eng c20fa4eae5 Triage some entries in expectations.txt
Change-Id: I51db1f499db3037a0ff572434efd141610dd0542
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/98066
Commit-Queue: Austin Eng <enga@chromium.org>
Bot-Commit: rubber-stamper@appspot.gserviceaccount.com <rubber-stamper@appspot.gserviceaccount.com>
2022-08-04 03:39:07 +00:00
Loko Kung e40bd8e964 Suppresses failing CTS tests for tint:1632
Bug: tint:1632
Change-Id: Ic21ce0e401a4af2f7b3aebc6d1823fad7e3b9643
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/98067
Kokoro: Kokoro <noreply+kokoro@google.com>
Commit-Queue: Loko Kung <lokokung@google.com>
Reviewed-by: Austin Eng <enga@chromium.org>
2022-08-03 22:06:36 +00:00
Li Hao e37f0a1943 cts: Use intel-gen-9 instead of intel-hd-630-family tag
There are many devices in Intel HD630 family, we cannot enumerate all
their device ids in the tag. We want cts to run as expected on other
Intel devices of the same architecture, add generation-based tag
intel-gen-9 to include a broad range of devices in the expectations.

Bug: dawn:1444
Change-Id: I80b6ae64ea2efc41bcc68e1c917919a86ec87f44
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/97760
Kokoro: Kokoro <noreply+kokoro@google.com>
Commit-Queue: Austin Eng <enga@chromium.org>
Reviewed-by: Brian Sheedy <bsheedy@google.com>
Reviewed-by: Austin Eng <enga@chromium.org>
2022-08-02 17:32:44 +00:00
Loko Kung cbadf96e79 Roll third_party/webgpu-cts/ 65130c197..94fd83896 (9 commits)
Update:
 - expectations.txt
 - ts_sources.txt
 - resource_files.txt
 - webtest .html files


65130c1970..94fd83896c
 - 94fd83 Expand readbackFromWebGPUCanvas test with alphaMode (#1673)
 - 7af1f6 Implement `mix` f32 tests (#1719)
 - 3fefce Validate a shader without an entry point is valid. (#1729)
 - 3dc2fe Add non-entrypoint tests to the builtin validation. (#1728)
 - 573361 Add test to validate parsing of `@builtin` (#1726)
 - c660f5 Trailing comma in `@align` should be valid. (#1727)
 - d1c579 Add test to allow builtin values as identifiers (#1725)
 - bab564 Implement `trunc` f32 tests (#1724)
 - 8fd9d5 Add `frag_depth` builtin validation. (#1723)

Created with './tools/run cts roll'

Change-Id: I55c38e9b2b32f6fdebd3d7d9fc5d29ef8f8054ee
Cq-Include-Trybots: luci.chromium.try:dawn-try-win10-x86-rel,linux-dawn-rel,mac-dawn-rel,win-dawn-rel
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/97862
Commit-Queue: Loko Kung <lokokung@google.com>
Reviewed-by: Austin Eng <enga@chromium.org>
Kokoro: Kokoro <noreply+kokoro@google.com>
2022-08-02 00:49:14 +00:00
Ben Clayton 271ba0edb3 Roll third_party/webgpu-cts/ e88fcf99d..65130c197 (8 commits)
Update:
 - expectations.txt
 - ts_sources.txt
 - resource_files.txt
 - webtest .html files


e88fcf99da..65130c1970
 - 65130c shader/execution: Optimize "const" shader exeuction
 - c8964b Implement `round` f32 tests (#1718)
 - 62ea12 Implement `step` f32 tests (#1717)
 - f2ab44 Implement `sign` f32 tests (#1701)
 - 8fed55 Implement `saturate` f32 tests (#1700)
 - 0eee5f Implement f32 `radians` tests (#1676)
 - a37fad Add WebCodec VideoFrame as input source for GPUExternalTexture cases (#1711)
 - 41f838 Add validation tests for @align. (#1664)

Created with './tools/run cts roll'

Change-Id: I3d16fefab8f70e858284792fb127a8e4ea673363
Cq-Include-Trybots: luci.chromium.try:dawn-try-win10-x86-rel,linux-dawn-rel,mac-dawn-rel,win-dawn-rel
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/97580
Reviewed-by: Austin Eng <enga@chromium.org>
Auto-Submit: Ben Clayton <bclayton@google.com>
Commit-Queue: Austin Eng <enga@chromium.org>
Kokoro: Kokoro <noreply+kokoro@google.com>
2022-07-28 19:43:01 +00:00
Brian Sheedy 2aea0e957f Add type to CTS runner message
Adds the "type" field to the websocket message sent
by the CTS JavaScript code with a value of
"TEST_FINISHED". This is in preparation for the
switch to using a heartbeat system for test timeouts
instead of a fixed timeout.

Bug: chromium:1340602
Change-Id: I886d89dbdfb1e3946dd8c59ecf23f9b18385b65e
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/97280
Reviewed-by: Austin Eng <enga@chromium.org>
Commit-Queue: Brian Sheedy <bsheedy@google.com>
Auto-Submit: Brian Sheedy <bsheedy@google.com>
Commit-Queue: Austin Eng <enga@chromium.org>
Kokoro: Kokoro <noreply+kokoro@google.com>
2022-07-27 01:04:35 +00:00
Yuly Novikov 7e33dcba5b Remove Linux Intel suppressions fixed in Mesa 20.0.8
Bug: dawn:1111, dawn:1050
Change-Id: If3036921655abca967ed2793b03982dfb1b815b0
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/97100
Auto-Submit: Yuly Novikov <ynovikov@chromium.org>
Kokoro: Kokoro <noreply+kokoro@google.com>
Reviewed-by: Austin Eng <enga@chromium.org>
Commit-Queue: Austin Eng <enga@chromium.org>
2022-07-25 17:04:28 +00:00
Ben Clayton f122fd52a8 Roll third_party/webgpu-cts/ 72e3a2249..e88fcf99d (3 commits)
Update:
 - expectations.txt
 - ts_sources.txt
 - resource_files.txt
 - webtest .html files


72e3a22491..e88fcf99da
 - e88fcf Implement val:queue,writeTexture:sample_count (#1703)
 - 75268b Implement val:queue,writeTexture:texture_state (#1702)
 - c4eb1d Fix testing of the offset in image_copy,layout_related:required_bytes_in_copy (#1704)

Created with './tools/run cts roll'

Change-Id: Ic1986bfac317aabfb623213bbc84dc3c38cd9a2a
Cq-Include-Trybots: luci.chromium.try:dawn-try-win10-x86-rel,linux-dawn-rel,mac-dawn-rel,win-dawn-rel
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/97001
Commit-Queue: Ben Clayton <bclayton@google.com>
Reviewed-by: Austin Eng <enga@chromium.org>
Kokoro: Kokoro <noreply+kokoro@google.com>
2022-07-23 00:21:26 +00:00
Yuly Novikov 9ec7893ad4 Follow up on Roll third_party/webgpu-cts/ a41bc407a..72e3a2249
1. Restore Optiplex 7080 Linux in the suppressions removed in
   https://dawn-review.googlesource.com/c/dawn/+/96880
2. Generalize depth_clip_clamp suppressions, since other combinations
   fail on Intel UHD 630 bot, see:
https://luci-milo.appspot.com/ui/p/chromium/builders/ci/Dawn%20Linux%20x64%20Release%20(Intel%20UHD%20630)/764/overview

Change-Id: Ia88d2c9903180db7c5ce7d6b366cfc6e6b2135d0
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/97000
Auto-Submit: Yuly Novikov <ynovikov@chromium.org>
Kokoro: Kokoro <noreply+kokoro@google.com>
Reviewed-by: Austin Eng <enga@chromium.org>
Commit-Queue: Austin Eng <enga@chromium.org>
2022-07-22 15:55:56 +00:00
Kai Ninomiya 5f5bd214f7 Roll third_party/webgpu-cts/ a41bc407a..72e3a2249 (15 commits)
Update:
 - expectations.txt
 - ts_sources.txt
 - resource_files.txt
 - webtest .html files


a41bc407a8..72e3a22491
 - 72e3a2 Expand map_detach test for buffer should detach on device.destroy (#1699)
 - d5e662 Enhance val:render_pass_descriptor:depth_stencil_attachment_depth_clear_value (#1674)
 - 12b775 Implement val:CopyExternalImageToTexture,destination_texture,dimension (#1695)
 - 2834ce Add an out-of-range check to the ranges test in writeBuffer.spec.ts (#1663)
 - bee493 Implement val:queue:writeTexture:usage (#1675)
 - ea0057 Add GPURenderPassDescriptor.maxDrawCount test plan (#1614)
 - d30940 Generate full range of `atan2` cases (#1679)
 - 5b9641 Correct the order of params in atan2 message (#1677)
 - 228c28 Implement f32 `degrees` tests (#1668)
 - 4786c2 Remove obsolete f32 testing infrastructure (#1665)
 - 8e1167 Add f32 tests for `pow` (#1658)
 - aa0719 Make `render_pass_descriptor:resolveTarget,usage` test a valid case together (#1660)
 - 6dfee4 Submit all shader batches before checking for results
 - bbd744 Convert `ldexp` tests to use interval framework (#1659)
 - 9d3043 Update f32 tests to handle returning undefined for infinity (#1655)

Created with './tools/run cts roll'

Change-Id: Ibdf6a28ea84e2115103c9c9637b3e648a62b8364
Cq-Include-Trybots: luci.chromium.try:dawn-try-win10-x86-rel,linux-dawn-rel,mac-dawn-rel,win-dawn-rel
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/96880
Commit-Queue: Kai Ninomiya <kainino@chromium.org>
Reviewed-by: Austin Eng <enga@chromium.org>
Kokoro: Kokoro <noreply+kokoro@google.com>
2022-07-22 01:13:15 +00:00
Austin Eng 8d73198aca Remove depth-clamping and add depth-clip-control feature
Fixed: dawn:1178
Change-Id: I251a7e05fec9ecef44300d4f948b2d0611888109
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/96320
Commit-Queue: Austin Eng <enga@chromium.org>
Reviewed-by: Corentin Wallez <cwallez@chromium.org>
Kokoro: Kokoro <noreply+kokoro@google.com>
2022-07-18 20:38:05 +00:00
Yuly Novikov cd74244614 Follow up on Roll third_party/webgpu-cts/ 8cfc317e2..a41bc407a
Include Optiplex 7080 Linux in the suppressions added in
https://dawn-review.googlesource.com/c/dawn/+/96200

Change-Id: I8f99da7e6e42b675b40e200f0c668e638e2238f2
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/96402
Auto-Submit: Yuly Novikov <ynovikov@chromium.org>
Commit-Queue: Ben Clayton <bclayton@google.com>
Reviewed-by: Ben Clayton <bclayton@google.com>
Kokoro: Kokoro <noreply+kokoro@google.com>
2022-07-18 14:06:42 +00:00
Austin Eng 30d672963c Skip CTS tests crashing with SwiftShader
Some web_platform:* tests are crashing due to issues with SharedImage
and canvas formats.

Bug: chromium:1344876
Change-Id: I0a708bad15b3d19299ce614ad43ab58c888e5291
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/96300
Commit-Queue: Austin Eng <enga@chromium.org>
Kokoro: Kokoro <noreply+kokoro@google.com>
Bot-Commit: rubber-stamper@appspot.gserviceaccount.com <rubber-stamper@appspot.gserviceaccount.com>
2022-07-15 19:12:29 +00:00
Ben Clayton e21267fe94 Roll third_party/webgpu-cts/ 8cfc317e2..a41bc407a (23 commits)
Update:
 - expectations.txt
 - ts_sources.txt
 - resource_files.txt
 - webtest .html files


8cfc317e23..a41bc407a8
 - a41bc4 Implement val:render_pass_descriptor:timestampWrite,same_query_index (#1656)
 - 167076 Implement val:render_pass_descriptor:timestamp_writes_query_set_type (#1653)
 - 06954d Implement val:render_pass_descriptor:timestampWrite,query_index (#1654)
 - deec4f Implement val:render_pass_descriptor:occlusion_query_set_type (#1652)
 - 3bef26 Succinct the test names of render_pass_descriptor.spec.ts (3/3) (#1651)
 - 425fc8 Convert `clamp` f32 tests to use interval framework (#1645)
 - 46fce2 Add support for multiple intervals to FP testing framework (#1643)
 - 09c7fb Address feedback from Kai
 - f803ff Add context configuration tests
 - d620a1 Address feedback from Kai
 - 77633d Add tests for getCurrentTexture and getPreferredCanvasFormat
 - 781ad8 Succinct the test names of render_pass_descriptor.spec.ts (2/n) (#1639)
 - d7ca02 Implement val:render_pass_descriptor:timestamp_writes_location (#1630)
 - 09793f Test zero levels or layers is invalid in render_pass,resolve:resolve_attachment (#1600)
 - daf0da Split shader_stages_and_visibility and add control cases
 - 496182 Rewrite usage validation scope tests
 - f4e9a3 refactor: split out makeConflictingBindGroups from testValidationScope
 - bc278d nits: simplify a few things in this file
 - a65914 Implement val:render_pass_descriptor:depth_stencil_attachment_depth_clear_value (#1640)
 - a6bab7 Implement api,validation,capability_checks,features,texture_formats:canvas_configuration_view_formats (#1593)
 - e7f8fe Succinct the test names of render_pass_descriptor.spec.ts (1/n) (#1619)
 - 7f3683 Convert `fract` tests to use interval framework (#1612)
 - d8009f Correct logInterval & log2Interval handling of out of bounds inputs (#1629)

Created with './tools/run cts roll'

Change-Id: I10d895c4a11252317619f7ea480c97d821cbf81c
Cq-Include-Trybots: luci.chromium.try:dawn-try-win10-x86-rel,linux-dawn-rel,mac-dawn-rel,win-dawn-rel
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/96200
Commit-Queue: Austin Eng <enga@chromium.org>
Kokoro: Kokoro <noreply+kokoro@google.com>
Reviewed-by: Austin Eng <enga@chromium.org>
Auto-Submit: Ben Clayton <bclayton@google.com>
2022-07-15 16:25:39 +00:00
Ben Clayton e1bcb0b416 cts: Clean up expectations.txt
• Add `intel-hd-630-family` to the list of GPU tags (crbug.com/dawn/1444).
• `[ Skip ]` all the `inputSource="const"` expression tests for now (crbug.com/tint/1613).
• Reorder / normalize the rest of the expectations with `./tools/run cts update`.

Bug: dawn:1444
Bug: tint:1613
Change-Id: I39efc454ecff6e804417bcade744a4251acbda07
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/95842
Reviewed-by: Austin Eng <enga@chromium.org>
Auto-Submit: Ben Clayton <bclayton@google.com>
Kokoro: Kokoro <noreply+kokoro@google.com>
Commit-Queue: Ben Clayton <bclayton@google.com>
2022-07-14 09:54:11 +00:00
Yuly Novikov 9fecd7ef8a Suppress WebGPU CTS failures on Linux UHD630
webgpu:shader,execution,expression,call,builtin,abs:f32:inputSource="const";*
webgpu:shader,execution,expression,call,builtin,atan:f32:inputSource="const";*
webgpu:shader,execution,expression,call,builtin,clamp:f32:inputSource="const";*

Bug: tint:1612
Change-Id: I3151cb02142f4a7b38d1f419bd5c49e981dce3a3
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/96103
Auto-Submit: Yuly Novikov <ynovikov@chromium.org>
Kokoro: Kokoro <noreply+kokoro@google.com>
Reviewed-by: Austin Eng <enga@chromium.org>
Commit-Queue: Yuly Novikov <ynovikov@chromium.org>
Commit-Queue: Austin Eng <enga@chromium.org>
2022-07-13 18:49:10 +00:00
Dan Sinclair caead5d3a5 Roll third_party/webgpu-cts/ 5de908c54..8cfc317e2 (1 commit)
Update:
 - expectations.txt
 - ts_sources.txt
 - resource_files.txt
 - webtest .html files


5de908c54a..8cfc317e23
 - 8cfc31 Seperate out interval operation definitions from builder functions (#1628)

Created with './tools/run cts roll'

Change-Id: Iddda2eebb44375a83f697b22f4969911f0944fcc
Cq-Include-Trybots: luci.chromium.try:dawn-try-win10-x86-rel,linux-dawn-rel,mac-dawn-rel,win-dawn-rel
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/95661
Auto-Submit: Dan Sinclair <dsinclair@chromium.org>
Commit-Queue: Ryan Harrison <rharrison@chromium.org>
Commit-Queue: Dan Sinclair <dsinclair@chromium.org>
Kokoro: Kokoro <noreply+kokoro@google.com>
Reviewed-by: Ryan Harrison <rharrison@chromium.org>
2022-07-06 18:01:40 +00:00
Dan Sinclair c1f9e47a9b Roll third_party/webgpu-cts/ 7334f06d2..6c0f3bab4 (11 commits)
Update:
 - expectations.txt
 - ts_sources.txt
 - resource_files.txt
 - webtest .html files


7334f06d2b..6c0f3bab40
 - 6c0f3b Update the descriptions of the tests of in_pass_encoder.spec.ts (#1598)
 - 7c96bd Fix an arithmitic error in memcpy
 - 6121d9 Address feedback from Austin
 - 145914 Optimized several expensive methods texture tests
 - dd6ecd Adjust skip criteria based on suggestion from Austin
 - a5c733 Guard against writeTimestamp() calls without the proper feature
 - 85f975 Describe each test of the validation tests in render|compute pass encoder (#1573)
 - 0bf125 Convert `min` tests to use interval framework (#1596)
 - 88a46e Convert multiplication tests to use interval framework (#1591)
 - 2379b9 Convert division tests to use interval framework (#1590)
 - 7cdef8 Convert `max` tests to use interval framework (#1595)

Created with './tools/run cts roll'

Change-Id: Ife3d6b89275ad66887d037aa4c66b385b2e1acbc
Cq-Include-Trybots: luci.chromium.try:dawn-try-win10-x86-rel,linux-dawn-rel,mac-dawn-rel,win-dawn-rel
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/95480
Auto-Submit: Dan Sinclair <dsinclair@chromium.org>
Commit-Queue: Dan Sinclair <dsinclair@chromium.org>
Commit-Queue: Ryan Harrison <rharrison@chromium.org>
Reviewed-by: Ryan Harrison <rharrison@chromium.org>
2022-07-05 21:20:42 +00:00
Zhaoming Jiang 531ce3fe53 CTS: Update expectation for non-ASCII entry point name
Remove failure expectation of entry_point_name_must_match CTS tests that
test non-ASCII entry point name. The fix CL is landed at
https://chromium-review.googlesource.com/c/chromium/src/+/3732308.

Bug: dawn:1474
Change-Id: Ib3379083696040aa3e6e8eb11fd12b9e0b26cc93
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/95321
Reviewed-by: Austin Eng <enga@chromium.org>
Commit-Queue: Zhaoming Jiang <zhaoming.jiang@intel.com>
2022-07-01 15:58:40 +00:00
Brian Sheedy cea7ce35be Move WebGPU worker globs
Creates worker_test_globs.txt, which is a newline-delimited list
of globs specifying which tests should be run in workers in
addition to the usual test run. By moving the list here instead of
having it in the Chromium-side test harness, Dawn contributors can
make changes without needing a full Chromium checkout.

Chromium-side change is crrev.com/c/3739461.

Change-Id: I59e305ef24d27da7702aeed723e12b3d08847d72
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/95301
Auto-Submit: Brian Sheedy <bsheedy@google.com>
Kokoro: Kokoro <noreply+kokoro@google.com>
Commit-Queue: Austin Eng <enga@chromium.org>
Commit-Queue: Brian Sheedy <bsheedy@google.com>
Reviewed-by: Austin Eng <enga@chromium.org>
2022-07-01 01:20:14 +00:00
Austin Eng 959a7696d9 Roll third_party/webgpu-cts/ cef4c7678..7334f06d2 (18 commits)
Update:
 - expectations.txt
 - ts_sources.txt
 - resource_files.txt
 - webtest .html files

https: //chromium.googlesource.com/external/github.com/gpuweb/cts/+log/cef4c7678130..7334f06d2b28
 - 7334f0 Convert `atan2` tests to use interval framework (#1586)
 - 31b648 Convert addition tests to use interval framework (#1582)
 - 4be8db Implement the writeTimestamp test to expect an exception (#1584)
 - 8276ee Convert `log2` tests to using new interval framework (#1579)
 - a1cde6 Convert `log` tests to using new interval framework (#1578)
 - 3d4386 Remove storage write tests (#1585)
 - 0d908a Update the createQuerySet test of query_types.spec.ts to expect an exception (#1571)
 - 426583 Convert `sin` tests to use interval framework (#1581)
 - 33df4b Convert negation tests to new interval framework (#1580)
 - 9c96bd Update 'zero_size' test to check 'usage' field (#1575)
 - e058d2 Convert `floor` tests to use new interval framework (#1535)
 - c9e0c0 Convert `exp2` tests to use new interval framework (#1534)
 - a7989f Convert `exp` tests to using new interval framework
 - bb12dc Add escape hatch for precisely expressing expectations
 - 610b24 Replace `;` with `,` in WGSL structs. (#1577)
 - 21e01f Use paramsSubcasesOnly()
 - 7ff215 Add tests for container type reflection attributes
 - 614d1a Move buffer_texture_copies.spec.ts from encoding/cmds to image_copy path (#1572)
Change-Id: I7ec19f87f049a06f0d24d2981ea941fa717dddf7
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/95281
Reviewed-by: Shrek Shao <shrekshao@google.com>
Commit-Queue: Shrek Shao <shrekshao@google.com>
Auto-Submit: Austin Eng <enga@chromium.org>
Kokoro: Kokoro <noreply+kokoro@google.com>
2022-06-30 19:42:54 +00:00
Austin Eng e093819064 Mark another flaky f32_logical inputSource="const" as Failure on Linux
This was missed in a previous roll.

Bug: none
Change-Id: If1be03751b99152d4f63324a298dc13ebb3067be
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/94920
Bot-Commit: rubber-stamper@appspot.gserviceaccount.com <rubber-stamper@appspot.gserviceaccount.com>
Kokoro: Kokoro <noreply+kokoro@google.com>
Reviewed-by: Corentin Wallez <cwallez@chromium.org>
Commit-Queue: Austin Eng <enga@chromium.org>
2022-06-28 06:43:56 +00:00
Brandon Jones 14e6dfbd95 Remove failing depth32float-stencil8 expectations
The issue causing these tests to fail was resolved in
https://chromium-review.googlesource.com/c/chromium/src/+/3716961

Bug: 1069302
Change-Id: Iacf06539a0415431b3355bc4b2345c2eb7cab61a
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/94761
Reviewed-by: Kai Ninomiya <kainino@chromium.org>
Commit-Queue: Brandon Jones <bajones@chromium.org>
Commit-Queue: Austin Eng <enga@chromium.org>
Auto-Submit: Brandon Jones <bajones@chromium.org>
Reviewed-by: Austin Eng <enga@chromium.org>
Commit-Queue: Kai Ninomiya <kainino@chromium.org>
2022-06-28 00:11:10 +00:00
Austin Eng 90ec3d1368 Change base directory for CTS runner, part 2
Now that the test harness serves resources from the new path at
BUILD_DIR/gen/third_party/dawn, remove the other import of the
framework/resources.js script from the old path.

Bug: chromium:1338672
Change-Id: I854e8276f30924a50cc1631f1b28520f16bb5558
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/94700
Commit-Queue: Brandon Jones <bajones@chromium.org>
Auto-Submit: Austin Eng <enga@chromium.org>
Kokoro: Kokoro <noreply+kokoro@google.com>
Reviewed-by: Brandon Jones <bajones@chromium.org>
2022-06-24 18:50:19 +00:00
Austin Eng c8a276a28e Skip inputSource="const";* f32_logical on Win NVIDIA x86
Also timing out on this platform. For example see:
https://ci.chromium.org/ui/p/chromium/builders/ci/Dawn%20Win10%20x86%20Release%20(NVIDIA)/63134/test-results

Bug: none
Change-Id: I922763a22899b11a9b95fb18248757c5d1ca5e61
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/94643
Commit-Queue: Austin Eng <enga@chromium.org>
Reviewed-by: Brandon Jones <bajones@chromium.org>
Reviewed-by: Ben Clayton <bclayton@google.com>
Kokoro: Kokoro <noreply+kokoro@google.com>
2022-06-24 18:30:59 +00:00
Brandon Jones 01e4d44e1e Roll third_party/webgpu-cts/ 5a30cb44c..cef4c7678 (33 commits)
Change-Id: Ie4943f8dcda0cc9d485c6c0b586ccb132a05389b
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/94500
Commit-Queue: Austin Eng <enga@chromium.org>
Kokoro: Kokoro <noreply+kokoro@google.com>
Reviewed-by: Austin Eng <enga@chromium.org>
2022-06-24 08:10:29 +00:00
Austin Eng 6241cf9632 Change base directory for CTS runner, part 1
Changes the test page to expect files to be served from BUILD_DIR
to BUILD_DIR/gen/third_party/dawn. Serving only the subdirectory
shaves multiple seconds off of harness startup in local builds.

Bug: chromium:1338672
Change-Id: I29927e8d0928874fe780f9b15910b0d2eed97833
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/94580
Kokoro: Kokoro <noreply+kokoro@google.com>
Reviewed-by: Kai Ninomiya <kainino@chromium.org>
Commit-Queue: Austin Eng <enga@chromium.org>
Reviewed-by: Brian Sheedy <bsheedy@google.com>
2022-06-23 21:45:18 +00:00
Brian Sheedy b6c150d6e0 Report WebGPU CTS JS time
Adds the duration of WebGPU CTS tests to the payload sent
to the test harness so that it can be reported to ResultDB.

Bug: chromium:1336333
Change-Id: I06e16be2c51807c8fbe37730008ed2bd68f82f6c
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/94520
Auto-Submit: Brian Sheedy <bsheedy@google.com>
Commit-Queue: Austin Eng <enga@chromium.org>
Commit-Queue: Brian Sheedy <bsheedy@google.com>
Reviewed-by: Austin Eng <enga@chromium.org>
2022-06-21 20:39:14 +00:00
Brian Sheedy 67973e6706 Suppress Mac Intel 12.4 failures
Suppresses failures found when switching from 11.5.2 to 12.4
on the Intel Mac Minis.

Bug: dawn:1461, dawn:1462, dawn:1463, chromium:1334335

Change-Id: Ie0d42a1b4aa81f457145a53eebb1501a5eb77fbe
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/93308
Reviewed-by: Austin Eng <enga@chromium.org>
Auto-Submit: Brian Sheedy <bsheedy@google.com>
Commit-Queue: Brian Sheedy <bsheedy@google.com>
Kokoro: Kokoro <noreply+kokoro@google.com>
2022-06-10 22:12:43 +00:00
Austin Eng 1ab815dcaa Add generated webtest .html files
Bug: chromium:1333969
Change-Id: I9b704eee654a96e96473a101157ce7fab4cc864e
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/93341
Reviewed-by: Kai Ninomiya <kainino@chromium.org>
Commit-Queue: Austin Eng <enga@chromium.org>
2022-06-10 22:00:33 +00:00
Ben Clayton bd67ffe0f0 Roll third_party/webgpu-cts/ fee6d96eb..5a30cb44c (7 commits)
Update expectations and ts_sources

fee6d96eb3..5a30cb44c5
 - 5a30cb [wgsl] use subcases in texture tests (#1514)
 - edd275 Add api,validation,resource_usages,buffer,in_pass_misc:* - Part II (#1511)
 - 484ae3 Update @stage attributes. (#1512)
 - 6ff559 Remove references to depth24unorm-stencil8 (#1513)
 - 9474c0 Implement new F32Interval class for floating point tests (#1500)
 - 3ebdea Add api,validation,resource_usages,buffer,in_pass_misc:* - Part I (#1509)
 - f19f0c Specify RENDER_ATTACHMENT usage when creating multisampled texture (#1507)

Created with './tools/run cts roll'

Change-Id: Icc2d66e8367ef58a35817afdce6ec87d6373c79c
Cq-Include-Trybots: luci.chromium.try:dawn-try-win10-x86-rel,linux-dawn-rel,mac-dawn-rel,win-dawn-rel
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/93143
Commit-Queue: Ben Clayton <bclayton@google.com>
Reviewed-by: Austin Eng <enga@chromium.org>
Kokoro: Kokoro <noreply+kokoro@google.com>
2022-06-09 14:07:34 +00:00
Austin Eng 225e39880d Remove comment that expectations.txt should not be manually edited
Bug: none
Change-Id: I6ff9dc090c7201bb5ed3fa7f6853d9f4177518fd
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/92909
Commit-Queue: Austin Eng <enga@chromium.org>
Bot-Commit: rubber-stamper@appspot.gserviceaccount.com <rubber-stamper@appspot.gserviceaccount.com>
2022-06-07 20:52:54 +00:00
Ben Clayton 2880e7062c Roll third_party/webgpu-cts/ d275c5e1e..fee6d96eb (5 commits)
Update expectations and ts_sources

d275c5e1e3..fee6d96eb3
 - fee6d9 Roll @webgpu/types to 0.1.18 (#1506)
 - 70df7a Add api,validation,resource_usages,buffer,in_pass_encoder:* - Part V (#1496) (#1502)
 - 6302a6 Change importExternalTexture,destroy to importExternalTexture,expired (#1474)
 - f188c0 Fix unnecessary imports
 - 8afdd9 Update texture format tests to expect exceptions

Created with './tools/run cts roll'

Change-Id: I8bcbca1747f0a2f1414b883860144817a1e16a8a
Cq-Include-Trybots: luci.chromium.try:dawn-try-win10-x86-rel,linux-dawn-rel,mac-dawn-rel,win-dawn-rel
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/92721
Auto-Submit: Ben Clayton <bclayton@google.com>
Commit-Queue: Austin Eng <enga@chromium.org>
Reviewed-by: Austin Eng <enga@chromium.org>
2022-06-07 20:26:04 +00:00
Ben Clayton a614993294 Roll third_party/webgpu-cts/ 70091fdb8..d275c5e1e (3 commits)
Update expectations and ts_sources

70091fdb8d..d275c5e1e3
 - d275c5 Factor copyToTexture:canvas tests common code. (#1497)
 - e4ee0a Add api,validation,resource_usages,buffer,in_pass_encoder:* - Part IV (#1496)
 - 24c2a7 Add api,validation,resource_usages,buffer,in_pass_encoder:* - Part III (#1480)

Created with './tools/run cts roll'

Change-Id: I95e875667222fcd3f262ed253ac9179f1cd941f2
Cq-Include-Trybots: luci.chromium.try:dawn-try-win10-x86-rel,linux-dawn-rel,mac-dawn-rel,win-dawn-rel
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/92260
Auto-Submit: Ben Clayton <bclayton@google.com>
Commit-Queue: Austin Eng <enga@chromium.org>
Reviewed-by: Austin Eng <enga@chromium.org>
2022-06-01 17:22:49 +00:00
Ben Clayton 8cbfad7e5d cts: Remove use of intel-0x5912 and intel-0x3e9b tags
The CTS runner can randomly pick between these two GPUs, leading to unstable expectations.

Just use 'intel' for now. We might get a more targetted tag in the future, but this will do for today.

Bug: dawn:1387
Bug: dawn:1444
Change-Id: I2c77ab0060976c40e34b1597b5594894867b7edd
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/92242
Commit-Queue: Corentin Wallez <cwallez@chromium.org>
Kokoro: Kokoro <noreply+kokoro@google.com>
Commit-Queue: Ben Clayton <bclayton@google.com>
Reviewed-by: Corentin Wallez <cwallez@chromium.org>
Auto-Submit: Ben Clayton <bclayton@google.com>
2022-06-01 12:15:49 +00:00
Ben Clayton 8b09bc97c0 tint: Lex abstract integers
Check that the parsed number fits in an abstract-integer.

Refactor the unit tests so that they're maintainable. Add missing tests.

Bug: tint:1504
Change-Id: I04b6604820d527da66e3f6fcb47391efc0c3330a
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/91701
Commit-Queue: Ben Clayton <bclayton@google.com>
Kokoro: Kokoro <noreply+kokoro@google.com>
Reviewed-by: David Neto <dneto@google.com>
2022-05-30 17:54:38 +00:00
Ben Clayton 1b69b8ad99 Roll third_party/webgpu-cts/ 5f05d6d5e..70091fdb8 (2 commits)
Update expectations and ts_sources

5f05d6d5e6..70091fdb8d
 - 70091f Draw buffer validation test for unused and overlapped cases (#1475)
 - cc8668 Revise ExternalTexture Video Test Expectations (#1471)

Created with './tools/run cts roll'

Change-Id: I9d46b7b6582301daaf1f74ddbc41f2ef3bb6b31f
Cq-Include-Trybots: luci.chromium.try:dawn-try-win10-x86-rel,linux-dawn-rel,mac-dawn-rel,win-dawn-rel
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/91848
Commit-Queue: Ben Clayton <bclayton@google.com>
Reviewed-by: Corentin Wallez <cwallez@chromium.org>
2022-05-30 16:33:38 +00:00
Ben Clayton cc32bccc77 Roll third_party/webgpu-cts/ 9618103c4..5f05d6d5e (1 commit)
Update expectations and ts_sources

9618103c4a..5f05d6d5e6
 - 5f05d6 Draw vertex buffer validation for instance step mode buffer (#1461)

Created with './tools/run cts roll'

Change-Id: Ib88732d694038b975581c389a84d6bc2a21f5583
Cq-Include-Trybots: luci.chromium.try:dawn-try-win10-x86-rel,linux-dawn-rel,mac-dawn-rel,win-dawn-rel
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/91364
Commit-Queue: Corentin Wallez <cwallez@chromium.org>
Reviewed-by: Austin Eng <enga@chromium.org>
Reviewed-by: Corentin Wallez <cwallez@chromium.org>
Auto-Submit: Ben Clayton <bclayton@google.com>
2022-05-25 22:42:19 +00:00
Corentin Wallez ce425feef5 Remove expectations for fixed createView default dimension.
Fixed: dawn:1380
Change-Id: I01c8de526208beea9733a4443e5fd6f50d7e0719
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/91620
Commit-Queue: Corentin Wallez <cwallez@chromium.org>
Auto-Submit: Corentin Wallez <cwallez@chromium.org>
Kokoro: Kokoro <noreply+kokoro@google.com>
Commit-Queue: Brandon Jones <bajones@chromium.org>
Reviewed-by: Brandon Jones <bajones@chromium.org>
2022-05-25 18:16:47 +00:00
Yunchao He 4e34192f9e Re-suppress WebGPU expectations
Bug: chromium:1328469, dawn:1319
Change-Id: Ic8a39707239fbe5b02a1be7a7a53be9d3afa3d46
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/91341
Commit-Queue: Yunchao He <yunchao.he@intel.com>
Reviewed-by: Corentin Wallez <cwallez@chromium.org>
2022-05-24 06:58:34 +00:00
Corentin Wallez cc2efbcdbf Roll third_party/webgpu-cts/ e48651de0..9618103c4 (3 commits)
Update expectations and ts_sources

e48651de01..9618103c4a
 - 961810 refresh origin trial tokens
 - 666c19 resource_init: Specify view dimension in checkContentsBySampling
 - b5cc68 Fix memory leak in vertex_buffer_OOB,vertex_step_mode (#1459)

Created with './tools/run cts roll'

Change-Id: If30569b2b6aaf98c30c363671793f990136021fc
Cq-Include-Trybots: luci.chromium.try:dawn-try-win10-x86-rel,linux-dawn-rel,mac-dawn-rel,win-dawn-rel
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/90644
Reviewed-by: Ben Clayton <bclayton@google.com>
Auto-Submit: Corentin Wallez <cwallez@chromium.org>
Commit-Queue: Ben Clayton <bclayton@google.com>
Kokoro: Kokoro <noreply+kokoro@google.com>
2022-05-23 13:44:10 +00:00
Corentin Wallez a4216e72d4 Remove passing WebGPU expectations
Bug: dawn:1319
Change-Id: Iae82a3ea568f1a178e4f516ee55f7028defd528a
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/90665
Reviewed-by: Austin Eng <enga@chromium.org>
Auto-Submit: Corentin Wallez <cwallez@chromium.org>
Kokoro: Kokoro <noreply+kokoro@google.com>
Commit-Queue: Austin Eng <enga@chromium.org>
2022-05-20 17:29:50 +00:00
Corentin Wallez afbc260f14 Roll third_party/webgpu-cts/ 8f2742e4a..e48651de0 (6 commits)
Update expectations and ts_sources

8f2742e4a4..e48651de01
 - e48651 Draw vertex buffer access test for vertex step mode buffer (#1450)
 - 0dd740 sort and comment
 - 36b070 part 4: no-floating-promises
 - bd4473 part 3: no-unnecessary-type-assertion
 - 31154b part 2: unbound-method
 - 05a264 Add "recommended" typescript-eslint lints (part 1)

Created with './tools/run cts roll'

Change-Id: If45ec0f188f2b875bd6a839a3385403ddc33dcf4
Cq-Include-Trybots: luci.chromium.try:dawn-try-win10-x86-rel,linux-dawn-rel,mac-dawn-rel,win-dawn-rel
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/90802
Auto-Submit: Corentin Wallez <cwallez@chromium.org>
Reviewed-by: Ben Clayton <bclayton@google.com>
Commit-Queue: Ben Clayton <bclayton@google.com>
2022-05-20 13:31:15 +00:00
Austin Eng 0c5aaf4833 Update expectations.txt for passing tests
Bug: chromium:1322180, dawn:1410
Change-Id: Iee9baa1a68961217664862c6e8bd31394ae6bf0b
Reviewed-on: https://dawn-review.googlesource.com/c/dawn/+/91061
Auto-Submit: Austin Eng <enga@chromium.org>
Reviewed-by: Corentin Wallez <cwallez@chromium.org>
Commit-Queue: Corentin Wallez <cwallez@chromium.org>
Kokoro: Kokoro <noreply+kokoro@google.com>
2022-05-20 08:19:40 +00:00