91 Commits

Author SHA1 Message Date
Jeremy Leconte
9795589f50 Add "iOS Debug (simulator)" CI bot.
Also set xcode back to xcode 13 for iOS 14.

Change-Id: Ic5475d274895b5f86e4fea36805dec4486adc79b
Bug: b/264630045
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/290894
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#39094}
2023-01-13 08:16:10 +00:00
Jeremy Leconte
83fd843535 Add a ios_x64_dbg_simulator try bot.
The goal of this bot is to replace ios_sim_x64_dbg_ios(12, 13 and 14).

Change-Id: I6d8f5004a9440f5fd8cb96730dc2dbb4abba2e61
Bug: b/264630045
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/290893
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#39086}
2023-01-12 14:07:37 +00:00
Jeremy Leconte
69ea6afa35 Refresh WebRTC mixins.pyl file.
The mixins 'win10' has been updated with https://crrev.com/c/4140185.
Windows 20H2 machines have been upgraded to 22h2 which causes WebRTC windows bots to fail with 'not enough capacity' errors.
https://ci.chromium.org/ui/p/webrtc/builders/try/win_x86_clang_rel/45466/overview

No-Try: True
Change-Id: If429275cc492df406b7a85fc697cd3ed775d9f24
Bug: chromium:1324840
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/290842
Reviewed-by: Christoffer Jansson <jansson@google.com>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Reviewed-by: Christoffer Jansson <jansson@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#39062}
2023-01-11 10:19:52 +00:00
Jeremy Leconte
91375aa8f3 Upgrade iOS perf tests xcode version from 12d4e to 13c100.
Also add "--xctest" cause I suspect this is what causes the current errors.

Change-Id: I541de48722bfea6dcf372e7155a9ea033e207c4f
Bug: b/262490083
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/290579
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#39020}
2023-01-06 09:09:13 +00:00
Björn Terelius
c044295ab4 Reland "Remove old Nexus perf bots"
This reverts commit f00483206dc3fc5d9ddc4e8822ecaba1925399ea.

Reason for revert: Attempt to reland

Original change's description:
> Revert "Remove old Nexus perf bots"
>
> This reverts commit ec609b1cdd3ffd15c45445275899cf4010285399.
>
> Reason for revert: Investigate whether the correct builder is used for Pixel devices
>
> Original change's description:
> > Remove old Nexus perf bots
> >
> > Bug: b/236797526
> > Change-Id: I3a3b88fb29ef8a8df074ead975c785a0bfbc84a7
> > Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/287700
> > Reviewed-by: Jeremy Leconte <jleconte@google.com>
> > Commit-Queue: Björn Terelius <terelius@webrtc.org>
> > Cr-Commit-Position: refs/heads/main@{#38895}
>
> Bug: b/236797526
> Change-Id: I3ca98ddc9a336fb91eec48d54a94ddff19038366
> No-Presubmit: true
> No-Tree-Checks: true
> No-Try: true
> Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/288240
> Commit-Queue: Björn Terelius <terelius@webrtc.org>
> Auto-Submit: Björn Terelius <terelius@webrtc.org>
> Bot-Commit: rubber-stamper@appspot.gserviceaccount.com <rubber-stamper@appspot.gserviceaccount.com>
> Cr-Commit-Position: refs/heads/main@{#38898}

Bug: b/236797526
Change-Id: I4fc2e1c1f195ce89e61f0767037b418030d94afe
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/288640
Reviewed-by: Andrey Logvin <landrey@webrtc.org>
Bot-Commit: rubber-stamper@appspot.gserviceaccount.com <rubber-stamper@appspot.gserviceaccount.com>
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Reviewed-by: Christoffer Jansson <jansson@google.com>
Commit-Queue: Björn Terelius <terelius@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#38927}
2022-12-20 13:34:59 +00:00
Björn Terelius
f00483206d Revert "Remove old Nexus perf bots"
This reverts commit ec609b1cdd3ffd15c45445275899cf4010285399.

Reason for revert: Investigate whether the correct builder is used for Pixel devices

Original change's description:
> Remove old Nexus perf bots
>
> Bug: b/236797526
> Change-Id: I3a3b88fb29ef8a8df074ead975c785a0bfbc84a7
> Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/287700
> Reviewed-by: Jeremy Leconte <jleconte@google.com>
> Commit-Queue: Björn Terelius <terelius@webrtc.org>
> Cr-Commit-Position: refs/heads/main@{#38895}

Bug: b/236797526
Change-Id: I3ca98ddc9a336fb91eec48d54a94ddff19038366
No-Presubmit: true
No-Tree-Checks: true
No-Try: true
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/288240
Commit-Queue: Björn Terelius <terelius@webrtc.org>
Auto-Submit: Björn Terelius <terelius@webrtc.org>
Bot-Commit: rubber-stamper@appspot.gserviceaccount.com <rubber-stamper@appspot.gserviceaccount.com>
Cr-Commit-Position: refs/heads/main@{#38898}
2022-12-15 12:44:07 +00:00
Björn Terelius
ec609b1cdd Remove old Nexus perf bots
Bug: b/236797526
Change-Id: I3a3b88fb29ef8a8df074ead975c785a0bfbc84a7
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/287700
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Commit-Queue: Björn Terelius <terelius@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#38895}
2022-12-15 09:14:21 +00:00
Byoungchan Lee
26c2dee621 Let iOS bots run unittests with XCTest.
When running Gtest-based tests, we use the WebRtcUnitTestDelegate
to call Gtest from the iOS application.
However, if tests take too long, iOS terminates that application.
The test execution code (ios/build/bots/scripts) retries up to three times,
but that functionality doesn't seem to work lately.
Because of this, module_unittests are failing at a fairly high rate.

Instead, use GoogleTestRunner to let XCTest run Gtest-based tests.
This is enabled with the --enable-run-ios-unittests-with-xctest flag,
which is passed when using the --xctest flag in ios/build/bots/scripts/run.py.
Existing XCTest-based tests (eg. sdk_unittest) are not affected
as the --xcode-parallelization flag takes precedence over --xctest.

Bug: None
Change-Id: Ib7f8a6d24f6b25444a47e3a83c0edbe96318be46
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/287180
Reviewed-by: Jeremy Leconte <jleconte@webrtc.org>
Reviewed-by: Björn Terelius <terelius@webrtc.org>
Commit-Queue: Daniel.L (Byoungchan) Lee <daniel.l@hpcnt.com>
Cr-Commit-Position: refs/heads/main@{#38859}
2022-12-09 10:44:23 +00:00
Jeremy Leconte
6419537b3b [iOS sim] Run modules_unittests on 12 cores.
Change-Id: If85ff709a55920cc914213edad5ed63826f6c5f3
Bug: None
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/287121
Reviewed-by: Björn Terelius <terelius@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#38849}
2022-12-08 13:43:23 +00:00
Byoungchan Lee
7970f87a37 Fix infra/specs/PRESUBMIT.py to not concatenate list to str
Fixing errors like this:

Evaluation of CheckChangeOnCommit failed: can only concatenate str (not "list") to str, Traceback (most recent call last):
...
  File "/path/to/webrtc/src/infra/specs/PRESUBMIT.py", line 31, in CheckPatchFormatted
    results.append(output_api.PresubmitError('Error calling "' + cmd + '"'))
TypeError: can only concatenate str (not "list") to str

Bug: None
Change-Id: Ia0b1c7a80a2752934c02d932a9206114769bcaa1
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/286547
Commit-Queue: Daniel.L (Byoungchan) Lee <daniel.l@hpcnt.com>
Reviewed-by: Jeremy Leconte <jleconte@webrtc.org>
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Reviewed-by: Björn Terelius <terelius@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#38831}
2022-12-06 21:29:47 +00:00
Byoungchan Lee
e4caacbfc3 Add default target to gn_isolate_map.pyl
This is required to compile the default target in Android bots.

Bug: webrtc:14743
Change-Id: Ib8248e3d874b45eb59283f9503e07eadcd53bad7
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/286545
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Commit-Queue: Daniel.L (Byoungchan) Lee <daniel.l@hpcnt.com>
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#38830}
2022-12-06 20:27:44 +00:00
Christoffer Jansson
cf78b19a6f remove perf-output from Fuchsia perf
Bug: b/232740856
Change-Id: I892911af7222e85c46089ba53b8b2c3328cc1872
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/286360
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Commit-Queue: Christoffer Jansson <jansson@webrtc.org>
Auto-Submit: Christoffer Jansson <jansson@webrtc.org>
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#38812}
2022-12-05 14:50:56 +00:00
Björn Terelius
737dc4455c Add new linux code coverage bot
Bug: b/236797073
Change-Id: I7acd8cbe12c1fe7455db337515178e28dffda523
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/285940
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Commit-Queue: Björn Terelius <terelius@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#38804}
2022-12-04 14:13:50 +00:00
Jeremy Leconte
d0eaa54104 Reland "Add working Perf tests for Fuchsia"
This is a reland of commit d8d86bd3329d05fdcc5402140917eb70b340c9c6

Original change's description:
> Add working Perf tests for Fuchsia
>
> Utilize VM in perf pool for Fuchsia (separate CL)
>
> Bug: b/232740856
> Change-Id: Ia69f72bbf2046db3bc9b1e5edabda6cc4a339fe6
> Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/285721
> Reviewed-by: Jeremy Leconte <jleconte@google.com>
> Commit-Queue: Christoffer Jansson <jansson@webrtc.org>
> Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
> Cr-Commit-Position: refs/heads/main@{#38787}

Bug: b/232740856
Change-Id: I3ae8b17990157bde4a08fd8a98379cffd2c38148
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/285881
Reviewed-by: Jeremy Leconte <jleconte@webrtc.org>
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Commit-Queue: Jeremy Leconte <jleconte@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#38802}
2022-12-02 20:35:28 +00:00
Jeremy Leconte
c8157c33b4 Add a column_limit=80 to yapf setup.cfg
Also apply the formatting to the .pyl files.

Change-Id: I5dc668b53570d042862d2de5948b72d1cf6d31b3
Bug: None
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/285941
Reviewed-by: Björn Terelius <terelius@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#38797}
2022-12-02 13:36:15 +00:00
Jeremy Leconte
cb885923d8 Revert "Add working Perf tests for Fuchsia"
This reverts commit d8d86bd3329d05fdcc5402140917eb70b340c9c6.

Reason for revert: Seems this causes an issue with the dimensions ?
  File "/b/s/w/ir/kitchen-checkout/recipe_engine/recipe_modules/swarming/api.py", line 463, in with_dimensions
    assert isinstance(k, basestring) and (isinstance(v, basestring)

Original change's description:
> Add working Perf tests for Fuchsia
>
> Utilize VM in perf pool for Fuchsia (separate CL)
>
> Bug: b/232740856
> Change-Id: Ia69f72bbf2046db3bc9b1e5edabda6cc4a339fe6
> Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/285721
> Reviewed-by: Jeremy Leconte <jleconte@google.com>
> Commit-Queue: Christoffer Jansson <jansson@webrtc.org>
> Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
> Cr-Commit-Position: refs/heads/main@{#38787}

Bug: b/232740856
Change-Id: Ibedff26cfe38fae0eb36158d5cd9f2bdfded319f
No-Presubmit: true
No-Tree-Checks: true
No-Try: true
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/285800
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Auto-Submit: Jeremy Leconte <jleconte@google.com>
Commit-Queue: Jeremy Leconte <jleconte@webrtc.org>
Bot-Commit: rubber-stamper@appspot.gserviceaccount.com <rubber-stamper@appspot.gserviceaccount.com>
Owners-Override: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#38790}
2022-12-01 17:06:20 +00:00
Christoffer Jansson
d8d86bd332 Add working Perf tests for Fuchsia
Utilize VM in perf pool for Fuchsia (separate CL)

Bug: b/232740856
Change-Id: Ia69f72bbf2046db3bc9b1e5edabda6cc4a339fe6
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/285721
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Commit-Queue: Christoffer Jansson <jansson@webrtc.org>
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#38787}
2022-12-01 14:02:47 +00:00
Jeremy Leconte
21a9bbcf39 Disable Fuchsia perf tests.
Change-Id: Iad6db19fa0ae3bd912ce072b161378e3e5db649a
Bug: b/232740856
No-Try: true
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/285662
Owners-Override: Jeremy Leconte <jleconte@google.com>
Reviewed-by: Jeremy Leconte <jleconte@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#38781}
2022-11-30 18:23:29 +00:00
Jeremy Leconte
77bb688982 Disable tests again on 'Win32 Debug (Clang)'.
module_unittests are failing with SEH exceptions.

Change-Id: Ic29def1d0f0c5976c1452e198cec2ee67dcaad9a
Bug: webrtc:14723
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/285472
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Reviewed-by: Christoffer Jansson <jansson@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#38778}
2022-11-30 16:39:33 +00:00
Jeremy Leconte
256d3ee2bf Specify the Windows version to run the CI tests.
Change-Id: I2a9f1d266ef5fe4d1e43431964f44a1f995c7490
Bug: None
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/285468
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#38775}
2022-11-30 14:21:57 +00:00
Jeremy Leconte
9665d01e69 Run tests on Windows CI for Release and Debug configuration.
Currently the tests are running only on Windows x86 Release.
* Windows capture_tests are moved to run on x64.
* win_x64_clang_dbg_win10 is removed because it's a duplicate of * win_x64_clang_dbg.

Change-Id: Ibf4db1d1749aa31d665ad30825e9dcfef6910be4
Bug: None
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/285540
Reviewed-by: Christoffer Jansson <jansson@google.com>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Reviewed-by: Christoffer Jansson <jansson@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#38772}
2022-11-30 08:31:48 +00:00
Christoffer Jansson
a5e7941a57 Rename Win 7 to Win 10 to reflect whats being benchmarked
Bug: None
Change-Id: If41eb2d47ee381afba66a9a62e1b7d9481df4efb
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/285465
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Commit-Queue: Christoffer Jansson <jansson@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#38763}
2022-11-29 15:59:18 +00:00
Christoffer Jansson
c06dc4df80 Add Fuchsia Perf bot
Bug: b/232740856
Change-Id: I901c283262cc444f835a099a99ee9a6e09d6b759
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/285442
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Commit-Queue: Christoffer Jansson <jansson@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#38758}
2022-11-29 13:27:52 +00:00
Jeremy Leconte
370ca9c52c Enable sharding for fuchsia bots.
* Add '--quick' argument to 'low_bandwidth_audio_test' even though it doesn't look like it makes much timing difference.
* Add sharding for 'svc_tests' and 'video_engine_tests'.

Change-Id: I6e3357954d18ad03ea9f62912dd77e0e1a74b97d
Bug: webrtc:14713
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/285100
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#38748}
2022-11-28 19:39:08 +00:00
Christoffer Jansson
569af3e80f [Fuchsia] - Add more tests that pass locally
Create bugs and add comments for failures.

Bug: b/232740856
Change-Id: Ic81477de73c3e848569dbd0c63c1a44542b90821
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/285081
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Commit-Queue: Christoffer Jansson <jansson@google.com>
Cr-Commit-Position: refs/heads/main@{#38744}
2022-11-28 09:16:51 +00:00
Jeremy Leconte
c6ae33fb07 Replace dash by underscore in the command line argument before absl flag parsing.
The expected behavior is to have something similar than python:
https://docs.python.org/dev/library/argparse.html#dest:
"Any internal - characters will be converted to _ characters to make sure the string is a valid attribute name".

This allows to catch chromium arguments like 'isolated-script-test-output' that previously needed some preprocessing done for example in flags_compatibility.py.

This CL also fixes a fuchsia specific issue where the test runner needs a 'isolated-script-test-output' argument but then pass the argument to WebRTC that expects a 'isolated_script_test_output' argument. Thus calling flags_compatibility before the test_runner fails and there is not much room to change the argument in between the test runner and the test.

Change-Id: I48a591743fa50484a0ec584a3f9e97d9e0fd25ef
Bug: webrtc:14694
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/284541
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Reviewed-by: Artem Titov <titovartem@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#38707}
2022-11-22 11:03:33 +00:00
Jeremy Leconte
cb2b133bf0 Ignore write-compiled-tests-json-to-writable-path flag.
Change-Id: Ic084a9a1eb77bde1eda6439d7aafe1c208f0595d
Bug: webrtc:14677
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/283761
Owners-Override: Jeremy Leconte <jleconte@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@webrtc.org>
Reviewed-by: Jeremy Leconte <jleconte@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#38654}
2022-11-16 19:28:53 +00:00
Mirko Bonadei
b301b58b3f Rename CI Android testers.
This makes it easier to update devices in th e future (avoiding multiple
CLs to change names, etc..).

Bug: b/259076774
Change-Id: I20ae940823978fbae84495d266345e4990184130
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/283720
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Commit-Queue: Mirko Bonadei <mbonadei@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#38650}
2022-11-16 15:38:21 +00:00
Jeremy Leconte
91e6987f66 Add a service account for the Android Perf bots.
Change-Id: I02446fbca310a70172160d4bf345428413094bda
Bug: None
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/283662
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#38647}
2022-11-16 13:20:14 +00:00
Jeremy Leconte
e085366aca Fix some minor issues with the android bots.
* Use the same logdog_butler as Chromium instead of redefining one.
* Use luci-auth to prevent "local auth - HTTP 400" errors.

Change-Id: I2a0d1393f9f0e1e41b2bcc9a9fec2c50c19675f3
Bug: None
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/283520
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#38637}
2022-11-16 09:09:25 +00:00
Mirko Bonadei
954cf1f853 Update mixins (copying ones removed by Chromium).
Bug: None
Change-Id: I7fe81736c27d0d3091d24553cb8a17286bdb9c27
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/283540
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Commit-Queue: Mirko Bonadei <mbonadei@webrtc.org>
Auto-Submit: Mirko Bonadei <mbonadei@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#38629}
2022-11-15 16:47:30 +00:00
Mirko Bonadei
76bd5a80ea Migrate WebRTC postsubmit to Walleye (from Bullhead).
Bug: b/259076774
Change-Id: I9237a454bf88427bc03f8e4d801c126b259a2231
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/283460
Commit-Queue: Mirko Bonadei <mbonadei@webrtc.org>
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#38628}
2022-11-15 16:10:55 +00:00
Mirko Bonadei
31364615d7 Migrate WebRTC presubmit to Walleye (from Bullhead).
No-Try: True
Bug: b/259076774
Change-Id: I87fdd2ca27f1f3774c0aee68680ae68afd8e59c6
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/283440
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Commit-Queue: Mirko Bonadei <mbonadei@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#38618}
2022-11-14 16:37:40 +00:00
Christoffer Jansson
f1fa7058b6 Add Fuchsia mixin, disable unsupported absl calls for fuchsia
Add a few tests to get started on debugging.

The goal of this CL is to get the Fuchsia bots running the tests without infra specific issues. After landing this, failures will be in test framework files (e.g. test/testsupport folder) and WebRTC code.

Bug: b/232740856
Change-Id: I332607fe875334769e7dadf6696d878a23a7e69f
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/280440
Reviewed-by: Andrey Logvin <landrey@webrtc.org>
Reviewed-by: Andrey Logvin <landrey@google.com>
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#38596}
2022-11-09 16:36:05 +00:00
Jeremy Leconte
d957836794 Use gtest_parallel for PipeWire tests.
This CL will also make PipeWire tests retried 3 times in case of failures.

Change-Id: I9c66351f7ee171e29266fe4b8dcd52ca282c8f6d
Bug: webrtc:14644
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/282820
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Owners-Override: Mirko Bonadei <mbonadei@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#38595}
2022-11-09 15:37:58 +00:00
Christoffer Jansson
119fb1910a Add Pixel2 and Pixel5 arm32 perf tester
Bug: b/257916734
Change-Id: I733e3d451daa47fa25d370f5d2fff7c9b1f5b8db
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/282560
Commit-Queue: Christoffer Jansson <jansson@webrtc.org>
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#38584}
2022-11-08 12:44:18 +00:00
landrey
822794d491 Ignore write-compiled-tests-json-to-writable-path flag
This flag is passed by default in chromium after https://crrev.com/c/3953676

Bug: b/257915522
Change-Id: If3518fa86f3e05ad02bfad8f200b17958f78602d
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/282225
Reviewed-by: Jeremy Leconte <jleconte@webrtc.org>
Commit-Queue: Andrey Logvin <landrey@google.com>
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Auto-Submit: Andrey Logvin <landrey@google.com>
Cr-Commit-Position: refs/heads/main@{#38581}
2022-11-08 11:31:12 +00:00
Jeremy Leconte
6a1320c2c0 Disable pipewire tests on sanitizer bots.
Change-Id: Ib3f06c3c4c64b918b59a02ac67fcea2e2b45112b
Bug: webrtc:14644
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/282600
Reviewed-by: Andrey Logvin <landrey@google.com>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Reviewed-by: Jeremy Leconte <jleconte@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#38580}
2022-11-08 11:22:41 +00:00
Christoffer Jansson
ddae5e6fae Add Pixel5 perf config
Bug: b/257916734
Change-Id: I7a9fc7db85cf7742b7de0ce4c2dc4d25548050f2
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/282220
Reviewed-by: Björn Terelius <terelius@webrtc.org>
Commit-Queue: Christoffer Jansson <jansson@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#38566}
2022-11-07 15:50:51 +00:00
Jeremy Leconte
bbd5fbf4f5 [iOS] Run SVC tests on 12 cores machines
Change-Id: I8e8bda835504ac1440c7d65bfc62ecbb619fce54
Bug: None
No-Try: true
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/281161
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Auto-Submit: Jeremy Leconte <jleconte@google.com>
Reviewed-by: Christoffer Jansson <jansson@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#38504}
2022-10-31 11:12:21 +00:00
Jan Grulich
1264dc165b PipeWire capturer: add initial test for SharedScreenCastStream
This test created another PipeWire stream we can connect to with
SharedScreenCastStream and recieve frames from there. This is an
initial version, where I test whether we can successfuly connect
and disconnect, receive frames and it also tests DesktopFrameQueue.

In the future I will add tests to test mouse cursor and try to
come up with some corner cases and possible scenarios.

Bug: webrtc:13429
Change-Id: Ib2a749207085c6324ffe3d5cc8f2f9c631fa6459
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/256267
Reviewed-by: Christoffer Jansson <jansson@webrtc.org>
Reviewed-by: Mark Foltz <mfoltz@chromium.org>
Reviewed-by: Harald Alvestrand <hta@webrtc.org>
Commit-Queue: Jan Grulich <grulja@gmail.com>
Reviewed-by: Jeremy Leconte <jleconte@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#38431}
2022-10-18 13:10:53 +00:00
Jeremy Leconte
56cf22227e Upgrade iOS internal bots to iOS 15.7
Change-Id: Ieb56aac56802ea621ed72823da5988562fcfcbc6
Bug: b/253400569
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/279101
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Reviewed-by: Mirko Bonadei <mbonadei@google.com>
Reviewed-by: Christoffer Jansson <jansson@google.com>
Reviewed-by: Christoffer Jansson <jansson@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#38386}
2022-10-13 11:32:40 +00:00
Christoffer Jansson
a45a7cbc0d Add fuchsia bot
No-Try: true
Bug: b/232740856
Change-Id: I5b4c9b41395466e68e00a7e63fffb26eb31d8313
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/274401
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Commit-Queue: Christoffer Jansson <jansson@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#38028}
2022-09-07 12:44:00 +00:00
Jeremy Leconte
1ab4e873e4 Run svc_tests on 4 shards.
The tests are sometimes hiting timeouts on msan runs:
https://chromium-swarm.appspot.com/task?id=5d02a893ec864210

Change-Id: I16f15f3ab5750bdcc37a1cd1e32846adb2fb7602
Bug: webrtc:11607
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/273343
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#37935}
2022-08-29 20:24:04 +00:00
Jeremy Leconte
b61f39e00e Remove process_perf_results_py2 now that recipe code is using py3.
Change-Id: I04085a3b773bac84b3b1da1a702f1a441fc2a097
Bug: webrtc:13835
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/272960
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#37904}
2022-08-25 13:30:34 +00:00
Jeremy Leconte
df4dc3ca6b Add a win10-any mixins that don't specify the version.
This is to fix "Win32 Release (Clang)" and "Perf Win7" bots that cannot find resources.

Change-Id: I0db4719d508b70c78f4357b28a69d3d711ca9be3
Bug: webrtc:14384
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/272362
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Reviewed-by: Christoffer Jansson <jansson@google.com>
Reviewed-by: Christoffer Jansson <jansson@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#37832}
2022-08-19 07:38:56 +00:00
Jeremy Leconte
5414cce0a1 Migrate iOS and Mac tests from mac-11 to mac-12 machines
Also remove unused mixins.

Bug: b/233192409
Change-Id: I959916b98cebd417088fb7804dc1f44f64134555
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/272241
Reviewed-by: Christoffer Jansson <jansson@google.com>
Reviewed-by: Jeremy Leconte <jleconte@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#37826}
2022-08-18 14:41:56 +00:00
Austin Orion
81797744fd Reland "Wait for frames to arrive in WgcCapturer instead of returning nothing."
This reverts commit dd32562f242b247aed8add4efecaf3e20c623b9a.

Reason for revert: Updated the original change to dynamically load
the CoreMessaging.dll instead of statically linking with the .lib.

Original change's description:
> Revert "Wait for frames to arrive in WgcCapturer instead of returning nothing."
>
> This reverts commit 93bb3051490253d56dc1cdab4701b91138a151c3.
>
> Reason for revert: It breaks a test while rolling into Chromium,
> see https://webrtc-review.googlesource.com/c/src/+/261780/21#message-4a96e33bfb475f19a618be82bbe72951b23085ef for details.
>
> Original change's description:
> > Wait for frames to arrive in WgcCapturer instead of returning nothing.
> >
> > We're seeing a high instance of "first capture failed" in Chromium when
> > using WGC. We can reduce this by waiting for frames to arrive if there
> > are none in the frame pool instead of returning a temporary error.
> >
> > I've set the maximum time to wait for a frame to 50ms. If no frame
> > arrives before 50ms has elapsed, we will return a temporary error.
> > Added a new test, FirstCaptureSucceeds, to verify that this is working
> > as expected.
> >
> > As part of this I updated the name of the `kCreateFreeThreadedFailed`
> > enum value to `kCreateFramePoolFailed`. The value remains the same
> > since they both report failures in frame pool creation.
> >
> > I also increased `kNumBuffers` from 1 to 2, so that the frame pool can
> > store two frames. This should prevent us from having to wait on the
> > event as frequently. This will increase the latency between capture
> > and display, however. High frame rate applications should not be
> > noticeably affected.
> >
> > Additionally, we uncovered a bug in the OS that prevents window capture
> > when there are displays attached, but none of them are active. Added
> > a new check to `IsWgcSupported` to cover this scenario.
> >
> > Finally, some issues with other WGC tests blocked moving the TryBots
> > to a newer version of Windows. This CL fixes those issues and updates
> > the TryBot configuration.
> >
> > bug: chromium:1314868
> > Change-Id: Id9c4d5ee98621e682ef04864c3848d50e761cdb7
> > Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/261780
> > Reviewed-by: Alexander Cooper <alcooper@chromium.org>
> > Reviewed-by: Jeremy Leconte <jleconte@webrtc.org>
> > Commit-Queue: Austin Orion <auorion@microsoft.com>
> > Reviewed-by: Jeremy Leconte <jleconte@google.com>
> > Cr-Commit-Position: refs/heads/main@{#37404}
>
> Change-Id: If237df4826fe20b6fe2ca4b57253623321bf33c5
> No-Presubmit: true
> No-Tree-Checks: true
> No-Try: true
> Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/267460
> Bot-Commit: rubber-stamper@appspot.gserviceaccount.com <rubber-stamper@appspot.gserviceaccount.com>
> Owners-Override: Mirko Bonadei <mbonadei@webrtc.org>
> Commit-Queue: Mirko Bonadei <mbonadei@webrtc.org>
> Auto-Submit: Mirko Bonadei <mbonadei@webrtc.org>
> Cr-Commit-Position: refs/heads/main@{#37408}

Change-Id: I6cc2becd9ed363782ab2f326f58d9401bc8fb820
Bug: chromium:1314868
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/267902
Reviewed-by: Jeremy Leconte <jleconte@webrtc.org>
Reviewed-by: Alexander Cooper <alcooper@chromium.org>
Commit-Queue: Austin Orion <auorion@microsoft.com>
Cr-Commit-Position: refs/heads/main@{#37470}
2022-07-06 20:28:26 +00:00
Mirko Bonadei
dd32562f24 Revert "Wait for frames to arrive in WgcCapturer instead of returning nothing."
This reverts commit 93bb3051490253d56dc1cdab4701b91138a151c3.

Reason for revert: It breaks a test while rolling into Chromium,
see https://webrtc-review.googlesource.com/c/src/+/261780/21#message-4a96e33bfb475f19a618be82bbe72951b23085ef for details.

Original change's description:
> Wait for frames to arrive in WgcCapturer instead of returning nothing.
>
> We're seeing a high instance of "first capture failed" in Chromium when
> using WGC. We can reduce this by waiting for frames to arrive if there
> are none in the frame pool instead of returning a temporary error.
>
> I've set the maximum time to wait for a frame to 50ms. If no frame
> arrives before 50ms has elapsed, we will return a temporary error.
> Added a new test, FirstCaptureSucceeds, to verify that this is working
> as expected.
>
> As part of this I updated the name of the `kCreateFreeThreadedFailed`
> enum value to `kCreateFramePoolFailed`. The value remains the same
> since they both report failures in frame pool creation.
>
> I also increased `kNumBuffers` from 1 to 2, so that the frame pool can
> store two frames. This should prevent us from having to wait on the
> event as frequently. This will increase the latency between capture
> and display, however. High frame rate applications should not be
> noticeably affected.
>
> Additionally, we uncovered a bug in the OS that prevents window capture
> when there are displays attached, but none of them are active. Added
> a new check to `IsWgcSupported` to cover this scenario.
>
> Finally, some issues with other WGC tests blocked moving the TryBots
> to a newer version of Windows. This CL fixes those issues and updates
> the TryBot configuration.
>
> bug: chromium:1314868
> Change-Id: Id9c4d5ee98621e682ef04864c3848d50e761cdb7
> Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/261780
> Reviewed-by: Alexander Cooper <alcooper@chromium.org>
> Reviewed-by: Jeremy Leconte <jleconte@webrtc.org>
> Commit-Queue: Austin Orion <auorion@microsoft.com>
> Reviewed-by: Jeremy Leconte <jleconte@google.com>
> Cr-Commit-Position: refs/heads/main@{#37404}

Change-Id: If237df4826fe20b6fe2ca4b57253623321bf33c5
No-Presubmit: true
No-Tree-Checks: true
No-Try: true
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/267460
Bot-Commit: rubber-stamper@appspot.gserviceaccount.com <rubber-stamper@appspot.gserviceaccount.com>
Owners-Override: Mirko Bonadei <mbonadei@webrtc.org>
Commit-Queue: Mirko Bonadei <mbonadei@webrtc.org>
Auto-Submit: Mirko Bonadei <mbonadei@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#37408}
2022-07-02 07:41:21 +00:00
Austin Orion
93bb305149 Wait for frames to arrive in WgcCapturer instead of returning nothing.
We're seeing a high instance of "first capture failed" in Chromium when
using WGC. We can reduce this by waiting for frames to arrive if there
are none in the frame pool instead of returning a temporary error.

I've set the maximum time to wait for a frame to 50ms. If no frame
arrives before 50ms has elapsed, we will return a temporary error.
Added a new test, FirstCaptureSucceeds, to verify that this is working
as expected.

As part of this I updated the name of the `kCreateFreeThreadedFailed`
enum value to `kCreateFramePoolFailed`. The value remains the same
since they both report failures in frame pool creation.

I also increased `kNumBuffers` from 1 to 2, so that the frame pool can
store two frames. This should prevent us from having to wait on the
event as frequently. This will increase the latency between capture
and display, however. High frame rate applications should not be
noticeably affected.

Additionally, we uncovered a bug in the OS that prevents window capture
when there are displays attached, but none of them are active. Added
a new check to `IsWgcSupported` to cover this scenario.

Finally, some issues with other WGC tests blocked moving the TryBots
to a newer version of Windows. This CL fixes those issues and updates
the TryBot configuration.

bug: chromium:1314868
Change-Id: Id9c4d5ee98621e682ef04864c3848d50e761cdb7
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/261780
Reviewed-by: Alexander Cooper <alcooper@chromium.org>
Reviewed-by: Jeremy Leconte <jleconte@webrtc.org>
Commit-Queue: Austin Orion <auorion@microsoft.com>
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#37404}
2022-07-01 17:42:20 +00:00