92 Commits

Author SHA1 Message Date
Jeremy Leconte
738abe0f8f Upgrade ios version used for perf tests.
https://chrome-swarming.appspot.com/bot?id=mac-438-e504

Also pick up the xcode_16_main changes done in Chromium.

Change-Id: Iab35695555ab2d3f058343001685f6f7576a2ac6
Bug: None
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/361161
Reviewed-by: Björn Terelius <terelius@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#42898}
2024-08-30 15:07:56 +00:00
Christoffer Dewerin
7e37e5fd5a Use xcode 16 for iOS debug simulators + fix version
Bug: chromium:361610467
Change-Id: I6ec53d7ca11c1537e8a59fdbc4a8ec277e39c626
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/360401
Commit-Queue: Jeremy Leconte <jleconte@webrtc.org>
Reviewed-by: Jeremy Leconte <jleconte@webrtc.org>
Commit-Queue: Christoffer Dewerin <jansson@google.com>
Auto-Submit: Christoffer Dewerin <jansson@google.com>
Cr-Commit-Position: refs/heads/main@{#42837}
2024-08-23 13:50:22 +00:00
Jeremy Leconte
c478ff6a49 Sync bot configs with Chromium.
Change-Id: Idad14d12331f0f113cfa3c4e2aa006feec407a67
Bug: None
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/360040
Reviewed-by: Christoffer Dewerin <jansson@webrtc.org>
Reviewed-by: Christoffer Dewerin <jansson@google.com>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#42812}
2024-08-20 08:47:43 +00:00
Jeremy Leconte
2a8cca6a5d Run tests on Mac-14 machines.
All the builder machines have been upgraded to Mac-14.

Change-Id: Ia6fe055e21bcf483d08debc85109b36dedf18c5b
Bug: None
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/357864
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Reviewed-by: Björn Terelius <terelius@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#42683}
2024-07-29 12:13:13 +00:00
Jeremy Leconte
175e0c95e3 iOS simulator upgrade iOS version to run the tests.
iOS 15.5 is not tested anymore and we start to test on iOS 18.0.

Change-Id: Ia7340d25f6cf8480763ea689db267c0c9a843319
Bug: b/353975341
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/357640
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#42659}
2024-07-22 08:54:06 +00:00
Jeremy Leconte
fbf754b581 Add new bot 'iwyu_verifier'.
Change-Id: I26a5022d1ffa1f6443c686b90d4a6322a27f81e2
Bug: b/236227627
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/356020
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Reviewed-by: Björn Terelius <terelius@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#42576}
2024-07-02 19:03:18 +00:00
Christoffer Dewerin
f79120a5f8 Update iOS perf dimensions to 16.7.5.
Comment out device_status as it seems to be unreliable.
Update iOS simulator runtime because generate_buildbot_json.py was complaining.

Bug: None
Change-Id: I34c3f43ebe23597351fc91884d991ef3241ac3ba
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/354520
Reviewed-by: Jeremy Leconte <jleconte@webrtc.org>
Commit-Queue: Christoffer Dewerin <jansson@google.com>
Cr-Commit-Position: refs/heads/main@{#42470}
2024-06-12 15:48:07 +00:00
Jeremy Leconte
5e194e9d24 Remove unused linux_memcheck bot.
Change-Id: I2427c05c8376f1d21703e05bb93c77982a5beb25
Bug: None
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/350605
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#42313}
2024-05-15 14:21:05 +00:00
Christoffer Dewerin
36ecffa129 Revert "Temporary disable sharding on Fuchsia bots."
This reverts commit 5dbc4a45bc3f8b6eee99426fb7ebfb76c861e8c2.

Reason for revert: Sharding should now work on fuchsia + no new generated starlark files have been uploaded since.

Original change's description:
> Temporary disable sharding on Fuchsia bots.
>
> Change-Id: I248ef19317de9a93751641e8bf0cab80a42a35f7
> Bug: b/338087169
> Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/349840
> Commit-Queue: Mirko Bonadei <mbonadei@webrtc.org>
> Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
> Cr-Commit-Position: refs/heads/main@{#42230}

Bug: b/338087169
Change-Id: I25f29a64a4a2ca40afb0ac9fbbc2a821c3ca4551
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/350182
Bot-Commit: rubber-stamper@appspot.gserviceaccount.com <rubber-stamper@appspot.gserviceaccount.com>
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#42282}
2024-05-13 08:53:13 +00:00
Jeremy Leconte
042973f624 Regenerate infra/specs json files.
* ios_runtime_cache_15_5 has been removed from Chromium config, adding it back in mixins_webrtc.pyl.
* The order of the arguments in the json file has been changed.
* Seems using 'remove_mixins' is now required to get the same behavior as before.

Change-Id: Ia252aaa6458f8c9caed5ead3b641bb85cd1917e8
Bug: None
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/350362
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Reviewed-by: Christoffer Dewerin <jansson@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#42279}
2024-05-13 07:22:45 +00:00
Jeremy Leconte
5dbc4a45bc Temporary disable sharding on Fuchsia bots.
Change-Id: I248ef19317de9a93751641e8bf0cab80a42a35f7
Bug: b/338087169
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/349840
Commit-Queue: Mirko Bonadei <mbonadei@webrtc.org>
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#42230}
2024-05-06 07:45:58 +00:00
Jeremy Leconte
8bfc3e99a6 Fix variant name for iOS simulator 17.4.
Change-Id: I66b00b360d8eace858046d73f40c7eac57375e7d
Bug: None
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/339843
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#41753}
2024-02-16 11:01:54 +00:00
Mirko Bonadei
85b405b798 Switch all Linux tasks from Focal to Jammy (except *san).
Bug: b/325441006
Change-Id: I761a84b8e3570d107b82280c1c7870b982bbc3f0
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/339865
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Commit-Queue: Mirko Bonadei <mbonadei@google.com>
Commit-Queue: Mirko Bonadei <mbonadei@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#41752}
2024-02-16 09:53:34 +00:00
Mirko Bonadei
1b52d5641e Fix generate_buildbot_json and switch to ios_runtime_cache_17_4.
When running it, even without changes at HEAD I got:

```
KeyError: 'ios_runtime_cache_17_0'
```

Bug: b/325441006
Change-Id: I7ea236ccc1f7439d7750208260b01d7636db4ae5
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/339842
Commit-Queue: Mirko Bonadei <mbonadei@webrtc.org>
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#41751}
2024-02-16 08:45:30 +00:00
Jeremy Leconte
199fd755bd Run video_codec_perf_tests using the quick mode on Android try bots.
Change-Id: I02678b033815f843e4aee1585ef64c4d9b7e7b14
Bug: None
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/334220
Reviewed-by: Sergey Silkin <ssilkin@webrtc.org>
Reviewed-by: Jeremy Leconte <jleconte@webrtc.org>
Reviewed-by: Erik Språng <sprang@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#41535}
2024-01-16 10:07:48 +00:00
Jeremy Leconte
293af4b5e0 Upgrade iOS simulator configuration.
Change-Id: I458417c94659188f26feac6237d066acce5ac3dd
Bug: b/319049739
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/333780
Commit-Queue: Jeremy Leconte <jleconte@webrtc.org>
Reviewed-by: Christoffer Dewerin <jansson@google.com>
Reviewed-by: Jeremy Leconte <jleconte@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#41473}
2024-01-08 11:00:27 +00:00
Christoffer Dewerin
6b559cd1a7 Migrate to Linux Focal 20.x
Bug: b/318586322
Change-Id: If39db560724fd5399eeb399cffc8150898213399
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/333381
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Commit-Queue: Christoffer Dewerin <jansson@google.com>
Cr-Commit-Position: refs/heads/main@{#41470}
2024-01-04 09:41:16 +00:00
Christoffer Jansson
336fb4faf4 Setup tests for win11 tryservers
Bug: b/316080018
Change-Id: I746724ae740be18540cde24ade8633870e275c1b
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/331361
Reviewed-by: Jeremy Leconte <jleconte@webrtc.org>
Commit-Queue: Christoffer Dewerin <jansson@google.com>
Cr-Commit-Position: refs/heads/main@{#41378}
2023-12-13 16:35:55 +00:00
Mirko Bonadei
b875b8b98b Rename xcode_parallelization to xcodebuild_sim_runner.
Bug: b/315770061
Change-Id: I7910a2885130655c8e81131537019137c0e61463
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/330960
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Commit-Queue: Mirko Bonadei <mbonadei@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#41352}
2023-12-11 14:00:26 +00:00
Christoffer Jansson
dfb54b5747 Remove video_capture_tests
Bug: b/312914606
Change-Id: I449647ba0158d947a6cff401139cf92ec05b23b4
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/330562
Reviewed-by: Jeremy Leconte <jleconte@webrtc.org>
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Commit-Queue: Christoffer Dewerin <jansson@google.com>
Cr-Commit-Position: refs/heads/main@{#41349}
2023-12-11 10:35:44 +00:00
Christoffer Jansson
988179a4c3 Add xcode caches to dimensions.
Bug: b/311568650
Change-Id: Idcdd1c627e74edc90d1e7ac264053698bed0e4b5
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/327721
Commit-Queue: Christoffer Jansson <jansson@webrtc.org>
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#41185}
2023-11-17 14:36:35 +00:00
Danil Chapovalov
8144935b78 Replace WebRTC-QuickPerfTest field trial with similar named dedicated test flag
Bug: webrtc:7101
Change-Id: I4034f90fdd3456c1d09981142ad494ad150f7b94
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/322801
Reviewed-by: Jeremy Leconte <jleconte@webrtc.org>
Commit-Queue: Danil Chapovalov <danilchap@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#40901}
2023-10-10 12:20:33 +00:00
Christoffer Jansson
d63cd63819 Use 8 shards for svc tests on android
Bug: webrtc:15538
Change-Id: Ib794bd6e0c8b43636da47bd662cf47ba40bd7576
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/322701
Commit-Queue: Christoffer Jansson <jansson@webrtc.org>
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Auto-Submit: Christoffer Jansson <jansson@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#40890}
2023-10-09 09:55:49 +00:00
Mirko Bonadei
b01cd19fd7 Switch svc_tests from using Pixel 2 to Pixel 3a.
Bug: webrtc:15538
Change-Id: I4c7dbd0bccf25f3d90b006c71b96bf7aa7fd8c68
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/322600
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Commit-Queue: Mirko Bonadei <mbonadei@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#40880}
2023-10-06 10:34:33 +00:00
Mirko Bonadei
9dae1dfda7 Refresh infra/specs.
Bug: None
Change-Id: I288a3b0983d9d53425982901643548adcca7ba9b
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/322601
Auto-Submit: Mirko Bonadei <mbonadei@webrtc.org>
Reviewed-by: Jeremy Leconte <jleconte@webrtc.org>
Commit-Queue: Mirko Bonadei <mbonadei@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#40879}
2023-10-06 08:54:52 +00:00
Christoffer Jansson
96de4d63e3 Update internal iOS dimensions
Bug: b/299058719
Change-Id: If356ba92bd49c5e650b3147ee94f28947318c4e5
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/318961
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Commit-Queue: Christoffer Jansson <jansson@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#40699}
2023-09-05 11:07:38 +00:00
Christoffer Jansson
c787adcfbf Remove decommisioned Pixel2 perf bots
Bug: None
Change-Id: I872fe20b9ce901e8a5dd2dd814f00bb7d368e1ec
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/313542
Reviewed-by: Björn Terelius <terelius@webrtc.org>
Commit-Queue: Christoffer Jansson <jansson@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#40486}
2023-07-28 13:27:31 +00:00
Jeremy Leconte
283c3df2ac Fix TCPChannelClientTest.java when running on multiple shards.
Change-Id: I57947d5801cc9545939a9d38d546424829583a07
Bug: None
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/311240
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#40391}
2023-07-03 13:28:59 +00:00
Florent Castelli
d797cb6ca7 Remove all split channels related code
Bug: webrtc:13931
Change-Id: I93b8ca0ba1ec15bf260236bbc914b41fbb30aa58
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/310680
Commit-Queue: Florent Castelli <orphis@webrtc.org>
Reviewed-by: Jeremy Leconte <jleconte@webrtc.org>
Reviewed-by: Harald Alvestrand <hta@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#40376}
2023-06-29 09:32:04 +00:00
Jeremy Leconte
7a24f2a7eb Call generate_buildbot_json.py to update json files.
This is a follow up on Chromium https://crrev.com/c/4632065.

Change-Id: I58244bd0814348f1401ff48e6ce71c1fe693c226
Bug: None
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/310780
Reviewed-by: Jeremy Leconte <jleconte@webrtc.org>
Commit-Queue: Florent Castelli <orphis@webrtc.org>
Auto-Submit: Jeremy Leconte <jleconte@google.com>
Reviewed-by: Florent Castelli <orphis@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#40369}
2023-06-28 14:39:29 +00:00
Jeremy Leconte
b29ee5bc8f Run the same perf tests on all platforms.
Change-Id: I49ac9921d92e3ff81569b162c64c96559565ae62
Bug: b/284448060
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/307021
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#40204}
2023-06-02 08:35:00 +00:00
Jeremy Leconte
2bb686dbc0 Stop running low_bandwith_audio_tests.
Change-Id: I55fff58d35787d0ff332fa750749c75d9f6a9b70
Bug: b/284448060
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/306740
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#40159}
2023-05-26 14:51:41 +00:00
Sergey Silkin
0328190ab3 Add video_codec_perf_tests to desktop and android perf test suites
Followed instructions in https://webrtc.googlesource.com/src/+/refs/heads/main/g3doc/add-new-test-binary.md

Bug: webrtc:14852
Change-Id: I4cdc7d55270de7b24723a89b8e3bb0d392d0e788
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/305600
Reviewed-by: Åsa Persson <asapersson@webrtc.org>
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Reviewed-by: Jeremy Leconte <jleconte@webrtc.org>
Commit-Queue: Sergey Silkin <ssilkin@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#40118}
2023-05-23 12:13:29 +00:00
Jeremy Leconte
4e0bdf550b iOS64 Perf bot build15-a7 is replaced by mac-254-e504.
Change-Id: I65a0065bee7dad345668541eddcc7a53fec2dab3
Bug: b/278663917
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/302402
Reviewed-by: Christoffer Jansson <jansson@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#39925}
2023-04-24 07:44:12 +00:00
Mirko Bonadei
2f7071a57a Add webrtc_nonparallel_tests to Fuchsia bots.
Bug: None
Change-Id: Icdb18969dda11a045232bea0f8eaa476bb474f69
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/297720
Commit-Queue: Mirko Bonadei <mbonadei@webrtc.org>
Reviewed-by: Christoffer Jansson <jansson@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#39562}
2023-03-15 08:44:59 +00:00
Harald Alvestrand
ff16f5f88e Add a new test binary to check if split-channel works
This test (and binary) will be used to verify that the field trial
for enabling split-MediaChannel works in both "off" and "on" modes,
so that it can be run as a field trial. It is intended to be deleted
once the conversion to split-MediaChannel is complete.

Bug: webrtc:13931
Change-Id: If62d19be9b2f205067b86dc859946279442fdd58
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/296322
Commit-Queue: Harald Alvestrand <hta@webrtc.org>
Reviewed-by: Emil Lundmark <lndmrk@webrtc.org>
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#39493}
2023-03-07 11:14:31 +00:00
Jeremy Leconte
5f246cb2bf Use win10 chromium mixins now that win bots are upgraded.
Change-Id: I03f9af65deb4bd11bb942639009936f883ef47fc
Bug: None
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/293220
Reviewed-by: Christoffer Jansson <jansson@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#39301}
2023-02-13 13:10:12 +00:00
Tom Anderson
4b0d6f908b Upgrade Linux MSan to Focal
Bug: chromium:1260217
Change-Id: I2c8ee36fbf2cd754ac5fd7a983c44478b81ef068
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/291840
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Auto-Submit: Thomas Anderson <thomasanderson@chromium.org>
Commit-Queue: Mirko Bonadei <mbonadei@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#39260}
2023-02-05 14:14:31 +00:00
Christoffer Jansson
0c1c9720d8 Fix gtest-output and resultdb for fuchsia
Bug: b/232740856
Change-Id: I37b5a10d3292aca0b4dca98cb04613db17bb6188
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/291115
Commit-Queue: Christoffer Jansson <jansson@webrtc.org>
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#39195}
2023-01-25 14:27:38 +00:00
Jeremy Leconte
4ccb616fa2 Old iOS sim bots clean up.
Change-Id: I9313b9ab034be8cf3933d82f72c4c8e8858ca6a5
Bug: b/264630045
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/291100
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#39133}
2023-01-18 11:14:50 +00:00
Jeremy Leconte
9795589f50 Add "iOS Debug (simulator)" CI bot.
Also set xcode back to xcode 13 for iOS 14.

Change-Id: Ic5475d274895b5f86e4fea36805dec4486adc79b
Bug: b/264630045
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/290894
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#39094}
2023-01-13 08:16:10 +00:00
Jeremy Leconte
83fd843535 Add a ios_x64_dbg_simulator try bot.
The goal of this bot is to replace ios_sim_x64_dbg_ios(12, 13 and 14).

Change-Id: I6d8f5004a9440f5fd8cb96730dc2dbb4abba2e61
Bug: b/264630045
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/290893
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#39086}
2023-01-12 14:07:37 +00:00
Jeremy Leconte
69ea6afa35 Refresh WebRTC mixins.pyl file.
The mixins 'win10' has been updated with https://crrev.com/c/4140185.
Windows 20H2 machines have been upgraded to 22h2 which causes WebRTC windows bots to fail with 'not enough capacity' errors.
https://ci.chromium.org/ui/p/webrtc/builders/try/win_x86_clang_rel/45466/overview

No-Try: True
Change-Id: If429275cc492df406b7a85fc697cd3ed775d9f24
Bug: chromium:1324840
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/290842
Reviewed-by: Christoffer Jansson <jansson@google.com>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Reviewed-by: Christoffer Jansson <jansson@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#39062}
2023-01-11 10:19:52 +00:00
Byoungchan Lee
26c2dee621 Let iOS bots run unittests with XCTest.
When running Gtest-based tests, we use the WebRtcUnitTestDelegate
to call Gtest from the iOS application.
However, if tests take too long, iOS terminates that application.
The test execution code (ios/build/bots/scripts) retries up to three times,
but that functionality doesn't seem to work lately.
Because of this, module_unittests are failing at a fairly high rate.

Instead, use GoogleTestRunner to let XCTest run Gtest-based tests.
This is enabled with the --enable-run-ios-unittests-with-xctest flag,
which is passed when using the --xctest flag in ios/build/bots/scripts/run.py.
Existing XCTest-based tests (eg. sdk_unittest) are not affected
as the --xcode-parallelization flag takes precedence over --xctest.

Bug: None
Change-Id: Ib7f8a6d24f6b25444a47e3a83c0edbe96318be46
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/287180
Reviewed-by: Jeremy Leconte <jleconte@webrtc.org>
Reviewed-by: Björn Terelius <terelius@webrtc.org>
Commit-Queue: Daniel.L (Byoungchan) Lee <daniel.l@hpcnt.com>
Cr-Commit-Position: refs/heads/main@{#38859}
2022-12-09 10:44:23 +00:00
Jeremy Leconte
6419537b3b [iOS sim] Run modules_unittests on 12 cores.
Change-Id: If85ff709a55920cc914213edad5ed63826f6c5f3
Bug: None
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/287121
Reviewed-by: Björn Terelius <terelius@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#38849}
2022-12-08 13:43:23 +00:00
Björn Terelius
737dc4455c Add new linux code coverage bot
Bug: b/236797073
Change-Id: I7acd8cbe12c1fe7455db337515178e28dffda523
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/285940
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Commit-Queue: Björn Terelius <terelius@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#38804}
2022-12-04 14:13:50 +00:00
Jeremy Leconte
9665d01e69 Run tests on Windows CI for Release and Debug configuration.
Currently the tests are running only on Windows x86 Release.
* Windows capture_tests are moved to run on x64.
* win_x64_clang_dbg_win10 is removed because it's a duplicate of * win_x64_clang_dbg.

Change-Id: Ibf4db1d1749aa31d665ad30825e9dcfef6910be4
Bug: None
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/285540
Reviewed-by: Christoffer Jansson <jansson@google.com>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Reviewed-by: Christoffer Jansson <jansson@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#38772}
2022-11-30 08:31:48 +00:00
Jeremy Leconte
370ca9c52c Enable sharding for fuchsia bots.
* Add '--quick' argument to 'low_bandwidth_audio_test' even though it doesn't look like it makes much timing difference.
* Add sharding for 'svc_tests' and 'video_engine_tests'.

Change-Id: I6e3357954d18ad03ea9f62912dd77e0e1a74b97d
Bug: webrtc:14713
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/285100
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#38748}
2022-11-28 19:39:08 +00:00
Christoffer Jansson
569af3e80f [Fuchsia] - Add more tests that pass locally
Create bugs and add comments for failures.

Bug: b/232740856
Change-Id: Ic81477de73c3e848569dbd0c63c1a44542b90821
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/285081
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Commit-Queue: Christoffer Jansson <jansson@google.com>
Cr-Commit-Position: refs/heads/main@{#38744}
2022-11-28 09:16:51 +00:00
Jeremy Leconte
c6ae33fb07 Replace dash by underscore in the command line argument before absl flag parsing.
The expected behavior is to have something similar than python:
https://docs.python.org/dev/library/argparse.html#dest:
"Any internal - characters will be converted to _ characters to make sure the string is a valid attribute name".

This allows to catch chromium arguments like 'isolated-script-test-output' that previously needed some preprocessing done for example in flags_compatibility.py.

This CL also fixes a fuchsia specific issue where the test runner needs a 'isolated-script-test-output' argument but then pass the argument to WebRTC that expects a 'isolated_script_test_output' argument. Thus calling flags_compatibility before the test_runner fails and there is not much room to change the argument in between the test runner and the test.

Change-Id: I48a591743fa50484a0ec584a3f9e97d9e0fd25ef
Bug: webrtc:14694
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/284541
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Reviewed-by: Artem Titov <titovartem@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#38707}
2022-11-22 11:03:33 +00:00