51 Commits

Author SHA1 Message Date
mbonadei
7b2797e7c7 Including extra_gn_args to log line.
In a recent commit we added --extra-gn-args flag but we forgot to log
the extra_gn_args variable and this can cause useless investigations.

BUG=None
NOTRY=True

Review-Url: https://codereview.webrtc.org/2698613004
Cr-Commit-Position: refs/heads/master@{#16639}
2017-02-16 09:40:59 +00:00
kjellander
1c3548c67c Reland of iOS: Use JSON for GN configuration instead of MB + remove symbols
Reason for revert:
MB is now updated to handle spaces in the buildername properly, something that
only affected our commit bots (not trybots).

Original issue's description:
> Revert of iOS: Use JSON for GN configuration instead of MB + remove symbols (patchset #4 id:80001 of https://codereview.webrtc.org/2688103002/ )
>
> Reason for revert:
> Something is different from trybots vs the commit bots, causing it to fail when running GN:
> https://build.chromium.org/p/client.webrtc/builders/iOS32%20Release/builds/10151
>
> Original issue's description:
> > iOS: Use JSON for GN configuration instead of MB + remove symbols.
> >
> > This aligns with how the ios recipe module is used in Chromium.
> > It should prevent breakages like one we had recently.
> >
> > It also means we're no longer setting symbol_level=1 explicitly.
> > The default is 0 (no symbols), which is now what's being used.
> >
> > Also move all the directories containing JSON files into
> > tools-webrtc/ios/bots to make it clearer (and more similar to
> > Chromium).
> >
> > BUG=webrtc:7140, webrtc:7161
> > NOTRY=True
> >
> > Review-Url: https://codereview.webrtc.org/2688103002
> > Cr-Commit-Position: refs/heads/master@{#16633}
> > Committed: 73f01de4ed
>
> TBR=ehmaldonado@webrtc.org
> # Skipping CQ checks because original CL landed less than 1 days ago.
> NOPRESUBMIT=true
> NOTREECHECKS=true
> NOTRY=true
> BUG=webrtc:7140, webrtc:7161
>
> Review-Url: https://codereview.webrtc.org/2694423002
> Cr-Commit-Position: refs/heads/master@{#16634}
> Committed: 68ab366547

TBR=ehmaldonado@webrtc.org
# Skipping CQ checks because original CL landed less than 1 days ago.
NOPRESUBMIT=true
NOTREECHECKS=true
NOTRY=true
BUG=webrtc:7140, webrtc:7161

Review-Url: https://codereview.webrtc.org/2697133002
Cr-Commit-Position: refs/heads/master@{#16636}
2017-02-16 06:38:22 +00:00
mbonadei
8714b8f1ae Improving parallelism when building with goma
It seems that ninja defaults the number of available CPUs.

BUG=chromium:690916
NOTRY=True

Review-Url: https://codereview.webrtc.org/2691393003
Cr-Commit-Position: refs/heads/master@{#16635}
2017-02-15 21:18:57 +00:00
kjellander
68ab366547 Revert of iOS: Use JSON for GN configuration instead of MB + remove symbols (patchset #4 id:80001 of https://codereview.webrtc.org/2688103002/ )
Reason for revert:
Something is different from trybots vs the commit bots, causing it to fail when running GN:
https://build.chromium.org/p/client.webrtc/builders/iOS32%20Release/builds/10151

Original issue's description:
> iOS: Use JSON for GN configuration instead of MB + remove symbols.
>
> This aligns with how the ios recipe module is used in Chromium.
> It should prevent breakages like one we had recently.
>
> It also means we're no longer setting symbol_level=1 explicitly.
> The default is 0 (no symbols), which is now what's being used.
>
> Also move all the directories containing JSON files into
> tools-webrtc/ios/bots to make it clearer (and more similar to
> Chromium).
>
> BUG=webrtc:7140, webrtc:7161
> NOTRY=True
>
> Review-Url: https://codereview.webrtc.org/2688103002
> Cr-Commit-Position: refs/heads/master@{#16633}
> Committed: 73f01de4ed

TBR=ehmaldonado@webrtc.org
# Skipping CQ checks because original CL landed less than 1 days ago.
NOPRESUBMIT=true
NOTREECHECKS=true
NOTRY=true
BUG=webrtc:7140, webrtc:7161

Review-Url: https://codereview.webrtc.org/2694423002
Cr-Commit-Position: refs/heads/master@{#16634}
2017-02-15 20:45:35 +00:00
kjellander
73f01de4ed iOS: Use JSON for GN configuration instead of MB + remove symbols.
This aligns with how the ios recipe module is used in Chromium.
It should prevent breakages like one we had recently.

It also means we're no longer setting symbol_level=1 explicitly.
The default is 0 (no symbols), which is now what's being used.

Also move all the directories containing JSON files into
tools-webrtc/ios/bots to make it clearer (and more similar to
Chromium).

BUG=webrtc:7140, webrtc:7161
NOTRY=True

Review-Url: https://codereview.webrtc.org/2688103002
Cr-Commit-Position: refs/heads/master@{#16633}
2017-02-15 20:34:03 +00:00
Henrik Kjellander
368b5ffecc Make iOS API Framework script use the src/ dir as cwd for commands.
The recent infra CL https://chromium-review.googlesource.com/c/439266/
seems to have broken our bot. It's better the script
doesn't have any assumptions on cwd when executing.

BUG=None
R=mbonadei@webrtc.org
TBR=mbonadei@webrtc.org

Review-Url: https://codereview.webrtc.org/2695303002 .
Cr-Commit-Position: refs/heads/master@{#16632}
2017-02-15 19:51:26 +00:00
kthelgason
4065a5762b Move iOS tests to XCTest from gtest.
This enables tighter integration with XCode tooling and is a prereq
for adding UI tests.

BUG=webrtc:7150

Review-Url: https://codereview.webrtc.org/2697603002
Cr-Commit-Position: refs/heads/master@{#16609}
2017-02-14 12:58:56 +00:00
oprypin
9b0dbd4438 Support selecting architectures in iOS build script
BUG=webrtc:7127

Review-Url: https://codereview.webrtc.org/2682223004
Cr-Commit-Position: refs/heads/master@{#16587}
2017-02-13 16:30:01 +00:00
ehmaldonado
f6ddbe77cb Fix check_package_boundaries presubmit test for Windows.
BUG=webrtc:6954
NOTRY=True

Review-Url: https://codereview.webrtc.org/2695573003
Cr-Commit-Position: refs/heads/master@{#16581}
2017-02-13 13:18:02 +00:00
mbonadei
585209b36e Adding --use-goma and --extra-gn-args flags to build_ios_libs.py
BUG=chromium:690916
NOTRY=True

Review-Url: https://codereview.webrtc.org/2692443003
Cr-Commit-Position: refs/heads/master@{#16579}
2017-02-13 12:59:27 +00:00
ehmaldonado
5583384048 Pass isolate output dir to gtest-parallel-wrapper.py
This makes it possible to archive all test execution logs on swarming jobs.

R=kjellander@webrtc.org
BUG=webrtc:7086
NOTRY=True

Review-Url: https://codereview.webrtc.org/2686563002
Cr-Commit-Position: refs/heads/master@{#16574}
2017-02-13 11:58:13 +00:00
Henrik Kjellander
5e5a072f2c iOS: Fix breakage caused by buildbot recipe update
Similar changes as in https://codereview.chromium.org/2659123003
Our MB configuration is still the actually used build config for these
bots.

BUG=686304
TBR=smut@google.com

Review-Url: https://codereview.webrtc.org/2685813003 .
Cr-Commit-Position: refs/heads/master@{#16486}
2017-02-08 11:04:20 +00:00
sakal
a53d4e7b4f Reduce parallel jobs in build_aar.py to 200 when building with goma.
Previously we were using 1024 parallel jobs. This is too much when
running on bots.

BUG=webrtc:7023
R=kjellander@webrtc.org
NOTRY=True

Review-Url: https://codereview.webrtc.org/2679123002
Cr-Commit-Position: refs/heads/master@{#16469}
2017-02-07 14:19:20 +00:00
sakal
1959b63b61 Remove Assert lint suppression.
BUG=webrtc:6597
NOTRY=True

Review-Url: https://codereview.webrtc.org/2668963002
Cr-Commit-Position: refs/heads/master@{#16460}
2017-02-07 09:41:47 +00:00
kjellander
6b3fcfd823 Add support for extra GN args to Android build script.
By using the --extra-gn-args flag, it is now possible to
specify additional GN arguments for the build. This is needed
in order to pass a non-default Goma directory (needed for the bots).
Example use: --extra-gn-args goma_dir=\"/path/to/goma\"
You can also pass multiple args (separated by spaces).

BUG=chromium:684387
NOTRY=True
TESTED=Did a local successful run.

Review-Url: https://codereview.webrtc.org/2670743004
Cr-Commit-Position: refs/heads/master@{#16458}
2017-02-07 09:11:06 +00:00
oprypin
7a2d8ca9bc Rewrite iOS FAT libraries build script in Python
BUG=webrtc:7049

Review-Url: https://codereview.webrtc.org/2662513004
Cr-Commit-Position: refs/heads/master@{#16453}
2017-02-06 15:53:41 +00:00
sakal
cb789bb510 Remove NewApi lint suppression.
BUG=webrtc:6597

Review-Url: https://codereview.webrtc.org/2662273004
Cr-Commit-Position: refs/heads/master@{#16448}
2017-02-06 13:34:26 +00:00
oprypin
873fcb958f Drop the check for stray mobileprovision (no longer needed)
BUG=webrtc:7049

Review-Url: https://codereview.webrtc.org/2676233002
Cr-Commit-Position: refs/heads/master@{#16444}
2017-02-06 11:43:58 +00:00
sakal
f7826d668a Remove InlinedApi lint ignore.
Adds ignore for all lint errors in Chromium code. Changes minimum SDK for
instrumentation tests to 16 from 14. Adds TargetApi annotations.

BUG=webrtc:6597

Review-Url: https://codereview.webrtc.org/2670473004
Cr-Commit-Position: refs/heads/master@{#16412}
2017-02-02 08:53:33 +00:00
philipel
a7ee14ebf5 Suppress Memcheck:Uninitialized error when printing rtc::optional.
BUG=chromium:687087, webrtc:6822
NOTRY=True

Review-Url: https://codereview.webrtc.org/2669463003
Cr-Commit-Position: refs/heads/master@{#16372}
2017-01-31 10:45:54 +00:00
ehmaldonado
4fb97462a8 Add presubmit check to prevent package boundary violations.
BUG=webrtc:6954
NOTRY=True

Review-Url: https://codereview.webrtc.org/2629723004
Cr-Commit-Position: refs/heads/master@{#16357}
2017-01-30 13:27:22 +00:00
Henrik Kjellander
284acf6eeb Disable VideoSendStreamTest.RemoveOverheadFromBandwidth for memcheck
This fails so often it's blocking rolling DEPS.

BUG=webrtc:6886
TBR=minyue@webrtc.org

Review-Url: https://codereview.webrtc.org/2655293004 .
Cr-Commit-Position: refs/heads/master@{#16312}
2017-01-27 07:31:49 +00:00
Mirko Bonadei
736871c7a8 No op changelist test
BUG=None
TBR=kjellander@webrtc.org

Review-Url: https://codereview.webrtc.org/2647353010 .
Cr-Commit-Position: refs/heads/master@{#16303}
2017-01-26 16:27:31 +00:00
Mirko Bonadei
b0dd784cba Fixing path to be compliant with new location
BUG=webrtc:7030
TBR=kjellander@webrtc.org

Review-Url: https://codereview.webrtc.org/2657943005 .
Cr-Commit-Position: refs/heads/master@{#16297}
2017-01-26 13:52:27 +00:00
Mirko Bonadei
ad524d66d3 Moving build/ios to tools-webrtc/ios
BUG=webrtc:7030
NOTRY=True
R=kjellander@webrtc.org

Review-Url: https://codereview.webrtc.org/2651973002 .
Cr-Commit-Position: refs/heads/master@{#16295}
2017-01-26 13:20:05 +00:00
mbonadei
26764613ad Moving build_aar.py to new location
We are moving the whole content of "webrtc/build" to new
locations (see crbug.com/611808 for further information).

The new location for the "webrtc/build/android" stuff is
"tools-webrtc/android".

BUG=webrtc:7030

Review-Url: https://codereview.webrtc.org/2647343006
Cr-Commit-Position: refs/heads/master@{#16269}
2017-01-25 15:42:08 +00:00
Mirko Bonadei
b63a8ac5da Moving gn_isolate_map.pyl to tools-webrtc/mb
BUG=webrtc:7030
R=kjellander@webrtc.org

Review-Url: https://codereview.webrtc.org/2648353004 .
Cr-Commit-Position: refs/heads/master@{#16262}
2017-01-25 08:36:50 +00:00
mbonadei
630f46a31e Moving adb_shell script to tools-webrtc
BUG=webrtc:7030

Review-Url: https://codereview.webrtc.org/2650653005
Cr-Commit-Position: refs/heads/master@{#16260}
2017-01-25 07:49:13 +00:00
mbonadei
18e83ea598 Moving sanitizers from build/ to base/
We have to move the content of the 'webrtc/build/' directory up of one level (see crbug.com/611808 for further details).

To avoid a collision with the DEPSed build/ at the top level we are moving all the content of 'webrtc/build/' to different locations (see webrtc:7030 for the suggested locations).

BUG=webrtc:7030
NOTRY=True

Review-Url: https://codereview.webrtc.org/2651913002
Cr-Commit-Position: refs/heads/master@{#16259}
2017-01-25 07:04:51 +00:00
mandermo
e6b4723790 Statically linked zxing. Without dependency on libMagick
BUG=webrtc:6633
NOTRY=True

Review-Url: https://codereview.webrtc.org/2653903002
Cr-Commit-Position: refs/heads/master@{#16243}
2017-01-24 13:02:35 +00:00
mbonadei
822d2586fb Move webrtc/build/android -> tools-webrtc/android
BUG=webrtc:7030

Review-Url: https://codereview.webrtc.org/2649883004
Cr-Commit-Position: refs/heads/master@{#16239}
2017-01-24 12:22:11 +00:00
mbonadei
ad452287b0 Moving get_landmines.py (build/ -> tools-webrtc/)
BUG=webrtc:7030
NOTRY=True

Review-Url: https://codereview.webrtc.org/2656553002
Cr-Commit-Position: refs/heads/master@{#16227}
2017-01-24 08:01:49 +00:00
Henrik Kjellander
f81d8efb24 Promote iOS Simulator 9.0 bot to main waterfall.
Rename existing iOS Simulator bots to match the new one.
Buildbot changes: https://chromium-review.googlesource.com/423055

BUG=chromium:677385
TBR=ehmaldonado@webrtc.org

Review-Url: https://codereview.webrtc.org/2601353003 .
Cr-Commit-Position: refs/heads/master@{#15842}
2016-12-30 07:26:24 +00:00
kjellander
957c1817b0 MB: Enable optimize_for_fuzzing=true for libfuzzer builds.
Build with this enabled since that's what Chromium bots do:
https://cs.chromium.org/chromium/src/build/config/compiler/BUILD.gn?rcl=0&l=89

BUG=chromium:677261
R=pbos@webrtc.org
NOTRY=True

Review-Url: https://codereview.webrtc.org/2604003002
Cr-Commit-Position: refs/heads/master@{#15838}
2016-12-29 20:25:53 +00:00
Henrik Kjellander
81fa52ff44 Change iOS Simulator bot to 32-bit and iPhone 5.
Before promoting it to the main waterfall I thought it made
sense to ensure it works for a phone that actually is 32-bit
(iPhone 6s isn't). It also makes more sense to run the older
iOS version (9) on the older phone.

BUG=chromium:677385
TBR=ehmaldonado@webrtc.org

Review-Url: https://codereview.webrtc.org/2604203002 .
Cr-Commit-Position: refs/heads/master@{#15837}
2016-12-29 20:01:38 +00:00
Henrik Kjellander
34203b4255 MB: Add symbol_level=2 to new Win ASan bot.
Hopefully that will give better error traces than just a memory
address upon failure.

BUG=chromium:677380
TBR=ehmaldonado@webrtc.org

Review-Url: https://codereview.webrtc.org/2604163002 .
Cr-Commit-Position: refs/heads/master@{#15830}
2016-12-29 09:45:08 +00:00
Henrik Kjellander
1f971427e8 Add iOS64 simulator bot running on iOS 9.0 simulator.
Add a new trybot configuration as well.

BUG=chromium:677385
TBR=ehmaldonado@webrtc.org

Review-Url: https://codereview.webrtc.org/2604153002 .
Cr-Commit-Position: refs/heads/master@{#15829}
2016-12-29 08:31:05 +00:00
Henrik Kjellander
7a7da3c6c1 MB: Replace Win SyzyASan bot with a Clang ASan bot in client.webrtc.fyi
BUG=chromium:677380
TBR=ehmaldonado@webrtc.org

Review-Url: https://codereview.webrtc.org/2609513002 .
Cr-Commit-Position: refs/heads/master@{#15827}
2016-12-29 06:54:55 +00:00
Henrik Kjellander
bee671297a MB: Add libfuzzer bots.
BUG=chromium:677261
TBR=ehmaldonado@webrtc.org

Review-Url: https://codereview.webrtc.org/2598363004 .
Cr-Commit-Position: refs/heads/master@{#15816}
2016-12-28 10:40:30 +00:00
Henrik Kjellander
91ef546a79 MB: Update moved bots from .fyi to .perf waterfall
BUG=None
TBR=ehmaldonado@webrtc.org

Review-Url: https://codereview.webrtc.org/2598363002 .
Cr-Commit-Position: refs/heads/master@{#15800}
2016-12-27 08:01:18 +00:00
Henrik Kjellander
f3115a043e Update Valgrind location after we stopped checking out Chromium.
The changes in https://codereview.webrtc.org/2594363002 contained
incorrect paths.

BUG=webrtc:5006
TBR=ehmaldonado@webrtc.org

Review-Url: https://codereview.webrtc.org/2605533002 .
Cr-Commit-Position: refs/heads/master@{#15772}
2016-12-23 20:45:30 +00:00
Henrik Kjellander
49d2f26859 Update Valgrind location after we stopped checking out Chromium.
BUG=webrtc:5006
TBR=ehmaldonado@webrtc.org

Review-Url: https://codereview.webrtc.org/2594363002 .
Cr-Commit-Position: refs/heads/master@{#15755}
2016-12-22 10:30:01 +00:00
kjellander@webrtc.org
177567c518 DEPS: Sync Git subtree mirrors instead of symlinking into chromium/src
This changes the way we pull in dependencies WebRTC shares with
Chromium. The base, build, tools and third_party directories from
Chromium are now synced as Git subtree mirrors in the DEPS file.

All symlinks to directories that were previously created by the
setup_links.py are replaced with proper DEPS entries.

One downside with this solution is that we get a lot of directories
in tools/ and third_party/ that we currently don't use. Going forward
it might be possible to improve this but as long as the BUILD.gn files
are stored in the Chromium repo rather at each dependency's repo,
this will be very cumbersome.

The DEPS file will be kept auto-rolled by the script in
https://chromium.googlesource.com/external/webrtc/+/master/tools-webrtc/autoroller/roll_deps.py
which is periodically executed by a bot.

This change brings back the Google Play Services download for Android,
which displays a license confirmation dialog to the user at the first sync.
By running it as a proper hook instead of inside sync_chromium.py, the
problems with that the interactive prompt gets hidden/stuck should be
fixed (now the behavior is identical to Chromium).

Some measurements on the size savings for a clean, newly created checkout:
Linux: 15GB -> 6.4GB (-8.6GB)
Linux (with Android): 25 GB -> 16 GB (-9GB). 8.4GB of this is Android SDK+NDK.
Mac (with iOS): 14 GB -> 5.6GB (-8.4GB)

Note that for all of the above, 1GB is occupied by the resources/ dir.

BUG=webrtc:5006, webrtc:5578
NOTRY=True
R=agable@chromium.org, henrika@webrtc.org, iannucci@chromium.org

Review-Url: https://codereview.webrtc.org/1414343008 .
Cr-Commit-Position: refs/heads/master@{#15754}
2016-12-22 09:40:28 +00:00
mbonadei
235d5cca4a Fixing relative paths and adding a docstring
BUG=webrtc:6828
NOTRY=True

Review-Url: https://codereview.webrtc.org/2589223002
Cr-Commit-Position: refs/heads/master@{#15714}
2016-12-20 15:19:18 +00:00
Henrik Kjellander
9547033637 Move tools/{msan,ubsan} -> tools-webrtc/
After landing https://codereview.chromium.org/2580313002/ in
Chromium and rolled it in, this is now possible.

BUG=webrtc:5006
TBR=charujain@webrtc.org
NOTRY=True

Review-Url: https://codereview.webrtc.org/2589093002 .
Cr-Commit-Position: refs/heads/master@{#15695}
2016-12-20 07:04:25 +00:00
Henrik Kjellander
b2d5577caf Move tools/mb -> tools-webrtc/mb
In addition to moving tools/mb -> tools-webrtc/mb, also
move webrtc/build/mb_config.pyl into tools-webrtc/mb
to match the default location better.
Remove Chromium-specific check for 'mb validate' that failed
due to doing this (we never cleaned that when we forked the code).

BUG=webrtc:5006
TBR=ehmaldonado@webrtc.org
NOTRY=True
TESTED=Manually ran:
tools-webrtc/mb/mb.py gen -m client.webrtc -b 'iOS64 Release' --config-file tools-webrtc/mb/mb_config.pyl  //out/Release-iphoneos
tools-webrtc/mb/mb.py gen -m client.webrtc -b 'Mac64 Release' --config-file tools-webrtc/mb/mb_config.pyl  //out/Release-mac

Review-Url: https://codereview.webrtc.org/2585743002 .
Cr-Commit-Position: refs/heads/master@{#15664}
2016-12-18 21:14:50 +00:00
kjellander
afd5494455 Move tools/valgrind-webrtc -> tools-webrtc/valgrind
The WebRTC valgrind wrapper scripts needs to be moved in order to
unlock us from depending on a Chromium checkout.

BUG=webrtc:5006
TBR=ehmaldonado@webrtc.org
NOTRY=True

Review-Url: https://codereview.webrtc.org/2578093002
Cr-Commit-Position: refs/heads/master@{#15662}
2016-12-17 20:21:39 +00:00
Andrii Shyshkalov
9a272059c2 whitespace by manual git cl land.
Cr-Commit-Position: refs/heads/master@{#15645}
2016-12-16 10:00:45 +00:00
tandrii
2d897bd31b CQ whitespace.
NOTRY=True
NOPRESUBMIT=True
NOTREECHECKS=True
TBR=kjellander@webrtc.org
BUG=

Review-Url: https://codereview.webrtc.org/2585683003
Cr-Commit-Position: refs/heads/master@{#15644}
2016-12-16 09:59:35 +00:00
Henrik Kjellander
24db179bbf Move tools/autoroller to tools-webrtc/ + rename script
The script is now capable of rolling more than the chromium_revision
so the name should reflect that.

BUG=webrtc:5006
TBR=charujain@webrtc.org

Review-Url: https://codereview.webrtc.org/2581493003 .
Cr-Commit-Position: refs/heads/master@{#15624}
2016-12-15 09:20:22 +00:00