Blink web tests (a.k.a. layout tests)
We continuously run Blink’s web tests (formerly known as “layout tests”) on our FYI waterfall to prevent integration problems with Chromium.
On test failures, the bots compare the results of V8 Tip-of-Tree with Chromium’s pinned V8 version, to only flag newly introduced V8 problems (with false positives < 5%). Blame assignment is trivial as the Linux release bot tests all revisions.
Commits with newly-introduced failures are normally reverted to unblock auto-rolling into Chromium. In case you notice you break layout tests or your commit gets reverted because of such breakage, and in case the changes are expected, follow this procedure to add updated baselines to Chromium before (re-)landing your CL:
- Land a Chromium change setting
[ Failure Pass ]for the changed tests (more).
- Land your V8 CL and wait 1-2 days until it cycles into Chromium.
- Follow these instructions to manually generate the new baselines. Note that if you’re making changes only to Chromium, this preferred automatic procedure should work for you.
- Remove the
[ Failure Pass ]entry from the test expectations file and commit it along with the new baselines in Chromium.
Please associate all CLs with a