(view as text)
What is the "Bot Update" step?
==============================
This step ensures that the source checkout on the bot (e.g. Chromium's src/ and
its dependencies) is checked out in a consistent state. This means that all of
the necessary repositories are checked out, no extra repositories are checked
out, and no locally modified files are present.
These actions used to be taken care of by the "gclient revert" and "update"
steps. However, those steps are known to be buggy and occasionally flaky. This
step has two main advantages over them:
* it only operates in Git, so the logic can be clearer and cleaner; and
* it is a slave-side script, so its behavior can be modified without
restarting the master.
Why Git, you ask? Because that is the direction that the Chromium project is
heading. This step is an integral part of the transition from using the SVN repo
at chrome/trunk/src to using the Git repo src.git. Please pardon the dust while
we fully convert everything to Git. This message will get out of your way
eventually, and the waterfall will be a happier place because of it.
This step can be activated or deactivated independently on every builder on
every master. When it is active, the "gclient revert" and "update" steps become
no-ops. When it is inactive, it prints this message, cleans up after itself, and
lets everything else continue as though nothing has changed. Eventually, when
everything is stable enough, this step will replace them entirely.
Debugging information:
(master/builder/slave may be unspecified on recipes)
master: chromium.mac
builder: iOS Device (ninja)
slave: mini43-a1
forced by recipes: N/A. Was not called by recipes
bot_update.py is: ACTIVE.
The bot will perform a Git checkout in this step.
The "gclient revert" and "update" steps are no-ops.
Gclient Solutions
=================
src (https://chromium.googlesource.com/chromium/src.git)
Dependencies file is .DEPS.git
Managed mode is OFF
Custom Variables:
googlecode_url = svn://svn-mirror.golo.chromium.org/%s
llvm_url = svn://svn-mirror.golo.chromium.org/llvm-project
nacl_trunk = svn://svn-mirror.golo.chromium.org/native_client/trunk
sourceforge_url = svn://svn-mirror.golo.chromium.org/%(repo)s
webkit_trunk = svn://svn-mirror.golo.chromium.org/blink/trunk
Custom Dependencies:
src/third_party/WebKit/LayoutTests: Ignore
src-internal (https:/chrome-internal.googlesource.com/chrome/src-internal.git)
Dependencies file is .DEPS.git
Managed mode is OFF
Custom Dependencies:
src/chrome/test/data/firefox2_profile/searchplugins: Ignore
src/chrome/test/data/firefox2_searchplugins: Ignore
src/chrome/test/data/firefox3_profile/searchplugins: Ignore
src/chrome/test/data/firefox3_searchplugins: Ignore
src/chrome/test/data/osdd: Ignore
src/chrome/test/data/ssl/certs: Ignore
src/data/autodiscovery: Ignore
src/data/esctf: Ignore
src/data/mach_ports: Ignore
src/data/memory_test: Ignore
src/data/mozilla_js_tests: Ignore
src/data/page_cycler: Ignore
src/data/selenium_core: Ignore
src/tools/grit/grit/test/data: Ignore
src/webkit/data/bmp_decoder: Ignore
src/webkit/data/ico_decoder: Ignore
src/webkit/data/test_shell/plugins: Ignore
src/webkit/data/xbm_decoder: Ignore
===Running /Library/Frameworks/Python.framework/Versions/2.7/Resources/Python.app/Contents/MacOS/python -u /b/depot_tools/third_party/gsutil/gsutil mv gs://chrome-bot-update/chromium.mac/iOS Device (ninja)/mini43-a1/start.json gs://chrome-bot-update/chromium.mac/iOS Device (ninja)/mini43-a1/start_old.json===
deleting /b/build/slave/iOS_Device__ninja_/build/src... done
deleting /b/build/slave/iOS_Device__ninja_/build/src-internal... done
Emitting flag file at /b/build/slave/iOS_Device__ninja_/build/update.flag
@@@STEP_TEXT@[181GB/464GB used (39%)]@@@
Revisions: ['272801']
Fetching Git checkout at src@272801
Fetching Git checkout
===Running /Library/Frameworks/Python.framework/Versions/2.7/Resources/Python.app/Contents/MacOS/python -u /b/depot_tools/git_cache.py unlock -vv --force --all --cache-dir /b/build/slave/cache_dir===
===Succeeded in 0.0 mins===
===Running /Library/Frameworks/Python.framework/Versions/2.7/Resources/Python.app/Contents/MacOS/python -u /b/depot_tools/git_cache.py populate -v --cache-dir /b/build/slave/cache_dir https://chromium.googlesource.com/chromium/src.git===
running "git config core.deltaBaseCacheLimit 2g" in "/b/build/slave/cache_dir/chromium.googlesource.com-chromium-src"
Copying gs://chrome-bot-update/chromium.mac/iOS Device (ninja)/mini43-a1/start.json...
running "git config remote.origin.url https://chromium.googlesource.com/chromium/src.git" in "/b/build/slave/cache_dir/chromium.googlesource.com-chromium-src"
running "git config --replace-all remote.origin.fetch +refs/heads/*:refs/heads/*" in "/b/build/slave/cache_dir/chromium.googlesource.com-chromium-src"
running "git fetch -v --progress origin +refs/heads/*:refs/heads/*" in "/b/build/slave/cache_dir/chromium.googlesource.com-chromium-src"
Removing gs://chrome-bot-update/chromium.mac/iOS Device (ninja)/mini43-a1/start.json...
===Succeeded in 0.0 mins===
===Running /Library/Frameworks/Python.framework/Versions/2.7/Resources/Python.app/Contents/MacOS/python -u /b/depot_tools/third_party/gsutil/gsutil mv gs://chrome-bot-update/chromium.mac/iOS Device (ninja)/mini43-a1/end.json gs://chrome-bot-update/chromium.mac/iOS Device (ninja)/mini43-a1/end_old.json===
InvalidUriError: Attempt to get key for "gs://chrome-bot-update/chromium.mac/iOS Device
(ninja)/mini43-a1/end.json" failed. This can happen if the URI refers to a non-
existent object or if you meant to operate on a directory (e.g., leaving off -R
option on gsutil cp, mv, or ls of a bucket).
===Failed in 0.0 mins===
===Running /Library/Frameworks/Python.framework/Versions/2.7/Resources/Python.app/Contents/MacOS/python -u /b/depot_tools/third_party/gsutil/gsutil mv gs://chrome-bot-update/chromium.mac/iOS Device (ninja)/mini43-a1/end.json gs://chrome-bot-update/chromium.mac/iOS Device (ninja)/mini43-a1/end_old.json (retry #1)===
InvalidUriError: Attempt to get key for "gs://chrome-bot-update/chromium.mac/iOS Device
(ninja)/mini43-a1/end.json" failed. This can happen if the URI refers to a non-
existent object or if you meant to operate on a directory (e.g., leaving off -R
option on gsutil cp, mv, or ls of a bucket).
===Failed in 0.0 mins===
===Running /Library/Frameworks/Python.framework/Versions/2.7/Resources/Python.app/Contents/MacOS/python -u /b/depot_tools/third_party/gsutil/gsutil mv gs://chrome-bot-update/chromium.mac/iOS Device (ninja)/mini43-a1/end.json gs://chrome-bot-update/chromium.mac/iOS Device (ninja)/mini43-a1/end_old.json (retry #2)===
InvalidUriError: Attempt to get key for "gs://chrome-bot-update/chromium.mac/iOS Device
(ninja)/mini43-a1/end.json" failed. This can happen if the URI refers to a non-
existent object or if you meant to operate on a directory (e.g., leaving off -R
option on gsutil cp, mv, or ls of a bucket).
===Failed in 0.0 mins===
Could not move end -> end_old! SubprocessFailed('/Library/Frameworks/Python.framework/Versions/2.7/Resources/Python.app/Contents/MacOS/python -u /b/depot_tools/third_party/gsutil/gsutil mv gs://chrome-bot-update/chromium.mac/iOS Device (ninja)/mini43-a1/end.json gs://chrome-bot-update/chromium.mac/iOS Device (ninja)/mini43-a1/end_old.json failed with code 1 in /b/build/slave/iOS_Device__ninja_/build after 3 attempts.',)
===Running /Library/Frameworks/Python.framework/Versions/2.7/Resources/Python.app/Contents/MacOS/python -u /b/depot_tools/third_party/gsutil/gsutil cp - gs://chrome-bot-update/chromium.mac/iOS Device (ninja)/mini43-a1/start.json===
Copying from <STDIN> [Content-Type=application/octet-stream]...
Uploading: 0.0 B
Uploading: 4.5 KB
===Succeeded in 0.0 mins===
From https://chromium.googlesource.com/a/chromium/src
= [up to date] git-svn -> git-svn
= [up to date] lkcr -> lkcr
= [up to date] lkgr -> lkgr
= [up to date] master -> master
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
Nothing new to pack.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
===Succeeded in 3.3 mins===
===Running /Library/Frameworks/Python.framework/Versions/2.7/Resources/Python.app/Contents/MacOS/python -u /b/depot_tools/git_cache.py exists --quiet --cache-dir /b/build/slave/cache_dir https://chromium.googlesource.com/chromium/src.git===
/b/build/slave/cache_dir/chromium.googlesource.com-chromium-src
===Succeeded in 0.0 mins===
===Running git clone --local --shared /b/build/slave/cache_dir/chromium.googlesource.com-chromium-src /b/build/slave/iOS_Device__ninja_/build/src===
Cloning into '/b/build/slave/iOS_Device__ninja_/build/src'...
done.
Checking connectivity... Checking out files: 4% (2467/61647)
Checking out files: 4% (2857/61647)
Checking out files: 5% (3083/61647)
Checking out files: 6% (3699/61647)
Checking out files: 6% (4253/61647)
Checking out files: 7% (4316/61647)
Checking out files: 8% (4932/61647)
Checking out files: 8% (5201/61647)
Checking out files: 9% (5549/61647)
Checking out files: 10% (6165/61647)
Checking out files: 10% (6771/61647)
Checking out files: 11% (6782/61647)
Checking out files: 12% (7398/61647)
Checking out files: 13% (8015/61647)
Checking out files: 14% (8631/61647)
Checking out files: 15% (9248/61647)
Checking out files: 15% (9695/61647)
Checking out files: 16% (9864/61647)
Checking out files: 17% (10480/61647)
Checking out files: 18% (11097/61647)
Checking out files: 19% (11713/61647)
Checking out files: 20% (12330/61647)
Checking out files: 20% (12378/61647)
Checking out files: 21% (12946/61647)
Checking out files: 22% (13563/61647)
Checking out files: 23% (14179/61647)
Checking out files: 23% (14737/61647)
Checking out files: 24% (14796/61647)
Checking out files: 25% (15412/61647)
Checking out files: 26% (16029/61647)
Checking out files: 27% (16645/61647)
Checking out files: 28% (17262/61647)
Checking out files: 28% (17598/61647)
Checking out files: 29% (17878/61647)
Checking out files: 30% (18495/61647)
Checking out files: 31% (19111/61647)
Checking out files: 31% (19662/61647)
Checking out files: 32% (19728/61647)
Checking out files: 33% (20344/61647)
Checking out files: 34% (20960/61647)
Checking out files: 34% (21104/61647)
Checking out files: 35% (21577/61647)
Checking out files: 36% (22193/61647)
Checking out files: 37% (22810/61647)
Checking out files: 38% (23426/61647)
Checking out files: 39% (24043/61647)
Checking out files: 39% (24468/61647)
Checking out files: 40% (24659/61647)
Checking out files: 41% (25276/61647)
Checking out files: 42% (25892/61647)
Checking out files: 42% (26290/61647)
Checking out files: 43% (26509/61647)
Checking out files: 43% (26652/61647)
Checking out files: 43% (26885/61647)
Checking out files: 44% (27125/61647)
Checking out files: 45% (27742/61647)
Checking out files: 46% (28358/61647)
Checking out files: 46% (28928/61647)
Checking out files: 47% (28975/61647)
Checking out files: 48% (29591/61647)
Checking out files: 49% (30208/61647)
Checking out files: 50% (30824/61647)
Checking out files: 51% (31440/61647)
Checking out files: 51% (31449/61647)
Checking out files: 52% (32057/61647)
Checking out files: 53% (32673/61647)
Checking out files: 54% (33290/61647)
Checking out files: 55% (33906/61647)
Checking out files: 56% (34523/61647)
Checking out files: 56% (35132/61647)
Checking out files: 57% (35139/61647)
Checking out files: 58% (35756/61647)
Checking out files: 59% (36372/61647)
Checking out files: 60% (36989/61647)
Checking out files: 60% (37203/61647)
Checking out files: 61% (37605/61647)
Checking out files: 62% (38222/61647)
Checking out files: 63% (38838/61647)
Checking out files: 63% (38853/61647)
Checking out files: 64% (39455/61647)
Checking out files: 65% (40071/61647)
Checking out files: 66% (40688/61647)
Checking out files: 66% (40789/61647)
Checking out files: 67% (41304/61647)
Checking out files: 68% (41920/61647)
Checking out files: 69% (42537/61647)
Checking out files: 70% (43153/61647)
Checking out files: 70% (43181/61647)
Checking out files: 71% (43770/61647)
Checking out files: 72% (44386/61647)
Checking out files: 73% (45003/61647)
Checking out files: 74% (45619/61647)
Checking out files: 75% (46236/61647)
Checking out files: 75% (46475/61647)
Checking out files: 76% (46852/61647)
Checking out files: 77% (47469/61647)
Checking out files: 78% (48085/61647)
Checking out files: 79% (48702/61647)
Checking out files: 80% (49318/61647)
Checking out files: 80% (49630/61647)
Checking out files: 81% (49935/61647)
Checking out files: 82% (50551/61647)
Checking out files: 83% (51168/61647)
Checking out files: 84% (51784/61647)
Checking out files: 84% (51901/61647)
Checking out files: 85% (52400/61647)
Checking out files: 86% (53017/61647)
Checking out files: 87% (53633/61647)
Checking out files: 87% (53980/61647)
Checking out files: 88% (54250/61647)
Checking out files: 89% (54866/61647)
Checking out files: 90% (55483/61647)
Checking out files: 91% (56099/61647)
Checking out files: 92% (56716/61647)
Checking out files: 93% (57332/61647)
Checking out files: 93% (57345/61647)
Checking out files: 94% (57949/61647)
Checking out files: 95% (58565/61647)
Checking out files: 96% (59182/61647)
Checking out files: 97% (59798/61647)
Checking out files: 97% (60097/61647)
Checking out files: 98% (60415/61647)
Checking out files: 98% (60620/61647)
Checking out files: 99% (61031/61647)
Checking out files: 100% (61647/61647)
Checking out files: 100% (61647/61647), done.
done
===Succeeded in 2.0 mins===
===Running git checkout --force origin/master===
Note: checking out 'origin/master'.
You are in 'detached HEAD' state. You can look around, make experimental
changes and commit them, and you can discard any commits you make in this
state without impacting any branches by performing another checkout.
If you want to create a new branch to retain commits you create, you may
do so (now or later) by using -b with the checkout command again. Example:
git checkout -b new_branch_name
HEAD is now at 9d5010f... Land a whitespace change to force the bots to cycle.
===Succeeded in 0.0 mins===
===Running git reset --hard===
HEAD is now at 9d5010f Land a whitespace change to force the bots to cycle.
===Succeeded in 0.0 mins===
===Running git clean -df===
===Succeeded in 0.0 mins===
===Running git fetch origin===
===Succeeded in 0.0 mins===
===Running git log -E --grep ^git-svn-id: [^ ]*@272801 --format=%H --max-count=1 origin/master===
9d5010f91b6029955613c73d7560aa4bc5a962c0
===Succeeded in 0.0 mins===
===Running git checkout 9d5010f91b6029955613c73d7560aa4bc5a962c0===
HEAD is now at 9d5010f... Land a whitespace change to force the bots to cycle.
===Succeeded in 0.0 mins===
===Running git log --format=%H --max-count=1===
9d5010f91b6029955613c73d7560aa4bc5a962c0
===Succeeded in 0.0 mins===
===Running /Library/Frameworks/Python.framework/Versions/2.7/Resources/Python.app/Contents/MacOS/python -u /b/depot_tools/git_cache.py populate -v --cache-dir /b/build/slave/cache_dir https:/chrome-internal.googlesource.com/chrome/src-internal.git===
running "git config core.deltaBaseCacheLimit 2g" in "/b/build/slave/cache_dir/-chrome--internal.googlesource.com-chrome-src--internal"
running "git config remote.origin.url https:/chrome-internal.googlesource.com/chrome/src-internal.git" in "/b/build/slave/cache_dir/-chrome--internal.googlesource.com-chrome-src--internal"
running "git config --replace-all remote.origin.fetch +refs/heads/*:refs/heads/*" in "/b/build/slave/cache_dir/-chrome--internal.googlesource.com-chrome-src--internal"
running "git fetch -v --progress origin +refs/heads/*:refs/heads/*" in "/b/build/slave/cache_dir/-chrome--internal.googlesource.com-chrome-src--internal"
ssh: Could not resolve hostname https: nodename nor servname provided, or not known
fatal: Could not read from remote repository.
Please make sure you have the correct access rights
and the repository exists.
WARNING: subprocess '"git" "fetch" "-v" "--progress" "origin" "+refs/heads/*:refs/heads/*"' in /b/build/slave/cache_dir/-chrome--internal.googlesource.com-chrome-src--internal failed; will retry after a short nap...
ssh: Could not resolve hostname https: nodename nor servname provided, or not known
fatal: Could not read from remote repository.
Please make sure you have the correct access rights
and the repository exists.
WARNING: subprocess '"git" "fetch" "-v" "--progress" "origin" "+refs/heads/*:refs/heads/*"' in /b/build/slave/cache_dir/-chrome--internal.googlesource.com-chrome-src--internal failed; will retry after a short nap...
ssh: Could not resolve hostname https: nodename nor servname provided, or not known
fatal: Could not read from remote repository.
Please make sure you have the correct access rights
and the repository exists.
WARNING: subprocess '"git" "fetch" "-v" "--progress" "origin" "+refs/heads/*:refs/heads/*"' in /b/build/slave/cache_dir/-chrome--internal.googlesource.com-chrome-src--internal failed; will retry after a short nap...
ssh: Could not resolve hostname https: nodename nor servname provided, or not known
fatal: Could not read from remote repository.
Please make sure you have the correct access rights
and the repository exists.
WARNING: subprocess '"git" "fetch" "-v" "--progress" "origin" "+refs/heads/*:refs/heads/*"' in /b/build/slave/cache_dir/-chrome--internal.googlesource.com-chrome-src--internal failed; will retry after a short nap...
WARNING:root:Fetch of +refs/heads/*:refs/heads/* failed
===Succeeded in 0.2 mins===
===Running /Library/Frameworks/Python.framework/Versions/2.7/Resources/Python.app/Contents/MacOS/python -u /b/depot_tools/git_cache.py exists --quiet --cache-dir /b/build/slave/cache_dir https:/chrome-internal.googlesource.com/chrome/src-internal.git===
/b/build/slave/cache_dir/-chrome--internal.googlesource.com-chrome-src--internal
===Succeeded in 0.0 mins===
===Running git clone --local --shared /b/build/slave/cache_dir/-chrome--internal.googlesource.com-chrome-src--internal /b/build/slave/iOS_Device__ninja_/build/src-internal===
Cloning into '/b/build/slave/iOS_Device__ninja_/build/src-internal'...
warning: You appear to have cloned an empty repository.
done.
Checking connectivity... done
===Succeeded in 0.0 mins===
===Running git checkout --force origin/master===
error: pathspec 'origin/master' did not match any file(s) known to git.
===Failed in 0.0 mins===
===Running git checkout --force origin/master (retry #1)===
error: pathspec 'origin/master' did not match any file(s) known to git.
===Failed in 0.0 mins===
===Running git checkout --force origin/master (retry #2)===
error: pathspec 'origin/master' did not match any file(s) known to git.
===Failed in 0.0 mins===
Traceback (most recent call last):
File "../../../scripts/slave/bot_update.py", line 1453, in <module>
sys.exit(main())
File "../../../scripts/slave/bot_update.py", line 1400, in main
gclient_output = ensure_checkout(**checkout_parameters)
File "../../../scripts/slave/bot_update.py", line 1033, in ensure_checkout
git_ref = git_checkout(solutions, revisions, shallow)
File "../../../scripts/slave/bot_update.py", line 807, in git_checkout
git('checkout', '--force', 'origin/master', cwd=sln_dir)
File "../../../scripts/slave/bot_update.py", line 399, in git
return call(*cmd, **kwargs)
File "../../../scripts/slave/bot_update.py", line 384, in call
(' '.join(args), code, os.getcwd(), tries), code)
__main__.SubprocessFailed: git checkout --force origin/master failed with code 1 in /b/build/slave/iOS_Device__ninja_/build after 3 attempts.