Error building CEF branch on macOS

[sjames1958]

I made sure and get the latest version of automate-git.py and ran this:

python ./automate-git.py --download-dir=. --x64-build --branch=4324

The build appears to work getting the CEF clone fine but the chromium clone gets all sorts of errors.

HEAD is now at 5c8711aa6 Update to Chromium version 88.0.4324.182
--> Reading /Users/sjames/CEF/build/cef/CHROMIUM_BUILD_COMPATIBILITY.txt
-------- Running "git checkout 55e9ddf219" in "/Users/sjames/CEF/build/depot_tools"...
Previous HEAD position was 36de4be9 presubmit: Use code-owners plugin if available.
HEAD is now at 55e9ddf2 Roll recipe dependencies (trivial).
--> CEF Output Directory: /Users/sjames/CEF/build/out_4324
--> Creating directory /Users/sjames/CEF/build/chromium
--> Writing /Users/sjames/CEF/build/chromium/.gclient
-------- Running "gclient sync --nohooks --with_branch_heads --jobs 16" in "/Users/sjames/CEF/build/chromium"...

________ running 'git -c core.deltaBaseCacheLimit=2g clone --no-checkout --progress https://chromium.googlesource.com/chromium/src.git /Users/sjames/CEF/build/chromium/_gclient_src_0oqhxu9l' in '/Users/sjames/CEF/build/chromium'
Cloning into '/Users/sjames/CEF/build/chromium/_gclient_src_0oqhxu9l'...
remote: Sending approximately 25.10 GiB ...
remote: Counting objects: 425763, done
remote: Finding sources: 100% (2397/2397)
error: RPC failed; curl 56 LibreSSL SSL_read: SSL_ERROR_SYSCALL, errno 60
fatal: the remote end hung up unexpectedly
fatal: early EOF
fatal: index-pack failed
1>WARNING: subprocess '"git" "-c" "core.deltaBaseCacheLimit=2g" "clone" "--no-checkout" "--progress" "https://chromium.googlesource.com/chromium/src.git" "/Users/sjames/CEF/build/chromium/_gclient_src_0oqhxu9l"' in /Users/sjames/CEF/build/chromium failed; will retry after a short nap...

________ running 'git -c core.deltaBaseCacheLimit=2g clone --no-checkout --progress https://chromium.googlesource.com/chromium/src.git /Users/sjames/CEF/build/chromium/_gclient_src_0oqhxu9l' in '/Users/sjames/CEF/build/chromium' attempt 2 / 4
Cloning into '/Users/sjames/CEF/build/chromium/_gclient_src_0oqhxu9l'...
fatal: unable to access 'https://chromium.googlesource.com/chromium/src.git/': Could not resolve host: chromium.googlesource.com
1>WARNING: subprocess '"git" "-c" "core.deltaBaseCacheLimit=2g" "clone" "--no-checkout" "--progress" "https://chromium.googlesource.com/chromium/src.git" "/Users/sjames/CEF/build/chromium/_gclient_src_0oqhxu9l"' in /Users/sjames/CEF/build/chromium failed; will retry after a short nap...

________ running 'git -c core.deltaBaseCacheLimit=2g clone --no-checkout --progress https://chromium.googlesource.com/chromium/src.git /Users/sjames/CEF/build/chromium/_gclient_src_0oqhxu9l' in '/Users/sjames/CEF/build/chromium' attempt 3 / 4
Cloning into '/Users/sjames/CEF/build/chromium/_gclient_src_0oqhxu9l'...
fatal: unable to access 'https://chromium.googlesource.com/chromium/src.git/': Could not resolve host: chromium.googlesource.com
1>WARNING: subprocess '"git" "-c" "core.deltaBaseCacheLimit=2g" "clone" "--no-checkout" "--progress" "https://chromium.googlesource.com/chromium/src.git" "/Users/sjames/CEF/build/chromium/_gclient_src_0oqhxu9l"' in /Users/sjames/CEF/build/chromium failed; will retry after a short nap...

________ running 'git -c core.deltaBaseCacheLimit=2g clone --no-checkout --progress https://chromium.googlesource.com/chromium/src.git /Users/sjames/CEF/build/chromium/_gclient_src_0oqhxu9l' in '/Users/sjames/CEF/build/chromium' attempt 4 / 4
Cloning into '/Users/sjames/CEF/build/chromium/_gclient_src_0oqhxu9l'...
remote: Sending approximately 22.69 GiB ...
remote: Counting objects: 425932, done
remote: Finding sources: 100% (2566/2566)
error: RPC failed; curl 56 LibreSSL SSL_read: SSL_ERROR_SYSCALL, errno 60
fatal: the remote end hung up unexpectedly
fatal: early EOF
fatal: index-pack failed
1>WARNING: subprocess '"git" "-c" "core.deltaBaseCacheLimit=2g" "clone" "--no-checkout" "--progress" "https://chromium.googlesource.com/chromium/src.git" "/Users/sjames/CEF/build/chromium/_gclient_src_0oqhxu9l"' in /Users/sjames/CEF/build/chromium failed; will retry after a short nap...
Syncing projects: 100% ( 1/ 1) src
src (ERROR)
----------------------------------------
[0:00:00] Started.
[0:00:00]
Traceback (most recent call last):
File "/Users/sjames/CEF/build/depot_tools/gclient_scm.py", line 1043, in _Clone
self._Run(clone_cmd, options, cwd=self._root_dir, retry=True,
File "/Users/sjames/CEF/build/depot_tools/gclient_scm.py", line 1411, in _Run
gclient_utils.CheckCallAndFilter(cmd, env=env, **kwargs)
File "/Users/sjames/CEF/build/depot_tools/gclient_utils.py", line 673, in CheckCallAndFilter
raise subprocess2.CalledProcessError(
subprocess2.CalledProcessError: Command 'git -c core.deltaBaseCacheLimit=2g clone --no-checkout --progress https://chromium.googlesource.com/chromium/src.git /Users/sjames/CEF/build/chromium/_gclient_src_0oqhxu9l' returned non-zero exit status 128 in /Users/sjames/CEF/build/chromium
[0:44:51] _____ Conflicting directory found in /Users/sjames/CEF/build/chromium/src. Moving to /Users/sjames/CEF/build/chromium/_bad_scm/srclxns30it.
----------------------------------------

[magreenblatt]

Looks like network errors. You can run the script again to resume, or try a clean checkout.

[sjames1958]

Thx for the response - I should have realized that those were network issues. I have gotten past that issue now I am getting

python ./automate-git.py --download-dir=. --x64-build --branch=4280 --no-debug-build --no-update --force-build

Code: Select all


File include/cef_config.h is already up to date.
--> /Users/sjames/CEF/build/chromium/src/out/Release_GN_x64/args.gn contents:
chrome_pgo_phase=0
clang_use_chrome_plugins=false
enable_background_mode=false
enable_basic_printing=true
enable_dsyms=true
enable_nacl=false
enable_print_preview=true
enable_resource_allowlist_generation=false
enable_widevine=true
forbid_non_component_debug_builds=false
is_component_build=false
is_debug=false
optimize_webui=true
target_cpu="x64"
-------- Running "ninja -C out/Release_GN_x64 cefclient" in "/Users/sjames/CEF/build/chromium/src"...
ninja: Entering directory `out/Release_GN_x64'
[513/41444] ACTION //third_party/blink/renderer/core:make_core_generated_css_primitive_value_unit_trie(//build/toolchain/mac:clang_x64)
FAILED: gen/third_party/blink/renderer/core/css/css_primitive_value_unit_trie.cc
python ../../third_party/blink/renderer/build/scripts/run_with_pythonpath.py -I ../../third_party/blink/renderer/build/scripts -I ../../third_party -I ../../tools ../../third_party/blink/renderer/build/scripts/core/css/make_css_primitive_value_unit_trie.py ../../third_party/blink/renderer/core/css/css_primitive_value_units.json5 --output_dir gen/third_party/blink/renderer/core/css
Traceback (most recent call last):
  File "../../third_party/blink/renderer/build/scripts/core/css/make_css_primitive_value_unit_trie.py", line 34, in <module>
    json5_generator.Maker(UnitTrieWriter).main()
  File "/Users/sjames/CEF/build/chromium/src/third_party/blink/renderer/build/scripts/json5_generator.py", line 339, in main
    writer.write_files(args.output_dir)
  File "/Users/sjames/CEF/build/chromium/src/third_party/blink/renderer/build/scripts/json5_generator.py", line 304, in write_files
    self._write_file_if_changed(output_dir, generator(), file_name)
  File "/Users/sjames/CEF/build/chromium/src/third_party/blink/renderer/build/scripts/template_expander.py", line 69, in generator_internal
    return apply_template(
  File "/Users/sjames/CEF/build/chromium/src/third_party/blink/renderer/build/scripts/template_expander.py", line 62, in apply_template
    return template.render(params)
  File "/Users/sjames/CEF/build/chromium/src/third_party/jinja2/asyncsupport.py", line 76, in render
    return original_render(self, *args, **kwargs)
  File "/Users/sjames/CEF/build/chromium/src/third_party/jinja2/environment.py", line 1008, in render
    return self.environment.handle_exception(exc_info, True)
  File "/Users/sjames/CEF/build/chromium/src/third_party/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/Users/sjames/CEF/build/chromium/src/third_party/jinja2/_compat.py", line 37, in reraise
    raise value.with_traceback(tb)
  File "/Users/sjames/CEF/build/chromium/src/third_party/blink/renderer/build/scripts/core/css/templates/css_primitive_value_unit_trie.cc.tmpl", line 20, in <module>
    {{ trie_length_switch(length_tries, trie_return_statement, True) | indent(4) }}
  File "/Users/sjames/CEF/build/chromium/src/third_party/jinja2/runtime.py", line 579, in _invoke
    rv = self._func(*arguments)
  File "/Users/sjames/CEF/build/chromium/src/third_party/blink/renderer/build/scripts/templates/macros.tmpl", line 70, in <module>
    {{ trie_switch(trie, 0, return_macro, lowercase_data) | indent(4) }}
  File "/Users/sjames/CEF/build/chromium/src/third_party/jinja2/runtime.py", line 579, in _invoke
    rv = self._func(*arguments)
  File "/Users/sjames/CEF/build/chromium/src/third_party/blink/renderer/build/scripts/templates/macros.tmpl", line 58, in <module>
    {{ trie_switch(value, index + 1, return_macro, lowercase_data) | indent(4) }}
  File "/Users/sjames/CEF/build/chromium/src/third_party/jinja2/runtime.py", line 579, in _invoke
    rv = self._func(*arguments)
  File "/Users/sjames/CEF/build/chromium/src/third_party/blink/renderer/build/scripts/templates/macros.tmpl", line 58, in <module>
    {{ trie_switch(value, index + 1, return_macro, lowercase_data) | indent(4) }}
  File "/Users/sjames/CEF/build/chromium/src/third_party/jinja2/runtime.py", line 579, in _invoke
    rv = self._func(*arguments)
  File "/Users/sjames/CEF/build/chromium/src/third_party/blink/renderer/build/scripts/templates/macros.tmpl", line 58, in <module>
    {{ trie_switch(value, index + 1, return_macro, lowercase_data) | indent(4) }}
  File "/Users/sjames/CEF/build/chromium/src/third_party/jinja2/runtime.py", line 579, in _invoke
    rv = self._func(*arguments)
  File "/Users/sjames/CEF/build/chromium/src/third_party/blink/renderer/build/scripts/templates/macros.tmpl", line 56, in <module>
    {% for char, value in trie.items()|sort %}
jinja2.exceptions.UndefinedError: 'str object' has no attribute 'items'
[526/41444] ACTION //third_party/blink/renderer/bindings:web_idl_database(//build/toolchain/mac:clang_x64)
FAILED: gen/third_party/blink/renderer/bindings/web_idl_database.pickle
python ../../third_party/blink/renderer/bindings/scripts/build_web_idl_database.py --output gen/third_party/blink/renderer/bindings/web_idl_database.pickle --runtime_enabled_features ../../third_party/blink/renderer/platform/runtime_enabled_features.json5 -- gen/third_party/blink/renderer/bindings/web_idl_in_core.pickle gen/third_party/blink/renderer/bindings/web_idl_in_core_for_testing.pickle gen/third_party/blink/renderer/bindings/web_idl_in_modules.pickle gen/third_party/blink/renderer/bindings/web_idl_in_modules_for_testing.pickle
Traceback (most recent call last):
  File "../../third_party/blink/renderer/bindings/scripts/build_web_idl_database.py", line 61, in <module>
    main()
  File "../../third_party/blink/renderer/bindings/scripts/build_web_idl_database.py", line 51, in main
    database = web_idl.build_database(
  File "/Users/sjames/CEF/build/chromium/src/third_party/blink/renderer/bindings/scripts/web_idl/database_builder.py", line 31, in build_database
    load_and_register_idl_definitions(
  File "/Users/sjames/CEF/build/chromium/src/third_party/blink/renderer/bindings/scripts/web_idl/ir_builder.py", line 60, in load_and_register_idl_definitions
    register_ir(builder.build_top_level_def(top_level_node))
  File "/Users/sjames/CEF/build/chromium/src/third_party/blink/renderer/bindings/scripts/web_idl/ir_builder.py", line 96, in build_top_level_def
    ir = build_functions[node.GetClass()](node)
  File "/Users/sjames/CEF/build/chromium/src/third_party/blink/renderer/bindings/scripts/web_idl/ir_builder.py", line 360, in _build_callback_function
    arguments = self._take_arguments(child_nodes)
  File "/Users/sjames/CEF/build/chromium/src/third_party/blink/renderer/bindings/scripts/web_idl/ir_builder.py", line 1106, in _take_arguments
    return self._take_and_build('Arguments', self._build_arguments,
  File "/Users/sjames/CEF/build/chromium/src/third_party/blink/renderer/bindings/scripts/web_idl/ir_builder.py", line 1102, in _take_and_build
    return build_func(node, **kwargs)
  File "/Users/sjames/CEF/build/chromium/src/third_party/blink/renderer/bindings/scripts/web_idl/ir_builder.py", line 427, in _build_arguments
    return [
  File "/Users/sjames/CEF/build/chromium/src/third_party/blink/renderer/bindings/scripts/web_idl/ir_builder.py", line 428, in <listcomp>
    build_argument(node, i)
  File "/Users/sjames/CEF/build/chromium/src/third_party/blink/renderer/bindings/scripts/web_idl/ir_builder.py", line 413, in build_argument
    idl_type = self._take_type(
  File "/Users/sjames/CEF/build/chromium/src/third_party/blink/renderer/bindings/scripts/web_idl/ir_builder.py", line 1146, in _take_type
    return self._take_and_build('Type', self._build_type, node_list,
  File "/Users/sjames/CEF/build/chromium/src/third_party/blink/renderer/bindings/scripts/web_idl/ir_builder.py", line 1102, in _take_and_build
    return build_func(node, **kwargs)
  File "/Users/sjames/CEF/build/chromium/src/third_party/blink/renderer/bindings/scripts/web_idl/ir_builder.py", line 800, in _build_type
    idl_type = self._build_type_internal(
  File "/Users/sjames/CEF/build/chromium/src/third_party/blink/renderer/bindings/scripts/web_idl/ir_builder.py", line 924, in _build_type_internal
    return build_functions[body_node.GetClass()](
  File "/Users/sjames/CEF/build/chromium/src/third_party/blink/renderer/bindings/scripts/web_idl/ir_builder.py", line 840, in build_union_type
    return self._idl_type_factory.union_type(
  File "/Users/sjames/CEF/build/chromium/src/third_party/blink/renderer/bindings/scripts/web_idl/idl_type.py", line 117, in union_type
    return self._create(UnionType, args, kwargs)
  File "/Users/sjames/CEF/build/chromium/src/third_party/blink/renderer/bindings/scripts/web_idl/idl_type.py", line 124, in _create
    idl_type = idl_type_concrete_class(
  File "/Users/sjames/CEF/build/chromium/src/third_party/blink/renderer/bindings/scripts/web_idl/idl_type.py", line 1130, in __init__
    assert isinstance(member_types, (list, tuple))
AssertionError
ninja: build stopped: subcommand failed.
Traceback (most recent call last):
  File "./automate-git.py", line 1504, in <module>
    run(command + build_path + target, chromium_src_dir, depot_tools_dir,
  File "./automate-git.py", line 69, in run
    return subprocess.check_call(
  File "/Users/sjames/.pyenv/versions/3.8.1/lib/python3.8/subprocess.py", line 364, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['ninja', '-C', 'out/Release_GN_x64', 'cefclient']' returned non-zero exit status 1.


[magreenblatt]

What MacOS and python versions are you using?

[sjames1958]

macOS 10.15.7
python --version
Python 3.8.1

[sdiverdi]

I just tried building CEF for the first time in a month and got a build error. In the last month I'd installed anaconda and was using the anaconda-installed python 3.8.1 instead of the system default python 2.7.16. I'm building now with the system python (turned off anaconda) and got past the build error. So give that a shot (if you have a different system config, you could use anaconda or other virtual env to set up a local python 2.7.16). I'm also on osx 10.15.7.

[sjames1958]

Thanks - Trying that now.

[sjames1958]

Dropping back to Python 2.7.18 allowed the build to succeed.