x86 4430 make_distrib build fails

Having problems with building or using CEF's C/C++ APIs? This forum is here to help. Please do not post bug reports or feature requests here.

Re: x86 4430 make_distrib build fails

Postby ndesktop » Fri Apr 23, 2021 12:19 am

My VS2017 previous build (failing on distrib) is using:
Code: Select all
set GN_ARGUMENTS=--ide=vs2017 --sln=cef --filters=//cef/*
set GN_DEFINES=is_official_build=true proprietary_codecs=true ffmpeg_branding=Chrome
set GYP_MSVS_VERSION=2017

I am building now use_thin_lto=false added to GN_DEFINES, now is rebuilding.

In cefclient
Code: Select all
#define CEF_USE_SANDBOX 1
is uncommented.

What I have noticed:
- cefclient's GPU process is crashing 100% launched normally. If using --no-sandbox, cefclient starts normally
- only browser and network service processes are running with sandbox
- make distrib fails as eveyrone else's on combine_libs.py with error 1107 (invalid or corrupt file).
I am placing a lot of LOG(INFO) around GPU various initializations and maybe I will spot something.

It should be something related to sandbox, but I do not know enough about how sandbox inner gore works to emit a non-laughable opinion yet.
If I would bet, I think is a problem related to linking (/llvmlibthin perhaps?) because I see pretty normal things in the debug.log (the one that crashes GPU, with sandbox) and based on the linker error which tells me it might be a disagreement of some kind on linking.
Adding various LOG(INFO) in debug.log in
src\media\gpu\windows\dxva_video_decode_accelerator_win.cc
src\media\capture\video\win\video_capture_device_factory_win.cc
src\content\gpu\gpu_main.cc

Code: Select all
[0422/121150.741:INFO:gpu_process_host.cc(1198)] [8.4.3][GpuProcessHost::LaunchGpuProcess] ok exe_path:C:\cef\90.5.4\chromium\src\out\Release_GN_x86\cefclient.exe
[0422/121150.741:INFO:gpu_process_host.cc(1296)] [8.4.6][GpuProcessHost::LaunchGpuProcess] success, returning true
[0422/121150.741:INFO:gpu_process_host.cc(906)] [8.5][GpuProcessHost::Init] LaunchGpuProcess ok, perform more initializations
[0422/121150.741:INFO:gpu_process_host.cc(946)] [8.6][GpuProcessHost::Init] returns true
[0422/121150.741:INFO:gpu_process_host.cc(593)] [7] host->Init() succeeded, returning host
[0422/121150.741:INFO:gpu_process_host.cc(547)] [1] GpuProcessHost::Get kind=1 force_create=1
[0422/121150.741:INFO:gpu_process_host.cc(555)] [2] GpuProcessHost::Get ok gpu_data_manager->GpuProcessStartAllowed()
[0422/121150.741:INFO:gpu_process_host.cc(570)] [3] GpuProcessHost::Get ok g_gpu_process_hosts[1]
[0422/121150.772:INFO:dxva_video_decode_accelerator_win.cc(1438)] ++ entering DXVAVideoDecodeAccelerator::PreSandboxInitialization
[0422/121150.788:INFO:gpu_process_host.cc(547)] [1] GpuProcessHost::Get kind=1 force_create=0
[0422/121150.788:INFO:gpu_process_host.cc(555)] [2] GpuProcessHost::Get ok gpu_data_manager->GpuProcessStartAllowed()
[0422/121150.788:INFO:gpu_process_host.cc(570)] [3] GpuProcessHost::Get ok g_gpu_process_hosts[1]
[0422/121150.788:INFO:gpu_process_host.cc(547)] [1] GpuProcessHost::Get kind=1 force_create=1
[0422/121150.788:INFO:gpu_process_host.cc(555)] [2] GpuProcessHost::Get ok gpu_data_manager->GpuProcessStartAllowed()
[0422/121150.788:INFO:gpu_process_host.cc(570)] [3] GpuProcessHost::Get ok g_gpu_process_hosts[1]
[0422/121150.788:INFO:gpu_process_host.cc(547)] [1] GpuProcessHost::Get kind=1 force_create=1
[0422/121150.788:INFO:gpu_process_host.cc(555)] [2] GpuProcessHost::Get ok gpu_data_manager->GpuProcessStartAllowed()
[0422/121150.788:INFO:gpu_process_host.cc(570)] [3] GpuProcessHost::Get ok g_gpu_process_hosts[1]
[0422/121150.834:VERBOSE1:network_delegate.cc(32)] NetworkDelegate::NotifyBeforeURLRequest: http://www.google.com/
[0422/121150.850:INFO:gpu_process_host.cc(547)] [1] GpuProcessHost::Get kind=1 force_create=1
[0422/121150.850:INFO:gpu_process_host.cc(555)] [2] GpuProcessHost::Get ok gpu_data_manager->GpuProcessStartAllowed()
[0422/121150.866:INFO:gpu_process_host.cc(570)] [3] GpuProcessHost::Get ok g_gpu_process_hosts[1]
[0422/121150.897:INFO:dxva_video_decode_accelerator_win.cc(1399)] ++ entering DXVAVideoDecodeAccelerator::GetSupportedProfiles
[0422/121150.897:INFO:dxva_video_decode_accelerator_win.cc(1402)] [DXVAVideoDecodeAccelerator::GetSupportedProfiles] mfdll=mf.dll
[0422/121150.897:INFO:dxva_video_decode_accelerator_win.cc(1402)] [DXVAVideoDecodeAccelerator::GetSupportedProfiles] mfdll=mfplat.dll
[0422/121150.897:INFO:dxva_video_decode_accelerator_win.cc(1402)] [DXVAVideoDecodeAccelerator::GetSupportedProfiles] mfdll=msmpeg2vdec.dll
[0422/121151.866:INFO:gpu_process_host.cc(547)] [1] GpuProcessHost::Get kind=1 force_create=0
[0422/121151.866:INFO:gpu_process_host.cc(555)] [2] GpuProcessHost::Get ok gpu_data_manager->GpuProcessStartAllowed()
[0422/121151.867:INFO:gpu_process_host.cc(570)] [3] GpuProcessHost::Get ok g_gpu_process_hosts[1]
...


After this I am preparing also a 2019 community build:
Code: Select all
set GN_ARGUMENTS=--ide=vs2019 --sln=cef --filters=//cef/*
set GN_DEFINES=is_official_build=true proprietary_codecs=true ffmpeg_branding=Chrome use_thin_lto=false
set GYP_MSVS_VERSION=2019


Maybe someone else knowing more and/or familiar with GPU unpleasantries will hopefully push me in the right direction.
ndesktop
Master
 
Posts: 750
Joined: Thu Dec 03, 2015 10:10 am

Re: x86 4430 make_distrib build fails

Postby ndesktop » Fri Apr 23, 2021 1:18 am

Long story short, VS2017 build successful for me.
It was the use_thin_lto=false that was missing from the GN_DEFINES for me, and I suspect for a part (if not all) of the other posters.

My environment:
- Windows 10 x64 Pro
- VS 2017 Community 15.9.35 (default location install)
- Python 2.7.17 x64

Configuration (from .bat file):
set GN_ARGUMENTS=--ide=vs2017 --sln=cef --filters=//cef/*
set GN_DEFINES=is_official_build=true use_thin_lto=false proprietary_codecs=true ffmpeg_branding=Chrome
set GYP_MSVS_VERSION=2017

Build succeeded, GPU process launches normally, with or without --no-sandbox.
Distribution also succeeded, no 1107 error from lib.exe as well.
ndesktop
Master
 
Posts: 750
Joined: Thu Dec 03, 2015 10:10 am

Re: x86 4430 make_distrib build fails

Postby vyunikov » Fri Apr 23, 2021 7:41 am

Thanks for you response, I'll give it a try as well
vyunikov
Newbie
 
Posts: 3
Joined: Wed Apr 21, 2021 1:49 pm

Re: x86 4430 make_distrib build fails

Postby rleblanc » Mon Jul 19, 2021 9:25 am

Hi,

I have the exact same problem with build 4472 on Windows 10.

update.bat:
Code: Select all
set GN_DEFINES=proprietary_codecs=true ffmpeg_branding="Chrome" is_official_build=true use_thin_lto=false

set GN_ARGUMENTS=--ide=vs2019 --sln=cef --filters=//cef/*
python ..\automate\automate-git.py --download-dir=c:\code\chromium_git --depot-tools-dir=c:\code\depot_tools --no-distrib --no-build --branch=4472 --force-config --force-clean


create.bat:
Code: Select all
set GN_DEFINES=proprietary_codecs=true ffmpeg_branding="Chrome" is_official_build=true

REM Use vs2017 or vs2019 as appropriate.
set GN_ARGUMENTS=--ide=vs2019 --sln=cef --filters=//cef/*
call cef_create_projects.bat


Packaging command:
Code: Select all
PS C:\code\chromium_git\chromium\src\cef\tools> set CEF_ARCHIVE_FORMAT=tar.bz2
PS C:\code\chromium_git\chromium\src\cef\tools> ./make_distrib.bat --ninja-build --x64-build


Did anyone find a solution yet?
rleblanc
Newbie
 
Posts: 4
Joined: Mon Jul 19, 2021 9:03 am

Re: x86 4430 make_distrib build fails

Postby magreenblatt » Mon Jul 19, 2021 9:58 am

You need to build before you can make a distribution. Only pass --x64-build if you have created an x64 build.
magreenblatt
Site Admin
 
Posts: 12382
Joined: Fri May 29, 2009 6:57 pm

Re: x86 4430 make_distrib build fails

Postby rleblanc » Mon Jul 19, 2021 10:16 am

magreenblatt wrote:You need to build before you can make a distribution. Only pass --x64-build if you have created an x64 build.


I did build both debug and release x64 versions prior to creating the package.
rleblanc
Newbie
 
Posts: 4
Joined: Mon Jul 19, 2021 9:03 am

Re: x86 4430 make_distrib build fails

Postby magreenblatt » Mon Jul 19, 2021 10:37 am

rleblanc wrote:
magreenblatt wrote:You need to build before you can make a distribution. Only pass --x64-build if you have created an x64 build.


I did build both debug and release x64 versions prior to creating the package.

Your GN_DEFINES don't match for create.bat and update.bat. You're missing use_thin_lto=false from create.bat.
magreenblatt
Site Admin
 
Posts: 12382
Joined: Fri May 29, 2009 6:57 pm

Re: x86 4430 make_distrib build fails

Postby rleblanc » Mon Jul 19, 2021 12:52 pm

Thanks @magreenblatt

When looking at the doc, I had the impression that it was needed only in the update.bat script. I'll give it a try and let you know.
rleblanc
Newbie
 
Posts: 4
Joined: Mon Jul 19, 2021 9:03 am

Re: x86 4430 make_distrib build fails

Postby rleblanc » Thu Jul 22, 2021 7:35 am

For the record, adding the flag use_thin_lto=false in both create.bat and update.bat did the job. It works perfectly fine now.

Thank you!
rleblanc
Newbie
 
Posts: 4
Joined: Mon Jul 19, 2021 9:03 am

Re: x86 4430 make_distrib build fails

Postby ValentinNikin » Wed Aug 11, 2021 11:51 pm

I have the same problem on the 4515 branch.

CEF successfully builded with command
Code: Select all
ninja -C out\Release_GN_x86 cef


When I compile the x64 version, with the same command, not problem met

But when I try to generate archives with binary (please see code below), I got that problem
Code: Select all
set CEF_USE_GN=1
set GN_DEFINES=is_official_build=true proprietary_codecs=true ffmpeg_branding=Chrome
set GN_ARGUMENTS=--ide=vs2019 --sln=cef --filters=//cef/*
set CEF_ARCHIVE_FORMAT=tar.bz2
C:\Users\nikin\AppData\Local\Programs\Python\Python39\python.exe ..\automate\automate-git.py --force-distrib --download-dir=D:\CEF\chromium_git --branch=4515 --minimal-distrib --client-distrib --no-update --no-chromium-update --no-depot-tools-update --no-build --no-debug-build --no-debug-tests --no-release-tests --distrib-subdir=\chromium\src\cef\binary_distrib --depot-tools-dir=D:\CEF\depot_tools


The problem log:
Code: Select all
...
"C:\Program Files (x86)\Microsoft Visual Studio\2019\Community\VC\Auxiliary\Build\vcvars32.bat"
**********************************************************************
** Visual Studio 2019 Developer Command Prompt v16.10.4
** Copyright (c) 2021 Microsoft Corporation
**********************************************************************
[vcvarsall.bat] Environment initialized for: 'x86'
PATH:
C:\Program Files (x86)\Microsoft Visual Studio\2019\Community\Common7\IDE\\Extensions\Microsoft\IntelliCode\CLI;C:\Program Files (x86)\Microsoft Visual Studio\2019\Community\VC\Tools\MSVC\14.29.30037\bin\HostX86\x86;C:\Program Files (x86)\Microsoft Visual Studio\2019\Community\Common7\IDE\VC\VCPackages;C:\Program Files (x86)\Microsoft Visual Studio\2019\Community\Common7\IDE\CommonExtensions\Microsoft\TestWindow;C:\Program Files (x86)\Microsoft Visual Studio\2019\Community\Common7\IDE\CommonExtensions\Microsoft\TeamFoundation\Team Explorer;C:\Program Files (x86)\Microsoft Visual Studio\2019\Community\MSBuild\Current\bin\Roslyn;C:\Program Files (x86)\Microsoft Visual Studio\2019\Community\Team Tools\Performance Tools;C:\Program Files (x86)\Microsoft Visual Studio\Shared\Common\VSPerfCollectionTools\vs2019\;C:\Program Files (x86)\Microsoft SDKs\Windows\v10.0A\bin\NETFX 4.8 Tools\;C:\Program Files (x86)\HTML Help Workshop;C:\Program Files (x86)\Microsoft Visual Studio\2019\Community\Common7\IDE\CommonExtensions\Microsoft\FSharp\Tools;C:\Program Files (x86)\Microsoft Visual Studio\2019\Community\Common7\Tools\devinit;C:\Program Files (x86)\Windows Kits\10\bin\10.0.19041.0\x86;C:\Program Files (x86)\Windows Kits\10\bin\x86;C:\Program Files (x86)\Microsoft Visual Studio\2019\Community\\MSBuild\Current\Bin;C:\Windows\Microsoft.NET\Framework\v4.0.30319;C:\Program Files (x86)\Microsoft Visual Studio\2019\Community\Common7\IDE\;C:\Program Files (x86)\Microsoft Visual Studio\2019\Community\Common7\Tools\;D:\CEF\depot_tools\bootstrap-2@3_8_10_chromium_20_bin\python3\bin;D:\CEF\depot_tools\bootstrap-2@3_8_10_chromium_20_bin\python3\bin\Scripts;D:\CEF\depot_tools;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Windows\System32\OpenSSH\;C:\Program Files\NVIDIA Corporation\NVIDIA NvDLISR;C:\Program Files (x86)\NVIDIA Corporation\PhysX\Common;C:\Program Files\dotnet\;C:\Program Files\Microsoft SQL Server\130\Tools\Binn\;C:\Program Files\Microsoft SQL Server\Client SDK\ODBC\170\Tools\Binn\;C:\Program Files\PuTTY\;C:\Program Files\Git\cmd;C:\Program Files\nodejs\;C:\Program Files\CMake\bin;C:\Program Files (x86)\Windows Kits\10\Windows Performance Toolkit\;C:\Ruby30-x64\bin;C:\Users\nikin\AppData\Local\Microsoft\WindowsApps;C:\Users\nikin\AppData\Local\Programs\Microsoft VS Code\bin;C:\Users\nikin\.dotnet\tools;C:\Users\nikin\AppData\Roaming\npm;C:\Ninja\ninja.exe;C:\Users\nikin\AppData\Local\Programs\Python\Python39\python.exe;C:\CEF\depot_tools;C:\Users\nikin\AppData\Local\Programs\Python\Python39\Scripts;;C:\Program Files\JetBrains\PyCharm Community Edition 2021.2\bin;;C:\Program Files (x86)\Microsoft Visual Studio\2019\Community\Common7\IDE\CommonExtensions\Microsoft\CMake\CMake\bin;C:\Program Files (x86)\Microsoft Visual Studio\2019\Community\Common7\IDE\CommonExtensions\Microsoft\CMake\Ninja;C:\Program Files (x86)\Microsoft Visual Studio\2019\Community\Common7\IDE\VC\Linux\bin\ConnectionManagerExe
command:
D:\CEF\depot_tools\bootstrap-2@3_8_10_chromium_20_bin\python3\bin\python3.exe combine_libs.py -o D:\chromium\src\cef\binary_distrib\Release\cef_sandbox.lib D:\CEF\chromium_git\chromium\src\out\Release_GN_x86\obj\base\base.lib D:\CEF\chromium_git\chromium\src\out\Release_GN_x86\obj\base\base_static.lib D:\CEF\chromium_git\chromium\src\out\Release_GN_x86\obj\base\third_party\double_conversion\double_conversion.lib D:\CEF\chromium_git\chromium\src\out\Release_GN_x86\obj\base\third_party\dynamic_annotations\dynamic_annotations.lib D:\CEF\chromium_git\chromium\src\out\Release_GN_x86\obj\base\win\pe_image.lib D:\CEF\chromium_git\chromium\src\out\Release_GN_x86\obj\cef\cef_sandbox.lib D:\CEF\chromium_git\chromium\src\out\Release_GN_x86\obj\sandbox\win\sandbox.lib
Traceback (most recent call last):
  File "combine_libs.py", line 121, in <module>
    sys.exit(Main())
  File "combine_libs.py", line 116, in Main
    CombineLibraries(output, remove_re, args)
  File "combine_libs.py", line 61, in CombineLibraries
    Shell(*args)
  File "combine_libs.py", line 29, in Shell
    raise RuntimeError('%s exited with status %d' % (args[0], retcode))
RuntimeError: lib.exe exited with status 1107
Traceback (most recent call last):
  File "make_distrib.py", line 908, in <module>
    combine_libs(platform, src_dir, sandbox_libs,
  File "make_distrib.py", line 401, in combine_libs
    run(cmdline, os.path.join(cef_dir, 'tools'))
  File "make_distrib.py", line 438, in run
    return subprocess.check_call(
  File "D:\CEF\depot_tools\bootstrap-2@3_8_10_chromium_20_bin\python3\bin\lib\subprocess.py", line 364, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['msvs_env.bat', 'win32', 'D:\\CEF\\depot_tools\\bootstrap-2@3_8_10_chromium_20_bin\\python3\\bin\\python3.exe', 'combine_libs.py', '-o', 'D:\\chromium\\src\\cef\\binary_distrib\\Release\\cef_sandbox.lib', 'D:\\CEF\\chromium_git\\chromium\\src\\out\\Release_GN_x86\\obj\\base\\base.lib', 'D:\\CEF\\chromium_git\\chromium\\src\\out\\Release_GN_x86\\obj\\base\\base_static.lib', 'D:\\CEF\\chromium_git\\chromium\\src\\out\\Release_GN_x86\\obj\\base\\third_party\\double_conversion\\double_conversion.lib', 'D:\\CEF\\chromium_git\\chromium\\src\\out\\Release_GN_x86\\obj\\base\\third_party\\dynamic_annotations\\dynamic_annotations.lib', 'D:\\CEF\\chromium_git\\chromium\\src\\out\\Release_GN_x86\\obj\\base\\win\\pe_image.lib', 'D:\\CEF\\chromium_git\\chromium\\src\\out\\Release_GN_x86\\obj\\cef\\cef_sandbox.lib', 'D:\\CEF\\chromium_git\\chromium\\src\\out\\Release_GN_x86\\obj\\sandbox\\win\\sandbox.lib']' returned non-zero exit status 1.
Traceback (most recent call last):
  File "D:\CEF\automate\automate-git.py", line 1629, in <module>
    run(path, cef_tools_dir, depot_tools_dir)
  File "D:\CEF\automate\automate-git.py", line 69, in run
    return subprocess.check_call(
  File "C:\Users\nikin\AppData\Local\Programs\Python\Python39\lib\subprocess.py", line 373, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['D:\\CEF\\depot_tools\\python3.bat', 'make_distrib.py', '--output-dir=../binary_distrib/', '--allow-partial', '--ninja-build', '--distrib-subdir=\\chromium\\src\\cef\\binary_distrib']' returned non-zero exit status 1.
ValentinNikin
Techie
 
Posts: 34
Joined: Fri Jun 18, 2021 1:37 am

PreviousNext

Return to Support Forum

Who is online

Users browsing this forum: yutou15 and 36 guests