Cannot build on Windows 10

[chaoming0625]

I cannot build JAX in my windows, no matter I "enable" or "disable" CUDA:

python .\build\build.py

The error result:

(base) D:\codes\github\ComputationFramework\jax>python build/build.py

     _   _  __  __
    | | / \ \ \/ /
 _  | |/ _ \ \  /
| |_| / ___ \/  \
 \___/_/   \/_/\_\


Bazel binary path: D:\softwares\bazel\bazel.EXE
Python binary path: C:/Users/adadu/Miniconda3/python.exe
Python version: 3.8
NumPy version: 1.20.2
SciPy version: 1.6.3
MKL-DNN enabled: yes
Target CPU features: release
CUDA enabled: no
TPU enabled: no
ROCm enabled: no

Building XLA and installing it in the jaxlib source tree...
D:\softwares\bazel\bazel.EXE run --verbose_failures=true --config=short_logs --config=mkl_open_source_only :build_wheel -- --output_path=D:\codes\github\ComputationFramework\jax\dist
INFO: Options provided by the client:
  Inherited 'common' options: --isatty=1 --terminal_columns=80
INFO: Reading rc options for 'run' from d:\codes\github\computationframework\jax\.bazelrc:
  Inherited 'common' options: --experimental_repo_remote_exec
INFO: Options provided by the client:
  Inherited 'build' options: --python_path=C:/Users/adadu/Miniconda3/python.exe
INFO: Reading rc options for 'run' from d:\codes\github\computationframework\jax\.bazelrc:
  Inherited 'build' options: --repo_env PYTHON_BIN_PATH=C:/Users/adadu/Miniconda3/python.exe --action_env=PYENV_ROOT --python_path=C:/Users/adadu/Miniconda3/python.exe --repo_env TF_NEED_CUDA=0 --action_env TF_CUDA_COMPUTE_CAPABILITIES=3.5,5.2,6.0,6.1,7.0 --repo_env TF_NEED_ROCM=0 --action_env TF_ROCM_AMDGPU_TARGETS=gfx803,gfx900,gfx906,gfx1010 --distinct_host_configuration=false -c opt --apple_platform_type=macos --macos_minimum_os=10.9 --announce_rc --define open_source_build=true --define=no_kafka_support=true --define=no_ignite_support=true --define=grpc_no_ares=true --spawn_strategy=standalone --strategy=Genrule=standalone --enable_platform_specific_config
INFO: Found applicable config definition build:short_logs in file d:\codes\github\computationframework\jax\.bazelrc: --output_filter=DONT_MATCH_ANYTHING
INFO: Found applicable config definition build:mkl_open_source_only in file d:\codes\github\computationframework\jax\.bazelrc: --define=tensorflow_mkldnn_contraction_kernel=1
INFO: Found applicable config definition build:windows in file d:\codes\github\computationframework\jax\.bazelrc: --copt=/D_USE_MATH_DEFINES --host_copt=/D_USE_MATH_DEFINES --copt=-DWIN32_LEAN_AND_MEAN --host_copt=-DWIN32_LEAN_AND_MEAN --copt=-DNOGDI --host_copt=-DNOGDI --copt=/Zc:preprocessor --cxxopt=/std:c++14 --host_cxxopt=/std:c++14 --linkopt=/DEBUG --host_linkopt=/DEBUG --linkopt=/OPT:REF --host_linkopt=/OPT:REF --linkopt=/OPT:ICF --host_linkopt=/OPT:ICF --experimental_strict_action_env=true
DEBUG: C:/users/adadu/_bazel_adadu/gj4czwcy/external/tf_runtime/third_party/cuda/dependencies.bzl:51:10: The following command will download NVIDIA proprietary software. By using the software you agree to comply with the terms of the license agreement that accompanies the software. If you do not agree to the terms of the license agreement, do not use the software.
INFO: Build options --@local_config_cuda//:enable_cuda, --action_env, --copt, and 3 more have changed, discarding analysis cache.
INFO: Repository llvm-project instantiated at:
  D:/codes/github/computationframework/jax/WORKSPACE:30:10: in <toplevel>
  C:/users/adadu/_bazel_adadu/gj4czwcy/external/org_tensorflow/tensorflow/workspace2.bzl:1097:21: in workspace
  C:/users/adadu/_bazel_adadu/gj4czwcy/external/org_tensorflow/tensorflow/workspace2.bzl:656:9: in _tf_repositories
  C:/users/adadu/_bazel_adadu/gj4czwcy/external/org_tensorflow/third_party/llvm/workspace.bzl:10:20: in repo
  C:/users/adadu/_bazel_adadu/gj4czwcy/external/org_tensorflow/third_party/repo.bzl:112:21: in tf_http_archive
Repository rule _tf_http_archive defined at:
  C:/users/adadu/_bazel_adadu/gj4czwcy/external/org_tensorflow/third_party/repo.bzl:65:35: in <toplevel>
WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/llvm/llvm-project/archive/eb6429d0fb94fd467e03d229177ae6ff3a44e3cc.tar.gz failed: class com.google.devtools.build.lib.bazel.repository.downloader.UnrecoverableHttpException GET returned 404 Not Found
WARNING: Download from https://github.com/llvm/llvm-project/archive/eb6429d0fb94fd467e03d229177ae6ff3a44e3cc.tar.gz failed: class java.io.IOException connect timed out
ERROR: An error occurred during the fetch of repository 'llvm-project':
   Traceback (most recent call last):
        File "C:/users/adadu/_bazel_adadu/gj4czwcy/external/org_tensorflow/third_party/repo.bzl", line 52, column 33, in _tf_http_archive_impl
                ctx.download_and_extract(
Error in download_and_extract: java.io.IOException: Error downloading [https://storage.googleapis.com/mirror.tensorflow.org/github.com/llvm/llvm-project/archive/eb6429d0fb94fd467e03d229177ae6ff3a44e3cc.tar.gz, https://github.com/llvm/llvm-project/archive/eb6429d0fb94fd467e03d229177ae6ff3a44e3cc.tar.gz] to C:/users/adadu/_bazel_adadu/gj4czwcy/external/llvm-project/temp1300579595705264524/eb6429d0fb94fd467e03d229177ae6ff3a44e3cc.tar.gz: connect timed out
ERROR: Error fetching repository: Traceback (most recent call last):
        File "C:/users/adadu/_bazel_adadu/gj4czwcy/external/org_tensorflow/third_party/repo.bzl", line 52, column 33, in _tf_http_archive_impl
                ctx.download_and_extract(
Error in download_and_extract: java.io.IOException: Error downloading [https://storage.googleapis.com/mirror.tensorflow.org/github.com/llvm/llvm-project/archive/eb6429d0fb94fd467e03d229177ae6ff3a44e3cc.tar.gz, https://github.com/llvm/llvm-project/archive/eb6429d0fb94fd467e03d229177ae6ff3a44e3cc.tar.gz] to C:/users/adadu/_bazel_adadu/gj4czwcy/external/llvm-project/temp1300579595705264524/eb6429d0fb94fd467e03d229177ae6ff3a44e3cc.tar.gz: connect timed out
INFO: Repository pocketfft instantiated at:
  D:/codes/github/computationframework/jax/WORKSPACE:24:10: in <toplevel>
  D:/codes/github/computationframework/jax/third_party/pocketfft/workspace.bzl:20:17: in repo
Repository rule http_archive defined at:
  C:/users/adadu/_bazel_adadu/gj4czwcy/external/bazel_tools/tools/build_defs/repo/http.bzl:336:31: in <toplevel>
ERROR: C:/users/adadu/_bazel_adadu/gj4czwcy/external/tf_runtime/BUILD:222:16: @tf_runtime//:support depends on @llvm-project//llvm:Support in repository @llvm-project which failed to fetch. no such package '@llvm-project//llvm': java.io.IOException: Error downloading [https://storage.googleapis.com/mirror.tensorflow.org/github.com/llvm/llvm-project/archive/eb6429d0fb94fd467e03d229177ae6ff3a44e3cc.tar.gz, https://github.com/llvm/llvm-project/archive/eb6429d0fb94fd467e03d229177ae6ff3a44e3cc.tar.gz] to C:/users/adadu/_bazel_adadu/gj4czwcy/external/llvm-project/temp1300579595705264524/eb6429d0fb94fd467e03d229177ae6ff3a44e3cc.tar.gz: connect timed out
ERROR: Analysis of target '//build:build_wheel' failed; build aborted: Analysis failed
INFO: Elapsed time: 66.826s
INFO: 0 processes.
FAILED: Build did NOT complete successfully (161 packages loaded, 7513 targets\
FAILED: Build did NOT complete successfully (161 packages loaded, 7513 targets\
 configured)
Traceback (most recent call last):
  File "build/build.py", line 560, in <module>
  File "build/build.py", line 555, in main
  File "build/build.py", line 51, in shell
  File "C:\Users\adadu\Miniconda3\lib\subprocess.py", line 415, in check_output
    return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
  File "C:\Users\adadu\Miniconda3\lib\subprocess.py", line 516, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['D:\\softwares\\bazel\\bazel.EXE', 'run', '--verbose_failures=true', '--config=short_logs', '--config=mkl_open_source_only', ':build_wheel', '--', '--output_path=D:\\codes\\github\\ComputationFramework\\jax\\dist']' returned non-zero exit status 1.

Can anyone help me?

[jakevdp]

Issue #6637 is a fairly active thread on this topic; you might find some ideas there.

[adam-hartshorne]

There are still major issues, and has been for several releases now.

[jakevdp]

Agreed, but that issue is the main place where such things are being discussed.

[chaoming0625]

Thanks for your help. I still cannot build JAX on my windows 10.

python .\build\build.py  --enable_cuda --cuda_path="C:/Program Files/NVIDIA GPU Computing Toolkit/CUDA/v11.0"  --cudnn_path="C:/Program Files/NVIDIA GPU Computing Toolkit/CUDA/v11.0"   --cuda_compute_capabilities=5.2  --cuda_version=11.0  --cudnn_version=8.1.1  --noenable_rocm --noenable_tpu

It output:

(py39) D:\codes\github\ComputationFramework\jax>python .\build\build.py  --enable_cuda --cuda_path="C:/Program Files/NVIDIA GPU Computing Toolkit/CUDA/v11.0"  --cudnn_path="C:/Program Files/NVIDIA GPU Computing Toolkit/CUDA/v11.0"   --cuda_compute_capabilities=5.2  --cuda_version=11.0  --cudnn_version=8.1.1  --noenable_rocm --noenable_tpu

     _   _  __  __
    | | / \ \ \/ /
 _  | |/ _ \ \  /
| |_| / ___ \/  \
 \___/_/   \/_/\_\


Bazel binary path: D:\softwares\bazel\bazel.EXE
Python binary path: C:/Users/adadu/Miniconda3/envs/py39/python.exe
Python version: 3.9
NumPy version: 1.20.2
SciPy version: 1.6.2
MKL-DNN enabled: yes
Target CPU features: release
CUDA enabled: yes
CUDA toolkit path: C:/Program Files/NVIDIA GPU Computing Toolkit/CUDA/v11.0
CUDNN library path: C:/Program Files/NVIDIA GPU Computing Toolkit/CUDA/v11.0
CUDA compute capabilities: 5.2
CUDA version: 11.0
CUDNN version: 8.1.1
TPU enabled: no
ROCm enabled: no

Building XLA and installing it in the jaxlib source tree...
D:\softwares\bazel\bazel.EXE run --verbose_failures=true --config=short_logs --config=mkl_open_source_only --config=cuda --define=xla_python_enable_gpu=true :build_wheel -- --output_path=D:\codes\github\ComputationFramework\jax\dist
INFO: Options provided by the client:
  Inherited 'common' options: --isatty=1 --terminal_columns=80
INFO: Reading rc options for 'run' from d:\codes\github\computationframework\jax\.bazelrc:
  Inherited 'common' options: --experimental_repo_remote_exec
INFO: Options provided by the client:
  Inherited 'build' options: --python_path=C:/Users/adadu/Miniconda3/envs/py39/python.exe
INFO: Reading rc options for 'run' from d:\codes\github\computationframework\jax\.bazelrc:
  Inherited 'build' options: --repo_env PYTHON_BIN_PATH=C:/Users/adadu/Miniconda3/envs/py39/python.exe --action_env=PYENV_ROOT --python_path=C:/Users/adadu/Miniconda3/envs/py39/python.exe --repo_env TF_NEED_CUDA=1 --action_env TF_CUDA_COMPUTE_CAPABILITIES=5.2 --repo_env TF_NEED_ROCM=0 --action_env TF_ROCM_AMDGPU_TARGETS=gfx803,gfx900,gfx906,gfx1010 --distinct_host_configuration=false -c opt --apple_platform_type=macos --macos_minimum_os=10.9 --announce_rc --define open_source_build=true --define=no_kafka_support=true --define=no_ignite_support=true --define=grpc_no_ares=true --spawn_strategy=standalone --strategy=Genrule=standalone --enable_platform_specific_config --action_env CUDA_TOOLKIT_PATH=C:/Program Files/NVIDIA GPU Computing Toolkit/CUDA/v11.0 --action_env CUDNN_INSTALL_PATH=C:/Program Files/NVIDIA GPU Computing Toolkit/CUDA/v11.0 --action_env TF_CUDA_VERSION=11.0 --action_env TF_CUDNN_VERSION=8.1.1
INFO: Found applicable config definition build:short_logs in file d:\codes\github\computationframework\jax\.bazelrc: --output_filter=DONT_MATCH_ANYTHING
INFO: Found applicable config definition build:mkl_open_source_only in file d:\codes\github\computationframework\jax\.bazelrc: --define=tensorflow_mkldnn_contraction_kernel=1
INFO: Found applicable config definition build:cuda in file d:\codes\github\computationframework\jax\.bazelrc: --crosstool_top=@local_config_cuda//crosstool:toolchain --@local_config_cuda//:enable_cuda
INFO: Found applicable config definition build:windows in file d:\codes\github\computationframework\jax\.bazelrc: --copt=/D_USE_MATH_DEFINES --host_copt=/D_USE_MATH_DEFINES --copt=-DWIN32_LEAN_AND_MEAN --host_copt=-DWIN32_LEAN_AND_MEAN --copt=-DNOGDI --host_copt=-DNOGDI --copt=/Zc:preprocessor --cxxopt=/std:c++14 --host_cxxopt=/std:c++14 --linkopt=/DEBUG --host_linkopt=/DEBUG --linkopt=/OPT:REF --host_linkopt=/OPT:REF --linkopt=/OPT:ICF --host_linkopt=/OPT:ICF --experimental_strict_action_env=true
DEBUG: C:/users/adadu/_bazel_adadu/gj4czwcy/external/tf_runtime/third_party/cuda/dependencies.bzl:51:10: The following command will download NVIDIA proprietary software. By using the software you agree to comply with the terms of the license agreement that accompanies the software. If you do not agree to the terms of the license agreement, do not use the software.
INFO: Build option --copt has changed, discarding analysis cache.
INFO: Analyzed target //build:build_wheel (0 packages loaded, 16798 targets configured).
INFO: Found 1 target...
ERROR: D:/codes/github/computationframework/jax/jaxlib/BUILD:350:17: Compiling jaxlib/cpu_feature_guard.c failed: (Exit 2): python.exe failed: error executing command
  cd C:/users/adadu/_bazel_adadu/gj4czwcy/execroot/__main__
  SET CUDA_TOOLKIT_PATH=C:/Program Files/NVIDIA GPU Computing Toolkit/CUDA/v11.0
    SET CUDNN_INSTALL_PATH=C:/Program Files/NVIDIA GPU Computing Toolkit/CUDA/v11.0
    SET INCLUDE=C:\Program Files (x86)\Microsoft Visual Studio\2019\Community\VC\Tools\MSVC\14.28.29910\ATLMFC\include;C:\Program Files (x86)\Microsoft Visual Studio\2019\Community\VC\Tools\MSVC\14.28.29910\include;C:\Program Files (x86)\Windows Kits\10\include\10.0.19041.0\ucrt;C:\Program Files (x86)\Windows Kits\10\include\10.0.19041.0\shared;C:\Program Files (x86)\Windows Kits\10\include\10.0.19041.0\um;C:\Program Files (x86)\Windows Kits\10\include\10.0.19041.0\winrt;C:\Program Files (x86)\Windows Kits\10\include\10.0.19041.0\cppwinrt
    SET LIB=C:\Program Files (x86)\Microsoft Visual Studio\2019\Community\VC\Tools\MSVC\14.28.29910\ATLMFC\lib\x64;C:\Program Files (x86)\Microsoft Visual Studio\2019\Community\VC\Tools\MSVC\14.28.29910\lib\x64;C:\Program Files (x86)\Windows Kits\10\lib\10.0.19041.0\ucrt\x64;C:\Program Files (x86)\Windows Kits\10\lib\10.0.19041.0\um\x64
    SET PATH=C:\Program Files (x86)\Microsoft Visual Studio\2019\Community\Common7\IDE\\Extensions\Microsoft\IntelliCode\CLI;C:\Program Files (x86)\Microsoft Visual Studio\2019\Community\VC\Tools\MSVC\14.28.29910\bin\HostX64\x64;C:\Program Files (x86)\Microsoft Visual Studio\2019\Community\Common7\IDE\VC\VCPackages;C:\Program Files (x86)\Microsoft Visual Studio\2019\Community\Common7\IDE\CommonExtensions\Microsoft\TestWindow;C:\Program Files (x86)\Microsoft Visual Studio\2019\Community\Common7\IDE\CommonExtensions\Microsoft\TeamFoundation\Team Explorer;C:\Program Files (x86)\Microsoft Visual Studio\2019\Community\MSBuild\Current\bin\Roslyn;C:\Program Files (x86)\Microsoft Visual Studio\2019\Community\Team Tools\Performance Tools\x64;C:\Program Files (x86)\Microsoft Visual Studio\2019\Community\Team Tools\Performance Tools;C:\Program Files (x86)\Microsoft Visual Studio\Shared\Common\VSPerfCollectionTools\vs2019\\x64;C:\Program Files (x86)\Microsoft Visual Studio\Shared\Common\VSPerfCollectionTools\vs2019\;C:\Program Files (x86)\Microsoft Visual Studio\2019\Community\Common7\Tools\devinit;C:\Program Files (x86)\Windows Kits\10\bin\10.0.19041.0\x64;C:\Program Files (x86)\Windows Kits\10\bin\x64;C:\Program Files (x86)\Microsoft Visual Studio\2019\Community\\MSBuild\Current\Bin;C:\Windows\Microsoft.NET\Framework64\v4.0.30319;C:\Program Files (x86)\Microsoft Visual Studio\2019\Community\Common7\IDE\;C:\Program Files (x86)\Microsoft Visual Studio\2019\Community\Common7\Tools\;;C:\WINDOWS\system32;C:\Program Files (x86)\Microsoft Visual Studio\2019\Community\Common7\IDE\CommonExtensions\Microsoft\CMake\CMake\bin;C:\Program Files (x86)\Microsoft Visual Studio\2019\Community\Common7\IDE\CommonExtensions\Microsoft\CMake\Ninja
    SET PWD=/proc/self/cwd
    SET RUNFILES_MANIFEST_ONLY=1
    SET TEMP=C:\Users\adadu\AppData\Local\Temp
    SET TF_CUDA_COMPUTE_CAPABILITIES=5.2
    SET TF_CUDA_VERSION=11.0
    SET TF_CUDNN_VERSION=8.1.1
    SET TF_ROCM_AMDGPU_TARGETS=gfx803,gfx900,gfx906,gfx1010
    SET TMP=C:\Users\adadu\AppData\Local\Temp
  C:/Users/adadu/Miniconda3/envs/py39/python.exe -B external/local_config_cuda/crosstool/windows/msvc_wrapper_for_nvcc.py /nologo /DCOMPILER_MSVC /DNOMINMAX /D_WIN32_WINNT=0x0600 /D_CRT_SECURE_NO_DEPRECATE /D_CRT_SECURE_NO_WARNINGS /D_SILENCE_STDEXT_HASH_DEPRECATION_WARNINGS /bigobj /Zm500 /J /Gy /GF /EHsc /wd4351 /wd4291 /wd4250 /wd4996 /I. /Ibazel-out/x64_windows-opt/bin /Iexternal/local_config_python /Ibazel-out/x64_windows-opt/bin/external/local_config_python /Iexternal/bazel_tools /Ibazel-out/x64_windows-opt/bin/external/bazel_tools /Iexternal/local_config_python/python_include /Ibazel-out/x64_windows-opt/bin/external/local_config_python/python_include /showIncludes /MD /O2 /DNDEBUG /D_USE_MATH_DEFINES -DWIN32_LEAN_AND_MEAN -DNOGDI /Zc:preprocessor -fno-strict-aliasing -fexceptions /Fobazel-out/x64_windows-opt/bin/jaxlib/_objs/cpu_feature_guard.so/cpu_feature_guard.obj /c jaxlib/cpu_feature_guard.c
Execution platform: @local_execution_config_platform//:platform
cl: 命令行 warning D9002 :忽略未知选项“-fno-strict-aliasing”
cl: 命令行 warning D9002 :忽略未知选项“-fexceptions”
Target //build:build_wheel failed to build
INFO: Elapsed time: 44.562s, Critical Path: 39.72s
INFO: 115 processes: 64 internal, 51 local.
FAILED: Build did NOT complete successfully
FAILED: Build did NOT complete successfully
Traceback (most recent call last):
  File "D:\codes\github\ComputationFramework\jax\build\build.py", line 560, in <module>
    main()
  File "D:\codes\github\ComputationFramework\jax\build\build.py", line 555, in main
    shell(command)
  File "D:\codes\github\ComputationFramework\jax\build\build.py", line 51, in shell
    output = subprocess.check_output(cmd)
  File "C:\Users\adadu\Miniconda3\envs\py39\lib\subprocess.py", line 424, in check_output
    return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
  File "C:\Users\adadu\Miniconda3\envs\py39\lib\subprocess.py", line 528, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['D:\\softwares\\bazel\\bazel.EXE', 'run', '--verbose_failures=true', '--config=short_logs', '--config=mkl_open_source_only', '--config=cuda', '--define=xla_python_enable_gpu=true', ':build_wheel', '--', '--output_path=D:\\codes\\github\\ComputationFramework\\jax\\dist']' returned non-zero exit status 1.