Runtime exception when creating initial firmware

[umop]

I am continuing instructions in https://github.com/cryptoadvance/specter-bootloader/blob/master/doc/selfsigned.md in order to test a bootloader. The build has completed successfully, but I am at the step of creating initial firmware. I installed virtualenv with python -m pip install --user virtualenv which wasn't in the instructions, but there was no virtualenv in my path. I ran python -m virtualenv .venv successfully and sourced the .venv with no errors, but while running:

pip install -r requirements.txt

I run into the following exception

Building wheels for collected packages: autopep8, bitstring, cffi, coverage, cryptography
  Building wheel for autopep8 (setup.py) ... done
  Created wheel for autopep8: filename=autopep8-1.5.3-py2.py3-none-any.whl size=44065 sha256=a1f66a80565314c05069aeb15d7ad94a1b6722728c10c1aff336f86399d1be83
  Stored in directory: /Users/umop/Library/Caches/pip/wheels/9b/38/92/84703cfe571c5a2c05a97834202c8e8fea43fc3b4b1b8b0555
  Building wheel for bitstring (setup.py) ... done
  Created wheel for bitstring: filename=bitstring-3.1.7-py3-none-any.whl size=37961 sha256=85bfe81d81566f346cbc286d2eccf4cb7ea94aa90cc29039ca55f4070ca73108
  Stored in directory: /Users/umop/Library/Caches/pip/wheels/a4/15/2d/b7f46fd1715be0a3b3ebfeba79cec71df60205a7a0d623de86
  Building wheel for cffi (setup.py) ... error
  error: subprocess-exited-with-error
  
  × python setup.py bdist_wheel did not run successfully.
  │ exit code: 1
  ╰─> [53 lines of output]
      /Users/umop/projects/safe-message/specter-bootloader/tools/.venv/lib/python3.10/site-packages/setuptools/config/setupcfg.py:508: SetuptoolsDeprecationWarning: The license_file parameter is deprecated, use license_files instead.
        warnings.warn(msg, warning_class)
      running bdist_wheel
      running build
      running build_py
      creating build
      creating build/lib.macosx-11.0-arm64-cpython-310
      creating build/lib.macosx-11.0-arm64-cpython-310/cffi
      copying cffi/backend_ctypes.py -> build/lib.macosx-11.0-arm64-cpython-310/cffi
      copying cffi/error.py -> build/lib.macosx-11.0-arm64-cpython-310/cffi
      copying cffi/setuptools_ext.py -> build/lib.macosx-11.0-arm64-cpython-310/cffi
      copying cffi/__init__.py -> build/lib.macosx-11.0-arm64-cpython-310/cffi
      copying cffi/cffi_opcode.py -> build/lib.macosx-11.0-arm64-cpython-310/cffi
      copying cffi/vengine_gen.py -> build/lib.macosx-11.0-arm64-cpython-310/cffi
      copying cffi/pkgconfig.py -> build/lib.macosx-11.0-arm64-cpython-310/cffi
      copying cffi/model.py -> build/lib.macosx-11.0-arm64-cpython-310/cffi
      copying cffi/ffiplatform.py -> build/lib.macosx-11.0-arm64-cpython-310/cffi
      copying cffi/api.py -> build/lib.macosx-11.0-arm64-cpython-310/cffi
      copying cffi/vengine_cpy.py -> build/lib.macosx-11.0-arm64-cpython-310/cffi
      copying cffi/commontypes.py -> build/lib.macosx-11.0-arm64-cpython-310/cffi
      copying cffi/lock.py -> build/lib.macosx-11.0-arm64-cpython-310/cffi
      copying cffi/recompiler.py -> build/lib.macosx-11.0-arm64-cpython-310/cffi
      copying cffi/cparser.py -> build/lib.macosx-11.0-arm64-cpython-310/cffi
      copying cffi/verifier.py -> build/lib.macosx-11.0-arm64-cpython-310/cffi
      copying cffi/_cffi_include.h -> build/lib.macosx-11.0-arm64-cpython-310/cffi
      copying cffi/parse_c_type.h -> build/lib.macosx-11.0-arm64-cpython-310/cffi
      copying cffi/_embedding.h -> build/lib.macosx-11.0-arm64-cpython-310/cffi
      copying cffi/_cffi_errors.h -> build/lib.macosx-11.0-arm64-cpython-310/cffi
      running build_ext
      building '_cffi_backend' extension
      creating build/temp.macosx-11.0-arm64-cpython-310
      creating build/temp.macosx-11.0-arm64-cpython-310/c
      clang -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /Users/umop/miniforge3/include -arch arm64 -fPIC -O2 -isystem /Users/umop/miniforge3/include -arch arm64 -DUSE__THREAD -DHAVE_SYNC_SYNCHRONIZE -I/usr/include/ffi -I/usr/include/libffi -I/Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/usr/include/ffi -I/Users/umop/projects/safe-message/specter-bootloader/tools/.venv/include -I/Users/umop/miniforge3/include/python3.10 -c c/_cffi_backend.c -o build/temp.macosx-11.0-arm64-cpython-310/c/_cffi_backend.o
      c/_cffi_backend.c:407:23: error: expression is not assignable
              Py_REFCNT(ct) = 43;
              ~~~~~~~~~~~~~ ^
      c/_cffi_backend.c:410:23: error: expression is not assignable
              Py_REFCNT(ct) = 0;
              ~~~~~~~~~~~~~ ^
      c/_cffi_backend.c:6185:5: warning: 'PyEval_InitThreads' is deprecated [-Wdeprecated-declarations]
          PyEval_InitThreads();
          ^
      /Users/umop/miniforge3/include/python3.10/ceval.h:122:1: note: 'PyEval_InitThreads' has been explicitly marked deprecated here
      Py_DEPRECATED(3.9) PyAPI_FUNC(void) PyEval_InitThreads(void);
      ^
      /Users/umop/miniforge3/include/python3.10/pyport.h:513:54: note: expanded from macro 'Py_DEPRECATED'
      #define Py_DEPRECATED(VERSION_UNUSED) __attribute__((__deprecated__))
                                                           ^
      c/_cffi_backend.c:6245:9: error: implicit declaration of function 'ffi_prep_closure' is invalid in C99 [-Werror,-Wimplicit-function-declaration]
          if (ffi_prep_closure(closure, &cif_descr->cif,
              ^
      1 warning and 3 errors generated.
      error: command '/usr/bin/clang' failed with exit code 1
      [end of output]

Looking at specter-bootloader/tools/.venv/lib/python3.10/site-packages/setuptools/config/setupcfg.py, I see references to both licence_file and licence_files:

    @property
    def parsers(self):
    ...
        return {
            ...
            'license': exclude_files_parser('license'),
            'license_file': self._deprecated_config_handler(
                exclude_files_parser('license_file'),
                "The license_file parameter is deprecated, "
                "use license_files instead.",
                SetuptoolsDeprecationWarning,
            ),
            'license_files': parse_list,
            'description': parse_file,
            ...

Should I be using an older version of something here or does the code need to be updated?

Thanks!

[stepansnigirev]

Looks like a problem installing python libraries. Not sure what exactly is the reason. I'll try to figure out during this week.

Meanwhile you can try building everything with docker:
https://github.com/cryptoadvance/specter-diy/blob/master/docs/reproducible-build.md

Docker file contains all necessary dependencies, and uses build_firmware.sh that you can customize if you want.