Upgrading from 3.7.5 to 4.0.6

[pehan-dotcom]

Hello, got troubles with upgrading to 4.0.6. All searching and googling depleted, so I try to find solution here.

Self-hosted
CentOS Stream release 9
Python 3.11.9

When I start sudo ./upgrade.sh after upgrading all dependecies I still end up with error. I suppose it has something to do with psycopg[c,pool]==3.1.19 requirement.

ERROR: Could not find a version that satisfies the requirement setuptools>=49.2.0 (from versions: none)
ERROR: No matching distribution found for setuptools>=49.2.

Looks like pip can't find setuptools but as I enter created venv, I see setuptools 65.5.0 is there.

[user@netbox netbox]$ source venv/bin/activate
(venv) [user@netbox netbox]$ python -m pip list
Package    Version
---------- -------
pip        24.1.1
setuptools 65.5.0
wheel      0.43.0

Can someone help please?
Thanks.
Complete output of sudo ./upgrade.sh below.

sudo ./upgrade.sh 
You are installing (or upgrading to) NetBox version 4.0.6
Using Python 3.11.9
Removing old virtual environment...
Creating a new virtual environment at /opt/netbox-4.0.6/venv...
Updating pip (python -m pip --proxy <PROXY> install --upgrade pip)...
Requirement already satisfied: pip in ./venv/lib/python3.11/site-packages (24.0)
Collecting pip
  Using cached pip-24.1.1-py3-none-any.whl.metadata (3.6 kB)
Using cached pip-24.1.1-py3-none-any.whl (1.8 MB)
Installing collected packages: pip
  Attempting uninstall: pip
    Found existing installation: pip 24.0
    Uninstalling pip-24.0:
      Successfully uninstalled pip-24.0
Successfully installed pip-24.1.1
pip 24.1.1 from /opt/netbox-4.0.6/venv/lib/python3.11/site-packages/pip (python 3.11)
Installing Python system packages (python -m pip --proxy <PROXY> install wheel)...
Collecting wheel
  Using cached wheel-0.43.0-py3-none-any.whl.metadata (2.2 kB)
Using cached wheel-0.43.0-py3-none-any.whl (65 kB)
Installing collected packages: wheel
Successfully installed wheel-0.43.0
Installing core dependencies (python -m pip --proxy <PROXY> install -r requirements.txt)...
Collecting Django==5.0.6 (from -r requirements.txt (line 1))
  Using cached Django-5.0.6-py3-none-any.whl.metadata (4.1 kB)
Collecting django-cors-headers==4.4.0 (from -r requirements.txt (line 2))
  Using cached django_cors_headers-4.4.0-py3-none-any.whl.metadata (16 kB)
Collecting django-debug-toolbar==4.3.0 (from -r requirements.txt (line 3))
  Using cached django_debug_toolbar-4.3.0-py3-none-any.whl.metadata (4.0 kB)
Collecting django-filter==24.2 (from -r requirements.txt (line 4))
  Using cached django_filter-24.2-py3-none-any.whl.metadata (5.1 kB)
Collecting django-htmx==1.18.0 (from -r requirements.txt (line 5))
  Using cached django_htmx-1.18.0-py3-none-any.whl.metadata (2.7 kB)
Collecting django-graphiql-debug-toolbar==0.2.0 (from -r requirements.txt (line 6))
  Using cached django_graphiql_debug_toolbar-0.2.0-py3-none-any.whl.metadata (3.5 kB)
Collecting django-mptt==0.16.0 (from -r requirements.txt (line 7))
  Using cached django_mptt-0.16.0-py3-none-any.whl.metadata (5.2 kB)
Collecting django-pglocks==1.0.4 (from -r requirements.txt (line 8))
  Using cached django_pglocks-1.0.4-py3-none-any.whl
Collecting django-prometheus==2.3.1 (from -r requirements.txt (line 9))
  Using cached django_prometheus-2.3.1-py2.py3-none-any.whl.metadata (9.4 kB)
Collecting django-redis==5.4.0 (from -r requirements.txt (line 10))
  Using cached django_redis-5.4.0-py3-none-any.whl.metadata (32 kB)
Collecting django-rich==1.9.0 (from -r requirements.txt (line 11))
  Using cached django_rich-1.9.0-py3-none-any.whl.metadata (7.0 kB)
Collecting django-rq==2.10.2 (from -r requirements.txt (line 12))
  Using cached django_rq-2.10.2-py2.py3-none-any.whl.metadata (18 kB)
Collecting django-taggit==5.0.1 (from -r requirements.txt (line 13))
  Using cached django_taggit-5.0.1-py3-none-any.whl.metadata (3.4 kB)
Collecting django-tables2==2.7.0 (from -r requirements.txt (line 14))
  Using cached django_tables2-2.7.0-py2.py3-none-any.whl.metadata (3.9 kB)
Collecting django-timezone-field==6.1.0 (from -r requirements.txt (line 15))
  Using cached django_timezone_field-6.1.0-py3-none-any.whl.metadata (12 kB)
Collecting djangorestframework==3.15.2 (from -r requirements.txt (line 16))
  Using cached djangorestframework-3.15.2-py3-none-any.whl.metadata (10 kB)
Collecting drf-spectacular==0.27.2 (from -r requirements.txt (line 17))
  Using cached drf_spectacular-0.27.2-py3-none-any.whl.metadata (14 kB)
Collecting drf-spectacular-sidecar==2024.6.1 (from -r requirements.txt (line 18))
  Using cached drf_spectacular_sidecar-2024.6.1-py3-none-any.whl.metadata (3.4 kB)
Collecting feedparser==6.0.11 (from -r requirements.txt (line 19))
  Using cached feedparser-6.0.11-py3-none-any.whl.metadata (2.4 kB)
Collecting gunicorn==22.0.0 (from -r requirements.txt (line 20))
  Using cached gunicorn-22.0.0-py3-none-any.whl.metadata (4.4 kB)
Collecting Jinja2==3.1.4 (from -r requirements.txt (line 21))
  Using cached jinja2-3.1.4-py3-none-any.whl.metadata (2.6 kB)
Collecting Markdown==3.6 (from -r requirements.txt (line 22))
  Using cached Markdown-3.6-py3-none-any.whl.metadata (7.0 kB)
Collecting mkdocs-material==9.5.27 (from -r requirements.txt (line 23))
  Using cached mkdocs_material-9.5.27-py3-none-any.whl.metadata (17 kB)
Collecting mkdocstrings==0.25.1 (from mkdocstrings[python-legacy]==0.25.1->-r requirements.txt (line 24))
  Using cached mkdocstrings-0.25.1-py3-none-any.whl.metadata (7.6 kB)
Collecting netaddr==1.3.0 (from -r requirements.txt (line 25))
  Using cached netaddr-1.3.0-py3-none-any.whl.metadata (5.0 kB)
Collecting nh3==0.2.17 (from -r requirements.txt (line 26))
  Using cached nh3-0.2.17-cp37-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (1.7 kB)
Collecting Pillow==10.3.0 (from -r requirements.txt (line 27))
  Using cached pillow-10.3.0-cp311-cp311-manylinux_2_28_x86_64.whl.metadata (9.2 kB)
Collecting psycopg==3.1.19 (from psycopg[c,pool]==3.1.19->-r requirements.txt (line 28))
  Using cached psycopg-3.1.19-py3-none-any.whl.metadata (4.2 kB)
Collecting PyYAML==6.0.1 (from -r requirements.txt (line 29))
  Using cached PyYAML-6.0.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (2.1 kB)
Collecting requests==2.32.3 (from -r requirements.txt (line 30))
  Using cached requests-2.32.3-py3-none-any.whl.metadata (4.6 kB)
Collecting social-auth-app-django==5.4.1 (from -r requirements.txt (line 31))
  Using cached social_auth_app_django-5.4.1-py3-none-any.whl.metadata (3.2 kB)
Collecting social-auth-core==4.5.4 (from -r requirements.txt (line 32))
  Using cached social_auth_core-4.5.4-py3-none-any.whl.metadata (4.1 kB)
Collecting strawberry-graphql==0.235.0 (from -r requirements.txt (line 33))
  Using cached strawberry_graphql-0.235.0-py3-none-any.whl.metadata (7.8 kB)
Collecting strawberry-graphql-django==0.44.2 (from -r requirements.txt (line 34))
  Using cached strawberry_graphql_django-0.44.2-py3-none-any.whl.metadata (4.9 kB)
Collecting svgwrite==1.4.3 (from -r requirements.txt (line 35))
  Using cached svgwrite-1.4.3-py3-none-any.whl.metadata (8.8 kB)
Collecting tablib==3.6.1 (from -r requirements.txt (line 36))
  Using cached tablib-3.6.1-py3-none-any.whl.metadata (3.8 kB)
Collecting tzdata==2024.1 (from -r requirements.txt (line 37))
  Using cached tzdata-2024.1-py2.py3-none-any.whl.metadata (1.4 kB)
Collecting asgiref<4,>=3.7.0 (from Django==5.0.6->-r requirements.txt (line 1))
  Using cached asgiref-3.8.1-py3-none-any.whl.metadata (9.3 kB)
Collecting sqlparse>=0.3.1 (from Django==5.0.6->-r requirements.txt (line 1))
  Using cached sqlparse-0.5.0-py3-none-any.whl.metadata (3.9 kB)
Collecting graphene-django>=2.0.0 (from django-graphiql-debug-toolbar==0.2.0->-r requirements.txt (line 6))
  Using cached graphene_django-3.2.2-py2.py3-none-any.whl.metadata (8.3 kB)
Collecting django-js-asset (from django-mptt==0.16.0->-r requirements.txt (line 7))
  Using cached django_js_asset-2.2.0-py3-none-any.whl.metadata (3.5 kB)
Collecting six>=1.0.0 (from django-pglocks==1.0.4->-r requirements.txt (line 8))
  Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB)
Collecting prometheus-client>=0.7 (from django-prometheus==2.3.1->-r requirements.txt (line 9))
  Using cached prometheus_client-0.20.0-py3-none-any.whl.metadata (1.8 kB)
Collecting redis!=4.0.0,!=4.0.1,>=3 (from django-redis==5.4.0->-r requirements.txt (line 10))
  Using cached redis-5.0.7-py3-none-any.whl.metadata (9.3 kB)
Collecting rich>=10 (from django-rich==1.9.0->-r requirements.txt (line 11))
  Using cached rich-13.7.1-py3-none-any.whl.metadata (18 kB)
Collecting rq>=1.14 (from django-rq==2.10.2->-r requirements.txt (line 12))
  Using cached rq-1.16.2-py3-none-any.whl.metadata (5.7 kB)
Collecting uritemplate>=2.0.0 (from drf-spectacular==0.27.2->-r requirements.txt (line 17))
  Using cached uritemplate-4.1.1-py2.py3-none-any.whl.metadata (2.9 kB)
Collecting jsonschema>=2.6.0 (from drf-spectacular==0.27.2->-r requirements.txt (line 17))
  Using cached jsonschema-4.22.0-py3-none-any.whl.metadata (8.2 kB)
Collecting inflection>=0.3.1 (from drf-spectacular==0.27.2->-r requirements.txt (line 17))
  Using cached inflection-0.5.1-py2.py3-none-any.whl.metadata (1.7 kB)
Collecting sgmllib3k (from feedparser==6.0.11->-r requirements.txt (line 19))
  Using cached sgmllib3k-1.0.0-py3-none-any.whl
Collecting packaging (from gunicorn==22.0.0->-r requirements.txt (line 20))
  Using cached packaging-24.1-py3-none-any.whl.metadata (3.2 kB)
Collecting MarkupSafe>=2.0 (from Jinja2==3.1.4->-r requirements.txt (line 21))
  Using cached MarkupSafe-2.1.5-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (3.0 kB)
Collecting babel~=2.10 (from mkdocs-material==9.5.27->-r requirements.txt (line 23))
  Using cached Babel-2.15.0-py3-none-any.whl.metadata (1.5 kB)
Collecting colorama~=0.4 (from mkdocs-material==9.5.27->-r requirements.txt (line 23))
  Using cached colorama-0.4.6-py2.py3-none-any.whl.metadata (17 kB)
Collecting mkdocs-material-extensions~=1.3 (from mkdocs-material==9.5.27->-r requirements.txt (line 23))
  Using cached mkdocs_material_extensions-1.3.1-py3-none-any.whl.metadata (6.9 kB)
Collecting mkdocs~=1.6 (from mkdocs-material==9.5.27->-r requirements.txt (line 23))
  Using cached mkdocs-1.6.0-py3-none-any.whl.metadata (6.0 kB)
Collecting paginate~=0.5 (from mkdocs-material==9.5.27->-r requirements.txt (line 23))
  Using cached paginate-0.5.6-py3-none-any.whl
Collecting pygments~=2.16 (from mkdocs-material==9.5.27->-r requirements.txt (line 23))
  Using cached pygments-2.18.0-py3-none-any.whl.metadata (2.5 kB)
Collecting pymdown-extensions~=10.2 (from mkdocs-material==9.5.27->-r requirements.txt (line 23))
  Using cached pymdown_extensions-10.8.1-py3-none-any.whl.metadata (3.0 kB)
Collecting regex>=2022.4 (from mkdocs-material==9.5.27->-r requirements.txt (line 23))
  Using cached regex-2024.5.15-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (40 kB)
Collecting click>=7.0 (from mkdocstrings==0.25.1->mkdocstrings[python-legacy]==0.25.1->-r requirements.txt (line 24))
  Using cached click-8.1.7-py3-none-any.whl.metadata (3.0 kB)
Collecting mkdocs-autorefs>=0.3.1 (from mkdocstrings==0.25.1->mkdocstrings[python-legacy]==0.25.1->-r requirements.txt (line 24))
  Using cached mkdocs_autorefs-1.0.1-py3-none-any.whl.metadata (6.9 kB)
Collecting platformdirs>=2.2.0 (from mkdocstrings==0.25.1->mkdocstrings[python-legacy]==0.25.1->-r requirements.txt (line 24))
  Using cached platformdirs-4.2.2-py3-none-any.whl.metadata (11 kB)
Collecting typing-extensions>=4.1 (from psycopg==3.1.19->psycopg[c,pool]==3.1.19->-r requirements.txt (line 28))
  Using cached typing_extensions-4.12.2-py3-none-any.whl.metadata (3.0 kB)
Collecting charset-normalizer<4,>=2 (from requests==2.32.3->-r requirements.txt (line 30))
  Using cached charset_normalizer-3.3.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (33 kB)
Collecting idna<4,>=2.5 (from requests==2.32.3->-r requirements.txt (line 30))
  Using cached idna-3.7-py3-none-any.whl.metadata (9.9 kB)
Collecting urllib3<3,>=1.21.1 (from requests==2.32.3->-r requirements.txt (line 30))
  Using cached urllib3-2.2.2-py3-none-any.whl.metadata (6.4 kB)
Collecting certifi>=2017.4.17 (from requests==2.32.3->-r requirements.txt (line 30))
  Using cached certifi-2024.7.4-py3-none-any.whl.metadata (2.2 kB)
Collecting oauthlib>=1.0.3 (from social-auth-core==4.5.4->-r requirements.txt (line 32))
  Using cached oauthlib-3.2.2-py3-none-any.whl.metadata (7.5 kB)
Collecting requests-oauthlib>=0.6.1 (from social-auth-core==4.5.4->-r requirements.txt (line 32))
  Using cached requests_oauthlib-2.0.0-py2.py3-none-any.whl.metadata (11 kB)
Collecting PyJWT>=2.7.0 (from social-auth-core==4.5.4->-r requirements.txt (line 32))
  Using cached PyJWT-2.8.0-py3-none-any.whl.metadata (4.2 kB)
Collecting cryptography>=1.4 (from social-auth-core==4.5.4->-r requirements.txt (line 32))
  Using cached cryptography-42.0.8-cp39-abi3-manylinux_2_28_x86_64.whl.metadata (5.3 kB)
Collecting defusedxml>=0.5.0rc1 (from social-auth-core==4.5.4->-r requirements.txt (line 32))
  Using cached defusedxml-0.8.0rc2-py2.py3-none-any.whl.metadata (33 kB)
Collecting python3-openid>=3.0.10 (from social-auth-core==4.5.4->-r requirements.txt (line 32))
  Using cached python3_openid-3.2.0-py3-none-any.whl.metadata (1.6 kB)
Collecting graphql-core<3.3.0,>=3.2.0 (from strawberry-graphql==0.235.0->-r requirements.txt (line 33))
  Using cached graphql_core-3.2.3-py3-none-any.whl.metadata (10 kB)
Collecting python-dateutil<3.0.0,>=2.7.0 (from strawberry-graphql==0.235.0->-r requirements.txt (line 33))
  Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB)
Collecting mkdocstrings-python-legacy>=0.2.1 (from mkdocstrings[python-legacy]==0.25.1->-r requirements.txt (line 24))
  Using cached mkdocstrings_python_legacy-0.2.3-py3-none-any.whl.metadata (5.1 kB)
Collecting psycopg-c==3.1.19 (from psycopg[c,pool]==3.1.19->-r requirements.txt (line 28))
  Using cached psycopg_c-3.1.19.tar.gz (562 kB)
  Installing build dependencies ... error
  error: subprocess-exited-with-error
  
  × pip subprocess to install build dependencies did not run successfully.
  │ exit code: 1
  ╰─> [7 lines of output]
      WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<pip._vendor.urllib3.connection.HTTPSConnection object at 0x7f23d46f2750>: Failed to establish a new connection: [Errno -2] Name or service not known')': /simple/setuptools/
      WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<pip._vendor.urllib3.connection.HTTPSConnection object at 0x7f23d46f32d0>: Failed to establish a new connection: [Errno -2] Name or service not known')': /simple/setuptools/
      WARNING: Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<pip._vendor.urllib3.connection.HTTPSConnection object at 0x7f23d46f3c10>: Failed to establish a new connection: [Errno -2] Name or service not known')': /simple/setuptools/
      WARNING: Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<pip._vendor.urllib3.connection.HTTPSConnection object at 0x7f23d44bc710>: Failed to establish a new connection: [Errno -2] Name or service not known')': /simple/setuptools/
      WARNING: Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<pip._vendor.urllib3.connection.HTTPSConnection object at 0x7f23d44bd310>: Failed to establish a new connection: [Errno -2] Name or service not known')': /simple/setuptools/
      ERROR: Could not find a version that satisfies the requirement setuptools>=49.2.0 (from versions: none)
      ERROR: No matching distribution found for setuptools>=49.2.0
      [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error

× pip subprocess to install build dependencies did not run successfully.
│ exit code: 1
╰─> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip.

[pehan-dotcom]

Ok I finally solve the problem. It seems --proxy option is not passed correctly to all modules or whatever. The final solution was bypass proxy and give the server direct connection to internet through corporate firewall (PAT). Then just run upgrade script withou ANY --proxy settings and voila:

Upgrade complete! Don't forget to restart the NetBox services: