Unable to GET Netbox Tags - Request failed

[steve-hbt]

Hello,
I'm trying to set up netbox-sync with a VCenter.

I'm encountering a problem during installation, when the script retrieves the Netbox tags.

The logs are as follows:

2025-06-13 17:21:21,265 - INFO: Successfully connected to vCenter SDK 'vcenter.my.domain'
2025-06-13 17:21:21,265 - INFO: Querying necessary objects from NetBox. This might take a while.
2025-06-13 17:21:21,266 - DEBUG: Requesting all tags from NetBox
{'_body_position': None,
 '_cookies': <RequestsCookieJar[Cookie(version=0, name='csrftoken', value='xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx', port=None, port_specified=False, domain='app-netbox.my.domain', domain_specified=False, domain_initial_dot=False, path='/', path_specified=True, secure=False, expires=1781277681, discard=False, comment=None, comment_url=None, rest={'SameSite': 'Lax'}, rfc2109=False)]>,
 'body': None,
 'headers': {'User-Agent': 'netbox-sync/1.8.0', 'Accept-Encoding': 'gzip, deflate', 'Accept': '*/*', 'Connection': 'keep-alive', 'Authorization': 'Token xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx', 'Content-Type': 'application/json', 'Cookie': 'csrftoken=xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx'},
 'hooks': {'response': []},
 'method': 'GET',
 'url': 'https://app-netbox.my.domain:443/api/extras/tags/?limit=200&exclude=config_context'}
2025-06-13 17:21:21,268 - DEBUG: Starting new HTTPS connection (1): app-netbox.my.domain:443
2025-06-13 17:21:21,271 - WARNING: Request failed, trying again: Sending GET to 'https://app-netbox.my.domain:443/api/extras/tags/?limit=200&exclude=config_context'
2025-06-13 17:21:21,271 - DEBUG: Starting new HTTPS connection (2): app-netbox.my.domain:443
2025-06-13 17:21:21,274 - WARNING: Request failed, trying again: Sending GET to 'https://app-netbox.my.domain:443/api/extras/tags/?limit=200&exclude=config_context'
2025-06-13 17:21:21,275 - DEBUG: Starting new HTTPS connection (3): app-netbox.my.domain:443
2025-06-13 17:21:21,277 - WARNING: Request failed, trying again: Sending GET to 'https://app-netbox.my.domain:443/api/extras/tags/?limit=200&exclude=config_context'
2025-06-13 17:21:21,278 - DEBUG: Starting new HTTPS connection (4): app-netbox.my.domain:443
2025-06-13 17:21:21,281 - WARNING: Request failed, trying again: Sending GET to 'https://app-netbox.my.domain:443/api/extras/tags/?limit=200&exclude=config_context'
ERROR: Giving up after 4 retries.

The API works correctly, however, when I pass the parameter in curl I have the following return:

(.venv) root@netbox:/opt/netbox-sync# curl -H "Authorization: Token xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx"      -H "Content-Type: application/json"      https://app-netbox.my.domain/api/extras/tags/?limit=200\&exclude=config_context -v
*   Trying 192.168.xxx.xxx:443...
* Connected to app-netbox.my.domain (192.168.xxx.xxx) port 443 (#0)
* ALPN, offering h2
* ALPN, offering http/1.1
*  CAfile: /etc/ssl/certs/ca-certificates.crt
*  CApath: /etc/ssl/certs
* TLSv1.0 (OUT), TLS header, Certificate Status (22):
* TLSv1.3 (OUT), TLS handshake, Client hello (1):
* TLSv1.2 (IN), TLS header, Certificate Status (22):
* TLSv1.3 (IN), TLS handshake, Server hello (2):
* TLSv1.2 (IN), TLS header, Finished (20):
* TLSv1.2 (IN), TLS header, Supplemental data (23):
* TLSv1.3 (IN), TLS handshake, Encrypted Extensions (8):
* TLSv1.2 (IN), TLS header, Supplemental data (23):
* TLSv1.3 (IN), TLS handshake, Certificate (11):
* TLSv1.2 (IN), TLS header, Supplemental data (23):
* TLSv1.3 (IN), TLS handshake, CERT verify (15):
* TLSv1.2 (IN), TLS header, Supplemental data (23):
* TLSv1.3 (IN), TLS handshake, Finished (20):
* TLSv1.2 (OUT), TLS header, Finished (20):
* TLSv1.3 (OUT), TLS change cipher, Change cipher spec (1):
* TLSv1.2 (OUT), TLS header, Supplemental data (23):
* TLSv1.3 (OUT), TLS handshake, Finished (20):
* SSL connection using TLSv1.3 / TLS_AES_256_GCM_SHA384
* ALPN, server accepted to use http/1.1
* Server certificate:
*  subject: C=FR; ST=DEPT; L=CITY; O=CMB; OU=SI; CN=app-netbox; emailAddress=xxxx@xxxxxxxxx.fr
*  start date: Dec 19 09:27:42 2024 GMT
*  expire date: Dec 19 09:27:42 2026 GMT
*  subjectAltName: host "app-netbox.my.domain" matched cert's "app-netbox.my.domain"
*  issuer: DC=XXXXX; DC=XX; CN=XX-PKI-CA
*  SSL certificate verify ok.
* TLSv1.2 (OUT), TLS header, Supplemental data (23):
> GET /api/extras/tags/?limit=200&exclude=config_context HTTP/1.1
> Host: app-netbox.my.domain
> User-Agent: curl/7.81.0
> Accept: */*
> Authorization: Token xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx
> Content-Type: application/json
>
* TLSv1.2 (IN), TLS header, Supplemental data (23):
* TLSv1.3 (IN), TLS handshake, Newsession Ticket (4):
* TLSv1.2 (IN), TLS header, Supplemental data (23):
* TLSv1.3 (IN), TLS handshake, Newsession Ticket (4):
* old SSL session ID is stale, removing
* TLSv1.2 (IN), TLS header, Supplemental data (23):
* Mark bundle as not supporting multiuse
< HTTP/1.1 200 OK
< Server: nginx/1.18.0 (Ubuntu)
< Date: Fri, 13 Jun 2025 15:26:44 GMT
< Content-Type: application/json
< Content-Length: 3306
< Connection: keep-alive
< Vary: HX-Request, Accept-Language, Cookie, origin
< Allow: GET, POST, PUT, PATCH, DELETE, HEAD, OPTIONS
< X-Request-ID: b5b3d2c7-c394-401f-ac94-7b02cf212181
< API-Version: 4.3
< X-Content-Type-Options: nosniff
< Referrer-Policy: same-origin
< Cross-Origin-Opener-Policy: same-origin
< X-Frame-Options: SAMEORIGIN
< Content-Language: en
<
{"count":9,"next":null,"previous":null,"results":[{"id":6,"url":"https://app-netbox.my.domain/api/extras/tags/6/","display_url":"https://app-netbox.my.domain/extras/tags/6/","display":"A JOUR","name":"A JOUR","slug":"a-jour","color":"8bc34a","description":"Données à jour","weight":1000,"object_types":[],"tagged_items":10,"created":"2024-09-17T08:39:50.738454Z","last_updated":"2024-09-17T08:39:50.738468Z"},{"id":4,"url":"https://app-netbox.my.domain/api/extras/tags/4/","display_url":"https://app-netbox.my.domain/extras/tags/4/","display":"MYCLUSTER","name":"MYCLUSTER","slug":"MYCLUSTER","color":"2196f3","description":"","weight":1000,"object_types":[],"tagged_items":5,"created":"2021-11-25T00:00:00Z","last_updated":"2021-11-25T13:23:19.127845Z"},{"id":9,"url":"https://app-netbox.my.domain/api/extras/tags/9/","display_url":"https://app-netbox.my.domain/extras/tags/9/","display":"XXXX","name":"XXXX","slug":"XXXX","color":"2196f3","description":"","weight":1000,"object_types":[],"tagged_items":9,"created":"2025-04-18T14:59:51.996387Z","last_updated":"2025-04-18T14:59:51.996401Z"},{"id":8,"url":"https://app-netbox.my.domain/api/extras/tags/8/","display_url":"https://app-netbox.my.domain/extras/tags/8/","display":"Docker","name":"Docker","slug":"docker","color":"2196f3","description":"","weight":1000,"object_types":["virtualization.virtualmachine"],"tagged_items":3,"created":"2025-01-31T10:21:15.115096Z","last_updated":"2025-01-31T10:21:15.115111Z"},{"id":7,"url":"https://app-netbox.my.domain/api/extras/tags/7/","display_url":"https://app-netbox.my.domain/extras/tags/7/","display":"MAJ A faire","name":"MAJ A faire","slug":"maj-a-faire","color":"ff5722","description":"Mise à jour des données à faire","weight":1000,"object_types":[],"tagged_items":29,"created":"2024-09-17T08:40:10.706023Z","last_updated":"2024-09-17T08:40:10.706040Z"},{"id":5,"url":"https://app-netbox.my.domain/api/extras/tags/5/","display_url":"https://app-netbox.my.domain/extras/tags/5/","display":"ENTERPRISE","name":"ENTERPRISE","slug":"ENTERPRISE","color":"cddc39","description":"Equipements gérés par ENTERPRISE pour le CA","weight":1000,"object_types":[],"tagged_items":1,"created":"2024-09-10T07:53:32.751868Z","last_updated":"2024-09-10T07:53:32.751884Z"},{"id":2,"url":"https://app-netbox.my.domain/api/extras/tags/2/","display_url":"https://app-netbox.my.domain/extras/tags/2/","display":"PoE","name":"PoE","slug":"poe","color":"ffc107","description":"Prise présentant une alimentation PoE","weight":1000,"object_types":[],"tagged_items":49,"created":"2021-10-18T00:00:00Z","last_updated":"2021-11-16T12:59:20.518314Z"},{"id":3,"url":"https://app-netbox.my.domain/api/extras/tags/3/","display_url":"https://app-netbox.my.domain/extras/tags/3/","display":"SI ADMIN","name":"SI ADMIN","slug":"si-admin","color":"aa1409","description":"","weight":1000,"object_types":[],"tagged_items":6,"created":"2021-11-16T00:00:00Z","last_updated":"2021-11-16T12:59:06.210396Z"},{"id":1,"url":"https://app-netbox.my.domain/api/extras/tags/1/","display_url":"https://app-netbox.* Connection #0 to host app-netbox.my.domain left intact
my.domain/extras/tags/1/","display":"Wifi","name":"Wifi","slug":"wifi","color":"795548","description":"","weight":1000,"object_types":[],"tagged_items":24,"created":"2020-08-20T00:00:00Z","last_updated":"2021-11-25T13:23:56.809995Z"}]}(

Do you have any ideas on how to solve this problem?

Thanks

[steve-hbt]

I just saw that the latest compatibility was for Netbox 4.2.
I'm currently on v4.3.1. Could this have an impact?

[bb-Ricardo]

Hi,

I just upgrade my test setup to 4.3.2 and I see no issue which you describe.

2025-06-16 08:46:47,496 - INFO: Starting NetBox Sync v1.8.0 (2025-03-07)
2025-06-16 08:46:47,499 - DEBUG: Created new requests Session for NetBox.
2025-06-16 08:46:47,587 - INFO: Successfully connected to NetBox 'netbox.test'
2025-06-16 08:46:47,587 - DEBUG: Detected NetBox API version: 4.3.2
2025-06-16 08:46:47,710 - INFO: Querying necessary objects from NetBox. This might take a while.
2025-06-16 08:46:47,710 - DEBUG: Requesting all tags from NetBox
2025-06-16 08:46:47,863 - DEBUG2: Received HTTP Status 200.
2025-06-16 08:46:47,864 - DEBUG: Successfully cached 4 objects.
2025-06-16 08:46:47,865 - DEBUG: Processing 4 returned tags

not sure why your setup does not work. Also strange that there is no error output. could you try using -l DEBUG2 and see if this gives you more details?

[steve-hbt]

Hi,
I was in DEBUG3 in my setting file, but there is DEBUG2 logs :
Thanks.

(.venv) root@netbox:/opt/netbox-sync# export REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt
(.venv) root@netbox:/opt/netbox-sync# ./netbox-sync.py -l DEBUG2
2025-06-16 09:05:38,826 - INFO: Starting NetBox Sync v1.8.0 (2025-03-07)
2025-06-16 09:05:38,826 - DEBUG: Using config file: /opt/netbox-sync/settings.ini
2025-06-16 09:05:38,827 - DEBUG: Config: common.log_level = DEBUG3
2025-06-16 09:05:38,827 - DEBUG: Config: common.log_to_file = False
2025-06-16 09:05:38,827 - DEBUG: Config: common.log_file = log/netbox_sync.log
2025-06-16 09:05:38,827 - DEBUG: Config: netbox.api_token = c8b***
2025-06-16 09:05:38,827 - DEBUG: Config: netbox.host_fqdn = app-netbox.my.domain
2025-06-16 09:05:38,827 - DEBUG: Config: netbox.port = 443
2025-06-16 09:05:38,828 - DEBUG: Config: netbox.disable_tls = False
2025-06-16 09:05:38,828 - DEBUG: Config: netbox.validate_tls_certs = True
2025-06-16 09:05:38,828 - DEBUG: Config: netbox.proxy = None
2025-06-16 09:05:38,828 - DEBUG: Config: netbox.client_cert = None
2025-06-16 09:05:38,828 - DEBUG: Config: netbox.client_cert_key = None
2025-06-16 09:05:38,828 - DEBUG: Config: netbox.prune_enabled = False
2025-06-16 09:05:38,828 - DEBUG: Config: netbox.prune_delay_in_days = 30
2025-06-16 09:05:38,828 - DEBUG: Config: netbox.ignore_unknown_source_object_pruning = False
2025-06-16 09:05:38,829 - DEBUG: Config: netbox.default_netbox_result_limit = 200
2025-06-16 09:05:38,829 - DEBUG: Config: netbox.timeout = 30
2025-06-16 09:05:38,829 - DEBUG: Config: netbox.max_retry_attempts = 4
2025-06-16 09:05:38,829 - DEBUG: Config: netbox.use_caching = True
2025-06-16 09:05:38,829 - DEBUG: Config: netbox.cache_directory_location = cache
2025-06-16 09:05:38,829 - DEBUG: Created new requests Session for NetBox.
2025-06-16 09:05:39,001 - INFO: Successfully connected to NetBox 'app-netbox.my.domain'
2025-06-16 09:05:39,001 - DEBUG: Detected NetBox API version: 4.3
2025-06-16 09:05:39,001 - DEBUG: Successfully configured cache directory: /opt/netbox-sync/cache
2025-06-16 09:05:39,001 - INFO: Initializing sources
2025-06-16 09:05:39,002 - DEBUG: Config: source.alphabeta-vcenter.enabled = True
2025-06-16 09:05:39,002 - DEBUG: Config: source.alphabeta-vcenter.type = vmware
2025-06-16 09:05:39,002 - DEBUG: Config: source.alphabeta-vcenter.host_fqdn = vcenter.my.domain
2025-06-16 09:05:39,002 - DEBUG: Config: source.alphabeta-vcenter.port = 443
2025-06-16 09:05:39,002 - DEBUG: Config: source.alphabeta-vcenter.username = xxxxxx@vsphere.local
2025-06-16 09:05:39,002 - DEBUG: Config: source.alphabeta-vcenter.password = xxxxxxxxxxxxxxxxxxxxxx
2025-06-16 09:05:39,002 - DEBUG: Config: source.alphabeta-vcenter.validate_tls_certs = False
2025-06-16 09:05:39,002 - DEBUG: Config: source.alphabeta-vcenter.proxy_host = None
2025-06-16 09:05:39,002 - DEBUG: Config: source.alphabeta-vcenter.proxy_port = None
2025-06-16 09:05:39,002 - DEBUG: Config: source.alphabeta-vcenter.permitted_subnets = 192.168.xxx.0/24, 192.168.xxx.0/24, 192.168.xxx.0/24, 192.168.xxx.0/24, 192.168.xxx.0/24, 192.168.xxx.0/24
2025-06-16 09:05:39,003 - DEBUG: Config: source.alphabeta-vcenter.cluster_exclude_filter = None
2025-06-16 09:05:39,003 - DEBUG: Config: source.alphabeta-vcenter.cluster_include_filter = None
2025-06-16 09:05:39,003 - DEBUG: Config: source.alphabeta-vcenter.host_exclude_filter = None
2025-06-16 09:05:39,003 - DEBUG: Config: source.alphabeta-vcenter.host_include_filter = None
2025-06-16 09:05:39,003 - DEBUG: Config: source.alphabeta-vcenter.vm_exclude_filter = None
2025-06-16 09:05:39,003 - DEBUG: Config: source.alphabeta-vcenter.vm_include_filter = None
2025-06-16 09:05:39,003 - DEBUG: Config: source.alphabeta-vcenter.vm_exclude_by_tag_filter = None
2025-06-16 09:05:39,003 - DEBUG: Config: source.alphabeta-vcenter.cluster_site_relation = None
2025-06-16 09:05:39,003 - DEBUG: Config: source.alphabeta-vcenter.host_site_relation = None
2025-06-16 09:05:39,003 - DEBUG: Config: source.alphabeta-vcenter.cluster_tenant_relation = None
2025-06-16 09:05:39,003 - DEBUG: Config: source.alphabeta-vcenter.host_tenant_relation = None
2025-06-16 09:05:39,004 - DEBUG: Config: source.alphabeta-vcenter.vm_tenant_relation = None
2025-06-16 09:05:39,004 - DEBUG: Config: source.alphabeta-vcenter.host_platform_relation = None
2025-06-16 09:05:39,004 - DEBUG: Config: source.alphabeta-vcenter.vm_platform_relation = None
2025-06-16 09:05:39,004 - DEBUG: Config: source.alphabeta-vcenter.host_role_relation = .* = Server
2025-06-16 09:05:39,004 - DEBUG: Config: source.alphabeta-vcenter.vm_role_relation = None
2025-06-16 09:05:39,004 - DEBUG: Config: source.alphabeta-vcenter.cluster_tag_relation = None
2025-06-16 09:05:39,004 - DEBUG: Config: source.alphabeta-vcenter.host_tag_relation = None
2025-06-16 09:05:39,004 - DEBUG: Config: source.alphabeta-vcenter.vm_tag_relation = None
2025-06-16 09:05:39,004 - DEBUG: Config: source.alphabeta-vcenter.match_host_by_serial = True
2025-06-16 09:05:39,005 - DEBUG: Config: source.alphabeta-vcenter.collect_hardware_asset_tag = True
2025-06-16 09:05:39,005 - DEBUG: Config: source.alphabeta-vcenter.collect_hardware_serial = True
2025-06-16 09:05:39,005 - DEBUG: Config: source.alphabeta-vcenter.dns_name_lookup = True
2025-06-16 09:05:39,005 - DEBUG: Config: source.alphabeta-vcenter.custom_dns_servers = None
2025-06-16 09:05:39,005 - DEBUG: Config: source.alphabeta-vcenter.set_primary_ip = when-undefined
2025-06-16 09:05:39,005 - DEBUG: Config: source.alphabeta-vcenter.skip_vm_comments = False
2025-06-16 09:05:39,005 - DEBUG: Config: source.alphabeta-vcenter.skip_vm_templates = True
2025-06-16 09:05:39,005 - DEBUG: Config: source.alphabeta-vcenter.skip_offline_vms = False
2025-06-16 09:05:39,005 - DEBUG: Config: source.alphabeta-vcenter.skip_srm_placeholder_vms = False
2025-06-16 09:05:39,006 - DEBUG: Config: source.alphabeta-vcenter.strip_host_domain_name = False
2025-06-16 09:05:39,006 - DEBUG: Config: source.alphabeta-vcenter.strip_vm_domain_name = False
2025-06-16 09:05:39,006 - DEBUG: Config: source.alphabeta-vcenter.cluster_tag_source = None
2025-06-16 09:05:39,006 - DEBUG: Config: source.alphabeta-vcenter.host_tag_source = None
2025-06-16 09:05:39,006 - DEBUG: Config: source.alphabeta-vcenter.vm_tag_source = None
2025-06-16 09:05:39,006 - DEBUG: Config: source.alphabeta-vcenter.sync_custom_attributes = False
2025-06-16 09:05:39,006 - DEBUG: Config: source.alphabeta-vcenter.host_custom_object_attributes = None
2025-06-16 09:05:39,006 - DEBUG: Config: source.alphabeta-vcenter.vm_custom_object_attributes = None
2025-06-16 09:05:39,006 - DEBUG: Config: source.alphabeta-vcenter.set_source_name_as_cluster_group = False
2025-06-16 09:05:39,006 - DEBUG: Config: source.alphabeta-vcenter.sync_vm_dummy_interfaces = False
2025-06-16 09:05:39,007 - DEBUG: Config: source.alphabeta-vcenter.disable_vlan_sync = False
2025-06-16 09:05:39,007 - DEBUG: Config: source.alphabeta-vcenter.vlan_sync_exclude_by_name = None
2025-06-16 09:05:39,007 - DEBUG: Config: source.alphabeta-vcenter.vlan_sync_exclude_by_id = None
2025-06-16 09:05:39,007 - DEBUG: Config: source.alphabeta-vcenter.vlan_group_relation_by_name = None
2025-06-16 09:05:39,008 - DEBUG: Config: source.alphabeta-vcenter.vlan_group_relation_by_id = None
2025-06-16 09:05:39,008 - DEBUG: Config: source.alphabeta-vcenter.track_vm_host = False
2025-06-16 09:05:39,008 - DEBUG: Config: source.alphabeta-vcenter.overwrite_device_interface_name = True
2025-06-16 09:05:39,008 - DEBUG: Config: source.alphabeta-vcenter.overwrite_vm_interface_name = True
2025-06-16 09:05:39,009 - DEBUG: Config: source.alphabeta-vcenter.overwrite_device_platform = True
2025-06-16 09:05:39,009 - DEBUG: Config: source.alphabeta-vcenter.overwrite_vm_platform = True
2025-06-16 09:05:39,009 - DEBUG: Config: source.alphabeta-vcenter.host_management_interface_match = management, mgmt
2025-06-16 09:05:39,009 - DEBUG: Config: source.alphabeta-vcenter.ip_tenant_inheritance_order = device, prefix
2025-06-16 09:05:39,009 - DEBUG: Config: source.alphabeta-vcenter.sync_vm_interface_mtu = True
2025-06-16 09:05:39,009 - DEBUG: Config: source.alphabeta-vcenter.host_nic_exclude_by_mac_list = None
2025-06-16 09:05:39,009 - DEBUG: Config: source.alphabeta-vcenter.custom_attribute_exclude = None
2025-06-16 09:05:39,009 - DEBUG: Config: source.alphabeta-vcenter.vm_disk_and_ram_in_decimal = True
2025-06-16 09:05:39,010 - DEBUG: Starting vCenter SDK connection to 'vcenter.my.domain'
2025-06-16 09:05:39,080 - INFO: Successfully connected to vCenter SDK 'vcenter.my.domain'
2025-06-16 09:05:39,081 - INFO: Querying necessary objects from NetBox. This might take a while.
2025-06-16 09:05:39,081 - DEBUG: Requesting all tags from NetBox
2025-06-16 09:05:39,085 - WARNING: Request failed, trying again: Sending GET to 'https://app-netbox.my.domain:443/api/extras/tags/?limit=200&exclude=config_context'
2025-06-16 09:05:39,088 - WARNING: Request failed, trying again: Sending GET to 'https://app-netbox.my.domain:443/api/extras/tags/?limit=200&exclude=config_context'
2025-06-16 09:05:39,091 - WARNING: Request failed, trying again: Sending GET to 'https://app-netbox.my.domain:443/api/extras/tags/?limit=200&exclude=config_context'
2025-06-16 09:05:39,095 - WARNING: Request failed, trying again: Sending GET to 'https://app-netbox.my.domain:443/api/extras/tags/?limit=200&exclude=config_context'
ERROR: Giving up after 4 retries.

[bb-Ricardo]

Ahh ok, didn't know you were on DEBUG3 already. Anything in the webserver or netbox logs?

[steve-hbt]

Okay, I found the problem.
I had to disable the "validate_tls_certs" option in my settings.ini.

Thanks anyway for your quick response!

[bb-Ricardo]

Great you solve it.