upgrade.sh ERROR Configuration File does not specify default realm

[cpoulter-kentcorp]

Setting up a brand new netbox server. Following the official install documentation. Can someone take a look and point me in the direction of a fix?
https://netbox.readthedocs.io/en/stable/installation/3-netbox/

Ubuntu 20.04.3 - Domain Joined (received the same results on another install where the OS is NOT domain joined)
Python 3.8.x

Successfully built ncclient pyeapi future yamlordereddictloader
Installing collected packages: pycparser, cffi, pynacl, future, cryptography, bcrypt, textfsm, paramiko, lxml, yamlordereddictloader, transitions, tenacity, scp, pyserial, passlib, ntc-templates, ncclient, loguru, dnspython, colorama, pyeapi, netmiko, junos-eznc, ciscoconfparse, napalm
Successfully installed bcrypt-3.2.0 cffi-1.14.6 ciscoconfparse-1.5.46 colorama-0.4.4 cryptography-35.0.0 dnspython-2.1.0 future-0.18.2 junos-eznc-2.6.3 loguru-0.5.3 lxml-4.6.3 napalm-3.3.1 ncclient-0.6.9 netmiko-3.4.0 ntc-templates-2.3.2 paramiko-2.7.2 passlib-1.7.4 pycparser-2.20 pyeapi-0.8.4 pynacl-1.4.0 pyserial-3.5 scp-0.14.1 tenacity-8.0.1 textfsm-1.1.2 transitions-0.8.10 yamlordereddictloader-0.4.0
Applying database migrations (python3 netbox/manage.py migrate)...
Traceback (most recent call last):
File "/opt/netbox/venv/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection
self.connect()
File "/opt/netbox/venv/lib/python3.8/site-packages/django/utils/asyncio.py", line 26, in inner
return func(*args, **kwargs)
File "/opt/netbox/venv/lib/python3.8/site-packages/django/db/backends/base/base.py", line 200, in connect
self.connection = self.get_new_connection(conn_params)
File "/opt/netbox/venv/lib/python3.8/site-packages/django/utils/asyncio.py", line 26, in inner
return func(*args, **kwargs)
File "/opt/netbox/venv/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 187, in get_new_connection
connection = Database.connect(**conn_params)
File "/opt/netbox/venv/lib/python3.8/site-packages/psycopg2/init.py", line 122, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
psycopg2.OperationalError: could not initiate GSSAPI security context: Unspecified GSS failure. Minor code may provide more information: Configuration file does not specify default realm
FATAL: password authentication failed for user "netbox"
FATAL: password authentication failed for user "netbox"

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "netbox/manage.py", line 10, in
execute_from_command_line(sys.argv)
File "/opt/netbox/venv/lib/python3.8/site-packages/django/core/management/init.py", line 419, in execute_from_command_line
utility.execute()
File "/opt/netbox/venv/lib/python3.8/site-packages/django/core/management/init.py", line 413, in execute
self.fetch_command(subcommand).run_from_argv(self.argv)
File "/opt/netbox/venv/lib/python3.8/site-packages/django/core/management/base.py", line 354, in run_from_argv
self.execute(*args, **cmd_options)
File "/opt/netbox/venv/lib/python3.8/site-packages/django/core/management/base.py", line 398, in execute
output = self.handle(*args, **options)
File "/opt/netbox/venv/lib/python3.8/site-packages/django/core/management/base.py", line 89, in wrapped
res = handle_func(*args, **kwargs)
File "/opt/netbox/venv/lib/python3.8/site-packages/django/core/management/commands/migrate.py", line 75, in handle
self.check(databases=[database])
File "/opt/netbox/venv/lib/python3.8/site-packages/django/core/management/base.py", line 419, in check
all_issues = checks.run_checks(
File "/opt/netbox/venv/lib/python3.8/site-packages/django/core/checks/registry.py", line 76, in run_checks
new_errors = check(app_configs=app_configs, databases=databases)
File "/opt/netbox/venv/lib/python3.8/site-packages/django/core/checks/model_checks.py", line 34, in check_all_models
errors.extend(model.check(**kwargs))
File "/opt/netbox/venv/lib/python3.8/site-packages/django/db/models/base.py", line 1290, in check
*cls._check_indexes(databases),
File "/opt/netbox/venv/lib/python3.8/site-packages/django/db/models/base.py", line 1682, in _check_indexes
connection.features.supports_covering_indexes or
File "/opt/netbox/venv/lib/python3.8/site-packages/django/utils/functional.py", line 48, in get
res = instance.dict[self.name] = self.func(instance)
File "/opt/netbox/venv/lib/python3.8/site-packages/django/db/backends/postgresql/features.py", line 93, in is_postgresql_11
return self.connection.pg_version >= 110000
File "/opt/netbox/venv/lib/python3.8/site-packages/django/utils/functional.py", line 48, in get
res = instance.dict[self.name] = self.func(instance)
File "/opt/netbox/venv/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 329, in pg_version
with self.temporary_connection():
File "/usr/lib/python3.8/contextlib.py", line 113, in enter
return next(self.gen)
File "/opt/netbox/venv/lib/python3.8/site-packages/django/db/backends/base/base.py", line 603, in temporary_connection
with self.cursor() as cursor:
File "/opt/netbox/venv/lib/python3.8/site-packages/django/utils/asyncio.py", line 26, in inner
return func(*args, **kwargs)
File "/opt/netbox/venv/lib/python3.8/site-packages/django/db/backends/base/base.py", line 259, in cursor
return self._cursor()
File "/opt/netbox/venv/lib/python3.8/site-packages/django/db/backends/base/base.py", line 235, in _cursor
self.ensure_connection()
File "/opt/netbox/venv/lib/python3.8/site-packages/django/utils/asyncio.py", line 26, in inner
return func(*args, **kwargs)
File "/opt/netbox/venv/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection
self.connect()
File "/opt/netbox/venv/lib/python3.8/site-packages/django/db/utils.py", line 90, in exit
raise dj_exc_value.with_traceback(traceback) from exc_value
File "/opt/netbox/venv/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection
self.connect()
File "/opt/netbox/venv/lib/python3.8/site-packages/django/utils/asyncio.py", line 26, in inner
return func(*args, **kwargs)
File "/opt/netbox/venv/lib/python3.8/site-packages/django/db/backends/base/base.py", line 200, in connect
self.connection = self.get_new_connection(conn_params)
File "/opt/netbox/venv/lib/python3.8/site-packages/django/utils/asyncio.py", line 26, in inner
return func(*args, **kwargs)
File "/opt/netbox/venv/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 187, in get_new_connection
connection = Database.connect(**conn_params)
File "/opt/netbox/venv/lib/python3.8/site-packages/psycopg2/init.py", line 122, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
django.db.utils.OperationalError: could not initiate GSSAPI security context: Unspecified GSS failure. Minor code may provide more information: Configuration file does not specify default realm
FATAL: password authentication failed for user "netbox"
FATAL: password authentication failed for user "netbox"

[candlerb]

The error is pretty clear: Netbox cannot authenticate to your postgres database.

psycopg2.OperationalError: could not initiate GSSAPI security context: Unspecified GSS failure. Minor code may provide more information: Configuration file does not specify default realm
FATAL: password authentication failed for user "netbox"
FATAL: password authentication failed for user "netbox"

I would ignore the GSSAPI (Kerberos) failure, because apparently it's then dropping down to password authentication, and that's failing. (But you might be able to silence it by creating /etc/krb5.conf with a default realm; and maybe the second error message is misleading)

Can you show the DATABASE section of configuration.py, with the password blanked out? Are you connecting to a local postgres database installed on the same server, or a remote postgres on a different server? For access to a remote database it's usually necessary to add an entry to /etc/postgresql/*/main/pg_hba.conf on the database server, to allow connections from the netbox server.

Also: try connecting to the postgres server using the psql command line tool, and the same credentials that you put in the DATABASE section. If that fails, then clearly it's not a problem with Netbox, but how the database was setup to allow connections from the netbox user. If it succeeds, then something else is going on.

[candlerb]

This post suggests that I was right in saying that you can ignore the GSSAPI error, because it's falling back to a different method, and that other method is failing.

Sorry to state the obvious, but when you did the psql test, did you copy-paste the password from the netbox configuration.py, not retype it? (Just to be 100% sure it's not something silly like a 1 versus l issue). And you didn't change any postgres settings? And the configuration.py you showed is /opt/netbox/netbox/netbox/configuration.py?

Apart from that, I'm afraid I really don't know why it won't connect.

[cpoulter-kentcorp]

Originally I copied from keypass which successfully authenticated.
I tested a 2nd time by copying directly from the configuration.py file and successfully authenticated again.

[cpoulter-kentcorp]

dumb. I changed the complex password in psql for user netbox and updated the configuration.py file.....and it worked.

Thank you for your help reviewing the error and suggestions @candlerb

[candlerb]

That's great. I wonder, did the password have a backslash in it? If so it would have to be doubled-up in the python string.

>>> print('foo\bar')
foar
>>> print('foo\\bar')
foo\bar

Another way is to prefix the string with r (for "raw")

>>> print(r'foo\bar')
foo\bar

[cpoulter-kentcorp]

Unfortunately once confirmed fixed I deleted the old password from my pass db, so I cannot confirm, but im willing to bet it did. Good to know for future setups.

Thanks again for your help!