Migrated from V2.11.0 to latest

[JHarrison712]

I have a Netbox Instance v2.10.5 running Ubuntu 1804 LTS and I got it to up v2.11.0, then I export the DB with this command.
pg_dump --username netbox --password --host localhost netbox > netbox.sql
after than I spun up a Ubuntu 2204 LTS instance went thro the installation of the new version. and then I ran the follow commands to import everything back
Set the secret_key in the configuration.py to the same value you used on the original server

Stop the NetBox Service with sudo systemctl stop netbox netbox-rq

Drop DB on new server, create a new blank, grant rights and import the dump:
sudo -u postgres psql -c 'drop database netbox'
sudo -u postgres psql -c 'create database netbox'
sudo -u postgres psql -c 'grant all privileges on database netbox to netbox'
sudo -u postgres psql netbox < netbox.sql
Then I did this source /opt/netbox/venv/bin/activate and run the migration script with python3 manage.py migrate
Restart Netbox with sudo systemctl start netbox netbox-rq and sudo systemctl enable netbox netbox-rq

Now I get the following errors in CLI

(venv) root@netbox-22:/opt/netbox/netbox# python3 manage.py migrate
Traceback (most recent call last):
File "/opt/netbox/venv/lib/python3.10/site-packages/django/db/migrations/loader.py", line 276, in build_graph
self.graph.validate_consistency()
File "/opt/netbox/venv/lib/python3.10/site-packages/django/db/migrations/graph.py", line 198, in validate_consistency
[n.raise_error() for n in self.node_map.values() if isinstance(n, DummyNode)]
File "/opt/netbox/venv/lib/python3.10/site-packages/django/db/migrations/graph.py", line 198, in
[n.raise_error() for n in self.node_map.values() if isinstance(n, DummyNode)]
File "/opt/netbox/venv/lib/python3.10/site-packages/django/db/migrations/graph.py", line 60, in raise_error
raise NodeNotFoundError(self.error_message, self.key, origin=self.origin)
django.db.migrations.exceptions.NodeNotFoundError: Migration dcim.0131_consoleport_speed dependencies reference nonexistent parent node ('dcim', '0130_sitegroup')

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/opt/netbox/netbox/manage.py", line 10, in
execute_from_command_line(sys.argv)
File "/opt/netbox/venv/lib/python3.10/site-packages/django/core/management/init.py", line 442, in execute_from_command_line
utility.execute()
File "/opt/netbox/venv/lib/python3.10/site-packages/django/core/management/init.py", line 436, in execute
self.fetch_command(subcommand).run_from_argv(self.argv)
File "/opt/netbox/venv/lib/python3.10/site-packages/django/core/management/base.py", line 412, in run_from_argv
self.execute(*args, **cmd_options)
File "/opt/netbox/venv/lib/python3.10/site-packages/django/core/management/base.py", line 458, in execute
output = self.handle(*args, **options)
File "/opt/netbox/venv/lib/python3.10/site-packages/django/core/management/base.py", line 106, in wrapper
res = handle_func(*args, **kwargs)
File "/opt/netbox/venv/lib/python3.10/site-packages/django/core/management/commands/migrate.py", line 117, in handle
executor = MigrationExecutor(connection, self.migration_progress_callback)
File "/opt/netbox/venv/lib/python3.10/site-packages/django/db/migrations/executor.py", line 18, in init
self.loader = MigrationLoader(self.connection)
File "/opt/netbox/venv/lib/python3.10/site-packages/django/db/migrations/loader.py", line 58, in init
self.build_graph()
File "/opt/netbox/venv/lib/python3.10/site-packages/django/db/migrations/loader.py", line 295, in build_graph
raise NodeNotFoundError(
django.db.migrations.exceptions.NodeNotFoundError: Migration dcim.0131_consoleport_speed depends on nonexistent node ('dcim', '0130_sitegroup'). Django tried to replace migration dcim.0130_sitegroup with any of [dcim.0003_squashed_0130] but wasn't able to because some of the replaced migrations are already applied.
(venv) root@netbox-22:/opt/netbox/netbox#

Now I get the following errors in GUI

Server Error
A database programming error was detected while processing this request. Common causes include the following:

Database migrations missing. When upgrading to a new NetBox release, the upgrade script must be run to apply any new database migrations. You can run migrations manually by executing python3 manage.py migrate from the command line.

Unsupported PostgreSQL version. Ensure that PostgreSQL version 12 or later is in use. You can check this by connecting to the database using NetBox's credentials and issuing a query for SELECT VERSION().

The complete exception is provided below:

<class 'django.db.utils.ProgrammingError'>

relation "extras_bookmark" does not exist
LINE 1: ...rk"."object_id", "extras_bookmark"."user_id" FROM "extras_bo...
^

Python version: 3.10.12
NetBox version: 3.7.3
Plugins: None installed
If further assistance is required, please post to the NetBox discussion forum on GitHub.

[candlerb]

django.db.migrations.exceptions.NodeNotFoundError: Migration dcim.0131_consoleport_speed depends on nonexistent node ('dcim', '0130_sitegroup'). Django tried to replace migration dcim.0130_sitegroup with any of [dcim.0003_squashed_0130] but wasn't able to because some of the replaced migrations are already applied.

0130_sitegroup.py was removed in 4383425 and has a replacement entry in netbox/dcim/migrations/0003_squashed_0130.py

    replaces = [
...
        ('dcim', '0130_sitegroup'),
    ]

Django seems to think you've partially applied this update. What happens if you drop the database, reimport and remigrate?

I note that 2.11.0 was released on Fri Apr 16 09:52:45 2021 -0400, but there was a commit a week later which may be relevant:

commit 4939b6b641020467a859b781e4de408647023d87
Author: jeremystretch <jeremy@netverity.dev>
Date:   Fri Apr 23 10:07:11 2021 -0400

    Fixes #6252: Fix assignment of console port speed values above 19.2kbps

diff --git a/netbox/dcim/migrations/0131_consoleport_speed.py b/netbox/dcim/migrations/0131_consoleport_speed.py
new file mode 100644
index 000000000..350162218
--- /dev/null
+++ b/netbox/dcim/migrations/0131_consoleport_speed.py
@@ -0,0 +1,21 @@
+from django.db import migrations, models
+
+
+class Migration(migrations.Migration):
+
+    dependencies = [
+        ('dcim', '0130_sitegroup'),
+    ]
+
+    operations = [
+        migrations.AlterField(
+            model_name='consoleport',
+            name='speed',
+            field=models.PositiveIntegerField(blank=True, null=True),
+        ),
+        migrations.AlterField(
+            model_name='consoleserverport',
+            name='speed',
+            field=models.PositiveIntegerField(blank=True, null=True),
+        ),
+    ]

Since this migration still exists in v3.7.3, I don't think it should cause any problem. Still, it is this migration that it's complaining about. It might not do any harm to upgrade your existing system to v2.11.12 first, then re-export the database, then drop the database on your new system and import this database dump.

[JHarrison712]

So I got my original Netbox Server to v2.11.12 and then exported the database again and then copied it to the new server and then reimported it to the new version v3.7.3 and ran the python3 manage.py migrate and now I get from the cli

Applying database migrations (python3 netbox/manage.py migrate)...
Operations to perform:
Apply all migrations: account, admin, auth, circuits, contenttypes, core, dcim, django_rq, extras, ipam, sessions, social_django, taggit, tenancy, users, virtualization, vpn, wireless
Running migrations:
Applying extras.0062_clear_secrets_changelog...Skipping config initialization (database unavailable)
Traceback (most recent call last):
File "/opt/netbox/venv/lib/python3.10/site-packages/django/db/backends/utils.py", line 89, in _execute
return self.cursor.execute(sql, params)
File "/opt/netbox/venv/lib/python3.10/site-packages/psycopg/cursor.py", line 732, in execute
raise ex.with_traceback(None)
psycopg.errors.InFailedSqlTransaction: current transaction is aborted, commands ignored until end of transaction block

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/opt/netbox/netbox/manage.py", line 10, in
execute_from_command_line(sys.argv)
File "/opt/netbox/venv/lib/python3.10/site-packages/django/core/management/init.py", line 442, in execute_from_command_line
utility.execute()
File "/opt/netbox/venv/lib/python3.10/site-packages/django/core/management/init.py", line 436, in execute
self.fetch_command(subcommand).run_from_argv(self.argv)
File "/opt/netbox/venv/lib/python3.10/site-packages/django/core/management/base.py", line 412, in run_from_argv
self.execute(*args, **cmd_options)
File "/opt/netbox/venv/lib/python3.10/site-packages/django/core/management/base.py", line 458, in execute
output = self.handle(*args, **options)
File "/opt/netbox/venv/lib/python3.10/site-packages/django/core/management/base.py", line 106, in wrapper
res = handle_func(*args, **kwargs)
File "/opt/netbox/venv/lib/python3.10/site-packages/django/core/management/commands/migrate.py", line 356, in handle
post_migrate_state = executor.migrate(
File "/opt/netbox/venv/lib/python3.10/site-packages/django/db/migrations/executor.py", line 135, in migrate
state = self._migrate_all_forwards(
File "/opt/netbox/venv/lib/python3.10/site-packages/django/db/migrations/executor.py", line 167, in _migrate_all_forwards
state = self.apply_migration(
File "/opt/netbox/venv/lib/python3.10/site-packages/django/db/migrations/executor.py", line 252, in apply_migration
state = migration.apply(state, schema_editor)
File "/opt/netbox/venv/lib/python3.10/site-packages/django/db/migrations/migration.py", line 132, in apply
operation.database_forwards(
File "/opt/netbox/venv/lib/python3.10/site-packages/django/db/migrations/operations/special.py", line 193, in database_forwards
self.code(from_state.apps, schema_editor)
File "/opt/netbox/netbox/extras/migrations/0062_clear_secrets_changelog.py", line 12, in clear_secrets_changelog
ObjectChange.objects.filter(changed_object_type__in=content_type_ids).delete()
File "/opt/netbox/venv/lib/python3.10/site-packages/django/db/models/query.py", line 1148, in delete
deleted, _rows_count = collector.delete()
File "/opt/netbox/venv/lib/python3.10/site-packages/django/db/models/deletion.py", line 506, in delete
count = query.delete_batch(pk_list, self.using)
File "/opt/netbox/venv/lib/python3.10/site-packages/django/db/models/sql/subqueries.py", line 42, in delete_batch
num_deleted += self.do_query(
File "/opt/netbox/venv/lib/python3.10/site-packages/django/db/models/sql/subqueries.py", line 20, in do_query
cursor = self.get_compiler(using).execute_sql(CURSOR)
File "/opt/netbox/venv/lib/python3.10/site-packages/django/db/models/sql/compiler.py", line 1562, in execute_sql
cursor.execute(sql, params)
File "/opt/netbox/venv/lib/python3.10/site-packages/django/db/backends/utils.py", line 67, in execute
return self._execute_with_wrappers(
File "/opt/netbox/venv/lib/python3.10/site-packages/django/db/backends/utils.py", line 80, in _execute_with_wrappers
return executor(sql, params, many, context)
File "/opt/netbox/venv/lib/python3.10/site-packages/django/db/backends/utils.py", line 84, in _execute
with self.db.wrap_database_errors:
File "/opt/netbox/venv/lib/python3.10/site-packages/django/db/utils.py", line 91, in exit
raise dj_exc_value.with_traceback(traceback) from exc_value
File "/opt/netbox/venv/lib/python3.10/site-packages/django/db/backends/utils.py", line 89, in _execute
return self.cursor.execute(sql, params)
File "/opt/netbox/venv/lib/python3.10/site-packages/psycopg/cursor.py", line 732, in execute
raise ex.with_traceback(None)
django.db.utils.InternalError: current transaction is aborted, commands ignored until end of transaction block

[candlerb]

Applying extras.0062_clear_secrets_changelog...Skipping config initialization (database unavailable)

I haven't seen this error before. Are you running the right version of postgres? Version 12 or later is required.

[JHarrison712]

I decided to just make a new Netbox Database and start over. Looks like it wasn't straight forward what Netbox devs said it was and they wouldn't help either.