Migration failed when updating from 4.0.11-2.9.1 to 4.1-3.0.1

[Horstinator]

I'm trying to upgrade my netbox instance from 4.0.11-2.9.1 to 4.1-3.0.1 but am running into an issue:
The database migration fails with the error ERROR: relation "extras_objectchange" does not exist at character 506, however the table does exist and the query that fails runs just fine if I run it manually (returning 0 rows).

docker exec netbox-postgres-1 psql -U netbox netbox -c 'SELECT "extras_objectchange"."id", "extras_objectchange"."time", "extras_objectchange"."user_name", "extras_objectchange"."request_id", "extras_objectchange"."action", "extras_objectchange"."changed_object_id", "extras_objectchange"."related_object_id", "extras_objectchange"."object_repr", "extras_objectchange"."prechange_data", "extras_objectchange"."postchange_data", "extras_objectchange"."changed_object_type_id", "extras_objectchange"."related_object_type_id", "extras_objectchange"."user_id" FROM "extras_objectchange" WHERE "extras_objectchange"."changed_object_type_id" IN (149) ORDER BY "extras_objectchange"."time" DESC;'
 id | time | user_name | request_id | action | changed_object_id | related_object_id | object_repr | prechange_data | postchange_data | changed_object_type_id | related_object_type_id | user_id
----+------+-----------+------------+--------+-------------------+-------------------+-------------+----------------+-----------------+------------------------+------------------------+---------
(0 rows)

I'm not sure if this issue is related to netbox-docker or the core netbox project.

Docker Logs:

docker compose up
[+] Running 7/7
 ⠿ Network netbox_default                  Created                                                                                                                                                                                                                  0.1s
 ⠿ Container netbox-postgres-1             Created                                                                                                                                                                                                                  0.3s
 ⠿ Container netbox-redis-1                Created                                                                                                                                                                                                                  0.2s
 ⠿ Container netbox-redis-cache-1          Created                                                                                                                                                                                                                  0.3s
 ⠿ Container netbox-netbox-1               Created                                                                                                                                                                                                                  0.1s
 ⠿ Container netbox-netbox-worker-1        Created                                                                                                                                                                                                                  0.1s
 ⠿ Container netbox-netbox-housekeeping-1  Created                                                                                                                                                                                                                  0.1s
Attaching to netbox-netbox-1, netbox-netbox-housekeeping-1, netbox-netbox-worker-1, netbox-postgres-1, netbox-redis-1, netbox-redis-cache-1
netbox-redis-cache-1          | 1:C 06 Sep 2024 10:35:05.398 # WARNING Memory overcommit must be enabled! Without it, a background save or replication may fail under low memory condition. Being disabled, it can also cause failures without low memory condition, see https://github.com/jemalloc/jemalloc/issues/1328. To fix this issue add 'vm.overcommit_memory = 1' to /etc/sysctl.conf and then reboot or run the command 'sysctl vm.overcommit_memory=1' for this to take effect.
netbox-redis-cache-1          | 1:C 06 Sep 2024 10:35:05.398 * oO0OoO0OoO0Oo Valkey is starting oO0OoO0OoO0Oo
netbox-redis-cache-1          | 1:C 06 Sep 2024 10:35:05.398 * Valkey version=7.9.240, bits=64, commit=00000000, modified=0, pid=1, just started
netbox-redis-cache-1          | 1:C 06 Sep 2024 10:35:05.398 * Configuration loaded
netbox-redis-cache-1          | 1:M 06 Sep 2024 10:35:05.399 * monotonic clock: POSIX clock_gettime
netbox-redis-cache-1          | 1:M 06 Sep 2024 10:35:05.400 * Running mode=standalone, port=6379.
netbox-redis-cache-1          | 1:M 06 Sep 2024 10:35:05.400 * Server initialized
netbox-redis-cache-1          | 1:M 06 Sep 2024 10:35:05.401 * Loading RDB produced by Valkey version 7.9.240
netbox-redis-cache-1          | 1:M 06 Sep 2024 10:35:05.401 * RDB age 5 seconds
netbox-redis-cache-1          | 1:M 06 Sep 2024 10:35:05.401 * RDB memory usage when created 1.10 Mb
netbox-redis-cache-1          | 1:M 06 Sep 2024 10:35:05.401 * Done loading RDB, keys loaded: 1, keys expired: 0.
netbox-redis-cache-1          | 1:M 06 Sep 2024 10:35:05.401 * DB loaded from disk: 0.000 seconds
netbox-redis-cache-1          | 1:M 06 Sep 2024 10:35:05.401 * Ready to accept connections tcp
netbox-redis-1                | 1:C 06 Sep 2024 10:35:05.586 # WARNING Memory overcommit must be enabled! Without it, a background save or replication may fail under low memory condition. Being disabled, it can also cause failures without low memory condition, see https://github.com/jemalloc/jemalloc/issues/1328. To fix this issue add 'vm.overcommit_memory = 1' to /etc/sysctl.conf and then reboot or run the command 'sysctl vm.overcommit_memory=1' for this to take effect.
netbox-redis-1                | 1:C 06 Sep 2024 10:35:05.586 * oO0OoO0OoO0Oo Valkey is starting oO0OoO0OoO0Oo
netbox-redis-1                | 1:C 06 Sep 2024 10:35:05.586 * Valkey version=7.9.240, bits=64, commit=00000000, modified=0, pid=1, just started
netbox-redis-1                | 1:C 06 Sep 2024 10:35:05.586 * Configuration loaded
netbox-redis-1                | 1:M 06 Sep 2024 10:35:05.586 * monotonic clock: POSIX clock_gettime
netbox-redis-1                | 1:M 06 Sep 2024 10:35:05.587 * Running mode=standalone, port=6379.
netbox-redis-1                | 1:M 06 Sep 2024 10:35:05.588 * Server initialized
netbox-redis-1                | 1:M 06 Sep 2024 10:35:05.588 * Reading RDB base file on AOF loading...
netbox-redis-1                | 1:M 06 Sep 2024 10:35:05.588 * Loading RDB produced by Valkey version 7.9.240
netbox-redis-1                | 1:M 06 Sep 2024 10:35:05.588 * RDB age 8303 seconds
netbox-redis-1                | 1:M 06 Sep 2024 10:35:05.588 * RDB memory usage when created 0.96 Mb
netbox-redis-1                | 1:M 06 Sep 2024 10:35:05.588 * RDB is base AOF
netbox-redis-1                | 1:M 06 Sep 2024 10:35:05.588 * Done loading RDB, keys loaded: 0, keys expired: 0.
netbox-redis-1                | 1:M 06 Sep 2024 10:35:05.588 * DB loaded from base file appendonly.aof.1.base.rdb: 0.000 seconds
netbox-redis-1                | 1:M 06 Sep 2024 10:35:05.591 * DB loaded from incr file appendonly.aof.1.incr.aof: 0.003 seconds
netbox-redis-1                | 1:M 06 Sep 2024 10:35:05.591 * DB loaded from append only file: 0.003 seconds
netbox-redis-1                | 1:M 06 Sep 2024 10:35:05.591 * Opening AOF incr file appendonly.aof.1.incr.aof on server start
netbox-redis-1                | 1:M 06 Sep 2024 10:35:05.591 * Ready to accept connections tcp
netbox-postgres-1             |
netbox-postgres-1             | PostgreSQL Database directory appears to contain a database; Skipping initialization
netbox-postgres-1             |
netbox-postgres-1             | 2024-09-06 10:35:05.857 UTC [1] LOG:  starting PostgreSQL 16.4 on x86_64-pc-linux-musl, compiled by gcc (Alpine 13.2.1_git20240309) 13.2.1 20240309, 64-bit
netbox-postgres-1             | 2024-09-06 10:35:05.857 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
netbox-postgres-1             | 2024-09-06 10:35:05.857 UTC [1] LOG:  listening on IPv6 address "::", port 5432
netbox-postgres-1             | 2024-09-06 10:35:05.870 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
netbox-postgres-1             | 2024-09-06 10:35:05.887 UTC [29] LOG:  database system was shut down at 2024-09-06 10:35:00 UTC
netbox-postgres-1             | 2024-09-06 10:35:05.905 UTC [1] LOG:  database system is ready to accept connections
netbox-netbox-1               | ⚙️ Applying database migrations
netbox-netbox-1               | 🧬 loaded config '/etc/netbox/config/configuration.py'
netbox-netbox-1               | 🧬 loaded config '/etc/netbox/config/extra.py'
netbox-netbox-1               | 🧬 loaded config '/etc/netbox/config/logging.py'
netbox-netbox-1               | 🧬 loaded config '/etc/netbox/config/plugins.py'
netbox-netbox-1               | Operations to perform:
netbox-netbox-1               |   Apply all migrations: account, auth, circuits, contenttypes, core, dcim, django_rq, extras, ipam, sessions, social_django, taggit, tenancy, users, virtualization, vpn, wireless
netbox-netbox-1               | Running migrations:
netbox-postgres-1             | 2024-09-06 10:35:20.849 UTC [42] ERROR:  relation "extras_objectchange" does not exist at character 506
netbox-postgres-1             | 2024-09-06 10:35:20.849 UTC [42] STATEMENT:  SELECT "extras_objectchange"."id", "extras_objectchange"."time", "extras_objectchange"."user_name", "extras_objectchange"."request_id", "extras_objectchange"."action", "extras_objectchange"."changed_object_id", "extras_objectchange"."related_object_id", "extras_objectchange"."object_repr", "extras_objectchange"."prechange_data", "extras_objectchange"."postchange_data", "extras_objectchange"."changed_object_type_id", "extras_objectchange"."related_object_type_id", "extras_objectchange"."user_id" FROM "extras_objectchange" WHERE "extras_objectchange"."changed_object_type_id" IN (149) ORDER BY "extras_objectchange"."time" DESC
netbox-netbox-1               |   Applying extras.0117_move_objectchange...Traceback (most recent call last):
netbox-netbox-1               |   File "/opt/netbox/venv/lib/python3.12/site-packages/django/db/backends/utils.py", line 105, in _execute
netbox-netbox-1               |     return self.cursor.execute(sql, params)
netbox-netbox-1               |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
netbox-netbox-1               |   File "/opt/netbox/venv/lib/python3.12/site-packages/psycopg/cursor.py", line 97, in execute
netbox-netbox-1               |     raise ex.with_traceback(None)
netbox-netbox-1               | psycopg.errors.UndefinedTable: relation "extras_objectchange" does not exist
netbox-netbox-1               | LINE 1: ...ct_type_id", "extras_objectchange"."user_id" FROM "extras_ob...
netbox-netbox-1               |                                                              ^
netbox-netbox-1               |
netbox-netbox-1               | The above exception was the direct cause of the following exception:
netbox-netbox-1               |
netbox-netbox-1               | Traceback (most recent call last):
netbox-netbox-1               |   File "/opt/netbox/netbox/./manage.py", line 10, in <module>
netbox-netbox-1               |     execute_from_command_line(sys.argv)
netbox-netbox-1               |   File "/opt/netbox/venv/lib/python3.12/site-packages/django/core/management/__init__.py", line 442, in execute_from_command_line
netbox-netbox-1               |     utility.execute()
netbox-netbox-1               |   File "/opt/netbox/venv/lib/python3.12/site-packages/django/core/management/__init__.py", line 436, in execute
netbox-netbox-1               |     self.fetch_command(subcommand).run_from_argv(self.argv)
netbox-netbox-1               |   File "/opt/netbox/venv/lib/python3.12/site-packages/django/core/management/base.py", line 413, in run_from_argv
netbox-netbox-1               |     self.execute(*args, **cmd_options)
netbox-netbox-1               |   File "/opt/netbox/venv/lib/python3.12/site-packages/django/core/management/base.py", line 459, in execute
netbox-netbox-1               |     output = self.handle(*args, **options)
netbox-netbox-1               |              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
netbox-netbox-1               |   File "/opt/netbox/venv/lib/python3.12/site-packages/django/core/management/base.py", line 107, in wrapper
netbox-netbox-1               |     res = handle_func(*args, **kwargs)
netbox-netbox-1               |           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
netbox-netbox-1               |   File "/opt/netbox/venv/lib/python3.12/site-packages/django/core/management/commands/migrate.py", line 356, in handle
netbox-netbox-1               |     post_migrate_state = executor.migrate(
netbox-netbox-1               |                          ^^^^^^^^^^^^^^^^^
netbox-netbox-1               |   File "/opt/netbox/venv/lib/python3.12/site-packages/django/db/migrations/executor.py", line 135, in migrate
netbox-netbox-1               |     state = self._migrate_all_forwards(
netbox-netbox-1               |             ^^^^^^^^^^^^^^^^^^^^^^^^^^^
netbox-netbox-1               |   File "/opt/netbox/venv/lib/python3.12/site-packages/django/db/migrations/executor.py", line 167, in _migrate_all_forwards
netbox-netbox-1               |     state = self.apply_migration(
netbox-netbox-1               |             ^^^^^^^^^^^^^^^^^^^^^
netbox-netbox-1               |   File "/opt/netbox/venv/lib/python3.12/site-packages/django/db/migrations/executor.py", line 252, in apply_migration
netbox-netbox-1               |     state = migration.apply(state, schema_editor)
netbox-netbox-1               |             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
netbox-netbox-1               |   File "/opt/netbox/venv/lib/python3.12/site-packages/django/db/migrations/migration.py", line 132, in apply
netbox-netbox-1               |     operation.database_forwards(
netbox-netbox-1               |   File "/opt/netbox/venv/lib/python3.12/site-packages/django/db/migrations/operations/special.py", line 193, in database_forwards
netbox-netbox-1               |     self.code(from_state.apps, schema_editor)
netbox-netbox-1               |   File "/opt/netbox/netbox/extras/migrations/0117_move_objectchange.py", line 8, in update_content_types
netbox-netbox-1               |     ContentType.objects.filter(app_label='core', model='objectchange').delete()
netbox-netbox-1               |   File "/opt/netbox/venv/lib/python3.12/site-packages/django/db/models/query.py", line 1187, in delete
netbox-netbox-1               |     collector.collect(del_query)
netbox-netbox-1               |   File "/opt/netbox/venv/lib/python3.12/site-packages/django/db/models/deletion.py", line 348, in collect
netbox-netbox-1               |     if getattr(on_delete, "lazy_sub_objs", False) or sub_objs:
netbox-netbox-1               |                                                      ^^^^^^^^
netbox-netbox-1               |   File "/opt/netbox/venv/lib/python3.12/site-packages/django/db/models/query.py", line 414, in __bool__
netbox-netbox-1               |     self._fetch_all()
netbox-netbox-1               |   File "/opt/netbox/venv/lib/python3.12/site-packages/django/db/models/query.py", line 1928, in _fetch_all
netbox-netbox-1               |     self._result_cache = list(self._iterable_class(self))
netbox-netbox-1               |                          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
netbox-netbox-1               |   File "/opt/netbox/venv/lib/python3.12/site-packages/django/db/models/query.py", line 91, in __iter__
netbox-netbox-1               |     results = compiler.execute_sql(
netbox-netbox-1               |               ^^^^^^^^^^^^^^^^^^^^^
netbox-netbox-1               |   File "/opt/netbox/venv/lib/python3.12/site-packages/django/db/models/sql/compiler.py", line 1562, in execute_sql
netbox-netbox-1               |     cursor.execute(sql, params)
netbox-netbox-1               |   File "/opt/netbox/venv/lib/python3.12/site-packages/django/db/backends/utils.py", line 79, in execute
netbox-netbox-1               |     return self._execute_with_wrappers(
netbox-netbox-1               |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
netbox-netbox-1               |   File "/opt/netbox/venv/lib/python3.12/site-packages/django/db/backends/utils.py", line 92, in _execute_with_wrappers
netbox-netbox-1               |     return executor(sql, params, many, context)
netbox-netbox-1               |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
netbox-netbox-1               |   File "/opt/netbox/venv/lib/python3.12/site-packages/django/db/backends/utils.py", line 100, in _execute
netbox-netbox-1               |     with self.db.wrap_database_errors:
netbox-netbox-1               |   File "/opt/netbox/venv/lib/python3.12/site-packages/django/db/utils.py", line 91, in __exit__
netbox-netbox-1               |     raise dj_exc_value.with_traceback(traceback) from exc_value
netbox-netbox-1               |   File "/opt/netbox/venv/lib/python3.12/site-packages/django/db/backends/utils.py", line 105, in _execute
netbox-netbox-1               |     return self.cursor.execute(sql, params)
netbox-netbox-1               |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
netbox-netbox-1               |   File "/opt/netbox/venv/lib/python3.12/site-packages/psycopg/cursor.py", line 97, in execute
netbox-netbox-1               |     raise ex.with_traceback(None)
netbox-netbox-1               | django.db.utils.ProgrammingError: relation "extras_objectchange" does not exist
netbox-netbox-1               | LINE 1: ...ct_type_id", "extras_objectchange"."user_id" FROM "extras_ob...
netbox-netbox-1               |                                                              ^
netbox-netbox-1 exited with code 1

[lopar]

It is related to core netbox project. There are existing discussions about this error.
netbox-community/netbox#17382
netbox-community/netbox#17388

[wessrow]

Yup. Same issue - tried both upgrading and fresh install, and then database import, both scenarios result in the migration to crash:

netbox-1       |     return self.cursor.execute(sql, params)
netbox-1       |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
netbox-1       |   File "/opt/netbox/venv/lib/python3.12/site-packages/psycopg/cursor.py", line 97, in execute
netbox-1       |     raise ex.with_traceback(None)
netbox-1       | django.db.utils.ProgrammingError: relation "extras_objectchange" does not exist
netbox-1       | LINE 1: ...ct_type_id", "extras_objectchange"."user_id" FROM "extras_ob...
netbox-1       |

Not related to netbox-docker though, as others are having the same issue using netbox core: #17388