regression: Fedora IoT 42 doesn't run %post kickstart sections #6397

bam80 · 2025-05-06T10:28:53Z

bam80
May 6, 2025

https://bugzilla.redhat.com/show_bug.cgi?id=2364442

Any help for debug?

Jul 18, 2025

This issue is most likely not caused by Anaconda, but by image-builder (which builds these ISOs) failing to activate a module; I'm still investigating but I'll update the Bugzilla with more information after I confirm some more bits. It is probably this bug: osbuild/bootc-image-builder#968

View full answer

bam80 · 2025-05-06T16:37:48Z

bam80
May 6, 2025
Author

This is regression.

With the very same kickstart, Fedora IoT 41 does run %post sections:

# grep -irI %post /tmp/
/tmp/anaconda.log:15:59:53,292 INF kickstart.script: Running kickstart %%post script(s)
/tmp/anaconda.log:15:59:57,469 INF kickstart.script: All kickstart %%post script(s) have been run

I do not see any attempts on Fedora IoT 42. %pre section runs, though.

0 replies

bam80 · 2025-05-13T13:05:56Z

bam80
May 13, 2025
Author

Anybody?

0 replies

bam80 · 2025-05-30T14:00:11Z

bam80
May 30, 2025
Author

IoT folks say it's Anaconda bug:
fedora-iot/iot-distro#97 (comment)

Any help to debug it?

@KKoukiou @jkonecny12

4 replies

bam80 Jul 14, 2025
Author

Any help? The issue is still there with the latest IoT image.

KKoukiou Jul 17, 2025
Maintainer

By latest do you mean Fedora 42 or Rawhide? Can you make sure this is broken in Rawhide, if you proceed with bug report?

bam80 Jul 17, 2025
Author

I mean latest Fedora 42, I'll check with 43 ISO you provided, thanks.

bam80 Jul 17, 2025
Author

43 (Rawhide) is also suffered.

bam80 · 2025-07-17T11:10:12Z

bam80
Jul 17, 2025
Author

I looked closely and apparently the problem is no Tasks are actually run:

# less /tmp/anaconda.log
...
19:54:57,938 INF core.threads: Running Thread: AnaTaskThread-RunInstallationTask-1 (139673938683584)
19:54:57,940 INF modules.common.task.task: Run the installation queue.
19:54:57,941 DBG ui.tui.spokes.installation_progress: The installation has started.
19:54:58,809 INF installation: Top-level task queue: Complete installation queue
Number of task queues: 17
Number of tasks: 28
Task & task group listing:
 Task queue: Installation queue
  Task queue: Installation environment setup
   Task: Get missing keyboard settings.
  Task queue: Early storage configuration
   Task: Create storage layout
   Task: Mount filesystems
  Task queue: Pre-install scripts
   Task: Run scripts
  Task queue: Pre install tasks
   Task: Find additional packages & run pre_install()
19:54:57,940 INF modules.common.task.task: Run the installation queue.
19:54:57,941 DBG ui.tui.spokes.installation_progress: The installation has started.
19:54:58,809 INF installation: Top-level task queue: Complete installation queue
Number of task queues: 17
Number of tasks: 28
Task & task group listing:
 Task queue: Installation queue
  Task queue: Installation environment setup
   Task: Get missing keyboard settings.
  Task queue: Early storage configuration
   Task: Create storage layout
   Task: Mount filesystems
  Task queue: Pre-install scripts
   Task: Run scripts
  Task queue: Pre install tasks
   Task: Find additional packages & run pre_install()
  Task queue: Payload installation
   Task: Install the payload
  Task queue: Late storage configuration
   Task: Write the storage configuration
  Task queue: Bootloader installation
   Task: Configure bootloader
   Task: Install bootloader
  Task queue: Post-installation setup tasks
   Task: Run post-installation setup tasks
 Task queue: Configuration queue
  Task queue: Installed system configuration
   Task: Set the Hardware Clock from the System Clock
   Task: Configure time zone
   Task: Configure NTP
   Task: Configure language
   Task: Configure keyboard
   Task: Configure firewall
  Task queue: Network configuration
   Task: Network configuration
  Task queue: User creation
   Task: Create groups
   Task: Create users
   Task: Configure root password
   Task: Set SSH keys
   Task: Configure optional root password SSH login
  Task queue: Anaconda addon configuration
  Task queue: Initramfs generation
   Task: Generate initramfs
  Task: Rerun zipl
  Task queue: Write configs and kickstarts
   Task: Store kickstarts
  Task queue: Post installation scripts
   Task: Run scripts
  Task: Set file contexts
  Task: Copy installation logs
19:54:58,811 INF installation: Task started: Installation queue (1/28)
19:54:58,812 INF installation: Queue started: Installation queue (1/17)
19:54:58,813 INF installation: Queue started: Installation environment setup (2/17)
19:54:58,840 INF installation: Queue started: Early storage configuration (3/17)
19:55:24,160 INF installation: Queue started: Pre-install scripts (4/17)
19:55:24,202 INF installation: Queue started: Pre install tasks (5/17)
19:55:24,203 DBG payload.migrated: Nothing to do in the pre-install step.
19:55:24,205 INF installation: Queue started: Payload installation (6/17)
20:03:35,994 INF installation: Queue started: Late storage configuration (7/17)
20:03:36,135 INF installation: Queue started: Bootloader installation (8/17)
20:03:36,455 INF installation: Queue started: Post-installation setup tasks (9/17)
20:03:45,235 DBG installation: Task completed: Installation queue (1/28) (526.4 s)
20:03:45,238 INF installation: Task started: Configuration queue (2/28)
20:03:45,239 INF installation: Queue started: Configuration queue (10/17)
20:03:45,239 INF installation: Queue started: Installed system configuration (11/17)
20:03:51,612 INF installation: Queue started: Network configuration (12/17)
20:03:52,527 INF installation: Queue started: User creation (13/17)
20:04:13,351 INF installation: Queue started: Anaconda addon configuration (14/17)
20:04:13,354 INF installation: Queue started: Initramfs generation (15/17)
20:04:13,462 INF installation: Queue started: Write configs and kickstarts (16/17)
20:04:13,695 INF installation: Queue started: Post installation scripts (17/17)
20:04:18,137 DBG installation: Task completed: Configuration queue (2/28) (32.9 s)
20:04:18,140 INF installation: All tasks in the installation queue are done. Installation successfully fi
nished.
20:04:18,141 INF core.threads: Thread Done: AnaTaskThread-RunInstallationTask-1 (139673938683584)
20:04:18,143 DBG ui.tui.spokes.installation_progress: The installation has finished.

From total 28 tasks, only 2 of them are started:

19:54:58,811 INF installation: Task started: Installation queue (1/28)
...
20:03:45,235 DBG installation: Task completed: Installation queue (1/28) (526.4 s)
20:03:45,238 INF installation: Task started: Configuration queue (2/28)
...
20:04:18,137 DBG installation: Task completed: Configuration queue (2/28) (32.9 s)

However, these should be a queues, not the tasks (see sample of the correct output: https://bugzilla.redhat.com/show_bug.cgi?id=2105961).

So the problem appearing to be more deep and is not related to %post sections particularly.
It also is not related with IoT, there were confirmations on other systems:
ublue-os/cayo#118

As always, any help? Thoughts?
Or am I on my own here?
@KKoukiou @jkonecny12 @bcl

2 replies

KKoukiou Jul 17, 2025
Maintainer

@bam80 please use bugzilla for reporting bugs https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&version=rawhide&component=anaconda

We do not follow the discussions section as closely, therefore you did not get any reply. Please include a step by step reproducer; did you suggest that https://kojipkgs.fedoraproject.org/compose/iot/latest-Fedora-IoT-43/compose/IoT/x86_64/iso/ is currently broken?

When was the last known working compose?

bam80 Jul 17, 2025
Author

@bam80 please use bugzilla for reporting bugs https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&version=rawhide&component=anaconda

@KKoukiou
This has been done from the beginning:
https://bugzilla.redhat.com/show_bug.cgi?id=2364442

We do not follow the discussions section as closely, therefore you did not get any reply. Please include a step by step reproducer;

The step by step reproducer was also provided in the bug report above.

did you suggest that https://kojipkgs.fedoraproject.org/compose/iot/latest-Fedora-IoT-43/compose/IoT/x86_64/iso/ is currently broken?

Yes, the Rawhide is also suffered.

When was the last known working compose?

The last working IoT ISO I have is:
Fedora-IoT-ostree-41-20241027.0.x86_64.iso

bam80 · 2025-07-17T17:46:50Z

bam80
Jul 17, 2025
Author

I think we could adjust test_kickstart.py to catch this problem (if it doesn't already):

anaconda/tests/unit_tests/pyanaconda_tests/modules/boss/test_kickstart.py

Lines 350 to 361 in fc489c6

    
           def test_run_scripts_with_task(self, mock_to_object_path): 
        
               """Test running scripts through DBus interface.""" 
        
               scripts_mock = Mock() 
        
               scripts_interface = ScriptsInterface(scripts_mock) 
        
               # Test running post scripts 
        
               script_type = KS_SCRIPT_POST 
        
               scripts_interface.RunScriptsWithTask(script_type) 
        
               # Ensure that the task for running the scripts is executed 
        
               scripts_mock.run_scripts_with_task.assert_called_once_with(script_type) 
        
               mock_to_object_path.assert_called_once()

0 replies

supakeen · 2025-07-18T07:29:22Z

supakeen
Jul 18, 2025

This issue is most likely not caused by Anaconda, but by image-builder (which builds these ISOs) failing to activate a module; I'm still investigating but I'll update the Bugzilla with more information after I confirm some more bits. It is probably this bug: osbuild/bootc-image-builder#968

1 reply

bam80 Jul 18, 2025
Author

Thanks, hopefully will be solved on the next IoT respin then. Closing.

regression: Fedora IoT 42 doesn't run %post kickstart sections #6397

Uh oh!

Uh oh!

bam80 May 6, 2025

Replies: 6 comments · 7 replies

Uh oh!

bam80 May 6, 2025 Author

Uh oh!

bam80 May 13, 2025 Author

Uh oh!

Uh oh!

bam80 May 30, 2025 Author

Uh oh!

bam80 Jul 14, 2025 Author

Uh oh!

KKoukiou Jul 17, 2025 Maintainer

Uh oh!

bam80 Jul 17, 2025 Author

Uh oh!

bam80 Jul 17, 2025 Author

Uh oh!

bam80 Jul 17, 2025 Author

Uh oh!

KKoukiou Jul 17, 2025 Maintainer

Uh oh!

bam80 Jul 17, 2025 Author

Uh oh!

bam80 Jul 17, 2025 Author

Uh oh!

Uh oh!

supakeen Jul 18, 2025

Uh oh!

bam80 Jul 18, 2025 Author

bam80
May 6, 2025

Replies: 6 comments 7 replies

bam80
May 6, 2025
Author

bam80
May 13, 2025
Author

bam80
May 30, 2025
Author

bam80 Jul 14, 2025
Author

KKoukiou Jul 17, 2025
Maintainer

bam80 Jul 17, 2025
Author

bam80 Jul 17, 2025
Author

bam80
Jul 17, 2025
Author

KKoukiou Jul 17, 2025
Maintainer

bam80 Jul 17, 2025
Author

bam80
Jul 17, 2025
Author

supakeen
Jul 18, 2025

bam80 Jul 18, 2025
Author