OC command not in /usr/local/bin/bootkube.sh error

[aheath1992]

Trying to install a single node OKD system and getting the following errors in the journalctl -b -f -u release-image.service -u bootkube.service command trying to watch the cluster standup

Jan 29 20:46:16 localhost.localdomain podman[11789]: 2025-01-29 20:46:16.739304509 +0000 UTC m=+0.031106272 container remove 7eb63c2d4bd768101a954c6c9bb49e61db383e820b24ae912ca2e8d6b05aeefb (image=quay.io/okd/scos-release@sha256:a4c786872daa033c942a56ee437b52b1546abfe5f546754845b805a7cff6c0c4, name=confident_yonath, io.openshift.release=4.17.0-okd-scos.0, io.openshift.release.base-image-digest=sha256:95e0a08c2404b32ec56aec62abc23dcb583996624b39a58e6e1b80347a674ce0)
Jan 29 20:46:16 localhost.localdomain podman[11800]: 2025-01-29 20:46:16.784083854 +0000 UTC m=+0.032149086 container create de26d2264b3bc7b717d8d7e7c571b7c142bc3ac4cc86b70a848681e7edcee2ae (image=quay.io/okd/scos-release@sha256:a4c786872daa033c942a56ee437b52b1546abfe5f546754845b805a7cff6c0c4, name=goofy_galois, io.openshift.release=4.17.0-okd-scos.0, io.openshift.release.base-image-digest=sha256:95e0a08c2404b32ec56aec62abc23dcb583996624b39a58e6e1b80347a674ce0)
Jan 29 20:46:16 localhost.localdomain podman[11800]: 2025-01-29 20:46:16.835336551 +0000 UTC m=+0.083401777 container init de26d2264b3bc7b717d8d7e7c571b7c142bc3ac4cc86b70a848681e7edcee2ae (image=quay.io/okd/scos-release@sha256:a4c786872daa033c942a56ee437b52b1546abfe5f546754845b805a7cff6c0c4, name=goofy_galois, io.openshift.release=4.17.0-okd-scos.0, io.openshift.release.base-image-digest=sha256:95e0a08c2404b32ec56aec62abc23dcb583996624b39a58e6e1b80347a674ce0)
Jan 29 20:46:16 localhost.localdomain podman[11800]: 2025-01-29 20:46:16.837447131 +0000 UTC m=+0.085512339 container start de26d2264b3bc7b717d8d7e7c571b7c142bc3ac4cc86b70a848681e7edcee2ae (image=quay.io/okd/scos-release@sha256:a4c786872daa033c942a56ee437b52b1546abfe5f546754845b805a7cff6c0c4, name=goofy_galois, io.openshift.release=4.17.0-okd-scos.0, io.openshift.release.base-image-digest=sha256:95e0a08c2404b32ec56aec62abc23dcb583996624b39a58e6e1b80347a674ce0)
Jan 29 20:46:16 localhost.localdomain podman[11800]: 2025-01-29 20:46:16.83779352 +0000 UTC m=+0.085858737 container attach de26d2264b3bc7b717d8d7e7c571b7c142bc3ac4cc86b70a848681e7edcee2ae (image=quay.io/okd/scos-release@sha256:a4c786872daa033c942a56ee437b52b1546abfe5f546754845b805a7cff6c0c4, name=goofy_galois, io.openshift.release=4.17.0-okd-scos.0, io.openshift.release.base-image-digest=sha256:95e0a08c2404b32ec56aec62abc23dcb583996624b39a58e6e1b80347a674ce0)
Jan 29 20:46:16 localhost.localdomain goofy_galois[11811]: quay.io/okd/scos-content@sha256:acc0f64aed2c63e44311e3aba8cc35ea126a8c8accf153fe01c598d7c3705585
Jan 29 20:46:16 localhost.localdomain podman[11800]: 2025-01-29 20:46:16.774049573 +0000 UTC m=+0.022114797 image pull 0b58a6a12084985ae2be8b7418719d78342a736854c8dc5b2ce56ab192f24876 quay.io/okd/scos-release@sha256:a4c786872daa033c942a56ee437b52b1546abfe5f546754845b805a7cff6c0c4
Jan 29 20:46:16 localhost.localdomain podman[11821]: 2025-01-29 20:46:16.89190808 +0000 UTC m=+0.023630256 container died de26d2264b3bc7b717d8d7e7c571b7c142bc3ac4cc86b70a848681e7edcee2ae (image=quay.io/okd/scos-release@sha256:a4c786872daa033c942a56ee437b52b1546abfe5f546754845b805a7cff6c0c4, name=goofy_galois, io.openshift.release.base-image-digest=sha256:95e0a08c2404b32ec56aec62abc23dcb583996624b39a58e6e1b80347a674ce0, io.openshift.release=4.17.0-okd-scos.0)
Jan 29 20:46:16 localhost.localdomain podman[11821]: 2025-01-29 20:46:16.906132283 +0000 UTC m=+0.037854445 container remove de26d2264b3bc7b717d8d7e7c571b7c142bc3ac4cc86b70a848681e7edcee2ae (image=quay.io/okd/scos-release@sha256:a4c786872daa033c942a56ee437b52b1546abfe5f546754845b805a7cff6c0c4, name=goofy_galois, io.openshift.release=4.17.0-okd-scos.0, io.openshift.release.base-image-digest=sha256:95e0a08c2404b32ec56aec62abc23dcb583996624b39a58e6e1b80347a674ce0)
Jan 29 20:46:16 localhost.localdomain bootkube.sh[11833]: /usr/local/bin/bootkube.sh: line 85: oc: command not found

looking a bit closer the release-image-pivot.service also failed with the following errors

Jan 29 20:45:45 localhost.localdomain systemd[1]: Starting release-image-pivot.service - Pivot bootstrap to the OpenShift Release Image...
Jan 29 20:45:45 localhost.localdomain bootstrap-pivot.sh[9214]: touch: cannot touch '/usr/.test': Read-only file system
Jan 29 20:45:46 localhost.localdomain podman[9244]: 2025-01-29 20:45:46.08098635 +0000 UTC m=+0.034666973 container create 4e63acbb4e7c3061b9c4e50c91ea9c2738c7e20ea2b4eedbbed15ba29ab44e1d (image=quay.io/okd/scos-release@sha256:a4c786872d>
Jan 29 20:45:46 localhost.localdomain podman[9244]: 2025-01-29 20:45:46.130749882 +0000 UTC m=+0.084430511 container init 4e63acbb4e7c3061b9c4e50c91ea9c2738c7e20ea2b4eedbbed15ba29ab44e1d (image=quay.io/okd/scos-release@sha256:a4c786872da>
Jan 29 20:45:46 localhost.localdomain podman[9244]: 2025-01-29 20:45:46.132801508 +0000 UTC m=+0.086482122 container start 4e63acbb4e7c3061b9c4e50c91ea9c2738c7e20ea2b4eedbbed15ba29ab44e1d (image=quay.io/okd/scos-release@sha256:a4c786872d>
Jan 29 20:45:46 localhost.localdomain podman[9244]: 2025-01-29 20:45:46.133248758 +0000 UTC m=+0.086929386 container attach 4e63acbb4e7c3061b9c4e50c91ea9c2738c7e20ea2b4eedbbed15ba29ab44e1d (image=quay.io/okd/scos-release@sha256:a4c786872>
Jan 29 20:45:46 localhost.localdomain intelligent_spence[9254]: quay.io/okd/scos-content@sha256:1ddb74181a918712054aad400c0a83b69cafc948ccbf77116782b4b82d3bcbca
Jan 29 20:45:46 localhost.localdomain podman[9244]: 2025-01-29 20:45:46.15319671 +0000 UTC m=+0.106877340 container died 4e63acbb4e7c3061b9c4e50c91ea9c2738c7e20ea2b4eedbbed15ba29ab44e1d (image=quay.io/okd/scos-release@sha256:a4c786872daa>
Jan 29 20:45:46 localhost.localdomain podman[9244]: 2025-01-29 20:45:46.071257388 +0000 UTC m=+0.024938018 image pull 0b58a6a12084985ae2be8b7418719d78342a736854c8dc5b2ce56ab192f24876 quay.io/okd/scos-release@sha256:a4c786872daa033c942a56>
Jan 29 20:45:46 localhost.localdomain podman[9265]: 2025-01-29 20:45:46.192052089 +0000 UTC m=+0.030510714 container remove 4e63acbb4e7c3061b9c4e50c91ea9c2738c7e20ea2b4eedbbed15ba29ab44e1d (image=quay.io/okd/scos-release@sha256:a4c786872>
Jan 29 20:45:46 localhost.localdomain bootstrap-pivot.sh[9206]: Pulling quay.io/okd/scos-content@sha256:1ddb74181a918712054aad400c0a83b69cafc948ccbf77116782b4b82d3bcbca...
Jan 29 20:45:47 localhost.localdomain bootstrap-pivot.sh[9283]: fb8cc77eae8418bcd612aca2cdb7561717bfe3dd0d25478a58a2b9ae0673df29
Jan 29 20:45:47 localhost.localdomain podman[9283]: 2025-01-29 20:45:47.041526762 +0000 UTC m=+0.802882005 image pull fb8cc77eae8418bcd612aca2cdb7561717bfe3dd0d25478a58a2b9ae0673df29 quay.io/okd/scos-content@sha256:1ddb74181a918712054aad>
Jan 29 20:45:47 localhost.localdomain bootstrap-pivot.sh[9308]: error: Remounting /sysroot read-write: Permission denied
Jan 29 20:45:47 localhost.localdomain systemd[1]: release-image-pivot.service: Main process exited, code=exited, status=1/FAILURE
Jan 29 20:45:47 localhost.localdomain systemd[1]: release-image-pivot.service: Failed with result 'exit-code'.
Jan 29 20:45:47 localhost.localdomain systemd[1]: Failed to start release-image-pivot.service - Pivot bootstrap to the OpenShift Release Image.

Not sure what's causing the bootstrap installer to fail in this way? any advice would be helpful.

[JaimeMagiera]

What version of OKD, what platform, etc? Help us help you.

[aheath1992]

Sure
OKD version: 4.17.0-okd-scos.0
Fedora Version: fedora-coreos-39.20231101.3.0
ARCH: X86_64

Single node OKD instance running as a VM in Libvirt in my home lab, to get a better understanding of OpenShift

[digilink]

Having the exact same issues, same version as OP and following instructions verbatim as listed here:

https://docs.okd.io/4.17/installing/installing_sno/install-sno-installing-sno.html#install-sno-installing-sno-manually

I am using an install on a Proxmox VM (kvm). The machine appears to boot fine and I able to ssh to it.

[aheath1992]

I think I see my issue @JaimeMagiera im trying to install 4.17.0 on Fedora Core OS rather then Centos Stream CoreOS (SCOS) and I believe that is causing issues, where it was stated in okd-future-statement that OKD is moveing from Fedora to CentOS but most of the Documentation and tooling is still aimed at Fedora. I installed OKD 4.15 and it seems to be installing fine.