"nomad job stop -purge" does not destroy the container

[OneOfTheJohns]

Hi,

Im running nomad-podman env with versions:
Nomad v1.8.1
podman version 5.1.1

On a Freebsd host.

I do get the containers running, but when i want to remove them by running:
nomad job stop -purge <container_id>
Nomad job gets removed, but container still keeps living.

Is that a bug, or a feature?

[OneOfTheJohns]

Based on https://developer.hashicorp.com/nomad/plugins/drivers/podman#plugin-options - Container - Defaults to true. This option can be used to disable Nomad from removing a container when the task exits. . So it seems that by default Nomad should destroy the running container. So it seems like a bug.

[shoenig]

Hi @OneOfTheJohns, nomad job stop -purge immediately removes the job from the perspective of the server, but leaves the cleanup of the allocation(s) to the normal reconciliation / garbage collection process of each client. Are you waiting long enough to allow the clients to do that GC? If you do see the clients doing GC steps in logs but the container is still running then yeah that would be a bug.

[OneOfTheJohns]

Hi, thanks for your answer @shoenig . How long does this cleanup take? It actually might be that im not waiting long enough...

[courtland]

https://developer.hashicorp.com/nomad/docs/commands/system/gc