global_setup.sh fail: "docker.service: Failed at step EXEC spawning /usr/bin/dockerd-current: Permission denied"

Description

Seems that all builds fail now because the global setup script fails
to setup the slave.

Some examples:

Log from the failed step:
https://jenkins.ovirt.org/blue/rest/organizations/jenkins/pipelines/vdsm_standard-check-patch/runs/25522/nodes/150/steps/204/log/?start=0

[2020-12-07T18:09:18.284Z] Dec 07 15:11:08
vm0148.workers-phx.ovirt.org dockerd-current[1342]:
time="2020-12-07T15:11:08.426348650Z" level=warning
msg="d10f349413a9ce2b5f6cb33d7d721d133b323aba1bf00021ce4d714059b00813
cleanup: failed to unmount secrets: invalid argument"
[2020-12-07T18:09:18.284Z] Dec 07 15:11:39
vm0148.workers-phx.ovirt.org dockerd-current[1342]:
time="2020-12-07T15:11:39.112783512Z" level=warning
msg="55ff0f77d37781237a199a8ba86bc544932f10b1018a3e614bd967b8b5956fd5
cleanup: failed to unmount secrets: invalid argument"
[2020-12-07T18:09:18.284Z] Dec 07 15:11:40
vm0148.workers-phx.ovirt.org dockerd-current[1342]:
time="2020-12-07T15:11:40.654819711Z" level=info msg="Layer
sha256:9d23de0c6d4682039041ca8bb2825278a71c411a22799aeb7b47739514a731d0
cleaned up"
[2020-12-07T18:09:18.284Z] Dec 07 15:11:41
vm0148.workers-phx.ovirt.org dockerd-current[1342]:
time="2020-12-07T15:11:41.290807003Z" level=info msg="Layer
sha256:9d23de0c6d4682039041ca8bb2825278a71c411a22799aeb7b47739514a731d0
cleaned up"
[2020-12-07T18:09:18.284Z] Dec 07 15:11:45
vm0148.workers-phx.ovirt.org systemd[1]: docker.service: Main process
exited, code=exited, status=2/INVALIDARGUMENT
[2020-12-07T18:09:18.284Z] – Subject: Unit process exited
[2020-12-07T18:09:18.284Z] – Defined-By: systemd
[2020-12-07T18:09:18.284Z] – Support:
https://lists.freedesktop.org/mailman/listinfo/systemd-devel
[2020-12-07T18:09:18.284Z] –
[2020-12-07T18:09:18.284Z] – An ExecStart= process belonging to unit
docker.service has exited.
[2020-12-07T18:09:18.284Z] –
[2020-12-07T18:09:18.284Z] – The process' exit code is 'exited' and
its exit status is 2.
[2020-12-07T18:09:18.284Z] Dec 07 15:11:45
vm0148.workers-phx.ovirt.org systemd[1]: docker.service: Failed with
result 'exit-code'.
[2020-12-07T18:09:18.284Z] – Subject: Unit failed
[2020-12-07T18:09:18.284Z] – Defined-By: systemd
[2020-12-07T18:09:18.284Z] – Support:
https://lists.freedesktop.org/mailman/listinfo/systemd-devel
[2020-12-07T18:09:18.284Z] –
[2020-12-07T18:09:18.284Z] – The unit docker.service has entered the
'failed' state with result 'exit-code'.
[2020-12-07T18:09:18.284Z] Dec 07 15:12:30
vm0148.workers-phx.ovirt.org systemd[1]: Starting Docker Application
Container Engine...
[2020-12-07T18:09:18.284Z] – Subject: A start job for unit
docker.service has begun execution
[2020-12-07T18:09:18.284Z] – Defined-By: systemd
[2020-12-07T18:09:18.284Z] – Support:
https://lists.freedesktop.org/mailman/listinfo/systemd-devel
[2020-12-07T18:09:18.284Z] –
[2020-12-07T18:09:18.284Z] – A start job for unit docker.service has
begun execution.
[2020-12-07T18:09:18.284Z] –
[2020-12-07T18:09:18.284Z] – The job identifier is 109048.
[2020-12-07T18:09:18.284Z] Dec 07 15:12:30
vm0148.workers-phx.ovirt.org systemd[4524]: docker.service: Failed to
execute command: Permission denied
[2020-12-07T18:09:18.284Z] Dec 07 15:12:30
vm0148.workers-phx.ovirt.org systemd[4524]: docker.service: Failed at
step EXEC spawning /usr/bin/dockerd-current: Permission denied
[2020-12-07T18:09:18.284Z] – Subject: Process
/usr/bin/dockerd-current could not be executed
[2020-12-07T18:09:18.284Z] – Defined-By: systemd
[2020-12-07T18:09:18.284Z] – Support:
https://lists.freedesktop.org/mailman/listinfo/systemd-devel
[2020-12-07T18:09:18.284Z] –
[2020-12-07T18:09:18.284Z] – The process /usr/bin/dockerd-current
could not be executed and failed.
[2020-12-07T18:09:18.284Z] –
[2020-12-07T18:09:18.284Z] – The error number returned by this
process is ERRNO.
[2020-12-07T18:09:18.284Z] Dec 07 15:12:30
vm0148.workers-phx.ovirt.org systemd[1]: docker.service: Main process
exited, code=exited, status=203/EXEC
[2020-12-07T18:09:18.284Z] – Subject: Unit process exited
[2020-12-07T18:09:18.284Z] – Defined-By: systemd
[2020-12-07T18:09:18.284Z] – Support:
https://lists.freedesktop.org/mailman/listinfo/systemd-devel
[2020-12-07T18:09:18.284Z] –
[2020-12-07T18:09:18.284Z] – An ExecStart= process belonging to unit
docker.service has exited.
[2020-12-07T18:09:18.284Z] –
[2020-12-07T18:09:18.284Z] – The process' exit code is 'exited' and
its exit status is 203.
...

Activity

Show:
Evgheni Dereveanchin
December 15, 2020, 12:14 PM

Do we still see that? The patch removing all fc30 jobs should be merged.

Ehud Yonasi
December 8, 2020, 1:43 PM
Ehud Yonasi
December 8, 2020, 1:40 PM

I see it happens on FC30 vms which is now EOL.

I have forwared it to infra-team to upgrade those slaves (FC32) or convert them to el8.

Your pinned fields
Click on the next to a field label to start pinning.

Assignee

Ehud Yonasi

Reporter

Nir Soffer