Started 2 days 11 hr ago
Build has been executing for 2 days 11 hr on vm0038.workers-phx.ovirt.or
please update what filled the disk, we should add it to the slave cleaner script,
We've seen more and more reports on out of space for the VM slaves, we should find out the root cause for it.
Do we have a service which tracks the slave disk space. And, if it reaches a certain threshold... performs some remediation steps?
I've cleaned the host, and it is not up and running.
The problem was that due filled disk, there were stuck VMs there that prevented the host from being cleaned up.
Remediation and Monitoring are not the same. Don't you think we should have a remediation service which will prevent such cases in the future?