[FIRING:1] LowDiskSpace_NodeExporter_v1_0 resources.ovirt.org:9100 ovirt-resources (/dev/sdb ext4 /home/jenkins)

Description

Labels:

  • alertname = LowDiskSpace_NodeExporter_v1_0

  • device = /dev/sdb

  • fstype = ext4

  • instance = resources.ovirt.org:9100

  • job = ovirt-resources

  • mountpoint = /home/jenkins

Annotations:

  • description = resources.ovirt.org:9100 of job ovirt-resources has less than 10% free disk space

Source: http://prometheus-0:9090/graph?g0.expr=node_filesystem_free_bytes+%2F+node_filesystem_size_bytes%7Bdevice%21%3D%22tmpfs%22%7D+%3C+0.2&g0.tab=1

Activity

Show:
Shlomi Zidmi
September 8, 2020, 9:53 AM
Evgheni Dereveanchin
September 8, 2020, 3:02 PM

I see that free space is back to normal on Nagios. did you clean up the partition manually or the publisher cron task finally ran?

Ehud Yonasi
September 8, 2020, 5:30 PM
Edited

yeah, it moved the files after i manually deleted all the {.ready} dirs that were not cleanup. u can close the issue

Shlomi Zidmi
September 15, 2020, 3:48 PM

Seems like the disk is stable and the clean up task is working fine.
Closing

Evgheni Dereveanchin
September 16, 2020, 9:38 AM

Did we manage to find the reason behind this? It’s the second time we see this in the last couple of months so it may repeat again. May be some slow publisher job, large artifact or something else causing this.

Assignee

Ehud Yonasi

Reporter

Alertmanager_Bot

Blocked By

None

Priority

Medium
Configure