resources partition 80% full

Description

The Nagios warning threshold on the resources partition is currently 20%.
As the partition is 400GB in space, this means a warning will appear when there's still 20GB free on the disk. We started getting alerts overnight, so let's set this to 15% for now. Once that starts triggering we can check the trend and grow the partition if necessary.

Activity

Show:
Evgheni Dereveanchin
August 9, 2016, 6:59 AM

Thresholds changed to 15% for warning and 7% for critical in nrpe.conf on the resources server.

Eyal Edri
August 9, 2016, 7:00 AM

I think we should increase the partition,
I expect much more space taken soon once we'll move system tests to run per
patch and also once we enable appliance/ngn on experimental repo.

On Tue, Aug 9, 2016 at 9:56 AM, Evgheni Dereveanchin (oVirt JIRA) <


Eyal Edri
Associate Manager
RHV DevOps
EMEA ENG Virtualization R&D
Red Hat Israel

phone: +972-9-7692018
irc: eedri (on #tlv #rhev-dev #rhev-integ)

Evgheni Dereveanchin
August 9, 2016, 7:06 AM

Reopened this, will check how the disk is set up now (i.e if it's better to grow the disk or add a new one) and act accordingly. I think we already had issues with disk filling before, that's why monitoring was added for partitions on this server. I think growing it by 200GB should be OK for the near future.

Evgheni Dereveanchin
August 16, 2016, 12:29 PM
Edited

I am backing up the content of /srv/resources and will add 200GB to this partition this week.

Evgheni Dereveanchin
August 17, 2016, 3:53 PM

Task completed successfully. If the current trend continues this will last for 3-4 more months at which point we'll have to extend again.

Fixed

Assignee

Evgheni Dereveanchin

Reporter

Evgheni Dereveanchin

Blocked By

None

Priority

Medium