move stats VM to el7

Description

stats.ovirt.org is running an old Fedora release. It needs to be rebuilt with EL7 or replaced with a different stats generation system. As reported in stats generation is partially broken anyway.

Activity

Show:

Former user March 29, 2017 at 6:02 PM

Imported a single weekly log from resources (~650k lines) - this took around an hour. Now we can test UI performance and set up archive generations as page loads slowed down considerably.

Former user March 29, 2017 at 4:56 PM

added Piwik info to resources but don't see any data sent by the JS tracker.

Also tested Apache log import using the provided import tool on Gerrit-Staging with a command like this:

  1. python piwik/misc/log-analytics/import_logs.py --url=https://stats.phx.ovirt.org --login=USER --password=PASS --idsite=3 /var/log/httpd/ssl_access_log

This successfully parses logs at a speed of around 200 per minute. It can be added as a pre-rotation hook to logrotate to feed the latest log to piwik

Former user March 29, 2017 at 3:52 PM

I installed Piwik 3.0.2 on https://stats.phx.ovirt.org/

We can now add the JS tracker to our website in order to start gathering statistics data.
The h5ai fancy index on resources also supports piwik, I can enable it there for a start before we get logs streaming into piwik.

Former user March 27, 2017 at 8:39 AM

Piwik should be good enough for us. let's have a basic setup and start feeding data to it - it'll still perform better than awstats.

Marc Dequènes (Duck) March 27, 2017 at 2:51 AM

There was a thread from John Marks <jmarks@redhat.com> called "Tracking page visits on oVirt.org" and Piwik was mentioned too.
BKP does not seem to have an account in here, so here is what he said about collecting visits stats with Bitergia: « I can't seem to log in to make a comment, but I can tell you right now Bitergia is not an option. They are too expensive. ». So it seem we're keeping Bitergia at the moment for some specific stats we cannot do easily otherwise; but again we should ask direct advice to BKP.

Done

Details

Assignee

Reporter

Priority

Created January 11, 2017 at 2:48 PM
Updated June 1, 2017 at 11:32 AM
Resolved May 10, 2017 at 7:58 AM