Nothing in Top Content Analytics

jule · July 30, 2015, 5:56pm

I was copying embed code from kmc and pull on a website on another server.

The table is still empty

jess · July 30, 2015, 6:01pm

look at the gz files under /opt/kaltura/web/logs/. open one and make sure you see requests that have:
/api_v3/index.php?service=stats&action=collect
If so, try copying one of these files and adding a number to the end of the timestamp (cause perhaps they were previously taken and failed to process and will therefore not be taken again) so for example:
# cp /opt/kaltura/web/logs/hostname-kaltura_apache_access.log-20150703-20.gz /opt/kaltura/web/logs/hostname-kaltura_apache_access.log-20150703-20-00.gz

Then try to rerun the script, check that the new file was processed with:
select * from kalturadw_ds.files where insert_time >=20150730;

and inspect the logs for ERROR

jule · July 30, 2015, 6:39pm

I keep you inform tomorrow morning.

PS: What is your time zone?

jess · July 30, 2015, 6:57pm

BST. its 19:55 here.

jule · July 30, 2015, 11:23pm

Hi Jess,

there is something strange in log I don’t have action=collect but action=kmcCollect.

zgrep "service=stats\&action\=" *
kaltest2.univ-amu.fr-kaltura_apache_access.log-20150730-17.gz:147.94.156.8 - - [30/Jul/2015:17:47:06 +0200] "GET /api_v3/index.php?service=stats&action=kmcCollect&kalsig=919d04b43d0baf0769f79343430f9a34&kmcEvent%3ApartnerId=101&kmcEvent%3AclientVer=1%2E0%3AKMC%5FANDROMEDA%2FReports%20and%20Analytics%3A4%2E0&kmcEvent%3AeventTimestamp=1438271231%2E401&kmcEvent%3AobjectType=KalturaStatsKmcEvent&clientTag=kmc%3A5%2E39%2E6&apiVersion=3%2E1%2E5&ks=MjQzMTVkYzgyYjNkMjE5OGNjMzczYjYyZDcyNjBkN2ExMWE0OGE2OXwxMDE7MTAxOzE0MzgzNTQ4MDM7MjsxNDM4MjY4NDAzLjMyMjg7anVsaWVuLmNhbW9pbkB1bml2LWFtdS5mcjsqLGRpc2FibGVlbnRpdGxlbWVudDs7&ignoreNull=1&kmcEvent%3AkmcEventActionPath=Main%20Menu%3EContents%20and%20Reports%20Tab&kmcEvent%3AkmcEventType=1071&partnerId=101 HTTP/1.1" 200 113 0/419397 "http://kaltest2.univ-amu.fr/index.php/kmc/kmc4" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.134 Safari/537.36" "-" 147.94.156.8 "-" "kaltest2.univ-amu.fr"
kaltest2.univ-amu.fr-kaltura_apache_access.log-20150730-17.gz:147.94.156.8 - - [30/Jul/2015:17:47:12 +0200] "GET /api_v3/index.php?service=stats&action=kmcCollect&kalsig=865e245aa8e711a4be04c259996c77e9&clientTag=kmc%3A5%2E39%2E6&apiVersion=3%2E1%2E5&ks=MjQzMTVkYzgyYjNkMjE5OGNjMzczYjYyZDcyNjBkN2ExMWE0OGE2OXwxMDE7MTAxOzE0MzgzNTQ4MDM7MjsxNDM4MjY4NDAzLjMyMjg7anVsaWVuLmNhbW9pbkB1bml2LWFtdS5mcjsqLGRpc2FibGVlbnRpdGxlbWVudDs7&kmcEvent%3AkmcEventType=1072&kmcEvent%3AeventTimestamp=1438271237%2E571&kmcEvent%3AkmcEventActionPath=Main%20Menu%3EUsers%20and%20Community%20Reports&kmcEvent%3AclientVer=1%2E0%3AKMC%5FANDROMEDA%2FReports%20and%20Analytics%3A4%2E0&kmcEvent%3ApartnerId=101&ignoreNull=1&kmcEvent%3AobjectType=KalturaStatsKmcEvent&partnerId=101 HTTP/1.1" 200 113 0/271351 "http://kaltest2.univ-amu.fr/index.php/kmc/kmc4" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.134 Safari/537.36" "-" 147.94.156.8 "-" "kaltest2.univ-amu.fr"
kaltest2.univ-amu.fr-kaltura_apache_access.log-20150730-17.gz:147.94.156.8 - - [30/Jul/2015:17:47:20 +0200] "GET /api_v3/index.php?service=stats&action=kmcCollect&kalsig=5bb6611decc542066fbef877e1075858&apiVersion=3%2E1%2E5&ks=MjQzMTVkYzgyYjNkMjE5OGNjMzczYjYyZDcyNjBkN2ExMWE0OGE2OXwxMDE7MTAxOzE0MzgzNTQ4MDM7MjsxNDM4MjY4NDAzLjMyMjg7anVsaWVuLmNhbW9pbkB1bml2LWFtdS5mcjsqLGRpc2FibGVlbnRpdGxlbWVudDs7&partnerId=101&kmcEvent%3AkmcEventActionPath=Main%20Menu%3EBandwidth%20Usage%20Tab&kmcEvent%3ApartnerId=101&clientTag=kmc%3A5%2E39%2E6&kmcEvent%3AeventTimestamp=1438271244%2E877&ignoreNull=1&kmcEvent%3AkmcEventType=1070&kmcEvent%3AobjectType=KalturaStatsKmcEvent&kmcEvent%3AclientVer=1%2E0%3AKMC%5FANDROMEDA%2FReports%20and%20Analytics%3A4%2E0 HTTP/1.1" 200 113 0/330871 "http://kaltest2.univ-amu.fr/index.php/kmc/kmc4" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.134 Safari/537.36" "-" 147.94.156.8 "-" "kaltest2.univ-amu.fr"
kaltest2.univ-amu.fr-kaltura_apache_access.log-20150730-17.gz:147.94.156.8 - - [30/Jul/2015:17:47:31 +0200] "GET /api_v3/index.php?service=stats&action=kmcCollect&kalsig=9b2e869a4d9ffddd0324e5d0167164f6&kmcEvent%3AclientVer=1%2E0%3AKMC%5FANDROMEDA%2FReports%20and%20Analytics%3A4%2E0&kmcEvent%3AeventTimestamp=1438271256%2E77&kmcEvent%3AkmcEventActionPath=Main%20Menu%3EBandwidth%20Usage%20Tab&kmcEvent%3AkmcEventType=1070&partnerId=101&kmcEvent%3ApartnerId=101&clientTag=kmc%3A5%2E39%2E6&apiVersion=3%2E1%2E5&ks=MjQzMTVkYzgyYjNkMjE5OGNjMzczYjYyZDcyNjBkN2ExMWE0OGE2OXwxMDE7MTAxOzE0MzgzNTQ4MDM7MjsxNDM4MjY4NDAzLjMyMjg7anVsaWVuLmNhbW9pbkB1bml2LWFtdS5mcjsqLGRpc2FibGVlbnRpdGxlbWVudDs7&ignoreNull=1&kmcEvent%3AobjectType=KalturaStatsKmcEvent HTTP/1.1" 200 113 0/368269 "http://kaltest2.univ-amu.fr/index.php/kmc/kmc4" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.134 Safari/537.36" "-" 147.94.156.8 "-" "kaltest2.univ-amu.fr"
kaltest2.univ-amu.fr-kaltura_apache_access.log-20150730-19.gz:147.94.156.8 - - [30/Jul/2015:19:20:10 +0200] "GET /api_v3/index.php?service=stats&action=kmcCollect&kalsig=295486f2a03936472e50f5ae2213006d&apiVersion=3%2E1%2E5&kmcEvent%3AkmcEventActionPath=Main%20Menu%3EContents%20and%20Reports%20Tab&kmcEvent%3AkmcEventType=1071&kmcEvent%3AobjectType=KalturaStatsKmcEvent&clientTag=kmc%3A5%2E39%2E6&partnerId=101&kmcEvent%3AeventTimestamp=1438276814%2E913&ignoreNull=1&ks=MjQzMTVkYzgyYjNkMjE5OGNjMzczYjYyZDcyNjBkN2ExMWE0OGE2OXwxMDE7MTAxOzE0MzgzNTQ4MDM7MjsxNDM4MjY4NDAzLjMyMjg7anVsaWVuLmNhbW9pbkB1bml2LWFtdS5mcjsqLGRpc2FibGVlbnRpdGxlbWVudDs7&kmcEvent%3AclientVer=1%2E0%3AKMC%5FANDROMEDA%2FReports%20and%20Analytics%3A4%2E0&kmcEvent%3ApartnerId=101 HTTP/1.1" 200 113 0/211539 "http://kaltest2.univ-amu.fr/index.php/kmc/kmc4" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.134 Safari/537.36" "-" 147.94.156.8 "-" "kaltest2.univ-amu.fr"
kaltest2.univ-amu.fr-kaltura_apache_access.log-20150730-19.gz:147.94.156.8 - - [30/Jul/2015:19:20:33 +0200] "GET /api_v3/index.php?service=stats&action=kmcCollect&kalsig=4110ba89c032aca797b97874ac23b1a6&kmcEvent%3AeventTimestamp=1438276838%2E091&kmcEvent%3AclientVer=1%2E0%3AKMC%5FANDROMEDA%2FReports%20and%20Analytics%3A4%2E0&ks=MjQzMTVkYzgyYjNkMjE5OGNjMzczYjYyZDcyNjBkN2ExMWE0OGE2OXwxMDE7MTAxOzE0MzgzNTQ4MDM7MjsxNDM4MjY4NDAzLjMyMjg7anVsaWVuLmNhbW9pbkB1bml2LWFtdS5mcjsqLGRpc2FibGVlbnRpdGxlbWVudDs7&kmcEvent%3AkmcEventType=1072&kmcEvent%3ApartnerId=101&clientTag=kmc%3A5%2E39%2E6&ignoreNull=1&apiVersion=3%2E1%2E5&kmcEvent%3AobjectType=KalturaStatsKmcEvent&kmcEvent%3AkmcEventActionPath=Main%20Menu%3EUsers%20and%20Community%20Reports&partnerId=101 HTTP/1.1" 200 113 0/169810 "http://kaltest2.univ-amu.fr/index.php/kmc/kmc4" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.134 Safari/537.36" "-" 147.94.156.8 "-" "kaltest2.univ-amu.fr"
kaltest2.univ-amu.fr-kaltura_apache_access.log-20150730-19.gz:147.94.156.8 - - [30/Jul/2015:19:20:48 +0200] "GET /api_v3/index.php?service=stats&action=kmcCollect&kalsig=f875315b4f5cc832f4584c9474b921dd&kmcEvent%3AeventTimestamp=1438276848%2E997&kmcEvent%3ApartnerId=101&ks=MjQzMTVkYzgyYjNkMjE5OGNjMzczYjYyZDcyNjBkN2ExMWE0OGE2OXwxMDE7MTAxOzE0MzgzNTQ4MDM7MjsxNDM4MjY4NDAzLjMyMjg7anVsaWVuLmNhbW9pbkB1bml2LWFtdS5mcjsqLGRpc2FibGVlbnRpdGxlbWVudDs7&clientTag=kmc%3A5%2E39%2E6&kmcEvent%3AclientVer=1%2E0%3AKMC%5FANDROMEDA%2FReports%20and%20Analytics%3A4%2E0&kmcEvent%3AkmcEventType=1070&kmcEvent%3AkmcEventActionPath=Main%20Menu%3EBandwidth%20Usage%20Tab&ignoreNull=1&kmcEvent%3AobjectType=KalturaStatsKmcEvent&apiVersion=3%2E1%2E5&partnerId=101 HTTP/1.1" 200 114 0/113963 "http://kaltest2.univ-amu.fr/index.php/kmc/kmc4" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.134 Safari/537.36" "-" 147.94.156.8 "-" "kaltest2.univ-amu.fr"

I create the following:

[root@kaltest2 logs]# cp kaltest2.univ-amu.fr-kaltura_apache_access.log-20150730-19.gz kaltest2.univ-amu.fr-kaltura_apache_access.log-20150730-20.gz

And I obtain:

[root@kaltest2 ~]# echo "select * from kalturadw_ds.files where insert_time >=20150730;" | mysql
file_id file_name       file_status     prev_status     insert_time     run_time        transfer_time   lines   err_lines       file_size_kb    process_id      cycle_id        compression_suffix        subdir
1       kaltest2.univ-amu.fr-kaltura_apache_access.log-20150730-17      IN_CYCLE        NULL    2015-07-30 17:50:57     NULL    NULL    NULL    NULL    3       1       1       gz
2       kaltest2.univ-amu.fr-kaltura_apache_access.log-20150730-19      IN_CYCLE        NULL    2015-07-30 19:19:01     NULL    NULL    NULL    NULL    14      1       2       gz
3       kaltest2.univ-amu.fr-kaltura_apache_access.log-20150730-20      IN_CYCLE        NULL    2015-07-31 01:15:29     NULL    NULL    NULL    NULL    9       1       3       gz
4       kaltest2.univ-amu.fr-kaltura_apache_access.log-20150731-01      IN_CYCLE        NULL    2015-07-31 01:15:29     NULL    NULL    NULL    NULL    60      1       3       gz
[root@kaltest2 ~]#

jule · July 31, 2015, 11:52am

Hi Jess,

I was find an error in /etc/cron.d:

[root@kaltest2 cron]# cat dwh
00 * * * * kaltura /opt/kaltura/dwh -k /opt/kaltura/pentaho/pdi/kitchen.sh/etlsource/execute/etl_hourly.sh -p /opt/kaltura/dwh -k /opt/kaltura/pentaho/pdi/kitchen.sh
00 * * * * kaltura /opt/kaltura/dwh -k /opt/kaltura/pentaho/pdi/kitchen.sh/etlsource/execute/etl_update_dims.sh -p /opt/kaltura/dwh -k /opt/kaltura/pentaho/pdi/kitchen.sh
59 0,4,8,12,16,20 * * * kaltura /opt/kaltura/dwh -k /opt/kaltura/pentaho/pdi/kitchen.sh/etlsource/execute/etl_daily.sh -p /opt/kaltura/dwh -k /opt/kaltura/pentaho/pdi/kitchen.sh
30 12 * * * kaltura /opt/kaltura/dwh -k /opt/kaltura/pentaho/pdi/kitchen.sh/etlsource/execute/etl_perform_retention_policy.sh -p /opt/kaltura/dwh -k /opt/kaltura/pentaho/pdi/kitchen.sh
0 10 * * * kaltura /opt/kaltura/app/alpha/scripts/dwh/dwh_plays_views_sync.sh >> /opt/kaltura/log/cron.log

I correct based on /opt/kaltura/app/configurations/cron/dwh.template

[root@kaltest2 cron.d]# cat kaltura-dwh
    00 * * * * kaltura /opt/kaltura/dwh/etlsource/execute/etl_hourly.sh -p /opt/kaltura/dwh -k /opt/kaltura/pentaho/pdi/kitchen.sh
    00 * * * * kaltura /opt/kaltura/dwh/etlsource/execute/etl_update_dims.sh -p /opt/kaltura/dwh -k /opt/kaltura/pentaho/pdi/kitchen.sh
    59 0,4,8,12,16,20 * * * kaltura /opt/kaltura/dwh/etlsource/execute/etl_daily.sh -p /opt/kaltura/dwh -k /opt/kaltura/pentaho/pdi/kitchen.sh
    30 12 * * * kaltura /opt/kaltura/dwh/etlsource/execute/etl_perform_retention_policy.sh -p /opt/kaltura/dwh -k /opt/kaltura/pentaho/pdi/kitchen.sh
    0 10 * * * kaltura /opt/kaltura/app/alpha/scripts/dwh/dwh_plays_views_sync.sh >> /opt/kaltura/log/cron.log

It’s not correct the problem but etl was not working alone. There is an issue if you reinstall or reconfigure kaltura

jess · July 31, 2015, 12:05pm

Hi Jule,

Whenever you upgrade, you must rerun the config scripts, this is indicated here:

github.com

kaltura/platform-install-packages/blob/master/doc/install-kaltura-redhat-based.md#upgrade-kaltura

# Installing Kaltura on a Single Server (RPM)
This guide describes RPM installation of an all-in-one Kaltura server and applies to all major RH based Linux distros including Fedora Core, RHEL, CentOS, etc.
([Note the supported distros and versions](http://kaltura.github.io/platform-install-packages/#supported-distros)).

[Kaltura Inc.](http://corp.kaltura.com) also provides commercial solutions and services including pro-active platform monitoring, applications, SLA, 24/7 support and professional services. If you're looking for a commercially supported video platform  with integrations to commercial encoders, streaming servers, eCDN, DRM and more - Start a [Free Trial of the Kaltura.com Hosted Platform](http://corp.kaltura.com/free-trial) or learn more about [Kaltura' Commercial OnPrem Edition™](http://corp.kaltura.com/Deployment-Options/Kaltura-On-Prem-Edition). For existing RPM based users, Kaltura offers commercial upgrade options.

#### Table of Contents
[Prerequites](pre-requisites.md)

[Pre-Install Steps](install-kaltura-redhat-based.md#pre-install-steps)

[Non-SSL Step-by-step Installation](install-kaltura-redhat-based.md#non-ssl-step-by-step-installation)

[Apache SSL Step-by-step Installation](install-kaltura-redhat-based.md#apache-ssl-step-by-step-installation)

[Nginx SSL Configuration](nginx-ssl-config.md)

[Unattended Installation](install-kaltura-redhat-based.md#unattended-installation)

[Live Streaming with Nginx and the RTMP module](install-kaltura-redhat-based.md#live-streaming-with-nginx-and-the-rtmp-module)

This file has been truncated. show original

Is it all working for you now?

jule · July 31, 2015, 12:27pm

Hi Jess,

I was follow the documentation.
Actually it’s not working still nothing in table dwh_fact_events
And about KmcCollect in my logs ? It’s a normal case ?

jule · July 31, 2015, 12:30pm

Do you wish to have an ssh access on the server ?

jess · July 31, 2015, 4:10pm

Hi Jule,

It should be collect, not kmcCollect… are you playing from within the KMC? you need to play from the outside, i.e, an external page where the entry is embedded. You can go to KMC, Content tab, and, under the Actions column select Preview and embed and then click on the link under the label: ‘View a standalone page with this player’ which will open a standalone page, then, on that page, hit play and make sure a collect request registered in the Apache access log.

jule · July 31, 2015, 5:48pm

Hey Jess,

I was have HTTP Progressive Download in advanced option not Kaltura Auto, now I have:

 "GET /api_v3/index.php?service=stats&apiVersion=3.1&expiry=86400&clientTag=kwidget%3Av2.33&format=1&ignoreNull=1&action=collect&event:eventType=7&event:clientVer=2.33&event:currentPoint=181207&event:duration=184.669&event:eventTimestamp=1438363713629&event:isFirstInSession=false&event:objectType=KalturaStatsEvent&event:partnerId=101&event:sessionId=0ee40044-b951-c6e0-e73b-b410fe7db93f&event:uiconfId=23448187&event:seek=false&event:entryId=0_9nsflyah&event:widgetId=_101&event:referrer=http%253A%252F%252Fjule.pj.univ-amu.fr%252F&kalsig=5f9a3154f0a40a63f684325856dfbcdf HTTP/1.1" 200 4 0/66054 "http://jule.pj.univ-amu.fr/" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.134 Safari/537.36" "-" 147.94.156.8 "-" "kaltest2.univ-amu.fr"

Still nothing in the table:

MariaDB [(none)]> select * from kalturadw.dwh_fact_events;
Empty set (0.00 sec)

jess · August 2, 2015, 1:23pm

Hi,

The call you posted looks valid. Did you run the analytics script post making it? since it has been more than a day since, they should have run automatically via crond. Are you seeing stats now?

jess · November 20, 2015, 11:48am

Hello,

First things to be aware of:
0. Analytics is updated every 24 hours

Only playback from outside KMC [i.e, from embedded players] is counted.

If you have waited 24 hours and you do not see stats, follow troubleshooting instructions here:

github.com

kaltura/platform-install-packages/blob/Kajam-11.2.0/doc/kaltura-packages-faq.md#analytics-issues

# Frequently Asked Questions

### Before You Get Started Notes
* If you see a `#` at the beginning of a line, this line should be run as `root`.

### Commercial Editions and Paid Support

The Open Source Kaltura Platform is provided under the [AGPLv3 license](http://www.gnu.org/licenses/agpl-3.0.html) and with no commercial support or liability.  

[Kaltura Inc.](http://corp.kaltura.com) also provides commercial solutions and services including pro-active platform monitoring, applications, SLA, 24/7 support and professional services. If you're looking for a commercially supported video platform  with integrations to commercial encoders, streaming servers, eCDN, DRM and more - Start a [Free Trial of the Kaltura.com Hosted Platform](http://corp.kaltura.com/free-trial) or learn more about [Kaltura' Commercial OnPrem Edition™](http://corp.kaltura.com/Deployment-Options/Kaltura-On-Prem-Edition). For existing RPM based users, Kaltura offers commercial upgrade options.

### How to contribute
We value contributions from our CE user base very much. To make a contribution, follow the [See our CONTRIBUTERS doc](https://github.com/kaltura/platform-install-packages/blob/IX-9.19.0/doc/CONTRIBUTERS.md).


### Changing Apache configurations post install.

Sometimes, you may want to change deployment settings post installation, for example: replacing the domain, port or protocol, or changing the system to use SSL or stop using SSL.   
You can run `/opt/kaltura/bin/kaltura-front-config.sh` as many times as you'd like with different values. The script will re-configure the system accordingly.   
For instance, you may want to change the service URL, port or protocol.

This file has been truncated. show original

luca.guindani · May 17, 2017, 2:20pm

I also have nothing in the Top Content or for Bandwidth usage BUT Top Contributors & Storage are populated.

I have logs in “/opt/kaltura/web/logs/” coming from the front server logrotation process & no errors if I “grep ERROR /opt/kaltura/dwh/logs/*” on the dwh server.

The only things I found when I did a “grep pentaho /opt/kaltura/dwh/logs/*” was the following.

/opt/kaltura/dwh/logs/etl_daily-20170517.log:/opt/kaltura/pentaho/pdi/kitchen.sh: line 11: cd: /root: Permission denied
/opt/kaltura/dwh/logs/etl_hourly-20170517-08.log:/opt/kaltura/pentaho/pdi/kitchen.sh: line 11: cd: /root: Permission denied
/opt/kaltura/dwh/logs/etl_perform_retention_policy-20170517.log:/opt/kaltura/pentaho/pdi/kitchen.sh: line 11: cd: /root: Permission denied
/opt/kaltura/dwh/logs/etl_update_dims-20170517-08.log:/opt/kaltura/pentaho/pdi/kitchen.sh: line 11: cd: /root: Permission denied

When I check the apache access logs I can see “collect” requests like below.

[17/May/2017:15:46:56 +0200] “GET /api_v3/index.php?service=stats&apiVersion=3.1&expiry=86400&clientTag=kwidget%3Av2.55.2&format=1&ignoreNull=1&action=collect&event:eventType=13&event:clientVer=2.55.2&event:currentPoint=0&event:duration=194.932&event:eventTimestamp=1495028816753&event:isFirstInSession=false&event:objectType=KalturaStatsEvent&event:partnerId=101&event:sessionId=ff0cad81-497f-53c8-0754-dc003ad2c9aa&event:uiconfId=23448199&event:seek=false&event:entryId=0_rjx0qtzr&event:historyEvents=111000000001100000000000-5-5&event:widgetId=_101&event:referrer=https%253A%252F%252Fmy-domain%252Findex.php%252Fextwidget%252Fpreview%252Fpartner_id%252F101%252Fuiconf_id%252F23448199%252Fentry_id%252F0_rjx0qtzr%252Fembed%252Fauto%253F%2526flashvars%255BstreamerType%255D%253Dauto&kalsig=7aebb03318e1b213dc5a1345fb6a9c3830 HTTP/1.1” 200 438 0/10925

Help please (CentOS7 - cluster install)

@jess I can email you some access logs if needed

jess · May 18, 2017, 8:46am

Hi @luca.guindani,

Please follow the checklist here:

github.com

kaltura/platform-install-packages/blob/Lynx-12.16.0/doc/kaltura-packages-faq.md#analytics-issues

# Frequently Asked Questions

### Before You Get Started Notes
* If you see a `#` at the beginning of a line, this line should be run as `root`.

### Commercial Editions and Paid Support

The Open Source Kaltura Platform is provided under the [AGPLv3 license](http://www.gnu.org/licenses/agpl-3.0.html) and with no commercial support or liability.  

[Kaltura Inc.](http://corp.kaltura.com) also provides commercial solutions and services including pro-active platform monitoring, applications, SLA, 24/7 support and professional services. If you're looking for a commercially supported video platform  with integrations to commercial encoders, streaming servers, eCDN, DRM and more - Start a [Free Trial of the Kaltura.com Hosted Platform](http://corp.kaltura.com/free-trial) or learn more about [Kaltura' Commercial OnPrem Edition™](http://corp.kaltura.com/Deployment-Options/Kaltura-On-Prem-Edition). For existing RPM based users, Kaltura offers commercial upgrade options.

### How to contribute
We value contributions from our CE user base very much. To make a contribution, follow the [See our CONTRIBUTERS doc](https://github.com/kaltura/platform-install-packages/blob/IX-9.19.0/doc/CONTRIBUTERS.md).


### Changing Apache configurations post install.

Sometimes, you may want to change deployment settings post installation, for example: replacing the domain, port or protocol, or changing the system to use SSL or stop using SSL.   
You can run `/opt/kaltura/bin/kaltura-front-config.sh` as many times as you'd like with different values. The script will re-configure the system accordingly.   
For instance, you may want to change the service URL, port or protocol.

This file has been truncated. show original

Once you’ve confirmed everything is properly set up, please run all the queries and post the results here.

Do not drop the DB and attempt a reinstall at this point, this is the very last resort and is typically not needed.

luca.guindani · May 18, 2017, 9:25am

Hello @jess

Thanks for your quick reply.

I followed the faq documentation and check that everything is properly set up.

About the queries:

MariaDB [(none)]> select * from kalturadw_ds.locks ;

±--------±------------------------±--------------------±-----------+
| lock_id | lock_name | lock_time | lock_state |
±--------±------------------------±--------------------±-----------+
| 1 | daily_lock | 2017-05-18 08:59:05 | 0 |
| 2 | retention_lock | 2017-05-17 12:30:05 | 0 |
| 3 | update_dims_lock | 2017-05-18 10:00:12 | 0 |
| 4 | hourly_my_dwh_host | 2017-05-18 10:00:10 | 0 |
±--------±------------------------±--------------------±-----------+

MariaDB [(none)]> select * from kalturadw_ds.files where insert_time >=20170518;

±--------±-----------------------------------------------------------±------------±------------±--------------------±---------±--------------±------±----------±-------------±-----------±---------±-------------------±-------+
| file_id | file_name | file_status | prev_status | insert_time | run_time | transfer_time | lines | err_lines | file_size_kb | process_id | cycle_id | compression_suffix | subdir |
±--------±-----------------------------------------------------------±------------±------------±--------------------±---------±--------------±------±----------±-------------±-----------±---------±-------------------±-------+
| 8 | my_front_server_dns-kaltura_apache_access.log-20170518-03 | IN_CYCLE | NULL | 2017-05-18 04:00:09 | NULL | NULL | NULL | NULL | 788 | 1 | 8 | gz | |
±--------±-----------------------------------------------------------±------------±------------±--------------------±---------±--------------±------±----------±-------------±-----------±---------±-------------------±-------+

select * from kalturadw.dwh_fact_events where event_date_id >=20170518 ;

Empty set (0.00 sec)

select * from kalturadw.dwh_fact_events ;

Empty set (0.00 sec)

No error when executing the following script

/opt/kaltura/bin/kaltura-run-dwh.sh

Nothing strange in “/opt/kaltura/dwh/logs/log_events_events.log” or “/opt/kaltura/dwh/logs/etl_daily-20170518.log”

jess · May 18, 2017, 9:37am

Hi @luca.guindani,

Does /opt/kaltura/web/logs/my_front_server_dns-kaltura_apache_access.log-20170518-03.gz contain:
/api_v3/index.php?service=stats.*&action=collect
lines?
Also, since it’s from today, are you sure the DWH procs specified in /etc/cron.d/kaltura-dwh completed their run?
Let’s also check records from the day before…

luca.guindani · May 18, 2017, 9:57am

I have about 150 lines like the one below in “/opt/kaltura/web/logs/my_front_server_dns-kaltura_apache_access.log-20170518-03.gz”:

[17/May/2017:08:56:41 +0200] “GET /api_v3/index.php?service=stats&apiVersion=3.1&expiry=86400&clientTag=kwidget%3Av2.55.2&format=1&ignoreNull=1&action=collect&event:eventType=13&event:clientVer=2.55.2&event:currentPoint=0&event:duration=628.653&event:eventTimestamp=1495004202040&event:isFirstInSession=false&event:objectType=KalturaStatsEvent&event:partnerId=101&event:sessionId=41bd0f35-0a41-b28d-90c2-133609e938c1&event:uiconfId=23448242&event:seek=false&event:entryId=0_ixeguw5j&event:historyEvents=111000000001100000000000-5-5&event:widgetId=_101&event:referrer=https%253A%252F%252Fmy_lb_dns%252Findex.php%252Fextwidget%252Fpreview%252Fpartner_id%252F101%252Fuiconf_id%252F23448242%252Fentry_id%252F0_ixeguw5j%252Fembed%252Fauto%253F%2526flashvars%255BstreamerType%255D%253Dauto&kalsig=9b9c4d98f42b6cc275060c2f039b2499 HTTP/1.1” 200 437 0/9999 “https://my_lb_dns/index.php/extwidget/preview/partner_id/101/uiconf_id/23448242/entry_id/0_ixeguw5j/embed/auto?&flashvars[streamerType]=auto” “Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_4) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.110 Safari/537.36” “-” “-” “my_lb_dns” 15090 761896350 - 1826 “-” “” “-” “-” “no-store, no-cache, must-revalidate, post-check=0, pre-check=0” -

If I check the “/opt/kaltura/log/cron.log” I get the following.

Thu May 18 10:00:01 CEST 2017
start dwh triggers
2017-05-18 10:00:01 [require_once] INFO: Starting script
2017-05-18 10:00:01 [require_once] INFO: Initializing database…
2017-05-18 10:00:01 [require_once] INFO: Database initialized successfully
2017-05-18 10:00:01 [KalturaPDO->__construct] DEBUG: conn took - 0.013130187988281 seconds to mysql:host=my_dwh_host;port=3306;dbname=kaltura;
2017-05-18 10:00:01 [Propel::initConnection] NOTICE: total conn took 0.013963937759399 mysql:host=my_dwh_host;port=3306;dbname=kaltura;
start dwh wrap
end dwh
Thu May 18 10:58:00 CEST 2017
start dwh triggers
2017-05-18 10:58:00 [require_once] INFO: Starting script
2017-05-18 10:58:00 [require_once] INFO: Initializing database…
2017-05-18 10:58:00 [require_once] INFO: Database initialized successfully
2017-05-18 10:58:00 [KalturaPDO->__construct] DEBUG: conn took - 0.0021908283233643 seconds to mysql:host=my_dwh_host;port=3306;dbname=kaltura;
2017-05-18 10:58:00 [Propel::initConnection] NOTICE: total conn took 0.0028469562530518 mysql:host=my_dwh_host;port=3306;dbname=kaltura;
start dwh wrap
end dwh

The day before I also have about 150 stats+collect in the log file (if you need a complete log file I can easily email one to you @jess).

One more thing; the dwh is hosted on the same server than the main db.