Hi all,
For DHW / Pentaho I need to make on Ubuntu a few corrections for Apache Logs Behaviour as mentioned here:http://www.panda-os.com/tag/kaltura-dwh/#.V3RIm1e5nMU
#!/bin/bash
KITCHEN=$BASE_DIR/pentaho/pdi/kitchen.sh
Now I am receiving correct log out puts for Statistics / Analytics but If am checking the DB Table dwh_fact_events after I made some plays, where also get recgonized in the logs under /opt/kaltura/logs kaltura_apache_access.log and events.log correctly, the table is still empty and no errors in error log…
Any advice?
root@video:~# grep ERROR /opt/kaltura/dwh/logs/*
jess
June 30, 2016, 8:03pm
3
Hello,
Seems like either some plugins under /opt/kaltura/pentaho/pdi/plugins or there is a permission issue.
# Frequently Asked Questions
### Before You Get Started Notes
* If you see a `#` at the beginning of a line, this line should be run as `root`.
### Commercial Editions and Paid Support
The Open Source Kaltura Platform is provided under the [AGPLv3 license](http://www.gnu.org/licenses/agpl-3.0.html) and with no commercial support or liability.
[Kaltura Inc.](http://corp.kaltura.com) also provides commercial solutions and services including pro-active platform monitoring, applications, SLA, 24/7 support and professional services. If you're looking for a commercially supported video platform with integrations to commercial encoders, streaming servers, eCDN, DRM and more - Start a [Free Trial of the Kaltura.com Hosted Platform](http://corp.kaltura.com/free-trial) or learn more about [Kaltura' Commercial OnPrem Edition™](http://corp.kaltura.com/Deployment-Options/Kaltura-On-Prem-Edition). For existing RPM based users, Kaltura offers commercial upgrade options.
### How to contribute
We value contributions from our CE user base very much. To make a contribution, follow the [See our CONTRIBUTERS doc](https://github.com/kaltura/platform-install-packages/blob/IX-9.19.0/doc/CONTRIBUTERS.md).
### Changing Apache configurations post install.
Sometimes, you may want to change deployment settings post installation, for example: replacing the domain, port or protocol, or changing the system to use SSL or stop using SSL.
You can run `/opt/kaltura/bin/kaltura-front-config.sh` as many times as you'd like with different values. The script will re-configure the system accordingly.
For instance, you may want to change the service URL, port or protocol.
show original
Hello,
jess
July 1, 2016, 11:05pm
5
Hi,
Did you look at https://github.com/kaltura/platform-install-packages/blob/Kajam-11.18.0/doc/kaltura-packages-faq.md#analytics-issues ? did you make these queries? please post what each returns.
mysql> select * from kalturadw_ds.files where insert_time >=%Y%m%d;
should return the archive paths for the apache access logs that DWH went though, does it?
Note that plays made within the KMC will never be counted in Analytics.
Hi,
Result is, without complete path in DB, just with file name, but files will land after they are processed in folders like:
1 video-kaltura_apache_access.log-20160622-06 IN_CYCLE 2016-06-27 12:02:06 1018 1 1 gz
and files does include collect statements:
109.70.113.100 - - [30/Jun/2016:23:17:34 +0200] “GET /api_v3/index.php?service=stats&action=kmcCollect&kalsig=a420284a3a8c5cf4cb55cece6c4a7b55&ks=YjA1ZjdhYWQ4ODQ1YTMxYTc5YTUzNTA2OWFiMDZjZmFkNzc0MTRjZXwxMDE7MTAxOzE0Njc0MDQ4NjM7MjsxNDY3MzE4NDYzLjIwMzg7YWdAcXVhZGNvbS5jaDtkaXNhYmxlZW50aXRsZW1lbnQ7Ow%3D%3D&kmcEvent%3AeventTimestamp=1467321454%2E427&ignoreNull=1&kmcEvent%3AobjectType=KalturaStatsKmcEvent&kmcEvent%3ApartnerId=101&clientTag=kmc%3A5%2E40%2E2&kmcEvent%3AclientVer=1%2E0%3AKMC%5FANDROMEDA%2FReports%20and%20Analytics%3A4&kmcEvent%3AkmcEventType=1071&apiVersion=3%2E1%2E5&kmcEvent%3AkmcEventActionPath=Main%20Menu%3EContents%20and%20Reports%20Tab&partnerId=101 HTTP/1.1” 200 607 0/53411 “http://video.quadcom.ch/index.php/kmc/kmc4 ” “Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_4) AppleWebKit/601.5.17 (KHTML, like Gecko) Version/9.1 Safari/601.5.17” “-” 109.70.113.100 “-” “video.quadcom.ch ” 25009 862617523 + 1251 “-” “-” “-” “-” “no-store, no-cache, must-revalidate, post-check=0, pre-check=0” 101252Fvideo.quadcom.ch %252Findex.php%252Fextwidget%252Fpreview%252Fpartner_id%252F101%252Fuiconf_id%252F23448214%252Fentry_id%252F0_inp6xswf%252Fembed%252Fdynamic%253F%2526flashvars%255BstreamerType%255D%253Dauto&kalsig=9580db4f35e414c99dad27fa3bb7e377 HTTP/1.1” 200 458 0/22779 “http://video.quadcom.ch/index.php/extwidget/preview/partner_id/101/uiconf_id/23448214/entry_id/0_inp6xswf/embed/dynamic?&flashvars[streamerType]=auto ” “Mozilla/5.0 (iPhone; CPU iPhone OS 9_3_2 like Mac OS X) AppleWebKit/601.1.46 (KHTML, like Gecko) Version/9.0 Mobile/13F69 Safari/601.1” “-” 109.70.113.100 “-” “video.quadcom.ch ” 25457 1265801784 + 1191 “-” “-” “-” “-” “no-store, no-cache, must-revalidate, post-check=0, pre-check=0” -252Fvideo.quadcom.ch %252Findex.php%252Fextwidget%252Fpreview%252Fpartner_id%252F101%252Fuiconf_id%252F23448214%252Fentry_id%252F0_inp6xswf%252Fembed%252Fdynamic%253F%2526flashvars%255BstreamerType%255D%253Dauto&kalsig=6d02641c1713cc937a4401d4f773e92d HTTP/1.1” 200 457 0/20776 “http://video.quadcom.ch/index.php/extwidget/preview/partner_id/101/uiconf_id/23448214/entry_id/0_inp6xswf/embed/dynamic?&flashvars[streamerType]=auto ” “Mozilla/5.0 (iPhone; CPU iPhone OS 9_3_2 like Mac OS X) AppleWebKit/601.1.46 (KHTML, like Gecko) Version/9.0 Mobile/13F69 Safari/601.1” “-” 109.70.113.100 “-” “video.quadcom.ch ” 25011 993648063 + 1191 “-” “-” “-” “-” “no-store, no-cache, must-revalidate, post-check=0, pre-check=0” -
Also the entries are there, but last Sync date is
2 0 dim_sync_last_update -1 2016-06-20 01:03:41
Edit: but the directory: TransferPath = ${CyclePath}/transfer/ as defined in kettle.properties isn’t there. Should I create the directory?https://share.quadcom.ch/share/proxy/alfresco-noauth/api/internal/shared/node/content/55_KVzoyRsG3iIy2O8WobA/ErrorLog.rtf?a=true