About the Analytics, The plays and views of entry never change!

Whatever how many times I try to play the media,In KMC , the plays still the some value .I think other statistical data didn’t work too…
anyone know the matter?
HELP!

It updates daily, have you waited a day?
Also, the kaltura-sanity.sh includes a test for DWH, does that run successfully?

I have been waiting for many days , Some media still plays 0 times.
How to check the kaltura-sanity.sh run successfully? just run it on server end?

Yes, that is correct. just run:
# kaltura-sanity.sh

Also, look for errors in /opt/kaltura/dwh/logs

I run kaltura-santiy.sh
[DWH cycle] [FAILED, RC: 255]

the DWH failed, How to fix it ?

What do the logs show?

I am not sure it is the matter or not:

ERROR 11-03 20:00:09,109 - Lock is already seized - Row nr 1 causing abort : [update_dims_lock], [1], [0], [null]
ERROR 11-03 20:00:09,109 - Lock is already seized - Aborting after having seen 1 rows.
ERROR 11-03 20:00:09,110 - seize_lock_by_name - Errors detected!
ERROR 11-03 20:00:09,110 - seize_lock_by_name - Errors detected!

Yes, to fix this, first ensure there are no current DWH jobs by running:
# ps fax|grep dwh
Then:
# mysql -h$DB1_HOST -uetl -p$DWH_PASS kalturadw_ds
mysql> update locks set lock_state = 0;
Then try sanity again.

I run # ps fax|grep dwh:

16445 ? Ss 0:00 _ /bin/bash /opt/kaltura/dwh/etlsource/execute/etl_update_dims.sh -p /opt/kaltura/dwh -k /opt/kaltura/pentaho/pdi/kitchen.sh
16453 ? S 0:00 _ sh /opt/kaltura/pentaho/pdi/kitchen.sh /file /opt/kaltura/dwh/etlsource/dimensions/update_dimensions.kjb
17415 pts/0 S+ 0:00 _ grep dwh

and run that :# mysql -h$DB1_HOST -uetl -p$DWH_PASS kalturadw_ds
mysql> update locks set lock_state = 0;

Query OK, 1 row affected (0.00 sec)
Rows matched: 4 Changed: 1 Warnings: 0

try sanity again and DWH still failed…

You need to first kill the existing processes, then update lock_state, then run.

I found that a processes keep changing the pid , how to kill that process…TAT

[root@Vmook-haidian ~]# ps fax|grep dwh
29208 pts/0 S+ 0:00 _ grep dwh
[root@Vmook-haidian ~]# ps fax|grep dwh
29292 pts/0 S+ 0:00 _ grep dwh
[root@Vmook-haidian ~]# ps fax|grep dwh
29300 pts/0 S+ 0:00 _ grep dwh

and should I restart the process? how?

Now that all are down, run kaltura-sanity.sh to see if the cycle ends successfully.
Again, make sure no locks are set to 1.

except lock_state,What locks should be set to 0? I had set lock_state to 0,but the problem still exists.

SELECT * FROM LOCKS;
±--------±---------------------±--------------------±-----------+
| lock_id | lock_name | lock_time | lock_state |
±--------±---------------------±--------------------±-----------+
| 1 | daily_lock | 2015-03-11 20:59:11 | 0 |
| 2 | retention_lock | 2015-03-11 12:30:15 | 0 |
| 3 | update_dims_lock | 2015-03-11 22:00:17 | 0 |
| 4 | hourly_Vmook-haidian | 2015-03-11 22:00:20 | 0 |
±--------±---------------------±--------------------±-----------+

It still [DWH cycle] [FAILED, RC: 255] - [6.210736793] …
may be i should restart the server??
@jess
thanks

Jess,
because of the DWH problem,I reinstall the Kaltura, and I fount a new error report:

    ERROR 13-04 14:00:08,347 - Mapping (sub-transformation) - Unable to load the mapping transformation because of an error : org.pentaho.di.core.exception.KettleException:
Unable to load the specified mapping

Error reading object from XML file

Unable to load step info from XML step nodeorg.pentaho.di.core.exception.KettleStepLoaderException:
Unable to load class for step/plugin with id [MapperFieldRunner]. Check if the plugin is available in the plugins subdirectory of the Kettle distribution.


Unable to load class for step/plugin with id [MapperFieldRunner]. Check if the plugin is available in the plugins subdirectory of the Kettle distribution.




ERROR 13-04 14:00:08,348 - Mapping (sub-transformation) - org.pentaho.di.core.exception.KettleException:
Unable to load the specified mapping

Error reading object from XML file

Unable to load step info from XML step nodeorg.pentaho.di.core.exception.KettleStepLoaderException:
Unable to load class for step/plugin with id [MapperFieldRunner]. Check if the plugin is available in the plugins subdirectory of the Kettle distribution.


Unable to load class for step/plugin with id [MapperFieldRunner]. Check if the plugin is available in the plugins subdirectory of the Kettle distribution.




        at org.pentaho.di.trans.steps.mapping.MappingMeta.loadMappingMeta(MappingMeta.java:593)
        at org.pentaho.di.trans.steps.mapping.Mapping.init(Mapping.java:480)
        at org.pentaho.di.trans.step.StepInitThread.run(StepInitThread.java:52)
        at java.lang.Thread.run(Thread.java:745)
Caused by: org.pentaho.di.core.exception.KettleXMLException:
Error reading object from XML file

Unable to load step info from XML step nodeorg.pentaho.di.core.exception.KettleStepLoaderException:
Unable to load class for step/plugin with id [MapperFieldRunner]. Check if the plugin is available in the plugins subdirectory of the Kettle distribution.

DWH still something wrong, do you know the reason?

Hello,

Try running:
# drop-dwh-data.sh
then edit:
$BASE_DIR/dwh/setup/dwh_setup.sh

and replace:
#!/bin/bash
with
#!/bin/bash -x
for debug info
then run /opt/kaltura/bin/kaltura-dwh-config.sh again and look for errors.

I have the same problem (no analytics)

  • no analytics updated after play videos
  • run dwh cron scripts manually seems ok
  • all kaltura-sanity.sh results ok

after read all thread I try with drop-dwh-data.sh and get these errors

root@kaltura01:~# /opt/kaltura/bin/drop-dwh-data.sh nlabs
This will remove all data from the DWH [analytics] DBs and cannot be reverted.
Are you sure you want to continue? [N/y]
y
ERROR 1051 (42S02) at line 1: Unknown table 'dwh_aggr_events_entry_partitions’
ERROR 1051 (42S02) at line 1: Unknown table 'dwh_dim_countries’
ERROR 1051 (42S02) at line 1: Unknown table 'dwh_dim_countries_states’
ERROR 1051 (42S02) at line 1: Unknown table 'dwh_dim_entries_v’
ERROR 1051 (42S02) at line 1: Unknown table 'dwh_dim_partners_v’
ERROR 1051 (42S02) at line 1: Unknown table 'dwh_dim_referrer’
ERROR 1051 (42S02) at line 1: Unknown table 'dwh_dim_ui_conf_v’
ERROR 1051 (42S02) at line 1: Unknown table 'dwh_dim_user_reports_allowed_partners’
ERROR 1051 (42S02) at line 1: Unknown table 'dwh_view_entry_type_display’
ERROR 1051 (42S02) at line 1: Unknown table 'dwh_view_monthly_active_partners’
ERROR 1051 (42S02) at line 1: Unknown table 'dwh_view_partners_monthly_billing’
ERROR 1051 (42S02) at line 1: Unknown table 'dwh_view_partners_monthly_billing_last_updated_at’
ERROR 1051 (42S02) at line 1: Unknown table 'ri_defaults_grouped’
ERROR 1051 (42S02) at line 1: Unknown table 'ri_mapping_and_defaults’
ERROR 1051 (42S02) at line 1: Unknown table 'ds_events_partitions’
ERROR 1305 (42000) at line 1: PROCEDURE kalturadw.add_cycle_partition does not exist
ERROR 1305 (42000) at line 1: PROCEDURE kalturadw.drop_cycle_partition does not exist
ERROR 1305 (42000) at line 1: PROCEDURE kalturadw.empty_cycle_partition does not exist
ERROR 1305 (42000) at line 1: PROCEDURE kalturadw.fms_sessionize does not exist
ERROR 1305 (42000) at line 1: PROCEDURE kalturadw.fms_sessionize_by_date_id does not exist
ERROR 1305 (42000) at line 1: PROCEDURE kalturadw.insert_invalid_ds_line does not exist
ERROR 1305 (42000) at line 1: PROCEDURE kalturadw.register_file does not exist
ERROR 1305 (42000) at line 1: PROCEDURE kalturadw.restore_file_status does not exist
ERROR 1305 (42000) at line 1: PROCEDURE kalturadw.set_cycle_status does not exist
ERROR 1305 (42000) at line 1: PROCEDURE kalturadw.set_file_status does not exist
ERROR 1305 (42000) at line 1: PROCEDURE kalturadw.set_file_status_full does not exist
ERROR 1305 (42000) at line 1: PROCEDURE kalturadw.transfer_cycle_partition does not exist
ERROR 1305 (42000) at line 1: PROCEDURE kalturadw.unify_incomplete_api_calls does not exist

Now, i will delete all dwh manually and run dwh_setup.sh again.

I tried to run this command and got the following errors.

ERROR 2005 (HY000): Unknown MySQL server host '-N' (1)
ERROR 2005 (HY000): Unknown MySQL server host '-N' (1)
ERROR 2005 (HY000): Unknown MySQL server host '-N' (1)
ERROR 2005 (HY000): Unknown MySQL server host '-N' (1)
ERROR 2005 (HY000): Unknown MySQL server host '-p%%ROOTPassword%%' (1)
ERROR 2005 (HY000): Unknown MySQL server host '-p%%ROOTPassword%%' (1)

I am going to guess that since Kaltura DWH can not find the database host that something broke in the configuration that did not properly set my host to local or use the hostname. How do I fix this is there are ini or configuration file I can check to update the information for the DHW host name or IP that the script show be using.

If the file used to define the connection is:

/opt/kaltura/app/configurations/system.ini

Then I have check that file and the host is setup the local IP address 127.0.0.1 which is working but I have no idea what host the script is calling to for it to return an unknown error. Oddly, I didn’t get an error when I setup DWH so I am not sure why the process isnt working. I will try the trouble shooting page and manually drop the DWH data and recreate it then run a sanity check and the script manually again.