After Upgrading Kaltura CE from 10.14.0 to 11.5.0 KMC does not working anymore

daniel_mueller_1 · January 12, 2016, 10:52am

Hello community,

I had a successful Kaltura CE 10.14.0 installation running based on CentoOS 6.5.
Today I did run yum update and after the upgrade the KMC Webinterface didn’t work anymore.
If I do a login with a publisher user and after that I get a blank screen with a spinning “loading” on the top beside the kaltura logo. It seems that the flash content isn’t available anymore.

I did run kaltlog and got some path errors:

==> /opt/kaltura/log/kaltura_apache_errors.log <==
[Tue Jan 12 10:25:58 2016] [error] [client 10.30.5.51] File does not exist: /opt/kaltura/web/flash/kmc/v5.39.3, referer: http://agsstr01/index.php/kmc/kmc4
[Tue Jan 12 10:26:01 2016] [error] [client 10.30.5.51] File does not exist: /opt/kaltura/web/flash/kmc/v5.39.3, referer: http://agsstr01/index.php/kmc/kmc4
[Tue Jan 12 10:26:01 2016] [error] [client 10.30.5.51] File does not exist: /opt/kaltura/web/flash/kmc/v5.39.3, referer: http://agsstr01/index.php/kmc/kmc4
[Tue Jan 12 10:26:44 2016] [error] [client 10.30.5.51] File does not exist: /opt/kaltura/web/flash/kmc/v5.39.3, referer: http://agsstr01/index.php/kmc/kmc4
[Tue Jan 12 10:26:44 2016] [error] [client 10.30.5.51] File does not exist: /opt/kaltura/web/flash/kmc/v5.39.3, referer: http://agsstr01/index.php/kmc/kmc4
[Tue Jan 12 10:27:34 2016] [error] [client 127.0.0.1] File does not exist: /opt/kaltura/web/html5/html5lib/v2.32
[Tue Jan 12 10:27:41 2016] [error] [client 127.0.0.1] File does not exist: /opt/kaltura/web/html5/html5lib/v2.32
[Tue Jan 12 10:27:42 2016] [error] [client 127.0.0.1] File does not exist: /opt/kaltura/web/html5/html5lib/v2.32
[Tue Jan 12 10:27:57 2016] [error] [client 127.0.0.1] File does not exist: /opt/kaltura/web/html5/html5lib/v2.32
[Tue Jan 12 10:27:57 2016] [error] [client 127.0.0.1] File does not exist: /opt/kaltura/web/html5/html5lib/v2.32

If I browse to /opt/kaltura/web/flash/kmc/ I can see a folder v5.39.11 but no v5.39.3
Same for /opt/kaltura/web/html5/html5lib/ I can see many version there, but no v2.32

Is there a way to fix the links?

Do I have to run a reconfiguration script like in this topic?

If yes what scripts can I use for CentOS?

Another thing I get from the Log is a permission error:

==> /opt/kaltura/log/batch/bulkdownloadcloser-0-2016-01-12.log <==
PHP Class map could not be saved2016-01-12 09:37:49 [1726583493] [KBatchBase->__construct] DEBUG: ___________________________________________________________________________________
2016-01-12 09:37:49 [1726583493] [KBatchBase->__construct] INFO: 2.0.2

==> /opt/kaltura/log/batch/bulkupload-0-2016-01-12.err.log <==
PHP Warning: rename(/tmp/classMap.cacheSYsJAn,/opt/kaltura/app/cache//batch/classMap.cache): Permission denied in /opt/kaltura/app/infra/KAutoloader.php on line 433
PHP Class map could not be saved to path [/opt/kaltura/app/cache//batch/classMap.cache] folder permissions [755]

==> /opt/kaltura/log/batch/bulkupload-0-2016-01-12.log <==
PHP Class map could not be saved2016-01-12 09:38:02 [1388463956] [KBatchBase->__construct] DEBUG: ___________________________________________________________________________________
2016-01-12 09:38:02 [1388463956] [KBatchBase->__construct] INFO: 2.0.2

==> /opt/kaltura/log/batch/bulkuploadcloser-0-2016-01-12.err.log <==
PHP Warning: rename(/tmp/classMap.cacheTDfYW9,/opt/kaltura/app/cache//batch/classMap.cache): Permission denied in /opt/kaltura/app/infra/KAutoloader.php on line 433
PHP Class map could not be saved to path [/opt/kaltura/app/cache//batch/classMap.cache] folder permissions [755]

==> /opt/kaltura/log/batch/bulkuploadcloser-0-2016-01-12.log <==
PHP Class map could not be saved2016-01-12 09:37:50 [2139124142] [KBatchBase->__construct] DEBUG: ___________________________________________________________________________________
2016-01-12 09:37:50 [2139124142] [KBatchBase->__construct] INFO: 2.0.2

==> /opt/kaltura/log/batch/convert-0-2016-01-12.err.log <==
PHP Warning: file_get_contents(/opt/kaltura/app/vendor/google-api-php-client-1.1.2/src/Google/Service/Bigquery.php): failed to open stream: Permission denied in /opt/kaltura/app/infra/KAutoloader.php on line 110
PHP Warning: rename(/tmp/classMap.cached8EBwH,/opt/kaltura/app/cache//batch/classMap.cache): Permission denied in /opt/kaltura/app/infra/KAutoloader.php on line 433
PHP Class map could not be saved to path [/opt/kaltura/app/cache//batch/classMap.cache] folder permissions [755]

==> /opt/kaltura/log/batch/convert-0-2016-01-12.log <==
PHP Class map could not be saved2016-01-12 09:38:00 [861999558] [KBatchBase->__construct] DEBUG: ___________________________________________________________________________________
2016-01-12 09:38:00 [861999558] [KBatchBase->__construct] INFO: 2.0.2

Thanks for every suggestion and help!
I hope I’ll get Kaltura back to work

jess · January 12, 2016, 1:02pm

Hello,

Post upgrading the RPMs, you need to rerun the config scripts, as explained here:

github.com

kaltura/platform-install-packages/blob/master/doc/install-kaltura-redhat-based.md#upgrade-kaltura

# Installing Kaltura on a Single Server (RPM)
This guide describes RPM installation of an all-in-one Kaltura server and applies to all major RH based Linux distros including Fedora Core, RHEL, CentOS, etc.
([Note the supported distros and versions](http://kaltura.github.io/platform-install-packages/#supported-distros)).

[Kaltura Inc.](http://corp.kaltura.com) also provides commercial solutions and services including pro-active platform monitoring, applications, SLA, 24/7 support and professional services. If you're looking for a commercially supported video platform  with integrations to commercial encoders, streaming servers, eCDN, DRM and more - Start a [Free Trial of the Kaltura.com Hosted Platform](http://corp.kaltura.com/free-trial) or learn more about [Kaltura' Commercial OnPrem Edition™](http://corp.kaltura.com/Deployment-Options/Kaltura-On-Prem-Edition). For existing RPM based users, Kaltura offers commercial upgrade options.

#### Table of Contents
[Prerequites](pre-requisites.md)

[Pre-Install Steps](install-kaltura-redhat-based.md#pre-install-steps)

[Non-SSL Step-by-step Installation](install-kaltura-redhat-based.md#non-ssl-step-by-step-installation)

[Apache SSL Step-by-step Installation](install-kaltura-redhat-based.md#apache-ssl-step-by-step-installation)

[Nginx SSL Configuration](nginx-ssl-config.md)

[Unattended Installation](install-kaltura-redhat-based.md#unattended-installation)

[Live Streaming with Nginx and the RTMP module](install-kaltura-redhat-based.md#live-streaming-with-nginx-and-the-rtmp-module)

This file has been truncated. show original

You should be fine after that.

daniel_mueller_1 · January 12, 2016, 3:05pm

Hi Jess,

Thanks for your fast reply.

If I run ./kaltura-db-update.sh I get:
Error occured during DB update
But the second script /opt/kaltura/bin/kaltura-config-all.sh went successful trough.

The KMC Console seems to work again, but if I click on a video I get: Internal Server error occured

If I have a look on the kaltlog output I’ve still some errors:

==> /opt/kaltura/log/generate.php.log <==
PHP Warning: require_once(/opt/kaltura/app/api_v3/lib/types/batch/filters/base/KalturaMediaServerBaseFilter.php): failed to open stream: No such file or directory in /opt/kaltura/app/infra/KAutoloader.php on line 81
PHP Fatal error: require_once(): Failed opening required ‘/opt/kaltura/app/api_v3/lib/types/batch/filters/base/KalturaMediaServerBaseFilter.php’ (include_path=’/opt/kaltura/app/vendor/ZendFramework/library:.:/usr/share/pear:/usr/share/php:/opt/kaltura/app:/opt/kaltura/app/vendor/symfony:/opt/kaltura/app/vendor/symfony/vendor:/opt/kaltura/app/vendor/ZendFramework/library:/opt/kaltura/app/alpha:/opt/kaltura/app/alpha/lib:/opt/kaltura/app/alpha/apps/kaltura/lib’) in /opt/kaltura/app/infra/KAutoloader.php on line 81

Further I got some path errors of a missing html5lib directory:

==> /opt/kaltura/log/kaltura_apache_errors.log <==
[Tue Jan 12 15:12:35 2016] [error] [client 127.0.0.1] File does not exist: /opt/kaltura/web/html5/html5lib/v2.32
[Tue Jan 12 15:12:35 2016] [error] [client 127.0.0.1] File does not exist: /opt/kaltura/web/html5/html5lib/v2.32
[Tue Jan 12 15:12:54 2016] [error] [client 127.0.0.1] File does not exist: /opt/kaltura/web/html5/html5lib/v2.32
[Tue Jan 12 15:12:54 2016] [error] [client 127.0.0.1] File does not exist: /opt/kaltura/web/html5/html5lib/v2.32

Internal Server error Message

8 {main}
2016-01-12 15:08:46 [0.000267] [] [935804612] [451] [%context%] [kSphinxSearchManager->getSphinxSaveSql] ERR: exception ‘Exception’ with message ‘Dynamic enum not found [thumbCuePoint.Thumb] for type [CuePointType]’ in /opt/kaltura/app/infra/log/KalturaLog.php:83
Stack trace:
0 /opt/kaltura/app/plugins/sphinx_search/lib/kSphinxSearchManager.php(257): KalturaLog::err(‘Dynamic enum no…’)

3 {main}
2016-01-12 15:11:22 [0.000192] [245352076] [39] [BATCH] [KJobHandlerWorker->closeJobOnError] ERR: exception ‘Exception’ with message ‘Internal server error occurred’ in /opt/kaltura/app/infra/log/KalturaLog.php:83
Stack trace:
0 /opt/kaltura/app/batch/batches/KJobHandlerWorker.class.php(149): KalturaLog::err(‘Internal server…’)

If I run kaltura-sanity.sh I get the following output:

[root@agsstr01 bin]# kaltura-sanity.sh
[Space on /] [PASSED, RC: 0] - [.004472056]
[Space on /opt/kaltura/web] [PASSED, RC: 0] - [.004172254]
[Check httpd daemon status] [PASSED, RC: 0] - [.047184749]
Napping 1 seconds to allow the daemon httpd to finish its init after monit restarted it…
Napping 2 seconds to allow the daemon httpd to finish its init after monit restarted it…
Napping 3 seconds to allow the daemon httpd to finish its init after monit restarted it…
Napping 4 seconds to allow the daemon httpd to finish its init after monit restarted it…
Napping 5 seconds to allow the daemon httpd to finish its init after monit restarted it…
Napping 6 seconds to allow the daemon httpd to finish its init after monit restarted it…
[Check httpd daemon is started by Monit] [PASSED, RC: 0] - [7.381969639]
[check daemon httpd init status] [PASSED, RC: 0] - [.005734348]
[Check kaltura-sphinx daemon status] [PASSED, RC: 0] - [.070706821]
[Check kaltura-sphinx daemon is started by Monit] [PASSED, RC: 0] - [10.591412233]
[check daemon kaltura-sphinx init status] [PASSED, RC: 0] - [.005499495]
[Check kaltura-batch daemon status] [PASSED, RC: 0] - [.040232098]
Napping 1 seconds to allow the daemon kaltura-batch to finish its init after monit restarted it…
Napping 2 seconds to allow the daemon kaltura-batch to finish its init after monit restarted it…
Napping 3 seconds to allow the daemon kaltura-batch to finish its init after monit restarted it…
Napping 4 seconds to allow the daemon kaltura-batch to finish its init after monit restarted it…
Napping 5 seconds to allow the daemon kaltura-batch to finish its init after monit restarted it…
Napping 6 seconds to allow the daemon kaltura-batch to finish its init after monit restarted it…
[Check kaltura-batch daemon is started by Monit] [PASSED, RC: 0] - [6.323235904]
[check daemon kaltura-batch init status] [PASSED, RC: 0] - [.008287944]
[Check kaltura-monit daemon status] [PASSED, RC: 0] - [.032569880]
[check daemon kaltura-monit init status] [PASSED, RC: 0] - [.005327624]
[Check memcached daemon status] [PASSED, RC: 0] - [.032018775]
Napping 1 seconds to allow the daemon memcached to finish its init after monit restarted it…
Napping 2 seconds to allow the daemon memcached to finish its init after monit restarted it…
Napping 3 seconds to allow the daemon memcached to finish its init after monit restarted it…
Napping 4 seconds to allow the daemon memcached to finish its init after monit restarted it…
Napping 5 seconds to allow the daemon memcached to finish its init after monit restarted it…
Napping 6 seconds to allow the daemon memcached to finish its init after monit restarted it…
Napping 7 seconds to allow the daemon memcached to finish its init after monit restarted it…
Napping 8 seconds to allow the daemon memcached to finish its init after monit restarted it…
[Check memcached daemon is started by Monit] [PASSED, RC: 0] - [8.440213194]
[check daemon memcached init status] [PASSED, RC: 0] - [.005468180]
[kaltura-html5lib ver in KMC config.ini] [PASSED, RC: 0] - [.159830357]
[kaltura-kdp3 ver in KDP3 config.ini] [PASSED, RC: 0] - [.076737044]
[kaltura-kmc ver in KMC config.ini] [PASSED, RC: 0] - [.097974480]
[Get KMC SWFs] [PASSED, RC: 0] - [.179204081]
[check_testme_page] [PASSED, RC: 0] - [13.468455228]
[check_kmc_index_page] [PASSED, RC: 0] - [.025178005]
[check_admin_console_index_page] [PASSED, RC: 0] - [.502298137]
[check_studio_index_page] [PASSED, RC: 0] - [.015618990]
[check_clipapp_index_page] [PASSED, RC: 0] - [.582779928]
[Create Partner] [FAILED, RC: 255] - [3.019599963]
Partner creation failed. I will skip all tests that require it.
[Red5 file upload] [SKIPPED as OflaDemo isn’t configured]
see: https://github.com/kaltura/platform-install-packages/blob/master/doc/install-kaltura-redhat-based.md#configure-red5-server

jess · January 12, 2016, 6:00pm

Hi Daniel,

Welcome:)
Please see: Internal Server Error in KMC after 11.0.4 Upgrade

I believe you have the exact same issue.

daniel_mueller_1 · January 13, 2016, 1:57pm

Hi Jess,

Thank you very much. I’m happy! With your help I could solve the problem!

I did the same as described in the linked thread.

The error above should be resolved by running:
php $BASE_DIR/app/generator/generate.php
and:
$APP_DIR/deployment/base/scripts/installPlugins.php

After stopping the httpd,mechcached and kaltura-monit service I did run the php scripts manually.
The error message on the server disappeared and there is no more "'Dynamic enum not found " error messages in the log.

The issue with the missing html5 library could I solve by simply creating a new Folder called v2.32 and copy the content from v2.32.1 to it.