Moving /opt/kaltura/web folder to Windows Share

Community Forums Backend Server Support
1

Hello, I have Kaltura CE running on CentOS 6, but would like to mount our Drobo as the storage solution (rather than local storage). I have tried this via symlink, and mounting the web folder, but I am unable to upload files (stuck uploading).

I suspect this may be due to permissions but the Drobo share is wide open. Only thing I can think of, since this is a SMB/CIFS share, I cannot chown the folders, everything stays as root:root.

Is there something I’m missing to get this working?

TIA!
Kevin

2

Hi Kevin,

In general, I would recommend against using 777 on all relevant dirs. But technically, if indeed all relevant dirs are 777, it should work.

I’d suggest looking at the logs under /opt/kaltura/log/kaltura_api_v3.log, /opt/kaltura/log/kaltura_apache_errors.log and /opt/kaltura/log/batch/*log

You can also run:
# kaltlog
from the server’s shell while making the upload request and look for errors.

kaltlog is an alias for tail -f /opt/kaltura/log/.log /opt/kaltura/log/batch/.log | grep -A 1 -B 1 --color “ERR:|PHP|trace|CRIT|[error]”

makes it easier to find relevant error patterns.

3

Hi Jess,

Thanks for responding. The title should say Mounting, not Moving, but you understood and that’s all that matters!

So I tried to chmod -R 777 the entire mount, but no dice. Upload control shows the file going through the upload process, but when viewing the Content tab, the asset’s status is Uploading, and never changes.

Everything works, if I left it as is, but leaving the data on the local server does not make sense (not enough capacity nor redundancy).

I ran kaltlog and below is the output, loads of errors, ick?!

df -h
//172.16.233.92/a-store/_dam
8.0T 2.8T 5.3T 35% /opt/kaltura/web
[root@172 web]# kaltlog

==> /opt/kaltura/log/kaltura_apache_errors.log <==
[Thu Aug 13 13:39:09 2015] [error] [client 10.78.92.135] File does not exist: /opt/kaltura/app, referer: http://172.16.220.23/flash/kmc/v5.39.8/kmc.swf
[Thu Aug 13 13:39:11 2015] [error] [client 10.78.92.135] File does not exist: /opt/kaltura/app, referer: http://172.16.220.23/flash/kmc/v5.39.8/kmc.swf
[Thu Aug 13 13:39:15 2015] [error] [client 10.78.92.135] File does not exist: /opt/kaltura/app, referer: http://172.16.220.23/flash/kmc/v5.39.8/kmc.swf
[Thu Aug 13 13:39:39 2015] [error] [client 10.78.92.135] File does not exist: /opt/kaltura/app, referer: http://172.16.220.23/flash/kmc/v5.39.8/kmc.swf

--
  thrown in /opt/kaltura/app/vendor/propel/Propel.php on line 529
PHP Fatal error:  Uncaught exception 'PropelException' with message 'No connection information in your runtime configuration file for datasource [sphinx_log_read]' in /opt/kaltura/app/vendor/propel/Propel.php:529
Stack trace:
#0 /opt/kaltura/app/alpha/apps/kaltura/lib/myDbHelper.class.php(30): Propel::getConnection('sphinx_log_read')
--
2015-08-13 11:17:24 [1675008775] [addPermissionsAndItems.php] [addItemToPermissions] ALERT: exception 'Exception' with message 'ERROR - Permission name [] for partner [0] not found in database - skipping!' in /opt/kaltura/app/infra/log/KalturaLog.php:65
Stack trace:
#0 /opt/kaltura/app/alpha/scripts/utils/permissions/addPermissionsAndItems.php(280): KalturaLog::alert('ERROR - Permiss...')
--
==> /opt/kaltura/log/batch/concat-0-2015-08-13.err.log <==
PHP Warning:  mkdir(): Permission denied in /opt/kaltura/app/batch/batches/KBatchBase.class.php on line 523

--
==> /opt/kaltura/log/batch/convert-0-2015-08-13.err.log <==
PHP Warning:  mkdir(): Permission denied in /opt/kaltura/app/batch/batches/KBatchBase.class.php on line 523

--
==> /opt/kaltura/log/batch/convertcloser-0-2015-08-13.err.log <==
PHP Warning:  mkdir(): Permission denied in /opt/kaltura/app/batch/batches/KBatchBase.class.php on line 523

--
==> /opt/kaltura/log/batch/convertlivesegment-0-2015-08-13.err.log <==
PHP Warning:  mkdir(): Permission denied in /opt/kaltura/app/batch/batches/KBatchBase.class.php on line 523

--
==> /opt/kaltura/log/batch/kschedulehelper-0-2015-08-13.err.log <==
PHP Fatal error:  Uncaught exception 'KalturaException' with message 'Invalid KS "NGZiZDAyYTQ1NTkwM2Y2NjRkODg0YzBlNDMzMzg4ZTJjNDdiZDAxY3wtMTs7MTQ0MjA5Mjc5MDsyOzE0Mzk1MDA3OTAuNDAxO2JhdGNoVXNlcjtkaXNhYmxlZW50aXRsZW1lbnQ7LTE7", Error "-1,INVALID_STR"' in /opt/kaltura/app/batch/client/KalturaClientBase.php:768
Stack trace:
#0 /opt/kaltura/app/batch/client/KalturaClient.php(4558): KalturaClientBase->throwExceptionIfError(Array)
--
==> /opt/kaltura/log/batch/validatelivemediaservers-0-2015-08-13.err.log <==
PHP Fatal error:  Uncaught exception 'KalturaException' with message 'Internal server error occurred' in /opt/kaltura/app/batch/client/KalturaClientBase.php:768
Stack trace:
#0 /opt/kaltura/app/batch/client/KalturaClient.php(4176): KalturaClientBase->throwExceptionIfError(Array)
--
2015-08-13 18:07:38 [0.000348] [10.78.92.135] [1165962921] [54] [PS2] [KalturaStatement->execute] DEBUG: Sql took - 0.0002131462097168 seconds
2015-08-13 18:07:38 [0.000244] [10.78.92.135] [1165962921] [55] [PS2] [KExternalErrors::dieError] ERR: exception 'Exception' with message 'exiting on error 6 - requested flavor was not found' in /opt/kaltura/app/infra/log/KalturaLog.php:83
Stack trace:
#0 /opt/kaltura/app/alpha/apps/kaltura/lib/KExternalErrors.class.php(126): KalturaLog::err('exiting on erro...')
--
            [tmp_name] => /tmp/phpyufM1v
            [error] => 0
            [size] => 19353370
--
            [tmp_name] => /tmp/phpyufM1v
            [error] => 0
            [size] => 19353370
--
            [tmp_name] => /tmp/phpyufM1v
            [error] => 0
            [size] => 19353370
--
2015-08-13 18:08:14 [0.000920] [10.78.92.135] [217591861] [31] [API] [KalturaFrontController->errorHandler] WARN: /opt/kaltura/app/infra/storage/kFile.class.php line 398 - copy(/opt/kaltura/web/content/uploads/0_2e5999695db689dbccaa4a52df6082bd.mp4): failed to open stream: Permission denied
2015-08-13 18:08:14 [0.000209] [10.78.92.135] [217591861] [32] [API] [kFile::copySingleFile] ERR: exception 'Exception' with message 'Failed to copy file : [/tmp/phpyufM1v] to [/opt/kaltura/web/content/uploads/0_2e5999695db689dbccaa4a52df6082bd.mp4]' in /opt/kaltura/app/infra/log/KalturaLog.php:83
Stack trace:
#0 /opt/kaltura/app/infra/storage/kFile.class.php(399): KalturaLog::err('Failed to copy ...')
--
2015-08-13 18:08:14 [0.001651] [10.78.92.135] [217591861] [41] [API] [kFlowHelper::handleUploadFinished] DEBUG: File path [/opt/kaltura/web/content/uploads/0_2e5999695db689dbccaa4a52df6082bd.mp4] not found
2015-08-13 18:08:14 [0.000251] [10.78.92.135] [217591861] [42] [API] [kFlowHelper::handleUploadFinished] ERR: exception 'Exception' with message 'File path [/opt/kaltura/web/content/uploads/0_2e5999695db689dbccaa4a52df6082bd.mp4] could not be redirected' in /opt/kaltura/app/infra/log/KalturaLog.php:83
Stack trace:
#0 /opt/kaltura/app/alpha/apps/kaltura/lib/batch2/kFlowHelper.php(2447): KalturaLog::err('File path [/opt...')
--
2015-08-13 18:08:48 [0.000160] [10.78.92.135] [314087702] [57] [PS2] [kFileSyncUtils::getReadyFileSyncForKey] NOTICE: FileSync was not found
2015-08-13 18:08:48 [0.000540] [10.78.92.135] [314087702] [58] [PS2] [kCoreException->__construct] ERR: exception 'kFileSyncException' with message 'no ready filesync on current DC' in /opt/kaltura/app/alpha/apps/kaltura/lib/myEntryUtils.class.php:789
Stack trace:
#0 /opt/kaltura/app/alpha/lib/model/entry.php(3277): myEntryUtils::resizeEntryImage(Object(entry), 0, 120, 90, 2, 'F7F7F7', NULL, 0, 0, 0, 0, 0, -1, '-1', '-1')
--
2015-08-13 18:08:48 [0.000156] [10.78.92.135] [314087702] [66] [PS2] [kFileSyncUtils::getReadyFileSyncForKey] NOTICE: FileSync was not found
2015-08-13 18:08:48 [0.000193] [10.78.92.135] [314087702] [67] [PS2] [entry->getLocalThumbFilePath] ERR: exception 'Exception' with message 'No ready fileSync found on any DC.' in /opt/kaltura/app/infra/log/KalturaLog.php:83
Stack trace:
#0 /opt/kaltura/app/alpha/lib/model/entry.php(3294): KalturaLog::err('No ready fileSy...')
--
#16 {main}
2015-08-13 18:08:48 [0.000226] [10.78.92.135] [314087702] [68] [PS2] [KExternalErrors::dieError] ERR: exception 'Exception' with message 'exiting on error 10 - missing thumbnail fileSync for entry' in /opt/kaltura/app/infra/log/KalturaLog.php:83
Stack trace:
#0 /opt/kaltura/app/alpha/apps/kaltura/lib/KExternalErrors.class.php(126): KalturaLog::err('exiting on erro...')
4

I unmounted and tested upload to local store, and it works perfectly fine, but kaltlog still spits out a ton of errors. This is practically a bone-stock install. Is this, common?

5

Hello,

The relevant errors for your issue are these:
‘PHP Warning: mkdir(): Permission denied in’…

You should look at the logs and see what directories we attempted to create and failed.
You can certainly mount from remote storage and that is even desired, and, for cluster deployments, a must.
However, as I said, I would not suggest using 777, for security reasons.

Typically, we recommend you mount /opt/kaltura/web using NFS4.

6

Thanks Jess. My main problem is the Drobo then as it does not support NFS4. Will try with another NAS, thanks for your input!