Deadline Integration with shotgrid(Nuke)

Pipeline Integrations
1

Hi All,

I am new to the shotgrid & trying to submit renders from Nuke to deadline render farm using Thinkbox’s submit Nuke to Deadline script. Renders are getting submitted but giving an errors & getting failed.
Can someone please let me know the step by step guide of deadline integration.

Below is the farm error.

=======================================================
Error

Error: ManagedProcessAbort : Error: DirectoryNotFoundException : Could not find a part of the path ‘N:\Project\stmbt_001\sequences\KFA\KFA0780\CMP\work\nuke\main.v001.nk’.
at System.IO.FileSystem.CopyFile(String sourceFullPath, String destFullPath, Boolean overwrite)
at System.IO.File.Copy(String sourceFileName, String destFileName, Boolean overwrite)
at Deadline.IO.PathMappingUtils.CheckPathMappingInFileAndReplace(String inFileName, String outFileName, String forceSeperator, String stringsToReplace, String newStrings, DataController dataController, GenericDelegate11 logFunction, String regionID, Boolean readFileAsBytes) at Deadline.IO.PathMappingUtils.CheckPathMappingInFileAndReplace(String inFileName, String outFileName, String forceSeperator, String[] stringsToReplace, String[] newStrings, DataController dataController, GenericDelegate11 logFunction, String regionID)
at Deadline.IO.PathMappingUtils.CheckPathMappingInFileAndReplace(String inFileName, String outFileName, String stringsToReplace, String newStrings, DataController dataController, GenericDelegate1`1 logFunction, String regionID)
at Deadline.Scripting.RepositoryUtils.CheckPathMappingInFileAndReplace(String inFileName, String outFileName, String stringsToReplace, String newStrings) (Python.Runtime.PythonException)
File “C:\ProgramData\Thinkbox\Deadline10\workers\PUN-SC-RND45\plugins\643905644c2cb94af8f7dc1d\Nuke.py”, line 406, in PreRenderTasks
self.pathMappingWithFilePermissionFix( sceneFilename, self.TempSceneFilename, (“\[”,“\”, “TCL_ESCAPE”), (“TCL_ESCAPE”, “/”, “\[”) )
File “C:\ProgramData\Thinkbox\Deadline10\workers\PUN-SC-RND45\plugins\643905644c2cb94af8f7dc1d\Nuke.py”, line 328, in pathMappingWithFilePermissionFix
RepositoryUtils.CheckPathMappingInFileAndReplace( inFileName, outFileName, stringsToReplace, newStrings )
at Python.Runtime.Dispatcher.Dispatch(ArrayList args)
at __FranticX_GenericDelegate0Dispatcher.Invoke()
at FranticX.Processes.ManagedProcess.PreRenderTasks()
at FranticX.Processes.ManagedProcess.Execute(Boolean waitForExit)
at FranticX.Processes.ManagedProcess.GenerateManagedProcessAbortException(Exception e, String operationName)
at FranticX.Processes.ManagedProcess.Execute(Boolean waitForExit)
at Deadline.Plugins.DeadlinePlugin.RunManagedProcessAsUser(ManagedProcess managedProcess, String userName, String domain, String password, Boolean useSu, Boolean preserveEnvironment, Boolean setHomeVariable)
at Deadline.Plugins.DeadlinePlugin.RunManagedProcess(ManagedProcess managedProcess) (Python.Runtime.PythonException)
File “C:\ProgramData\Thinkbox\Deadline10\workers\PUN-SC-RND45\plugins\643905644c2cb94af8f7dc1d\Nuke.py”, line 283, in RenderTasks
self.RunManagedProcess( self.Process )
at Python.Runtime.Dispatcher.Dispatch(ArrayList args)
at __FranticX_GenericDelegate0Dispatcher.Invoke()
at Deadline.Plugins.DeadlinePlugin.RenderTasks()
at Deadline.Plugins.DeadlinePlugin.DoRenderTasks()
at Deadline.Plugins.PluginWrapper.RenderTasks(Task task, String& outMessage, AbortLevel& abortLevel)
at Deadline.Plugins.PluginWrapper.RenderTasks(Task task, String& outMessage, AbortLevel& abortLevel)

=======================================================
Type

RenderPluginException

=======================================================
Stack Trace

at Deadline.Plugins.SandboxedPlugin.d(DeadlineMessage bgj, CancellationToken bgk)
at Deadline.Plugins.SandboxedPlugin.RenderTask(Task task, CancellationToken cancellationToken)
at Deadline.Slaves.SlaveRenderThread.c(TaskLogWriter ajq, CancellationToken ajr)

=======================================================
Log

2023-04-14 13:18:53: 0: Loading Job’s Plugin timeout is Disabled
2023-04-14 13:18:53: 0: SandboxedPlugin: Render Job As User disabled, running as current user ‘deadline_render’
2023-04-14 13:18:56: 0: Executing plugin command of type ‘Initialize Plugin’
2023-04-14 13:18:56: 0: INFO: Executing plugin script ‘C:\ProgramData\Thinkbox\Deadline10\workers\PUN-SC-RND45\plugins\643905644c2cb94af8f7dc1d\Nuke.py’
2023-04-14 13:18:56: 0: INFO: Plugin execution sandbox using Python version 3
2023-04-14 13:18:56: 0: INFO: About: Nuke Plugin for Deadline
2023-04-14 13:18:56: 0: INFO: The job’s environment will be merged with the current environment before rendering
2023-04-14 13:18:56: 0: Done executing plugin command of type ‘Initialize Plugin’
2023-04-14 13:18:56: 0: Start Job timeout is disabled.
2023-04-14 13:18:56: 0: Task timeout is disabled.
2023-04-14 13:18:56: 0: Loaded job: main.v001.nk (643905644c2cb94af8f7dc1d)
2023-04-14 13:18:56: 0: Executing plugin command of type ‘Start Job’
2023-04-14 13:18:56: 0: DEBUG: S3BackedCache Client is not installed.
2023-04-14 13:18:56: 0: INFO: Executing global asset transfer preload script ‘C:\ProgramData\Thinkbox\Deadline10\workers\PUN-SC-RND45\plugins\643905644c2cb94af8f7dc1d\GlobalAssetTransferPreLoad.py’
2023-04-14 13:18:56: 0: INFO: Looking for legacy (pre-10.0.26) AWS Portal File Transfer…
2023-04-14 13:18:56: 0: INFO: Looking for legacy (pre-10.0.26) File Transfer controller in C:/Program Files/Thinkbox/S3BackedCache/bin/task.py…
2023-04-14 13:18:56: 0: INFO: Could not find legacy (pre-10.0.26) AWS Portal File Transfer.
2023-04-14 13:18:56: 0: INFO: Legacy (pre-10.0.26) AWS Portal File Transfer is not installed on the system.
2023-04-14 13:18:56: 0: Done executing plugin command of type ‘Start Job’
2023-04-14 13:18:56: 0: Plugin rendering frame(s): 1000
2023-04-14 13:18:57: 0: Executing plugin command of type ‘Render Task’
2023-04-14 13:18:57: 0: INFO: Enable Path Mapping: True
2023-04-14 13:18:57: 0: Done executing plugin command of type ‘Render Task’

=======================================================
Details

Date: 04/14/2023 13:19:00
Frames: 1000
Elapsed Time: 00:00:00:08
Job Submit Date: 04/14/2023 13:18:52
Job User: ravindrak
Average RAM Usage: 3723542528 (3%)
Peak RAM Usage: 3723542528 (3%)
Average CPU Usage: 1%
Peak CPU Usage: 1%
Used CPU Clocks (x10^6 cycles): 1857
Total CPU Clocks (x10^6 cycles): 185649

=======================================================
Worker Information

Worker Name: PUN-SC-RND45
Version: v10.1.22.5 Release (919d43564)
Operating System: Windows 10 Pro
Running As Service: Yes
Machine User: deadline_render
IP Address: 10.40.30.91
MAC Address: EC:EB:B8:88:F6:F0
CPU Architecture: x64
CPUs: 28
CPU Usage: 0%
Memory Usage: 3.5 GB / 127.9 GB (2%)
Free Disk Space: 1.665 TB
Video Card: Microsoft Basic Display Adapter

2

This is your error:

Error: ManagedProcessAbort : Error: DirectoryNotFoundException : Could not find a part of the path ‘N:\Project\stmbt_001\sequences\KFA\KFA0780\CMP\work\nuke\main.v001.nk’.

Are you sure your rendernodes are mapping the same way as your workstations?
i.e. N:\

3

Yes Ricardo all render nodes are mapped as N:\ drive.

4

There are plenty of posts on the Deadline forum regarding missing mounts.
Some of them seem impossible to solve. cannot find the relevant ones now, though.
https://forums.thinkboxsoftware.com/search?q=could%20not%20find

We had to mount the drives using Windows policies, because the Deadline auto mount was not working. Note that: mounts are per user, mounts might not be ready at the time the job starts, etc.

5

Well your error comes from Windows via Deadline.
Windows says that the path cannot be found/does not exist so the user your render process is running in does not seem to have that drive mapped.

For Windows renderfarms its best to use Deadline’s Path mapping so there is not need for drivemaps.
The SMB Protocol does not allow for multiple connections with different credentials from the same machine simultaneously, this can cause all kinds of issues.
Best to avoid and use path mapping.

1 Like