Network Rendering Disable with hython

Forums: Network Rendering Disable with hython
Houdini Integrated Plugin

Moderator: juanjgon

Network Rendering Disable with hython

Postby vime » Wed Mar 03, 2021 6:02 pm

vime Wed Mar 03, 2021 6:02 pm
Code: Select all
[Octane] Octane Render for Houdini. Build 2020.2.0.4 (Build date: Feb  8 2021 17:02:10)
[Octane] Octane API: 2020.2
[Octane] HDK API: 18.5.351
[Octane] Houdini host version: 18.5.351
[Octane] Initializing Octane API
[17:59:08.720]             Started logging on 03.03.21 18:59:08
[17:59:08.722]             
[17:59:08.722]             Flag                      Type    Value      Prefix       Description
[17:59:08.722]             ------------------------- ------- ---------- ------------ --------------------------------------------------------------------------------
[17:59:08.723]             activation                release 1          "activation" Enables log events for activation
[17:59:08.723]             apiChangeMgr              release 1          "apiChngMgr" Logs ApiChangeManager::update().
[17:59:08.723]             apiExport                 release 1          "apiExport"  Logs all geometry export operations.
[17:59:08.723]             apiForceConnectChecks     release 1          "apiChecks"  Enforces validation of node-pin connections.
[17:59:08.723]             apiNetwork                release 1          "apiNetwork" Logs all important calls into ApiNetRenderManager
[17:59:08.724]             apiNodeSystem             release 0          "apiNodeSys" Logs all write operations in the API node system.
[17:59:08.724]             apiProject                release 1          "apiProject" Logs all important calls into ApiProjectManager.
[17:59:08.724]             apiRender                 release 1          "apiRender"  Logs all important calls into ApiRenderEngine.
[17:59:08.724]             appShutdown               release 1          "appShutdow" Dumps information about application shutdown
[17:59:08.724]             assetsFinder              release 0          "assetsFind" Logs assets uploaded to ORC
[17:59:08.725]             cacheLoad                 release 0          "cacheLoad"  Dumps information about the data cache load
[17:59:08.725]             compAlwaysSync            release 0          "compute"    Always commit the command buffer and wait after each shader queued.
[17:59:08.725]             cudaAlwaysSync            release 0          "cuda"       Enables synchronization after each kernel call
[17:59:08.725]             cudaNoKernelFlush         release 0          "cuda"       Disables the explicit flushing of CUDA kernel calls
[17:59:08.725]             daemon                    release 0          "network"    Not used.
[17:59:08.725]             deactivation              release 1          "deactivati" Enables log events for deactivation
[17:59:08.726]             disableOoc                release 0          "cuda"       Disables out-of-core.
[17:59:08.726]             disableRtx                release 0          "disableRtx" Disables RTX acceleration.
[17:59:08.726]             dongle                    release 1          "dongle"     Enables logging of the dongle activity
[17:59:08.726]             dumpAlembicObjects        release 0          "AlembicObj" Dump data about exported Alembic objects
[17:59:08.726]             enableOoc                 release 0          "cuda"       Enables out-of-core.
[17:59:08.726]             forceMetalViewport        release 0          "forceMetal" Force to use HDR metal viewport.
[17:59:08.727]             forceOocImages            release 0          "cuda"       When out of core is enabled forces ALL images to go out of core.
[17:59:08.727]             forceOocMeshes            release 0          "cuda"       When out of core is enabled forces ALL meshes to go out of core (overrides forceP2PMeshes)
[17:59:08.727]             forceP2PMeshes            release 0          "cuda"       When P2P is enabled forces ALL meshes to use peer-to-peer memory
[17:59:08.727]             heartbeat                 release 0          "network"    Enables logging of the network rendering heartbeat.
[17:59:08.727]             hideOslEditor             release 0          ""           hides the OSL editor.
[17:59:08.727]             imageSaving               release 1          "imageSavin" Logs saving of render images.
[17:59:08.727]             licenseUsage              release 1          "licUsage"   Release logging flag for inter-process license usage
[17:59:08.728]             liveDBDebugging           release 0          "liveDB"     Logs information about the download process for debugging purposes
[17:59:08.728]             logAppendToFile           release 0          ""           If enabled, logging will be to the already existing log file appended
[17:59:08.728]             logFlags                  release 1          ""           If enabled, all log flags will be dumped during startup
[17:59:08.728]             logFlushTime              release 100        ""           The time (ms) after which the log is flushed. If set to 0, the timer based flush will be disabled.
[17:59:08.728]             logForceFlush             release 1          ""           If enabled, every logged line will be flushed
[17:59:08.729]             logJuce                   release 0          "JUCE"       If enabled, JUCE logging will go through the logging framework of Octane
[17:59:08.729]             logPrefix                 release 1          ""           If enabled, each log line will have a prefix
[17:59:08.729]             logTime                   release 1          ""           If enabled, each log line will have a timestamp
[17:59:08.729]             logToDebugConsole         release 0          ""           If enabled, logging will go to the debug console (Windows only)
[17:59:08.729]             logToFile                 release 1          ""           If enabled, logging will go to a log file
[17:59:08.729]             logToStdout               release 1          ""           If enabled, logging will go to standard out (when set to 1) or standard error (when set to 2)
[17:59:08.730]             makeAllInspectable        release 0          "geometryAr" If enabled, all geometry archives become inspectable. Should only be used if you know what you are doing.
[17:59:08.730]             moduleData                release 0          "moduleData" Logging for the loading/storage of module data
[17:59:08.730]             moduleLoader              release 0          "loader"     Logging for module loading and unloading.
[17:59:08.730]             navigateWhilePaused       release 0          ""           If enabled, camera changes will still be allowed while rendering is paused. The viewport will not update of course.
[17:59:08.730]             netRender                 release 0          "netRender"  General logging of network rendering
[17:59:08.730]             oocRamLimit               release 0          "cuda"       Sets the out-of-core RAM limit in MB.
[17:59:08.730]             optixDisableCompaction    release 0          "optix"      Disable OptiX data compaction
[17:59:08.731]             optixDisableUpdates       release 0          "optix"      Disable OptiX data updates
[17:59:08.731]             profEvents                release 0          "profile"    Enables logging of detailed profiling information
[17:59:08.731]             rdCacheDelay              release 0          "rdDataComp" Allows you to provide a msec delay >0 before caching begins.
[17:59:08.731]             rdNoFastBuild             release 0          "rdDataComp" Disables fast building of the render data (for testing purposes)
[17:59:08.731]             rdNoRamp                  release 0          "rdTarget"   If set, it disables the initial ramp up of the work chunk sizes.
[17:59:08.732]             rdStart                   release 1          "cuda"       Logs information about the creation and start up of render devices and threads.
[17:59:08.732]             stats                     release 1          "stats"      Enables logging of the statistics
[17:59:08.732]             subdivider                release 1          "subdivider" logs info about the subdivision process
[17:59:08.732]             
[17:59:08.732]             OctaneRender Enterprise 2020.2 (10021201)
[17:59:08.733]             
[17:59:31.023] cuda      : device 0: constructing with ID 0, name 'GeForce RTX 2060 SUPER', thread (nil)
[17:59:31.083] apiChngMgr: finishing update
[17:59:31.086] apiChngMgr: finishing update
[17:59:31.093] apiChngMgr: finishing update
[17:59:31.115] apiChngMgr: finishing update
[17:59:31.130] apiChngMgr: finishing update
[17:59:31.144] apiChngMgr: finishing update
[17:59:31.574] apiNetwork: enabled network rendering
[Octane] Network rendering enabled from hython automatically
[Octane] Network rendering: Enabled
[Octane] WARNING: preferences file not found: /home/vime/houdini18.5/octane.pref


Hi there,

we are loosing about 20 seconds while calling hython from commmand line on Ubuntu 20.04 (see the log).
I am pretty sure that this happens because it tries to activate Network Rendering. How can I deactivate that using hython?
vime
Licensed Customer
Licensed Customer
 
Posts: 15
Joined: Mon Aug 17, 2020 9:21 am

Re: Network Rendering Disable with hython

Postby juanjgon » Wed Mar 03, 2021 9:33 pm

juanjgon Wed Mar 03, 2021 9:33 pm
I don't think that this delay could come from the network rendering. The plugin is only enabling a flag. The network rendering linking happens at the render time. I think that this time is spent by Octane while loading its libs and initializing the API and licensing system, but I'll run a debug build to be sure.

Do you have the same delay while launching the main Houdini application?

Thanks,
-Juanjo
User avatar
juanjgon
Octane Plugin Developer
Octane Plugin Developer
 
Posts: 8867
Joined: Tue Jan 19, 2010 12:01 pm
Location: Spain

Re: Network Rendering Disable with hython

Postby vime » Thu Mar 04, 2021 6:45 am

vime Thu Mar 04, 2021 6:45 am
Hi juanjgon,

thank you for reaching out.
This is a headless machine, we only run hython-bin / hython on this machine and I cannot even test the GUI-version of Houdini as I cannot connect a screen.
The machine is quite heavy though, 64 cores, 250 gb RAM. We do not have this issue with version 1_5_1, which we still use for production due to issues we had with 2_0_2. Here is the full log of the starting sequence of our current setup:

Code: Select all
[Octane] Octane Render for Houdini. Build 2020.1.5.3 (Build date: Nov  5 2020 20:38:49)
[Octane] Octane API: 2020.1.5
[Octane] HDK API: 18.5.351
[Octane] Houdini host version: 18.5.351
[Octane] Initializing Octane API
[06:44:25.528]             Started logging on 04.03.21 07:44:25
[06:44:25.529]             
[06:44:25.529]             Flag                      Type    Value      Prefix       Description
[06:44:25.529]             ------------------------- ------- ---------- ------------ --------------------------------------------------------------------------------
[06:44:25.530]             activation                release 1          "activation" Release log for the activation manager
[06:44:25.530]             apiChangeMgr              release 1          "apiChngMgr" Logs ApiChangeManager::update().
[06:44:25.530]             apiExport                 release 1          "apiExport"  Logs all geometry export operations.
[06:44:25.530]             apiForceConnectChecks     release 1          "apiChecks"  Enforces validation of node-pin connections.
[06:44:25.530]             apiNetwork                release 1          "apiNetwork" Logs all important calls into ApiNetRenderManager
[06:44:25.531]             apiNodeSystem             release 0          "apiNodeSys" Logs all write operations in the API node system.
[06:44:25.531]             apiProject                release 1          "apiProject" Logs all important calls into ApiProjectManager.
[06:44:25.531]             apiRender                 release 1          "apiRender"  Logs all important calls into ApiRenderEngine.
[06:44:25.531]             appShutdown               release 1          "appShutdow" Dumps information about application shutdown
[06:44:25.531]             assetsFinder              release 0          "assetsFind" Logs assets uploaded to ORC
[06:44:25.532]             cacheLoad                 release 0          "cacheLoad"  Dumps information about the data cache load
[06:44:25.532]             cudaAlwaysSync            release 0          "cuda"       Enables synchronization after each kernel call
[06:44:25.532]             cudaNoKernelFlush         release 0          "cuda"       Disables the explicit flushing of CUDA kernel calls
[06:44:25.532]             daemon                    release 0          "network"    Not used.
[06:44:25.532]             disableRtx                release 0          "disableRtx" Disables RTX acceleration.
[06:44:25.533]             dongle                    release 1          "dongle"     Enables logging of the dongle activity
[06:44:25.533]             dumpAlembicObjects        release 0          "AlembicObj" Dump data about exported Alembic objects
[06:44:25.533]             heartbeat                 release 0          "network"    Enables logging of the network rendering heartbeat.
[06:44:25.533]             hideOslEditor             release 0          ""           hides the OSL editor.
[06:44:25.533]             imageSaving               release 1          "imageSavin" Logs saving of render images.
[06:44:25.534]             licenseUsage              release 1          "licUsage"   Release logging flag for inter-process license usage
[06:44:25.534]             liveDBDebugging           release 0          "liveDB"     Logs information about the download process for debugging purposes
[06:44:25.534]             logAppendToFile           release 0          ""           If enabled, logging will be to the already existing log file appended
[06:44:25.534]             logFlags                  release 1          ""           If enabled, all log flags will be dumped during startup
[06:44:25.534]             logFlushTime              release 100        ""           The time (ms) after which the log is flushed. If set to 0, the timer based flush will be disabled.
[06:44:25.534]             logForceFlush             release 1          ""           If enabled, every logged line will be flushed
[06:44:25.535]             logJuce                   release 0          "JUCE"       If enabled, JUCE logging will go through the logging framework of Octane
[06:44:25.535]             logPrefix                 release 1          ""           If enabled, each log line will have a prefix
[06:44:25.535]             logTime                   release 1          ""           If enabled, each log line will have a timestamp
[06:44:25.535]             logToDebugConsole         release 0          ""           If enabled, logging will go to the debug console (Windows only)
[06:44:25.535]             logToFile                 release 1          ""           If enabled, logging will go to a log file
[06:44:25.536]             logToStdout               release 1          ""           If enabled, logging will go to standard out (when set to 1) or standard error (when set to 2)
[06:44:25.536]             makeAllInspectable        release 0          "geometryAr" If enabled, all geometry archives become inspectable. Should only be used if you know what you are doing.
[06:44:25.536]             moduleData                release 0          "moduleData" Logging for the loading/storage of module data
[06:44:25.536]             moduleLoader              release 0          "loader"     Logging for module loading and unloading.
[06:44:25.537]             netRender                 release 0          "netRender"  General logging of network rendering
[06:44:25.537]             optixDisableCompaction    release 0          "optix"      Disable OptiX data compaction
[06:44:25.537]             optixDisableUpdates       release 0          "optix"      Disable OptiX data updates
[06:44:25.537]             rdCacheDelay              release 0          "rdDataComp" Allows you to provide a msec delay >0 before caching begins.
[06:44:25.537]             rdNoFastBuild             release 0          "rdDataComp" Disables fast building of the render data (for testing purposes)
[06:44:25.537]             rdNoRamp                  release 0          "rdTarget"   If set, it disables the initial ramp up of the work chunk sizes.
[06:44:25.538]             rdStart                   release 1          "cuda"       Logs information about the creation and start up of render devices and threads.
[06:44:25.538]             stats                     release 1          "stats"      Enables logging of the statistics
[06:44:25.538]             subdivider                release 1          "subdivider" logs info about the subdivision process
[06:44:25.538]             
[06:44:25.539]             OctaneRender Enterprise 2020.1.5 (8010500)
[06:44:25.539]             
[06:44:29.968] cuda      : device 0: constructing with ID 0, name 'GeForce RTX 2060 SUPER', thread (nil)
[06:44:29.996] apiChngMgr: finishing update
[06:44:29.999] apiChngMgr: finishing update
[06:44:30.127] apiChngMgr: finishing update
[06:44:30.134] apiChngMgr: finishing update
[06:44:30.150] apiChngMgr: finishing update
[06:44:30.165] apiChngMgr: finishing update
[Octane] WARNING: preferences file not found: /home/vime/houdini18.5/octane.pref
07:44:30 INFOR: [nodes] -------------  Registering Octane VOP nodes
[Octane] 07:44:30 INFOR: [nodes] -------------  Registering Octane VOP nodes
07:44:30 ERROR: [nodes] -------------    Custom attribute ID and IX don't match. Bypassing attribute
[Octane] 07:44:30 ERROR: [nodes] -------------    Custom attribute ID and IX don't match. Bypassing attribute
07:44:30 INFOR: [nodes] -------------  Octane VOP nodes registered
[Octane] 07:44:30 INFOR: [nodes] -------------  Octane VOP nodes registered
07:44:30 INFOR: [nodes] -------------  Registering the plugin custom VOP nodes
[Octane] 07:44:30 INFOR: [nodes] -------------  Registering the plugin custom VOP nodes
07:44:30 INFOR: [nodes] -------------  Plugin custom VOP nodes registered
[Octane] 07:44:30 INFOR: [nodes] -------------  Plugin custom VOP nodes registered
07:44:30 INFOR: [nodes] -------------  Registering Octane VOP nodes
[Octane] 07:44:30 INFOR: [nodes] -------------  Registering Octane VOP nodes
07:44:30 ERROR: [nodes] -------------    Custom attribute ID and IX don't match. Bypassing attribute
[Octane] 07:44:30 ERROR: [nodes] -------------    Custom attribute ID and IX don't match. Bypassing attribute
07:44:30 INFOR: [nodes] -------------  Octane VOP nodes registered
[Octane] 07:44:30 INFOR: [nodes] -------------  Octane VOP nodes registered
07:44:30 INFOR: [nodes] -------------  Registering the plugin custom VOP nodes
[Octane] 07:44:30 INFOR: [nodes] -------------  Registering the plugin custom VOP nodes
07:44:30 INFOR: [nodes] -------------  Plugin custom VOP nodes registered
[Octane] 07:44:30 INFOR: [nodes] -------------  Plugin custom VOP nodes registered

Python 3.7.4 (default, Mar 10 2020, 16:37:35)
[GCC 6.3.1 20170216 (Red Hat 6.3.1-3)] on linux
Houdini 18.5.351 hou module imported.
Type "help", "copyright", "credits" or "license" for more information.
>>>
vime
Licensed Customer
Licensed Customer
 
Posts: 15
Joined: Mon Aug 17, 2020 9:21 am

Re: Network Rendering Disable with hython

Postby juanjgon » Thu Mar 04, 2021 10:16 pm

juanjgon Thu Mar 04, 2021 10:16 pm
I've added some timing information to the latest Octane 2020.2.1.1 build just released only to confirm that the problem comes indeed from the Octane API initialization functions. I don't know why this has changed in Octane 2020.2, but I'll ask about it to the core devs. In my system Octane also spends 20 seconds in the initialization process ...

Code: Select all
[Octane] Octane Render for Houdini. Build 2020.2.1.1 (Build date: Mar  4 2021 19:19:21)
[Octane] Octane API: 2020.2.1
[Octane] HDK API: 18.5.499
[Octane] Houdini host version: 18.5.499
[Octane] Initializing Octane API
[Octane] Octane API ready. Initialization time: 20.570 seconds
[Octane] OCIO configuration ready. Initialization time: 0.370 seconds
[Octane] Octane network rendering enabled. Initialization time: 0.010 seconds
[Octane] Loading preferences from: /home/juanjo/houdini18.5/octane.pref


Thanks,
-Juanjo
User avatar
juanjgon
Octane Plugin Developer
Octane Plugin Developer
 
Posts: 8867
Joined: Tue Jan 19, 2010 12:01 pm
Location: Spain

Re: Network Rendering Disable with hython

Postby vime » Fri Mar 05, 2021 3:40 pm

vime Fri Mar 05, 2021 3:40 pm
Speaking about initialisation timing, do you think there is a way to have Octane running persistent in a houdini session? I understand that this might not be related to your plugin, however maybe you know something about that?
vime
Licensed Customer
Licensed Customer
 
Posts: 15
Joined: Mon Aug 17, 2020 9:21 am

Re: Network Rendering Disable with hython

Postby juanjgon » Fri Mar 05, 2021 5:00 pm

juanjgon Fri Mar 05, 2021 5:00 pm
Well, yes, in theory in hython you can load the scenes and render any number of frames without restarting it, but it depends on the renderer controller or script that you are using.

Thanks,
-Juanjo
User avatar
juanjgon
Octane Plugin Developer
Octane Plugin Developer
 
Posts: 8867
Joined: Tue Jan 19, 2010 12:01 pm
Location: Spain

Return to Houdini


Who is online

Users browsing this forum: No registered users and 14 guests

Thu Apr 25, 2024 12:17 am [ UTC ]