ORC uploader is way too slow

Forums: ORC uploader is way too slow
Discussion forum for OctaneRender Cloud

ORC uploader is way too slow

Postby Rikk The Gaijin » Fri Aug 05, 2016 2:50 am

Rikk The Gaijin Fri Aug 05, 2016 2:50 am
I have a scene with one character with long hair, and ocean waves in the background. The animation is 2800 frames.
The character moves, the hair move and the ocean waves move.
All these motion are stored in various alembic files.
The full 2800 frame alembic of the hair is gonna be something like 50+ GB of data, so for now I'm only exporting 100 frames.
The orbx to upoload is about 7 GB.
To upload those 7 GB on ORC it takes FOREVER. :x
I have 1 Gigabit fiber connection, but the upload on ORC is WAY too slow.

Can we do something about it? Is the bandwidth limited because it's still in beta? :cry:
Rikk The Gaijin
Licensed Customer
Licensed Customer
 
Posts: 1507
Joined: Tue Sep 20, 2011 2:28 pm
Location: Japan

Re: ORC uploader is way too slow

Postby Rikk The Gaijin » Fri Aug 05, 2016 4:03 am

Rikk The Gaijin Fri Aug 05, 2016 4:03 am
Oh, and btw, even after all the wait, the scene failed... :x
Rikk The Gaijin
Licensed Customer
Licensed Customer
 
Posts: 1507
Joined: Tue Sep 20, 2011 2:28 pm
Location: Japan

Re: ORC uploader is way too slow

Postby Goldorak » Fri Aug 05, 2016 5:40 am

Goldorak Fri Aug 05, 2016 5:40 am
Rikk The Gaijin wrote:I have a scene with one character with long hair, and ocean waves in the background. The animation is 2800 frames.
The character moves, the hair move and the ocean waves move.
All these motion are stored in various alembic files.
The full 2800 frame alembic of the hair is gonna be something like 50+ GB of data, so for now I'm only exporting 100 frames.
The orbx to upoload is about 7 GB.
To upload those 7 GB on ORC it takes FOREVER. :x
I have 1 Gigabit fiber connection, but the upload on ORC is WAY too slow.

Can we do something about it? Is the bandwidth limited because it's still in beta? :cry:


It's fast for us here in the US. I'm wondering if this is happening because you are uploading from Japan(?). If it's a region issue we can look into and address. Is this with the delta upload or ORBX upload?
User avatar
Goldorak
OctaneRender Team
OctaneRender Team
 
Posts: 2061
Joined: Sun Apr 22, 2012 8:09 pm

Re: ORC uploader is way too slow

Postby Rikk The Gaijin » Fri Aug 05, 2016 9:38 am

Rikk The Gaijin Fri Aug 05, 2016 9:38 am
Goldorak wrote:
Rikk The Gaijin wrote:I have a scene with one character with long hair, and ocean waves in the background. The animation is 2800 frames.
The character moves, the hair move and the ocean waves move.
All these motion are stored in various alembic files.
The full 2800 frame alembic of the hair is gonna be something like 50+ GB of data, so for now I'm only exporting 100 frames.
The orbx to upoload is about 7 GB.
To upload those 7 GB on ORC it takes FOREVER. :x
I have 1 Gigabit fiber connection, but the upload on ORC is WAY too slow.

Can we do something about it? Is the bandwidth limited because it's still in beta? :cry:


It's fast for us here in the US. I'm wondering if this is happening because you are uploading from Japan(?). If it's a region issue we can look into and address. Is this with the delta upload or ORBX upload?


ORBX upload. The Delta Upload doesn't seems to work (standalone)
EDIT: ok the delta uploader kinda works, but it's really annoying that the progress bar doesn't updates in real time, it seems to freeze after the first few megabytes, that's why I thought it wasn't working, but it actually uploads, you need to wait and eventually the progress bar will update, but it's really not a good feedback, you should do something about it, especially when it comes to uploading big files.

The scene keeps failing btw. That's basically happening every new scene I try on ORC. The system is really far from being ready... :cry:

EDIT 2: also why the "Preparing to start" often takes hours before actually starting (and then fails)? Even when I only want an estimation, that should be almost instantaneous, what's the point of waiting 2 hours for an estimation, when it takes two hours do do the actual render? :roll:
Rikk The Gaijin
Licensed Customer
Licensed Customer
 
Posts: 1507
Joined: Tue Sep 20, 2011 2:28 pm
Location: Japan

Re: ORC uploader is way too slow

Postby mojave » Tue Sep 27, 2016 12:26 am

mojave Tue Sep 27, 2016 12:26 am
Hi Rikk,

ORC developers have recently changed the way assets are uploaded so they go to the nearest available server so it should work faster now, could you please give it another try?

Regarding to the upload process, it could be made faster: at the moment the number of parallel uploads is limited to 2 by default, but you may increase this via Preferences -> Max. parallel uploads.

Also note that uploads from Standalone/plugins are limited to one parallel upload per asset due to the way ORC currently works, meaning that two assets can be uploaded in parallel but not two chunks of the same asset. If your scene contains a very big asset in comparison to the rest this may cause that eventually just one upload is being performed.

When you see that the upload progress does not change, it's quite likely due to that there's a hash calculation going on, as we need to calculate them prior to the upload, which might take some time for big files. We should probably look into accounting for this as part of the total progress, thank you for the feedback.
User avatar
mojave
OctaneRender Team
OctaneRender Team
 
Posts: 1063
Joined: Sun Feb 08, 2015 10:35 pm

Re: ORC uploader is way too slow

Postby Rikk The Gaijin » Wed Sep 28, 2016 8:31 am

Rikk The Gaijin Wed Sep 28, 2016 8:31 am
I tried it, and it doesn't upload anymore (web uploader). The upload starts, and then it stops after a a couple of minutes. :roll:
Rikk The Gaijin
Licensed Customer
Licensed Customer
 
Posts: 1507
Joined: Tue Sep 20, 2011 2:28 pm
Location: Japan

Re: ORC uploader is way too slow

Postby fuzzybro » Wed Sep 28, 2016 7:29 pm

fuzzybro Wed Sep 28, 2016 7:29 pm
Rikk The Gaijin wrote:I tried it, and it doesn't upload anymore (web uploader). The upload starts, and then it stops after a a couple of minutes. :roll:

We're checking what could be wrong. It works fine from US and Europe.
User avatar
fuzzybro
OctaneRender Team
OctaneRender Team
 
Posts: 562
Joined: Mon Jun 03, 2013 7:10 am
Location: Los Angeles, California

Re: ORC uploader is way too slow

Postby rleuchovius » Fri Sep 29, 2017 9:22 am

rleuchovius Fri Sep 29, 2017 9:22 am
I'm also having problems with the "preparing to start" phase.
I uploaded the same scene to another render farm, and it started rendering right away.
Still "preparing to start" on ORC, 30 minutes later.

What does the message mean, is it queued to be rendered?
It would help with more information on what's going on during the "preparing to start" process.
rleuchovius
Licensed Customer
Licensed Customer
 
Posts: 44
Joined: Sun May 03, 2015 1:47 pm

Re: ORC uploader is way too slow

Postby bepeg4d » Fri Sep 29, 2017 9:46 am

bepeg4d Fri Sep 29, 2017 9:46 am
Hi rleuchovius,
it would help if you coul share more info about your exxact Octane and plugin version, and type of scene sent.
Animation, still frame, VR, if other external plugin are used, polygons count, ecc.
ciao beppe
User avatar
bepeg4d
Octane Guru
Octane Guru
 
Posts: 7152
Joined: Wed Jun 02, 2010 6:02 am
Location: Italy

Return to OctaneRender Cloud


Who is online

Users browsing this forum: No registered users and 1 guest

Mon May 25, 2020 2:34 am [ UTC ]