Animation seamless over static cubemap? (360 pano/stereo)

[AndreasAtteneder]

In some threads I read that with the ORBX media player we can easily put an animation (as mp4) over a static cubemap by creating a file layout file that looks about like this:

• background.png (the complete background cubemap)
• mycontent_LR.mp4 (the animated part)
• mycontent_LR.json (the metatdata):

Code: Select all

{
   "title":      "My Content",
   "author":      "Me",
   "background":    "background.png",
   "loop":       true,
   "fovh":      90,
   "fovv":      90
}

I tried to create this and technically it works, but the overlayed video doesn't match exactly, so you can clearly see seams where the video ends. I also tried to tweak the field of view values, but that didn't work out either.

I'm most likely doing something wrong in creating the content, so let me descripte how i did it:

• set up the scene in octane standalone ( 3.0 beta 5 )
• the camera aims at the (small) part of the scene, that contains movement/animation. the rest is static.
• render the background with a panorama camera ( cubemap(all directions) @ 18436x1536 stereo side-by-side)
• adjust the (same) camera to cubemap ( -Z direction only) @ 3072x1536 stereo side-by-side and render the animation
• flip the rendered animation horizontally in post-pro, since it's wrong for some reason unkown to me.

That's it. I assumed that on side of the cube would mean 90 degree field of view in both directions.

Has anybody did something like that successfully and is willing to share his/her workflow?

Thanks a lot!

[bepeg4d]

Hi AndreasAtteneder,
You can use an Equirectangular format for the Panorama camera limited to 90°x90° stereo or below, in this way it is more easy to match the cube map with the mp4 file and you have not to invert the output due to the cube map format
In my experience, due to the compression, some pixels at the borders could be visible with .mp4 files and you have to make a bit of color correction for a perfect matching, while, with image sequences, the borders are almost invisible and there is no needs for color corrections
ciao beppe

[AndreasAtteneder]

thanks a lot for the hint bepeg4d!

gpus are started already. I'll test it asap.

[AndreasAtteneder]

IT WORKS!

you're right, that a little bit of seam is still there, but now it aligns perfectly with the background.

Thanks!

[JasmineJasmine]

Seams like eventually it would be possible to have all the static parts of the scene baked into one light field image, and alpha the animated elements on top. Can't wait for the future..

[yazze]

Isn't that supposed to be already possible with Lightfield and ORBX? From what I understand it should be able to generate a Lightfield scene in give camera range, but I haven't been able to find one concrete example for months now. As for animating it, this seem complicate to add animation or alphas on it.