hi,
the best setup for working with Octane is always to have one GPU (internal, iGPU, Quadro, single slot GTX) for system and monitors only, and one or more GPUs dedicated only for rendering.
Your internal GPU is a portable GPU and it is already heavily used by the system and the big monitor. And it is not the best for rendering, as you can see from the octanebench results:
https://render.otoy.com/octanebench/sum ... +GTX+680MXLowering the monitor resolution to something like 1440 or below, should give you a bit of VRAM for playing with very simple scenes, but nothing more.
The only solution for working with Octane on iMac smoothly is to have an external thunderbolt 2 adapter with some desktop GPUs attached to it:
viewtopic.php?f=9&t=43439ciao beppe