here's a simple scene with a grid made up of 3 mil points, and a torus to be instanced on it. The torus is large on purpose. Enable IPR, and you will run out of memory very quickly and it fails to render. It seems that octane is very bad at overlapping geo. (this has no problems running in redshift)
If you set the torus to a scale of 0.001 (which basically makes sure they dont intersect) the scene will render fine. In general, it would be great if these can be fixed.. Its not so much a houdini plugin issue, but an octane core issue (as i checked this in other octane plugins as well with the same result).
It also seems, that out of core geometry is not supported for instances ?
(houdini 17.5.448), octane (latest 2019 version), windows 10.