Hey guys,
Better late than never to this party
I had exactly the same issue lately, i.e. black lines building up on the edge of the Alpha, when I was compositing an Octane Multipass render in After Effects. FYI, I was rendering it all out from the Cinema 4D plugin into one Multipass EXR file.
I followed Raphael's advice about using the separate Beauty Pass's Alpha to cut out each multipass layer (using the Set Matte effect). However, there was still a 'residue' of the black line left even after that treatment.
After all, the issue is that for some reason the individual layers of the Multipass EXR file aren't using a Straight Alpha, or if they do, After Effects won't allow the use of the Interpret Footage dialogue to set it properly.
Therefore I was looking around on the internet, to find a way to 'interpret' the Alpha in the timeline. Lo and behold, I came across an old Creative Cow tutorial by grandmaster Aharon Rabinowitz, explaining After Effects' 'Remove Color Matting' effect.
https://library.creativecow.net/video_page.php?author_folder=rabinowitz_aharon&article_folder=CCQT_6_Remove_Color_MAttingIt pretty much describes the predicament I was facing, so I added the effect to the individual Multipass layers in my composition and - surprise - the black line disappeared.
So, bottom line, if Octane is once again delivering those nasty thin black or white outlines (an actual fix for that would be great of course), you can use the 'Remove Color Matting' effect to rectify it.
Mind you, not all Multipass layers seem to contribute to this. Neither Direct nor Indirect Diffuse seem to show any changes in the Alpha, when you use the effect on them. However, Direct/Indirect Reflection and Ambient definitely do.
Best, Ferdinand