Even if Cain suspected that Natasha or Nathan were the guilty culprits, it would be hard for him to prove without implicating himself and admitting to the blackmail. After all if all the evidence is pointing to Ryan, then the police won't be looking that hard for another suspect...