We did see Bob's twins quite recently actually, June/July maybe. Though they have been off screen for 4 years straight before, I'm sure.
I think Andy is supposed to be a bit dim, but that they try to mix it up a bit (otherwise they'd have two Sams.) Violence and statutory rape (which it was with Debbie) are things that Sam would never do.