He was not very popular, he always was bit jealous of Andy who was adopted. He had an affair with Katie even before she married Andy. He was responsible for Katie's death which was never found out about. When there was trouble in the village, it usually involved Robert. So I don't think that he was very popular with the other villagers.