He caught his wife with another but let them go