Perhaps he blames ninjas in general for the loss of someone close to him. For example, if a group of rogue ninjas were responsible for the death of a dear friend or family member, it could make him resent the whole ninja concept. He might think that if there were no ninjas, such tragedies wouldn't occur.