Emer always did feel like he was doing something wrong.
In his previous territory, he was fired because he apparently didn't guard the Lord's son well. He was tasked to guard the Lord's 20-year-old son on his trip to a Town (escorted by hired mercenaries of course), but the lad only had play and fun in his mind and didn't consider anything else.
The man was focused on 'tasting Town women' and Emer was asked to wait outside the inn while the master fulfilled his needs.
Emer was forced to just stand outside the door for hours on end—how could he help him out when the other man fell down the stairs and broke his leg?
In the territory before that, he was also fired. There, he was assigned to Gate duty. There were refugees who were extremely pitiful. They were hoping to get inside, but they didn't have enough copper on them. His heart softened and he gave them a few from his own wallet and for a while it felt nice to help people out.