Edgar's life was getting out of hand at this point. With the office still under his leadership and the agency his responsibility, he was swamped, to say the least.
However, he felt glad about it. The work put his mind off of things that made him sad. The last thing he wanted to do was to worry his children.
Sometimes, being a parent means pushing one's own emotional needs to the back to ensure your children are safe. It was the case with Edgar.
The reason why he loved his sons to death was partially for agent B. It was a way of compensating him or rather redeeming himself.
Since he gave up on someone who could die for him, he used the energy to love his choice in the same way. Unlike his counterpart, he chose to love his children and place their happiness before his.
This didn't make Bastian a bad person necessarily. It only made him different. He loved what he believed in. He loved his choice so much until the end.