The Conflict Between Lar and Aizu

Lashar left the inner garden to show Swordmad's group their rooms in the mansion, but Yale didn't go with them despite being the one who invited them.

Yale chose to go with Wyba and the beast horde to avoid them having any problems on the way to the designated area for the beast horde.

After all, although they had permission to keep the beasts in Larken City and those beasts were under Wyba's control, it wasn't impossible that someone wanted to kill them due to the fear and Wyba would have a rough time trying to protect the beast horde without harming any of the attackers.

Thus, Yale decided to tag along to use his Origin Sword Bloodline to keep the attackers unable to act towards them; that was the best deterrent for such problem.