The carriage had set off with Ray and Jack inside and they were now heading to Zrey. The problem was from Jack's memory his hometown was located in the Allure kingdom which meant they would have to head back out of their territory.
Although they had gotten rid of one guild, Slyvia had mentioned there were several other guilds that had been hired to protect the border as well. At the same time, slowly Ray's image was being known to the outside world. He wasn't naïve enough to think that the city they were in was full of people he could trust.
The empire bound to have paid one of the people in the city to gather as much information about what was going on. It was why they had also decided to keep the team small and full of trustworthy people to enter the shadow continent.