Confidence In A Rushed Plan.

It was someone else in their group that answered him. 

A large female spoke. She towered above the others and is also in front of their group. So she might be their leader.

She said with a sneer, "Unworthy child of the plane. Do not mind our presence. Just go ahead and take the crown. It is what you came here for after all."

She chose to ignore the question because he is right. They didn't become a group on purpose. They were just lucky enough to be deployed close to the divine crown. They all thought of the same thing. They might be able to track him but they also know where he is headed. They know that he will surely come for the divine crown. So they switched things up and decided to come here where they met each other.