If they were on a mission outside Olympus then it would be fine but... If the warriors stayed outside and started to build the base. The others would see it as them trying to expand their territory. The worst-case scenario would result in a large-scale war. It was especially the case if they build a base near the other Holy Lands or Large Countries.
Luckily, in the entire Hall Plains, there's not a single Large Country or Holy Land. Although this land was huge, it was still desolate and small in the eyes of those large countries. The territory of Olympus alone was sixty times larger than Hall Plains.
It was too large that it had hundreds of small countries in its territory. That's why sometimes, a small-scale war occurred inside the territory. Those small countries were fighting each other and the higher-ups couldn't even bother those people since they were too busy with a much bigger problem.