Other than the fact that he is using large amount of world force to seal the passageway between this world and the chaos world, the passageway that connects this world and the true fierce beast world is unique, the nine abyssal dragon door couldn't be closed once it opens.
He could only hope Banjo get stronger and create his own faction on the other side, as long as they protect the passageway between this world and the world behind the door, Gaia's strength would definitely increase and with him as the source, he will bring this world to the Divine Realm.
He had such a grand dream but first, he needed to increase the strength of the passageway of the worlds they have occupied, not to mention, he'll have to increase his strength and his empire's strength to contend against the forces from the Divine Realm.