Ye Mo knew that if he was to spirit control all the lightning orbs, he definitely wouldn't be able to beat that man. But he had to spirit control one layer of restriction for each orb to remove it from the orb. Seeing this, Ye Mo set up a stealth formation and threw out the time formation disk and started to spirit control the orbs.
As soon as the man started spirit controlling the gourd, he knew his plans had some error. He didn't attack the two immediately because he was certain that they couldn't escape.
He knew it would take at least half a day to escape from the entrance. He definitely would've spirit controlled the first layer of restriction by then. With that, the gourd would be his. They were inside his gourd, how could they escape?