Unfortunately, he couldn't control the house itself; otherwise, he would have moved it away as soon as Wen Wen and the other two had come.
He was lucky before, being out and about dealing with some matters when the Hunter came knocking. Realizing something was wrong, he first used puppets to hold off Wen Wen's group while he hurried back to Furong River City.
He could sense that all the puppets he had left in that inn had been destroyed. Without his puppets to lead the way, he doubted his chances of returning to that house.
So he had to make do with this place for now.
Luckily, this abandoned building also housed many people whose disappearance wouldn't alert the Hunter Association. He really should thank those responsible for these unfinished buildings; it was they who had created the breeding ground for monsters like him to grow stronger.