The group stayed their separate ways for almost three days, even when Grey accidentally encountered them, he pretended as if he didn't see them and went the other way.
Klaus and Reynolds wanted to go after him, but since people were there, he attacked the duo which came as a surprise for them, before telling them via the communication device that they've made too many enemies and he was still too young to die.
Klaus and Reynolds naturally didn't take it lying, but when they were ambushed by almost twenty people, they realized maybe they had gone too far.
They anonymously decided it was high time they left the mansion. Most people would be trying to recover what they've lost, and since there were possible treasures in some rooms, it was safe to assume that there would be people still inside the mansion.