Of course, they could already recognise that they stood no chance in defeating the two warriors alongside Orion, even if they all attacked together. Nonetheless, they also understood what Garnet was doing, which was that just because they couldn't launch an offensive didn't mean they couldn't go on the defensive.
With every important figure currently within the Gemheart clan manor, each holding significant influence in the Prismerian Kingdom, it wasn't an exaggeration to say that if Orion and the warriors he brought with him decided to fight and slaughter everyone in this room and the Gemheart Clan Manor, they would undoubtedly face the entire Prismerian Kingdom.
The citizens wouldn't sit idly by and bow their heads to an outsider, especially a foreigner who had slain one of their own.