Yang Lujia learned a great deal of information regarding the Holy Light Palace and Sheng Ao. All of them really thought that Sheng Ao was someone who touched a woman and they had evidence of it that he did. No matter the reason Sheng Ao would tell them, they would not accept it because the deed was already done. It was a wound that was healed but retained a scar.
On the other hand, the Holy Light Palace had five Arch-Cardinals and a bunch of cardinals and priests under them. On top of them of all was the Holy Light Emperor. Well, Yang Lujia already knew much of the Holy Light Emperor from the five divine beasts' story, of how the Holy Light Emperor saved my father.
It had to be noted, though, that Yang Lujia was not the one who was saved. It was his father. Thus, he did not owe anything to the Holy Light Emperor. Besides, with all the power he had now, it was already considered repaid.