So the only person that refuses to cave will be a total fool by everyone's definition because they will have to bear the whole burden by themselves, just like he is doing.
This burden is so great that it is difficult for him to take a single step without falling over. He falls over, he won't be able to stand back up. He will have to stay in the ground for the rest of the game.
It is clear to him that he won't be able to achieve anything significant with the repercussions of his defiance pressing down on him all the time. It made him marvel at those who defied the Baron and succeeded at it.
He had read a lot about these special people, but it is after experiencing it himself that he truly appreciates what they managed to pull off. He had also read about the many fools that defied the Baron and failed. The stress on his back trying to break his spine has made him feel sympathy for them.