King_Disturb
He never gave her a choice. He knocked her out and threw her into ocean and then went to others to tell how Erza 'betrayed' them and left without them. He then convinced them to work with him and complete the tower. Erza couldn't go back to rescue them cause she never knew the actual position of the tower.