They don't even know his identity. He could just not go back...
[Wait, Max! You might not need to do that. It's useless as they are just ignorant. If you want to get them back, find their backer!] Little Dou gave her advice, not wanting Max to waste his time on chess pieces.