I would say every 3-5 chapters or so if it happens so frequently the story just wont progress and it gets repetitive

Please continue writing this so far its really good and enjoyable pretty unique and a fun read overrall