Well, usually you can go into the settings related to your story and look for options like 'block viewers' or 'select who can see'. That way, you can prevent that one person from having access. Just make sure you know how the particular platform's settings work.
One way is to adjust the privacy settings of your story. For example, on some social media, you can select specific people who are not allowed to view it. Another option might be to not share the link or post it where that person has access.
You could set your account to private or restrict access for specific individuals. It depends on the platform you're using.