Maybe it distracts the audience from the plot. When the music is too intense or doesn't fit the mood, it can take the focus away from the story itself.
Adding music can make a story blurry because it might not match the tone or pace of the narrative. Sometimes, it can even drown out important details or cues that are crucial for understanding the story properly.
It could be that the music overpowers the dialogue or other important elements of the story. If it's not balanced well, it can make the story seem less clear and coherent. Also, the wrong type of music might not enhance the emotional impact but rather create confusion.