It depends on the style guide you're following. In many cases, italicizing a fictional book within a story is common practice to set it apart and make it stand out for the reader. However, some styles might have different rules.
Typically, you do italicize a fictional book in a fictional story. This visual cue indicates that it's a specific title and gives it emphasis within the text.