I don't think so. Hentai comics have specific adult content, and there's no indication that 'Is it really you Noelle' falls into that category. It could be a fantasy or adventure comic instead.
In the manga, Asta and Noelle's relationship progresses gradually. They face many challenges together, and eventually, their feelings for each other blossom into a romantic connection.
As of the latest manga chapters, Asta and Noelle haven't gotten together. Their relationship is still evolving and it's unclear if they will end up as a couple in the future.
In the manga, Asta and Noelle's relationship is complex. They have moments that hint at a possible future together, but it's not explicitly stated. You have to look closely at their evolving dynamic to draw your own conclusion.