Am I wrong for being sensitive to my boyfriends drinking?

I’m a 24F with a 22M partner. I have adhd and autism traits. I have other sensory issues and when my partner tells me he is having boys night or had a massive night or if he’s had more to drink then I have on a night out together, I have the same reaction as things I have sensory issues with. I feel uncomfortable, I shut down, I question the whole relationship. Is this normal or can it be fixed?