Lose smell and taste drinking alcohol

After I have a few drinks I can tell my sense of smell and taste start going away. As I keep drinking they are completely gone. Usually it takes an entire day of no alcohol before they start coming back and only then does it slowly come back over the next few days. I generally only drink on the weekends so by Thursday I’ve fully regained both senses but start drinking friday and they’re gone until Monday. I’m assuming i have developed some kind if allergy to alcohol that is causing this. Is this common? Anyway to keep smelling and tasting while enjoying some alcohol beverages? I’ve considered taking some benadryl before going to bed but not really sure I wanna mix meds and alcohol. Especially one that makes you drowsy