Am I being annoyed for no reason?

Hubby, not much of a drinker gets “annyoed” when I drink at home. Starts shutting down after an hour or so. Anyone else deal with this judgemental behavior from their spouse?