Having your own party

My husband who enjoys drinking, however not as much as me. There are times he goes to bed before me, then I will stay awake and have a few drinks and listen to my favorite music through my headphones (not to disturb him, he sometimes complains about this and says I should use the speaker, but I feel more free using my headphones.) He doesn’t like this, he wants me to come with him to bed. However, I find my alone time with a drink and music calms my soul. What’s everyone’s opinion about this?