Nervousness

Hi! So I’ve had this thing for a long, long time now, and it’s really bugging me. When I drink around people I’m comfortable with, my tolerance is high, but when I drink with co-workers or some people I hardly know, my tolerance is abysmal. I mean, the difference isn’t small, it’s massive- I can drink a shit ton with friends and not feel much, meanwhile when I drink with a sense of nervousness, I feel it after literally a pint or two, which is insane. Sure, you could say maybe I’m drinking quicker when I’m nervous so I can quench the nerves, but simply don’t notice it— tested it and that’s definitely not the case. Maybe I’m just more aware of my drunkness level when I’m nervous? Maybe. Wondering if anyone else is like this, and if they know why this happens, cause it really, really annoys me, and I’ve seen no studies or anything on it :/