Why do I feel tipsy after one drink during day or dinner?

If I’m going out for the night and start drinking, I don’t start “feeling it” until like 5 beers. But if I have a single drink at dinner or am hanging out at the pool and I have a drink, I feel tipsy as soon as I consume it, then I feel tired right after. But it’s one drink ? Why can I go out and drink a lot but during day I only have one?