Why does wine (white) give me the worst hangovers?

I love a good Chardonnay or Sauvignon Blanc. However, even a glass or two and I feel like trash the next day. If I have 2 or 3 cocktails however I don’t feel like that at all. And they’re typically fairly sugary (I make aviations, lemon drops, sidecars, etc). I’ve heard red wine can make hangovers worse, but why do I experience it so severely with white?