Why does my newborn seem to prefer my wife over me

This is probably dumb but it's bothering me more than I'd like to admit lol. My son is 5 weeks old and he just... settles better with her. I can burp him, feed him, hold him for hours and he's fine. But the moment she walks in the room he gets fussy and wants her. I know logically it's probably because she's the main food source (breast feeding) but it feels like I'm doing something wrong? Or is this just how it is in the beginning? How long before babies actually bond with their dads or is that like... not a thing?