Considering going back to work early - am I crazy?

I know this is unpopular but hear me out. I'm on paternity leave for 12 weeks total (my company offers it), I'm 6 weeks in, and I'm genuinely struggling. I love my daughter but I feel lost staying home. I'm not good at the tiny-task stuff - I get bored, I start doom-scrolling, I feel unproductive. At work I have structure and I solve problems and I feel competent.

My wife thinks I'm trying to escape which... maybe a little? But also I think we might be happier if I went back and she could just focus on the baby without managing me. Is this selfish?