Anyone else feel guilty for needing alone time?

I love my kids so much but after like 5 hours with them non stop I just need to sit in silence for 20 minutes. I feel like a bad dad when I do that. My wife gets it but I still get in my own head about it. Is this normal or am I just broken? Other dads never seem to talk about this stuff.