Is it weird that I dread PTO day more than work?

Don't get me wrong, I love my kids. But having them home from school for a random day means I have to explain why I can't just "pause work" to play with them all day. My 6yo doesn't understand that Daddy's job doesn't just pause for 8 hours. Yesterday was rough. Anyone else struggle with this or is it just me?