Just came back from paternity leave and feeling guilty

Took 4 weeks off when my daughter was born and it was incredible but now I'm back at work and I feel like I'm missing everything. My boss is already piling on the projects like I didn't just have a life changing event. The worst part is I get home after bedtime most nights. Wife is handling nights with the baby solo most of the time and I hate it. How do you guys deal with the guilt?