Just took 2 months paternity leave and going back to work is harder than I expected

These last couple months have been incredible with my newborn and my oldest. I've done so much with them, been present for everything. Now I have to go back full time next week and I'm dreading it. My company was great about the time off but I feel like I'm abandoning my family. My wife is staying home for now which helps but I'm going to miss so much. Anyone else deal with that post paternity leave guilt?