The promotion that's not worth it

Got offered a director level position that would mean way more travel and longer hours. More money obviously, and it would look great on the resume. But my oldest is in his last year of high school and I barely see him as it is. My wife made it clear she doesn't want me taking it. I keep going back and forth. Is it selfish to turn it down? I know a lot of you would kill for this opportunity. I just feel like I can't get these years back with my kids.