Skipped the office happy hour to make it to kids soccer game

New VP is visiting from HQ and everyone's going out after work. I told my boss I had to leave at 5 to get to my son's game across town. The look he gave me was not great but honestly he can deal with it. My kid's been practicing all season and I'm not gonna miss it for some forced networking. Anyone else ever have to make these choices? Worth it or am I being selfish?