Boss called me out for leaving at 5pm

In a meeting, my manager asked why I "couldn't stick around" more like the rest of the team. For context, my contract is 9-5. I leave at 5. Everyone else apparently stays until 6 or later by choice. When I explained I had pickup at 5:15, he said "yeah, but clients need us."

I think I need to update my resume. This place is not it.