Rant: Coworker complained about me taking flex time for doctor appointments

This guy in my department actually had the nerve to say something to me about taking Fridays at 3pm to pick up my kids from school while WFH. Like sorry my family matters to me? My boss has no problem with it and my work gets done. Some people are just bitter I guess. Anyone else dealing with coworkers who judge your parenting schedule?