Side hustle killing my mental health

Started freelancing on weekends to save for a house down payment. Seemed simple - 5 hours Saturday/Sunday. But now I'm doing it at night after the kids are asleep and it's like... I never actually stop working? I'm either at my job, with the kids, or grinding on projects. My wife mentioned I've been irritable, and she's right. Haven't had a single day off in 4 months. I know a lot of you do side hustles but how do you actually maintain anything resembling a life? Do I just accept that saving for a house means being a zombie for a couple years?