Man cave is basically a playroom now

I had this nice setup in the basement with my TV, gaming chair, mini fridge. Now it's got toy bins, a play kitchen, and lego everywhere. My son basically took over. Sometimes I sneak down there after bedtime and just sit in my chair and watch stuff but it's not the same. Do other dads deal with this or should I just accept my former hobbies are gone for like 10 years?