Anyone else spend way too much on their kids when it's their custody time?

This is embarrassing but I feel like I spoil my kids more on my weekends. We go to nicer restaurants, I let them get stuff at stores, we do paid activities. My ex pointed out that I'm "trying to buy their love" which made me feel like shit but also... am I? I just want them to have fun when they're here. But I also make less money than she does so it's not sustainable. How do you balance wanting to do fun stuff with not overcompensating?