Starting garden beds with kids - am I setting myself up for failure?

My wife keeps pushing for us to do a garden with the kids this spring. I love the idea in theory but I'm worried it's gonna be a project that requires constant nagging and I'll end up doing it all myself while my 6yo and 8yo lose interest after week two. Is this a realistic concern or am I being cynical? What actually works for families with young kids who have the attention span of goldfish?