Kayaking with a 4yo - nightmare or doable?

Been thinking about taking my son (4) kayaking this summer at Lake Tahoe. He's pretty fearless but obviously can't swim yet. Anyone done this? What kind of setup works? Do I need those sketchy tandem kayaks or should I just take turns with my wife watching him on shore? Worried about the money spent if he hates it.