Son won't sleep unless I'm holding him. Is this normal?

My boy is 3 weeks old and literally will not stay asleep in the bassinet. The second I put him down he starts fussing. My wife says it's just how newborns are but I'm exhausted and worried I'm doing something wrong. Anyone else dealing with this? Does it get better or am I stuck holding a baby all night for the next year?