Feeding nipple shield causing more problems?

My daughter is 6 weeks and we've been using a nipple shield since day 3 because of latch issues. My wife's consultant said we should try weaning off it now but every time we do the baby gets frustrated and hungry comes out wrong. The shield works great but now I'm paranoid we've messed something up permanently? Has anyone had success transitioning off the shield? Also is it weird that I'm kinda relieved when we use it because at least I know it's working?