I finally started working on getting this problem resolved. Here it turns out that my X pipe was up to far causing the reverse linkage to not go all of the way in. I'm havin a shop put in a 4 inch extension pipe between the header flange and X. Right now the X is right under the first U joint.

If anyone puts on an X pipe system and has a 4 speed, make sure you check this out before welding everything up.
My dad says, see I told you that you should've had a shop install it for you, and that's what you get for having to get one of the best exhaust systems and trying to install it yourself" of course he's only messing with me, because we always run into a problem.