Ryan might be onto something there. My brain just locks up if dimensions are all over the place, like a bad puzzle. Makes you wonder if some folks are just wired to sort through the visual noise easier.
Okay yeah, been there. Try putting all your dimensions on one layer set to a bright color, like red or cyan, so they pop. Keep leaders short and aim the text to read from the bottom or right side of the sheet. It forces a clean layout and stops the eye from jumping all over.