Use the Edit Node cursor (the second button in the Cursor toolbar) which is designed to change the shape of objects without scaling them. It is particularly useful when re-positioning Cable and Dogleg objects.With this cursor, selecting the dimension will show a number of 'handles', one of which is under the text. Simply pick the text up by this handle and drop it wherever you want.
I hope this is helpful.