Well I cannot claim to be an expert on the physiology of this, only what I have experienced and what other guys have reported.

Perhaps muscles are not the best comparison - as far as I know the tribes who stretch their ears, lips, necks etc don't go back to normal after they finish stretching.