Unless it's causing you problems, just enjoy it. If you have to jerk off to get to sleep, it doesn't take that long, does it?