You did the right thing -- start by ignoring the attention, then give the guy a polite no, and finally tell him to fuck off because you're not interested.