That’s all you can really do, like Jonb said. Its not like there some sort of conspiracy, were all the "gay guys" made up a plan to "get you".
Perhaps you have a "young innocent look that a few find attractive. Perhaps you look rough and tough ......who knows.

What ever it is take it all in stride, at least somebody out there finds you attractive.....a lot of people out there aren’t given a second look by men or women.....