There was a discussion here before about this situation. Here is the link: Maleboobs. I hope I have had done this correctly, although I fear I may not have.

There is a a lot of misinformation, unfortunately, about men and "boobies." I have been personally subject to ridicule and personal humilation because of my chest/boobs all of my life. The condition calls for internal anguish and pain for young men and for older men simply because of ignorance and lack of understanding or lack of wanting to understand physical conditions.

There was a time when I contemplated surgery but I realized that I was altering my body for the sake of pleasing others. I like me; I love me; I appreciate me. If others don't -- ah well... there loss.

There are a couple of pics I posted here before in my gallery showing my chest. You judge. Am I fat? Really???

I would also suggest you ask for a referral to see your Endocrinologist, as advised by No_Strings, for further investigation.