I believe inheritance plays some part. I have six brothers and my dad is one of 5 boys, all of whom only have male offspring. So lots of cousins. From observation I see that at least flaccid the majority are above average. A large flaccid penis may not be huge erect but will definitely be bigger than a small flaccid penis when erect. Genes play an important part I am sure.