In two words? Recessive genes.
Read about the duPont family sometime. They had a policy of marrying within the family and they were well-known for the amount of mental illness many family members suffered. So much, in fact, that an institution was built so the suffering family members could be sequestered without the public's knowledge. They're just one interesting example.
Speaking of examples here's an
article that might interest you.