I think it is natural not to be attracted to someone you've grown up with, and makes sense from an evolutionary point of view.

Studies have been done into this. For example there was a traditional type of arranged marriage in Taiwan where the girl was raised from a young age by the family of her future husband. They found that such marriages tended to be less successful (in terms of divorce and children) than ordinary marriages. Others conducted on Israeli kibbutzes where unrelated children were raised together found that they tended to reject those they grew up with as partners, despite their parents' hopes that they would marry within the collective.