But all white people are not albinos, and albino white people are clearly distinguishable from "regular" white people. Yellow Man is an albino but one look at his face would tell you that he is Black African.
Also, because some Black African people may have been shown to fear/abuse/quarantine/exile or whatever albino children in the past, it doesn't follow that all Black African people in the past did so.
Some people had a similar attitude to twins, and would abandon them to die when they were born because otherwise it was thought they would bring destruction on all the people. Others looked at twins as special and gave them privileges.