What was the primary reason that both women and blacks were largely excluded from the expansion of democracy?

Women were constantly thought of as less in most things in society, even thought to have a smaller brain at one point. Blacks were systematically oppressed and still is today, and one cannot oppress something that isn't believed to be beneath, thus affecting how politicians saw blacks when expanding democracy.