It's not equivalent because in no cases is racism a good or acceptable thing. There are, however, cases where gender disparity or absence is fine: boy scouts, girls scouts, some sports, certain rehabilitation centers, prisons, most changing rooms, lesbian phone hotlines, etc.