After first census, the naturalization act says only free whites can be naturalized as citizens. Another big boulder in that wall was the insistence that most mixed race people with african ancestry be defined as black. The infamous one drop rule didn't become law until the early twentieth century. But much earlier, states limited the amount of africans a person could have and still be considered white.