What was a major source of controversy for president andrew jackson?

The Indian Removal Act and the Trial of Tears.  

worcester v. georgia, legal case in which the u.s. supreme court on march 3, 1832, held (5–1) that the states did not have the right to impose regulations on native american land. andrew jackson refused to enforce the ruling, the decision form the basis for most subsequent indian law in the united states.