Ballot's tilt right could be a tough isssue for GOP