"The tea party folks were furious with that," he said. "The perception of the tea party was that Republican establishment types were trying to ram the primary down our throats. That erased a whole pile of good will. It really did. This isn't just a one-time thing that popped up. This has been brewing."