President Obama said it was by far his biggest problem