The president made the comment to South Carolina Republican Jeff Duncan on his way out of the House chamber following his State of the Union address.