He cited reports of “improper conduct” with subordinate staffers.