Why did Gandhi asked Fr. Charlie to leave India?

Gandhi told Charlie that Britons like himself need to leave the freedom struggle to the Indians. Perhaps he was concerned about Andrews spreading Catholicism.