To defer is to trust someone else more than yourself on an issue. It is a sign of integrity to sometimes trust someone else more than you in this way and to bet on their judgement over yours.
Contrast: refer, infer.