In physics, your solution should convince a reasonable person. In math, you have to convince a person who's trying to make trouble. Ultimately, in physics, you're hoping to convince Nature. And I've found Nature to be pretty reasonable.

Fantastic Realities: 49 Mind Journeys and a Trip to Stockholm (ed. World Scientific, 2006) - ISBN: 9789812566492