If doing mathematics or science is looked upon as a game, then one might say that in mathematics you compete against yourself or other mathematicians; in physics your adversary is nature and the stakes are higher.
Enigmas of Chance, Introduction (pp. xxiii-xxiv), Harper & Row Publisher. 1985