Mathematics is not just a language. Mathematics is a language plus reasoning. It's like a language plus logic. Mathematics is a tool for reasoning. It's, in fact, a big collection of the results of some person's careful thought and reasoning. By mathematics, it is possible to connect one statement to another.

chapter 2, The Relation of Mathematics to Physics - The Character of Physical Law (1965)