Control by experiment... is, of course, an essential prerequisite of the validity of any theory. But one can't possibly test everything. That is why I am so interested in your remarks about simplicity. Still, I should never claim that I really understood what is meant by the simplicity of natural laws.
In: Werner Heisenberg, Physics and Beyond: Encounters and Conversations, Chapter 5 (p. 69)