Even though no one else discovers the nonconformity or enforces the rules against it, the individual who has committed the impropriety may himself act as the enforcer. He may brand himself as deviant because of what he has done and punish himself in one way or another for his behavior.
p. 31. - Outsiders: Studies in the Sociology of Deviance (1963)