Before Henry VIII converted England to Protestantism, it had been fashionable to swear by Catholic saints (“By Saint George!” “By Saint Louis!”) After Catholicism was banned, people started saying “By George” instead.

source: Richard Zacks, An Underground Education, page 169