lead a double life
Live as if one were two persons, usually one good and one bad. For example, They learned that his frequent travels were actually fictitious, and he was leading a double life, with a second home on the other side of town. This phrase is frequently used for a married person who establishes a second household with a lover. [Late 1800s] Also see Jekyll and Hyde.
Dictionary.com presents 366 FAQs, incorporating some of the frequently asked questions from the past with newer queries.