lead a double life
Live as if one were two persons, usually one good and one bad. For example, They learned that his frequent travels were actually fictitious, and he was leading a double life, with a second home on the other side of town. This phrase is frequently used for a married person who establishes a second household with a lover. [Late 1800s] Also see Jekyll and Hyde.