make oneself scarce
Depart quickly, go away, as in The children saw Mrs. Frost coming and made themselves scarce. This idiom applies scarce in the sense of "seldom seen" to removing one's presence. [c. 1800]
Dictionary.com presents 366 FAQs, incorporating some of the frequently asked questions from the past with newer queries.