on the side

In addition to the main portion of something; also, in addition to one's regular job. For example, He ordered some French fries on the side , or She often prepared tax returns on the side . [Second half of 1800s]

See on someone's side ; on the side of the angels .