piece by piece
In stages, gradually, as in He took the clock apart piece by piece, or Let's go over your exam paper, piece by piece. Also see bit by bit.
