day by day
On each successive day, daily, as in Day by day he's getting better. Percy Bysshe Shelley used this expression, first recorded in 1362, in Adonais (1821): "fear and grief ... consume us day by day."