all along the line
Also, all the way down the line. At every point, stage, or moment. For example, We've had problems with this supplier all along the line, or He's been very helpful all the way down the line. The line originally referred to a row of troops, but the expression has been used figuratively since the late 1800s. Also see somewhere along the line.
Dictionary.com presents 366 FAQs, incorporating some of the frequently asked questions from the past with newer queries.