better safe than sorry
Being careful may avoid disaster, as in I'm not taking any short-cutsbetter safe than sorry. This cautionary phrase appeared as better sure than sorry in 1837.