wither on the vine
Fail to come to fruition, as in This building project will wither on the vine if they don't agree on a price. This expression alludes to grapes shriveling and drying up because they were not picked when ripe.
