"Vengeance is mine, ... saith the Lord. Therefore if thine enemy hunger, feed him; if he thirst, give him drink; for in so doing thou shalt heap coals of fire upon his head." [Paul to the Romans, xii:19-20]
with a vengeance
With great violence or energy; also, to an extreme degree. For example, The cottage was filthy and Ruth began cleaning with a vengeance, or December has turned cold with a vengeance. This expression was first recorded in 1533. Also see with a will.