give the devil his due
Give credit to what is good in a disagreeable or disliked person. For example, I don't like John's views on education, but give the devil his due, he always has something important to say, or I don't like what the new management has done, but give the devil his due, sales have improved. [Late 1500s]