Fundamentally, basically, as in He's a good fellow at heart. It was first recorded in Alexander Pope's Epistle to a Lady (1735): "But every Woman is at heart a Rake."
In one's deepest feelings, as a great concern, as in The governor has the party's best interests at heart. [Early 1700s]
Dictionary.com presents 366 FAQs, incorporating some of the frequently asked questions from the past with newer queries.