Hay was an active whig politician, member of parliament, placeman, and a pensioner. He wrote on religious and political subjects. He wrote only one original poem, Mount Caburn, in his lifetime. His most popular work was Deformity: an essay, a discussion of his own physical deformity.