Harrison was a clergyman, originally Baptist but converted to the Church of England. His earliest publications were funerary sermons, but he also wrote poems and popular hymns, collected in Poems on Divine Subjects. His most notable work was a dramatic poem called Belteshazzar, or, The Heroic Jew.