Gostling was a clergyman, antiquary, and topographer. He wrote verse, (though none published until after his death), most notably a versified version of Ebenezer Forrest's account of a trip made by Hogarth and some friends over five days into Kent in May 1732. This was printed in a limited edition of twenty copies in 1781 by John Nichols. His verses were also included in Nichols' 1781 Collection. Gostling is best remembered, however, for his prose work on Canterbury.