The son of the Rev. John Horseman (d. 1803); educated at Appleby and Corpus Christi College, Oxford (where Southey was a Balliol acquaintance), he was rector of Heydon with Little Chishall (1810) and rector of Great Chishall (1839) in Essex. There is a memoir in his Poems (1845).