The son of the first baronet (d. 1759) and nephew of Henry Thrale, he was a gambler, sportsman, and friend of the Prince of Wales whose wife Letitia had been a mistress of the Duke of York.