Following the birth of their daughter, Harriet separated from her husband. Lowry-Corry was created Baron Belmore, of Castle Coole at around this time, and later Viscount Belmore, but did not become an earl until 1797. The couple lived apart until their marriage was dissolved by an Act of Parliament in 1793. In the meantime, Harriet had formed a relationship with William Kerr, Lord Ancram,[2] who was Lord Lieutenant of Roxburghshire and Midlothan and the heir to William Kerr, 5th Marquess of Lothian. Immediately after the divorce, on 14 April 1793, Harriet married Kerr. Belmore also remarried.
A year after her second marriage, her father died and she inherited Blickling Hall and family estates in Norfolk.[2] With her second husband, she had a further four children::
Lord Schomberg Robert (1795–1825), soldier, who died unmarried and childless
Lady Isabella Emily Caroline (1797–1858), who died unmarried and childless
Reverend Lord Henry Francis Charles (1800–1882), who married Louisa Hope, a daughter of Sir Alexander Hope, and had children
She died, aged 43, before her husband inherited the title of Marquess from his father. He re-married a year after her death, his second wife being Lady Harriet Scott, by whom he had a further eight children.