In 1822 he married Jane Cochrane, daughter of Adm. Hon. Sir Alexander Cochrane (a son of the 8th Earl of Dundonald). Before her death in 1830, they were the parents of:[1]
Alexander Hervey Bruce (d. 1874), a Lt.-Col. in the Bengal Staff Corps who married Elizabeth Julia Mackinnon.[1]
Henry Stewart Beresford Bruce (1824–1908), a Lt.-Col. in the 2nd Lancashire Militia who married Marriette Hill, daughter of John Hill of Bellaghy Castle, County Londonderry, in 1846. After her death in 1886, he married her sister, Frances Jane Augusta (née Hill) Moran, widow of Edward Moran, in 1894.[1]
In 1832, following the death of his first wife, he married Louisa Mary Minchin Dalrymple, a daughter of Col. George Dalrymple.[3] Together, they were the parents of:[1]
James Minchin Bruce (1833–1901), a Rear-Admiral who married Elizabeth Lucas Hill, daughter of John Hill, in 1856.[1]
He is memorialised on the family gravestone in the south-east corner of North Berwick parish churchyard.[6]
"This piece of silver plate was presented to Sir Henry William Bruce by his Captains, Commanders, and Lieutenants in 1854 as a token of their grateful sense of his uniform, kindness and consideration to themselves, the officers and ship's companies under their command, during the period they had the pleasure of serving under him on the West Coast of Africa".[7]