On the 1st of July, 1852, he married Miss Elizabeth Holden, a daughter of Dr. Rufus Holden, of Belleville, and a sister of the wife of Professor Gregg, of Toronto. By this lady he now has a family of eight children, consisting of four sons and four daughters. After a pastorate of exactly eight years he left Kingston on the 5th of July, 1855, and settled at St. Catharines as first pastor of the United Church. He remained there nearly twelve years, during eight of which he also had charge of a congregation at Port Dalhousie, four miles distant. During his ministry at St. Catharines the new church now known as Knox Church was erected, and his congregation subsequently worshipped there. In 1862 he took a conspicuous part in starting Sabbath School Conventions in this country, which have since been attended by many blessings to the young. In the month of July, 1866, the degree of Doctor of Divinity was conferred upon him by Hamilton College, near Utica, in the State of New York, the leading literary institution of the New School of Presbyterians in that State. On the 20th of March, 1867, he became first pastor of the First Scotch Presbyterian Church in Chicago, which then and for some years thereafter belonged to the Canadian Church. During his incumbency of this charge he received several calls from various churches, all of which were declined. His Chicago pastorate lasted three years, during which the membership of his church trebled in number, and a fine new church was erected by the congregation on the corner of Adams and Sagamore Streets. In October, 1867, he accompanied the Rev. D. L. Moody, the Evangelist, from Chicago to Toronto, on the occasion of the first sitting of the Young Men's Christian Association Convention in the latter city. In the beginning of May, 1870, he returned to Canada, and was inducted into the pastorate of Cote Street Church, Montreal, where Dr. Fraser and the present Principal McVicar had previously ministered. Here he remained five years.
On the 18th of March, 1875, he was settled over Fort Massey Church, Halifax, of which the Rev. J. K. Smith, of Galt, had been for two years pastor. Here Dr. Burns has ever since remained. The congregation has since its commencement discarded pew rents, and has been conducted on the weekly free-will-offering system, the offertory being collected at the church door. Their annual givings to church purposes are said to exceed $100 for each family. He was Moderator of the Synod of Montreal in 1873, and also Chairman of the Montreal College Board; and on his removal to Halifax he was elected to the same post there, which he still fills. During the session of 1877 he delivered special courses of lectures before the Montreal and Halifax students, and in 1878 these were followed up by a second special course in the Halifax College. In 1877 he was associated with Principal Grant and others in pushing forward the $100,000 College Endowment Fund.