Campbell House was originally located on a plot of land 1 ½ kilometres to the southeast of its present location at the intersection of what is now Adelaide St. and Frederick St. (where the George Brown School of Hospitality is located today). After Sir William’s death in 1834, the house was willed to his wife, Lady Hannah, for her use. After her death in 1844 the property and contents of the house were auctioned off and the proceeds were distributed amongst their heirs. For most of the 19th century the house was maintained as a private residence. After the turn of the 20th century the building was used by several businesses as office space and as a factory, including a horseshoe nail company and an elevator company, and the house fell into disrepair.
The last owners of the property (Coutts-Hallmark Greeting Cards) wanted to demolish the house to extend their parking lot. At this time the house was offered to anyone who could remove it from the property. A professional association of Trial Lawyers known as the Advocates’ Society intervened to save the house, move the building and restore it to its present appearance. The house was moved to its present location at the corner of Queen and University on Friday, March 31st, 1972.