This house was most likely the first house Hannah and James Hargest occupied in 1804 in Baltimore. The house was later passed down to the Robb family who were Thomas Hargest descendants. Two of Thomas Hargest's daughters married Robb brothers.