The original house was a log cabin build by Josiah Smithfield from trees cut down from and stones dug up out of the land. It still stood and served as a "mad" house--a refuge from squabbling spouses, or a retreat for a family writer or artist. If you walked down a path that cut from the back gardens of the big house that replaced it, you'd find it comfortably settled just a few yards into the woods.