The Colonial Revival features of the house may be later additions, perhaps in the early 20th century. I don’t know that the diamond pane window sashes would have been in fashion in the 1870s, though it’s possible.

Madison Historic District, National Register of Historic Places