The well-known stained glass artist, Charles J. Connick of Boston designed and oversaw the installation of The Reformed Church's windows in the years between 1944 and 1945.

The windows are designed to tell various stories from the Bible: incidents of the Old Testament, and incidents in the life of Christ.

A large gallery window over the main entrance of the church serves as a World War II war memorial window.