looking at old maps I see a symbol at that location - a box with a cross and the letters CEM. next to it. Does not have the symbol for a church.
I looked at the 1865, 1878 and 1904 maps.
Looking at google maps it doesn't appear there was enough room on that parcel for a small church... If there was one, the maps would have indicated a church building.
I am research a Nathaniel Coffin (1799-aft1870) who married the widow Mary Fox Montgomery (1814-1901)