Pine Tree Cumberland Presbyterian Church began sponsoring Sunday School classes in the Spring Hill Schoolhouse after 1887. The Rev. W. M. Allen began to preach there on Sunday afternoons in 1891. The Rev. J. M. Robinson became the first resident pastor after the division of the two churches. The new congregation was named for Elmira Castleberry, matriarch of a prominent pioneer family. Her sons, James R. and Richard Castleberry, were founding elders of the church. James R. gave 35 acres of land and material for a school/church building in 1897-98. Always active with other denominations and in youth, community and missionary outreach programs, the church continues to serve the area. (1998)