Local landowner Jesse Odom persuaded an itinerant preacher to hold a revival for settlers in this area in 1877 and again in 1878. A congregation was organized and in 1879 a sanctuary was erected here on one acre of land donated by Mr. Odom. The Rev. S. W. Jones served as first pastor. A cemetery also was established that year on an adjacent tract of land donated by Henry P. Barron. The 1880 interment of Mr. Barron is the earliest recorded burial here. According to local tradition it was the aura of goodwill and harmony during the construction of the sanctuary that was expressed in the naming of the church and cemetery. In 1891 Jim and Henrietta Atkins (the parents of seven children under the age of 4 buried here between 1882 and 1898) donated an acre of land to the cemetery. In 1912 the Rev. W. B. Martin deeded land to the church. Will C. Hill donated an acre to the cemetery in 1914 and in 1916 the congregation replaced its original church building with a new sanctuary. The congregation erected its last sanctuary here in 1951. The church was dissolved in 1963 and in 1968 the Harmony Church building and land were sold to the Harmony Cemetery Foundation. The foundation continues to maintain the cemetery.