“We’ll Still Keep Marching On” was included in Waters’ Golden Harp for Sunday Schools, which was submitted for copyright deposit on April 14, 1863, by Horace Waters. It was later republished in The Athenaeum Collection of Hymns and Tunes for Church and Sunday School (New York: Horace Waters, 1863). The lyrics are by Mrs. Mary Ann Kidder.