St. Coloman is located in an open field near Schwangau. The Baroque church of today replaced an earlier chapel at the same spot, as it was widely believed, that the Irish pilgrim St. Coloman had stopped at this point on his pilgrimage to the Holy Land in the summer of 1012.

Master mason Hieronymus Vogler started the building in 1673, following draft of Johann Schmuzer from Wessobrunn. The church got consecrated in 1685 together with "Unserer Lieben Frau am Berg" in Füssen (see prev uplouds).

St. Coloman continued his pilgrimage but was arrested in Stockerau, near Vienna, as he was mistaken for a spy because of his strange appearance. He could not speak the local tongue, so he was tortured and hanged on 16 July 1012.