In 1615, Jesuits from Antwerp began construction of their Baroque church. In 1621, the Onze-Lieve-Vrouwekerk - as it was initially called - was completed. In 1773, the Jesuit order was abolished. A few decades later, the church became the parish church that it still is today and was given the name of its new patron saint: Sint-Carolus Borromeuskerk (St. Charles Borromeo Church).

This is the Rubens Church par excellence. As a painter, decorator and architect, Peter Paul Rubens had a hand in the tower, the façade, the high altar, the ceiling stucco work and the Lady Chapel.

Large sums of money were spent on decorating the interior. It was not for nothing that the church was called “the marble temple”. On 18 July 1718, lightning struck, destroying no fewer than 39 of Rubens' ceiling paintings in the flames. This was followed by a somewhat austere reconstruction of the column basilica. During the restoration in the 1980s, attempts were made to recreate the original interior from before 1718.