Rijnsburg had an important abbey from 1133 until 1574. It was destroyed during the siege of close-by Leiden.

The counts of Holland were buried in the abbey from the 12th century.

This tower is the only part that remains of the abbey. In later years the tower became part of a parish church.