The beautifully restored Turnhout Castle, also known as Castle of the Dukes of Brabant (Kasteel van de Hertogen van Brabant) dates back to the 12th century. Originally it was the first hunting lodge of the first Duke of Brabant. In the 16th century the castle was rebuilt into a renaissance palace by Mary of Hungary, at that time the governors of the Netherlands and was used as a court of pleasure.

During the Eighty Years' War (1568-1648) Turnhout Castle lay on the front line. As a result it changed hands several times between the Spanish army and the Dutch rebels. In 1597 the north wing was burned down by the troops of Maurice of Nassau, Prince of Orange. After that the castle lost its military importance.

In 1702 Turnhout became a Prussian barony under Frederick the Great. In 1789, during the Brabant Revolution, the Austrians were driven out of Turnhout. They returned twice but in 1796 the castle was occupied by the French. They turned the castle into a court house and prison. The building was also used as a warehouse, a fire brigade and a weaving school.

In the 20th century the decayed castle was purchased by the province of Antwerp and was renovated in a classicist inspired neo-baroque style. The last renovation took place around the year 2000 and was opened again in May of that year.

At present Turnhout Castle - one of the most interesting buildings in the city - is used as a court of justice and is not open for visitors.