The earliest known history of Kasteel Hackfort (Hackfort Castle) is dating back to the year of 1324, when the Lord of Bronckhorst commissioned the building of a castle. In 1392 ‘House Hacforden’ was nothing more than just a residential tower and a moat. In 1586 the castle was destroyed by the Spanish troops during the Eighty Year's War (the Dutch Independent War). After the liberation of the region by Prince Maurits van Oranje, the castle was rebuilt in 1598 by Borchard van Westerholt.

In 1788, Kasteel Hackfort underwent substantial renovations. The old gate house and outbuildings were demolished and the canals were filled in. The castle was transformed into an 18th-century manor house. Nowadays only the two thick cylindrical towers are reminders of the (former) castle. The castle is surrounded by forests and meadows and includes Hackfort Watermill.

The castle remained for centuries in the possession of the family Van Westerholt. When the last Baroness Westerholt of Hackfort died in1981, Kasteel Hackfort and estate were donated to Natuurmonumenten (a Dutch society for preservation of nature monuments).