The first Kasteel Neerijnen (Castle Neerijnen) was probably built around 1350 and was originally called Klingelenburg. It was the first noble house in Neerijnen. The inhabitants of the castle carried the name “De Cock van Neerijnen”. The present castle was built around 1600 on the foundations of the older one. It was radically rebuilt in the 18th century and was extended in the late 19th century. Together with the Kasteel Waardenburg (PiP4) built in 1265, it forms one estate. From 1700 onwards both castles have always had the same owners.

After the “De Cock” family, the estate was owned by various noble families. At the end of 1827, the estate came into the hands of “Frederik Willem Floris Theodorus baron van Pallandt”. This family owned the estate until 1971. On May 6 of that year the last baroness of “Pallandt van Neerijnen en Waardenburg” died. Three years later the estate came into the hands of the Stichting Gelders Landschap & Kasteelen, a foundation for the protection of nature and landscape in the province of Gelderland. From 1980 to 2019, Kasteel Neerijnen was in use as the town hall of the former municipality of Neerijnen.

The castle garden - situated between the castle and the reformed church of Neerijnen - had been seriously neglected for a long time. Since 1996 this garden has been renovated and maintained by volunteers, taking into account the original layout. The garden consists of several parts, including a herb garden, vegetable garden, flower garden and a rose garden.