Around the year 1200, Rhijnauwen Castle (a real fortress with a moat and a drawbridge) stood on the site of Huis Rhijnauwen (Manor Rhijnauwen). The castle was destroyed by the French in 1672. The current building was built around 1830. In 1919, the estate was purchased by the municipality of Utrecht from its last private owner.

Huis Rhijnauwen - located on the right bank of the river Kromme Rijn - has been used as a youth hostel since 1933, making it the oldest in the Netherlands.