The history of Het Armhuis dates back to 1632. In that year it was decided that a kind of home for former sailors should be created. Thanks to a generous donation from the clergyman Abraham Ursinius, the deaconry was able to take on this task. For centuries the house provided shelter to old (seafaring) people, the needy and later also to orphans. Until 1950 it functioned as an Armhuis.

After a thorough restoration in 1997, the building was used as a restaurant and gallery (in the meantime the restaurant will be closed on 1 June 2021). Het Armhuis is also an official wedding location on Vlieland.