The Crooked House was built in 1765 and was originally a farmhouse. During the early 19th century, mining in the area caused one side of the building to begin gradually sinking. It later became a public house called the Siden House, siden meaning "crooked" in the local Black Country dialect.

The building's leaning walls give rise to optical illusions. These include glasses slowly sliding across "level" tables and a marble appearing to roll uphill.