The island is dominated by the remains of the castle which is a rectangular tower with different sized round towers at the NE and SW corners. Once the stronghold of the MacFarlanes it was destroyed by soldiers loyal to Cromwell during the Commonwealth of 1649 to 1660 (perhaps c.1654). A sword and set of keys were found in the ruins some years ago.
The towers are later additions to the main tower block and appear to represent a later strengthening of the defences. The standing walls are built entirely of sandstone and are very obviously burnt. The castle stands no higher than the first floor and it is apparent that its destruction in the mid 17th century was comprehensive.