Dally Castle dates back to around 1239, when it was built as a motte-and-bailey fortress to protect the area. Legend has it that the owner's sister once fell in love with her brother's enemy, Gilbert of Tarset. He eventually killed him in a fight on a spot now known as Gib's Cross.
Next to the ruined castle, you will spot Dally Castle House, which was built in the 18th century. There is also an old flour mill on the other side of the road, used during the Napoleonic War to grind wheat.