The Castillo de Olvera was built at the end of the 12th century as part of the defence system of the Emirate of Granada. The castle stands on a rock at 623 metres above sea level, which is the highest point in the city.
The castle has an irregular triangular shape that matches the shape of the rock. It has an entrance gate protected by a barbican and a shelter for a shield. The castle consists of a main tower, a wall with a walkway, an underground recinct, and two water tanks.
The castle has been a Bien de Interés Cultural monument since 1982.