Built on a Vettonian fort that was destroyed by the Romans, it was built in the 12th century and rebuilt in the 14th century.
After being conquered from the Arabs, King Alfonso VI donated the Lordship of Valdecorneja to his daughter and son-in-law, Ramon de Borgoña, for repopulation. At the beginning of the 14th century, Henry II of Trastamara donated these lands to the House of Alba in the person of Don García Álvarez de Toledo. The House of Alba was responsible for building the castle. Grand Duke Don Fernando Álvarez de Toledo had his second residence here.
During the Peninsular War, it suffered significant deterioration, not only due to the war itself but also because its stones were used to build private homes. The old interior arcade (which apparently formed a double gallery on the inside of the tower) was dismantled and rebuilt to provide arcades for the town hall building, located in the Plaza Mayor. Between 1851 and 1904, the interior of the castle grounds was used as a municipal cemetery, which further deteriorated its condition.
Today, the exterior is in perfect condition after restorations carried out in 1985 and 2004, preserving its original perimeter. The pavement and part of the keep were repaired.
Access to the monument is free, and visitors can see the well located in the center of the courtyard, a vaulted cistern excavated in the subsoil rock, and the ancient windows and oriel windows with double pointed arches. The courtyard is used for certain cultural events held in this town.