After the original wooden building was destroyed during the Tatar invasion, the castle was rebuilt in the Renaissance style by János Héderváry. The castle acquired its current Baroque form in the second half of the 18th century. Károly Khuen-Héderváry had the castle rebuilt between 1906 and 1907, based on the plans of architect István Möller. The gate opening on the Baroque facade is guarded by two sphinxes. The castle is surrounded by an English park.
The castle was renovated from 2002 to 2004. In the spring of 2004, the four-star Hédervár Castle Hotel opened, which has been closed since 2012. In 2025, the castle stands seemingly empty and unused.