The former castle on the site of Batthyány Castle is first mentioned in a document from 1299. During the Turkish period, the last castle was subjected to fierce attacks, as evidenced by the fact that it was reinforced five times in 80 years. The fortress built by the Szentgróti family was later controlled by the Hagymásy family from Berekszó for more than 200 years and only became the property of Ádám Batthyány (I) after their extinction in 1654. After the Turks were expelled, it lost its importance and gradually fell into disrepair until Imre Batthyány demolished the castle in 1767, which was also looted.
The castle that still exists today was built in 1787 by Ferenc Batthyány on the site of the fortress and using its raw materials. At the end of the 19th century, the castle, which came into the possession of the Károlyi family, was rebuilt again, with the terrace with a carriage driveway being built. After the Second World War, 1947. On March 21, the building was taken over by the Ministry of Religion and Public Education.
Today's special education facility was founded in 1950. has been working in the building since October 15th. In the spring of 1995 he took the name Dezső Koncz, special education teacher and former principal. The last renovation of the castle began in 1984 and the work lasted four years. The Zala district municipality currently maintains the building.