The ruin of the Spornburg on the Schlossberg with the remains of an ancient Celtic-era, extensive prehistoric plant shows a section wall from the early Middle Ages (around 900), the so-called Hungary Wall. He protected a large refuge, which served the population of the area in the invasion of Hungary as a retreat. It was first mentioned in 983 in a document of Bishop Wolfgang. The strategically located between Naabtal and Vilstal at the crossroads of several old streets castle, whose builders are not finally clear, secured a 1230 as "old" circumscribed Reichszollstätte from. The castle was mortgaged by Ludwig the Bavarian in 1344 first to Regensburg, later to Thuringia, then to Hesse. A few years later came changing branches of the family of Wittelsbacher (Palatinate, Upper Bavaria, Palatinate Neuburg) back into the possession of the castle. In 1358, Count Palatine Ruprecht I was allowed to raise the castle, and in 1361 he had construction work carried out there. It was not until 1459 succeeded Duke Albrecht III, castle and market Kallmünz for Upper Bavaria to win back. During the Landshut War of Succession Palatine troops set fire to the castle in 1504, it was plundered after its reconstruction in the Thirty Years' War in 1633 by the imperial troops, 1641 by Swedish troops finally destroyed by fire and then served as a quarry. In 1793, the castle became the property of the municipality and was repeatedly renovated since the end of the 19th century.