Around 1596, Erasmus Leisser had the estate on the western edge of the town expanded into the north wing of the current complex. Between 1629 and 1636 the west and south wings were added. In 1645 the castle was looted and devastated by Swedish troops. Around 1740 the castle was largely renovated in Baroque style.
The Schad family made the neighboring Kronsegg Castle their seat of power and left Schiltern Castle (today: Zorimauer ruins) to decay. When Kronsegg no longer met the increased housing needs, Karl Freiherr von Hackelberg, who was now the owner of the estate, returned to Schiltern and moved into the newly built castle, which was looted and devastated by Swedish troops shortly after its completion in 1645. In 1663 the fief went to the brothers Johann, Ehrenreich and Ferdinand von Geymann, who repaired the damage from the Thirty Years' War.
After Schiltern became sovereign again, Johann Graf Fuchs appeared as the owner and in 1856 Karl Wolfgang Graf Aichelburg bought the estate as his own.
The municipality of Langenlois bought the castle in 1928 after the last member of the Aichelburg family line died, but a year later passed it on to the Kremser Institute of English Girls, which set up a school and boarding school in the building.
The German Reich confiscated the building in 1938 and handed it over to the SA two years later. After the Second World War, the castle was only briefly occupied by Soviet troops, so that the order was able to resume school lessons in 1947. However, the castle was in poor condition and required extensive renovation. John Schleifer, who emigrated from the Waldviertel to America as an unemployed person after the First World War and made a career there as director of the Chrysler works, assumed the considerable costs of the renovation.
The castle has belonged to the Psychosocial Center Schiltern GmbH since 1987. At the Schiltern Psychosocial Center, people with various psychological impairments are supported in re-integrating into the labor market. Difficult situations in life are to be fundamentally improved by means of meaningful employment in workshops, support and support. PSZ Schiltern GmbH has rented parts of the castle gardens to the Arche Noah association (Wikipedia).