The castle was probably built around 1200 as the ancestral seat of a branch of the noble von Hürnheim family, who subsequently named themselves after the castle (de alta domo, i.e. to or from the high house). In 1236 Rudolf I von Hochhaus is mentioned as a witness to a notarization.
In 1347 the complex was sold to the Counts of Oettingen-Oettingen by Konrad II for £ 3,000. The last of the lords of the skyscraper died in 1353 without an heir, which was probably one of the reasons for selling the castle. The counts use the castle as an official residence, which was modernized and strengthened in terms of defense technology in the 15th and 16th centuries.
In 1719 the old castle complex was finally expanded into a palace, but the fortifications and the old palace were largely retained. This castle building burned down in 1749, no reconstruction was needed.
Between 1787 and 1792 the journalist and educator Wilhelm Ludwig Wekhrlin was imprisoned in the skyscraper. While in custody, he writes articles for his political magazines Das graue Ungeheur, Hyperborean letters and paragraphs.
The old hall was used as the official building of the Oettingen-Wallerstein line until 1807 and then also left to decay. This decay was deliberately accelerated for romantic reasons; the castle ruins - like the neighboring Niederhaus castle - were to serve as a picturesque landscape scenery in the Karthäusertal. Nevertheless, the ruins are apparently still inhabited for a long time: In 1839, the city council of Nördlingen granted the court councilor Helene le Bret from the skyscraper to move to the city.
In the sixties of the twentieth century the countercarp of the neck ditch was secured (already partially collapsed again), other maintenance measures on the building fabric cannot be ascertained.