End of the 14th century Count Johann IV. Solms takes the city of Wetzlar and moved threateningly to the Hessian border towards Giessen.
1375-79 Landgrave Hermann I v. Hesse, the scholar, had Hermannstein Castle built as a protective castle on Solmser Grund at the gates of the city of Wetzlar and occupied it with castle men. In the peace treaty after the fighting between Hesse and Solms, the land had to be left to the Landgrave. With that the castle lost its importance. Initially it was still occupied by officials, was then pledged several times, later even half to Solms.
1481 The Hessian court marshal Johann Schenk zu Schweinsberg receives half as a fief and the other half as an after-fief. With it he founded the Hermannsteiner Line. 1483 The residential building of the lower castle is presumably due to the ldgfl. Builder H.J. built by Ettlingen.
In the 18th century The castle was given up as a residence and fell into disrepair. Parts of the system are canceled.