It was from here that the Lords of Hohenlohe, who initially named themselves after Weikersheim Castle and from 1178 after this castle, built their property. Konrad, one of the three sons of Konrad von Weikersheim, who was first mentioned in 1153, called himself "Konrad von Hohenlach" or "von Holach" after the castle. This name was later also used by his brothers Heinrich and Albert. The relocation of the headquarters from Weikersheim to Hohlach was probably connected with the right of escort on the trade routes that the Lords of Hohenlohe had around the Taubertal until the 14th century. Hohlach Castle once dominated the important trade route between Frankfurt am Main via Würzburg to Augsburg and further across the Alps.
When Gerlach von Hohenlohe sold the town and office of Uffenheim to Friedrich V, the burgrave of Nuremberg, in 1378, Hohlach was excluded from the sale. The Lords of Ehenheim (whose ancestral seat was a Hohenlohe fiefdom in Enheim) sat in Hohlach as Hohenlohe, later Ansbach feudal people, as well as at Brauneck Castle. The castle was already in ruins in the 13th century.
The Enheimers from the Evil von Ehenheim line then sat until 1645 in a permanent house in Hohlach, which was in the immediate vicinity of the church (to the west of it). This was probably also the location of the Hohenlohe family castle. After the Enheim died out in 1645, the manor was lent to their heirs, in 1718 it went to the imperial chamber director Johann Gallus von Jacob, in 1761 to the imperial provisions director Johann Christian von Oettinger and from 1810 to 1935 to the barons of Würtzburg. When and in what way the permanent house disappeared is unclear. The seat of the estate was the baroque castle on the northern edge of the village, dated 1718, which is still standing today. Whether the older moated castle stood there has not yet been researched.