The first documented owner of the property was Polykarp Hunt in 1466. Lukas and Peter, the Kammerers, are mentioned as landlords around 1600. There is unlikely to have been a noble von Kammer family.
Dietrich Khuen von Belasy acquired the Kammerhof estates from Peter Kemmerer and his son-in-law Georg Guthund between 1610 and 1614, freed them from the Hunt manorial lordship and built a castle there. The castle chapel was added in 1617 and consecrated by Bishop Johann Paulus Ciruletti. The estate remained in the possession of the Khuen von Belasy family. Mentioned are Siegmund Khuen (1640), Hans Christoph and Dietrich, the sons of Siegmund (1648), Georg Dietrich Khuen (1675), and May Preisgott Khuen (1707). In 1711 the property and chapel burned down. Reconstruction only began after the Khuen von Belasy's property in the whole of Pinzgau was sold to the Diocese of Chiemsee in 1722. The bishops had the property managed by their caretakers at Fischhorn Castle.
After secularization, Josef Neumayer acquired the property from the Bavarian Finance Chamber in 1812 by auction, having already been the tenant of the estate since 1785. The property is still owned by the Neumayer family today.