Around 1120, Adalbert von Sachsengang was documented as the first representative of the family named after the castle.
When Emperor Ferdinand III put Sachsengang up for sale in 1655, it was already in very poor condition. Johann Konrad von Richthausen became the new lord of the castle. He primarily engaged in alchemical experiments in Sachsengang. As early as 1659, he sold the castle to Dr. Jakob von Thavonat, a South Tyrolean, who had it expanded into a palace. His descendants still live in and manage the castle today.