Sachsenkam was probably founded as part of the settlement of Charlemagne in the 8th or 9th century. The name suggests settlers from Saxony or a local founder named Sahso o. Ä. A document from 1035 documents an early affiliation to the monastery Tegernsee, later the place belongs to the estate of Count Adalbero von Ebersberg. The coat of arms of those of Ingram, to whom the village fell to it, is since 1959 municipal coat of arms. Towards the end of the 15th century, the Tölz caretaker Kaspar Winzerer acquired the Hofmark Sachsenkam; after that, the place changes hands several times. When Hofmark was abolished in 1848, the village was owned by Sigriz.
Anna von Pinzenau received the place as a dowry in 1589 and in 1606 laid the foundation stone for a Loreto chapel, which was extended when it could no longer accommodate the growing stream of pilgrims. In 1735, work on the church and monastery was completed in its present form. The monastery, affiliated to the Bavarian Franciscan Province since 1651, has been running a famous pharmacy since 1668. The brewery dates back to the same period and continues today as a brewery cooperative. From 1837 to 1958 the monastery ran a girls' school, until today it leads a guesthouse. The nuns themselves also carry out a large part of the work that takes place in the monastery's agriculture.