Naumburg Castle has had a difficult history. From 1035 to 1504, the Benedictine monastery of Naumburg stood on the same site. It was destroyed in the Landshut War of Success and rebuilt with the help of the Seligenstadt Abbey. The Reformation and the Thirty Years' War led to its decline. In a transitional period, the monastery was continued as an agricultural estate. The building complex was later sold, gutted and converted into a hunting lodge (1750 - 1754). The architecture today appears highly inconsistent and reflects the diverse, often conflicting intentions of the many owners to this day.
Since the early 1970s, the entire property, including all outbuildings, has belonged to a Christian faith and residential community, which renovated the property and now uses it for residential purposes. The former monastery and castle can be reached by car from Erbstadt via a small country road.