The Mitwitz moated castle was first mentioned in 1266. At that time it belonged to the barons of Schaumberg as a Bamberg fief. The basement of the north wing and the northern corner tower already existed at that time. During the German Peasants' War, the castle was looted and partially destroyed by fire in 1525. In the years that followed, it could only be poorly repaired before it was acquired by Hieronymus von Würtzburg in 1575. At the end of the 16th century, Hans Veit I von Würtzburg had the castle of the eponymous family of those of Würtzburg rebuilt and expanded to its current appearance. He commissioned the builder Daniel Engelhardt, who had previously planned the expansion of the Rosenberg fortress in Kronach. Until the death of Ludwig Freiherr von Würtzburg at the age of 77 in 1922, the complex was owned by the Freiherr von Würtzburg. Since his daughter Annie von Würtzburg married Theodor von Cramer-Klett junior in 1903, son of the industrialist Theodor von Cramer-Klett, the castle became the property of the von Cramer-Klett family. At the end of the Second World War, the Frankfurt City Library was outsourced to the Mitwitz moated castle. The von Cramer-Klett family is still in the possession of the castle.
From 1977 to 1989, the Kronach district renovated the castle and received a 99-year usage right. In the castle there is the Upper Franconia Ecological Education Center and the Upper Franconia Beekeeping School with a small beekeeping museum that can be visited. Today the castle and the adjacent park are regularly used for cultural events, markets and festivals. Castle tours are held from May to September. With a purchase contract signed in December 2019, the Kronach district acquired the castle from the Cramer-Klett family at the beginning of 2020.