"Romungesdorf" was mentioned for the first time in 1293 in the eighth book of the imperial city of Rothenburg. In 1336 "Romungestorf" appears as the seat of the knight Fritz Vogel zu Dornberg. In 1388 the knight Peter Vogel zu Vogelsburg (= Burg Rammersdorf) is named, who was a liegeman of Würzburg. A little later, Rammersdorf passed to the Geissendorfer brothers. In 1390 the Vogelsburg had to cede to the Würzburg steward Arnold Hiltmar. Burkhart von Seckendorff-Jochsberg acquired the castle from him and received it as a burgrave's fief on April 6, 1390. In 1417, Schloss Rammersdorf appeared in a list of the castles of the district court of Graisbach. On January 1, 1571, the Brandenburg-Ansbach chamber councilor Veit Asmus von Eyb zu Vestenberg, from the von Eyb noble family, acquired the Rammersdorf/Vogelsburg manor from Martin Wolf von Redwitz, who had just bought it from his brother-in-law Hans Zobel von Giebelstadt. The family of Baron von Eyb has lived in the castle since that time. The castle is usually open to the public on Heritage Days