The first moated castle on the Pfatter River was probably built in the 12th century. The Köfering family was first mentioned in the mid-12th century. Around 1300, the castle was owned by Eckprecht von Haidau, who transferred it to the Bishopric of Regensburg in 1307, receiving it as a fief from the bishop. Other owners of the castle were Otto Zenger, Albrecht von Abensberg, Heinrich Nothaft von Mangolding, and Scheuer. In 1427, Dietrich von Stauf acquired the castle in Köfering through exchange. Köfering Fortress was besieged and destroyed on December 26, 1491, by Duke Albrecht IV of Bavaria and 1,000 soldiers during the Löwler League revolt, in which the castle owner, Hieronymus von Stauf, participated.
From 1569 to the present day, the Counts of Lerchenfeld have owned the moated castle. The castle was damaged in the Thirty Years' War and rebuilt in its present form from 1680 to 1720. Renovation began in 1980/81.
The moated castle is an irregular, Baroque, three-story, three-winged complex with hipped mansard roofs, an entrance projection with a portal, ground floor arcades, and a staircase with a hipped mansard roof. The White Hall with its inlaid parquet flooring and the chapel are worth seeing. The castle complex consists of a central projection, to which only a north wing adjoins. To the west is another wing with projecting corner projections, and to the south is the single-story former stable building. The former stable building is a single-story building with a dormer from the 19th century. The castle courtyard, with a plane tree approximately 200 years old, is bordered to the east by a row of pillars and a retaining wall. A three-arched stone bridge crosses the walled, still preserved moat, providing the only access to the castle.
The residential building (Im Schlosshof 1) is a two-story structure with a mansard hipped roof. The two-story manager's house (Kirchstraße 5) is also covered by a mansard hipped roof with a dormer window. At the western entrance to the castle is a pillar with pilasters and tops. The park walls surrounding the park, which includes a garden pavilion, date from approximately 1700 to 1720 and were altered in the 19th century.