The center of the medieval city center of Karlstadt am Main, which dates back to the late 12th century and is today largely reconstructed, is the market square. The square is dominated by the beginning of the 15th century Historical Town Hall with its stepped gable and the mighty double-flighted staircase, which was the only access to the upper floor until the 17th century. On the ground floor of the town hall there is a three-aisled market hall (today a restaurant), on the upper floor the largest civic hall in Franconia. The stone parapet on the pedestal in front of the pointed-arched portal to the first floor bears the coat of arms of the Würzburg Prince-Bishop Johann Philipp von Schönborn. The first is adorned with the clock tower of the town hall clock - below it stands a niche in 1718 by the Karlstadter sculptor Kilian Schüßler created figure, called "Schwedenmännle", a landmark of the city, which commemorates the occupation of the city in the Thirty Years' War by Swedish troops.