Around 1233, Elburg was given city rights and also the opportunity to build defenses. The city was walled and four wall towers were built.
Originally, the Vischpoort was a dense defense tower of the city. In 1592, when the fortifications were expanded, a passage was added to the gate. In the 19th century, various parts of the Elburg fortress were demolished, but the Vischpoort was retained. However, the doors were removed from the gate.
In 1992 a repair operation took place during which the gate was fitted with doors again. The waiting room is located above the passage. On the city side the gate has some windows, on the sea side the gate is windowless. There is a clock on the top of the gate. Four so-called Arkel towers have been placed on the four corners of the gate. The gate is crowned with an octagonal, constricted needle spire. This spire is covered with slates. On the outside, the sea side, the tower is equipped with a coastal light. There is a bell on the inside, which was installed in 1683 and gave the signal that the skipper was about to leave. The city wall of Elburg fortress runs on either side of the tower.
Of the gates that were previously built on the city walls, the Vischpoort is the only one left in Elburg.