Built in 1792, according to the design of Hilary Szpilowski, from the foundation of Jakub Paschalis Jakubowicz, an Armenian who came to Poland in the 1760s from Tokat in Anatolia and was ennobled by King Stanisław August Poniatowski.
Next to the building is the former manor park and the church of St. Roch, also founded in 1792 by Paschalis.
After the founder's death in 1816 or 1817, the manor was inherited by his son Marek Józef Paschalis. Later, Lipków belonged to the Miecznikowski, Worowski, Młodzianowski families, and from 1880 the owner was Kazimierz Szetkiewicz, later father-in-law of Henryk Sienkiewicz, who was probably the prototype for the character of Onufry Zagłoba. In the years 1881-83, the manor in Lipków was visited many times by Henryk Sienkiewicz. In 1909, the estate passed into the hands of Gustaw Daszkiewicz, and then Ludwik Suwald. The last, pre-war owner of the manor was Jerzy Suwalda. During World War II, the building was occupied by the German army, and after the war it was nationalized and transferred to apartments for employees of the State Agricultural Farm.
In 1948, the residents accidentally started a fire due to faulty coal stove pipes and the manor burned down. In 1956, the local parish of St. Roch began efforts to obtain the burnt manor for the purpose of a rectory, which was successful in 1957. In the same year, the building was rebuilt thanks to the efforts of Canon Stefan Kowalczyk, parish priest of the NMP parish in Warsaw, and Father Wacław Kurowski. Father Wacław Kurowski founded a private museum of the history of Lipków and its connections with Sienkiewicz in the manor. However, it has currently suspended its activities. The Lipków manor house served as a setting for several film episodes, including: The Relief of Vienna, Polish Roads, 07 Report, Catastrophe at Gibraltar. In 1957, the manor house began to serve as a rectory.