Bishop Jan Stefan Wydżga was in the government of Warmia during the Polish-Swedish War. Following the end of the war, there was no peace for the episcopal domain. The bishop’s concern was to free Frombork and Braniewo from the Brandenburgian occupation. He managed to free Frombork from the elector’s armies relatively quickly, whilst Braniewo was only left by Brandenburgian forces in October 1663. However, the threat from Brandenburg remained. When the Brandenburgian contingent was on its way to Ukraine, Warmia provided fodder and food, and when it returned it passed through the domain or nearby, the inhabitants again had to provision it. The bishop became alaramed in 1678, when a Swedish invasion of Royal Prussia. It seemed that the war would also affect the domain of Warmia. There was fear. Bishop Wydżga was constantly concerned about the taxation of the Polish troops. Taxes were passed by the Parliamentary General of Royal Prussia, the bishops in the Sejms agreed to the extraordinary taxes, and finally the priesthood had to provide a hyberne. Wydżgaand the canons did not object to the taxes, the hybernas brought in money which saved Warmia from the stopover of the crown’s armies. In the bishop’s correspondence tax issues occupy a substantial amount of space – to pay or delay with payment. Wydżga even brought in prepayments before the relevant tax resolutions were passed, he was afraid of the unpunished soldiers. The internal affairs of Warmia caused him a lot of trouble but he was able to deal with the problems extremely well. The bishop complained he had to financially support the manor, the poor, to repair the churches and to rebuild the Warmia after the destruction of the Polish-Swedish War. However, in his correspondence there is no mention of building a baroque mansion; at most repairing the buildings in the forecourt. It can therefore be concluded that the construction of the baroque palace on the southern side of the castle cannot be attributed to him. At most, Wydżga repaired the buildings constructed by Bishop Maurice Ferber.