The first wooden temple was built by Protestants in the Old Town in the first half of the 17th Century and served them until the second half of the 19th Century. Later, in a newer district of the town, a single-aisle Romanesque Revival (with Gothic elements) temple was built with two-coloured brick. The church was connected with an arcade walkway with the tall bell tower built next to the church. After World War II, the temple was converted into a Roman Catholic garrison church of the Holy Cross. When the garrison parish was dissolved, it was decided that the building will serve as the Holy Saviour church, a filial temple to the parish of St Nicholas of Myra.