The church was mentioned for the first time in 1522. The first church was probably wooden. At the beginning of the 18th century, during the Northern War, the Swedes destroyed it, and around 1720 a brick one was built. The current Church of the Apostles Saint Peter and Saint Paul was built in 1905 by priest Kazimieras Bandzevičius. The church is neo-baroque in style, with a Latin cross plan, 2 tall towers and a projecting facade. The interior of the church is cozy and bright. The altars and the organ avenue are neoclassical. There are 12 significant art treasures in the church.