It is the surviving part of an Augustian priory founded in 1131. The church has Norman architectural features, medieval brasses and wood carving, eighteenth-century monuments and modern stained glass. The building has been involved in many significant events of English history including the Peasants' Revolt, the annulment of Henry VIII's marriage to Katherine of Aragon and the civil war. The church still plays an important part in the town's life.