Béla IV of Hungary, here lived during the Mongolian invasion (1241 and 1242). Later it was owned by the Roman Catholic Church and became even the episcopal seat during the time of Bishop György Széchenyi (1648-1658).

The decline of the castle began in the 18th century, when after the Rákóczi War of Independence, it was set on fire in 1713, and substantially destroyed. From then on, the castle was exposed to the weather for two and a half centuries, and most of its stones were transported to the surrounding construction sites.

During the 20th century, parts of the castle were restored and today restoration works continue.