Founded around 1023 by Avesgaud, bishop of Le Mans and son of the count of Perche, the castle of La Ferté-Bernard has suffered many damages over time. A fortress first built of land and wood, the castle was then rebuilt in stone before being largely destroyed on the orders of Charles VI following the betrayal of his lord Pierre de Craon in 1392. Today, there are 2 towers, walls and a part of the house very modified over the centuries and now divided into private apartments. The garden is accessible during the European Heritage Days.
The St Lyphard chapel has a magnificent side oratory that was built at the end of the 14th by order of Louis d'Orléans and Valentine Visconti. Acquired by the city in 1980, it has been restored to become an exhibition space.