A walled enclosure follows the cliff edge on which the castle rises. There are eleven circular-plan towers, open towards the interior on their eastern side, and a single square tower to the south, dating back to the Christian period, which stands out on a distinct section of the wall where red plaster cement, characteristic of the previous Muslim period, was not used.

This is a significant archeological site where the remains of 12th-centruy palace-houses, once enclosed within the Muslim fortification, are still preserved. The rooms in these small palaces are set around a central courtyard and feature certain unique characteristics. The main dwelling rooms are to be found on the top floor of the premises, which typically also have a large water cistern (aljibe) under the courtyard and the remains of a Muslim sauna (hamman). The other dependencies of the castle occupy the ground floor and are generally set around a well-preserved sandstone courtyard, in which the remains of lobed arches, probably leading into the main chamber of other palaces, are still to be seen.

Excavation works have been very fruitful so far. Among the findings, it is worth mentioning the numerous and varied remains dating back to the first Medieval period, which are exhibited in the Museum of Albarracín and are part of one of the most notable 11th-century ceramics collection. The castle was last inhabited under the rule of Philip II of Spain, although some of the remains found are as recent as the 18th century.