Constructed around a rectangular interior court, the Upper Castle comprised four storeys and was conceived as a residential castle.
In the 1560s Archduke Ferdinand II caused the site to be redesigned into a Renaissance castle by the architects Giovanni and Alberto Lucchese. Even before the start of the rebuilding, Ferdinand II made a gift of the castle to his wife Philippine Welser to whom he was still secretly married.
