Originally the site of Kilkenny castle featured a motte and bailey fort built by Richard de Clare. William Marshall, Earl of Pembroke replaced this with a stone castle in the early thirteenth century. Three towers still remain from the original stone castle.

After the Norman invasion James Butler, 3rd Earl of Ormonde bought the castle in 1391. The Butler family remained in control of the area for the next five centuries.