That gap is held by Arundel; the Castle at Amberley was a palace of the Bishop of Chichester, granted to the Bishop of Selsey long before the Conquest; it was only castellated in the fourteenth century.