Pevensey Castle.

An English Heritage castle, it should be said that, though there's a lot of history in this area, the castle itself is pretty comprehensively ruined. I think Battle Abbey is better value for a day out.

Pevensey itself is a pretty village  - with its own jailhouse.  Check opening times though before you go.