What makes a castle a castle?

I want to built a castle in Mine-craft, but I don't know how castles were designed. Iv'e been to some ruins and some castles built into cliffs, Iv'e watched videos about other people who build Mine-craft castles, and Iv'e read books about castles, yet I still don't know how to design one! Any general tips?