What factors determine if a old building is called a castle, court, hall, house, etc.?

Question

I've been watching The Tutors and have spent a lot of time in England, but never heard what the difference is in these titles. I've been to a place called "Hampton Court" where the royalty once lived and to Windsor Castle, Heever Castle, Warwick Castle, Blackmore House, Raggly Hall...what determines the title of these places?

I think I once heard that if it has a chapel in it it is called a castle or something like that.

Thanks!

Answer 1

It might have something to do with the powers of the people who lived in them at different time periods..