I have already killed everyone in one Dunmer Stronghold, and it just happened to be the one that had the master trainer for Enchantment

I was going to go into another but i didnt want to find out i was killing someone else of value or importance, or if once i move the story line ahead they would stop attacking me. Any insight would be greatly appreciated.